Hey all, I am looking into Metaflow and have been ...
# ask-metaflow
a
Hey all, I am looking into Metaflow and have been working with it locally and it works great! As for the aws orchestration I don't have sufficient permissions to run the CloudFormation template (eg the DynamoDB). I have multiple ec2 instances running (and can fire-up more) and all of them have the same EFS drive mounted. I cannot easily create s3 buckets on the fly but can ask for more. I was wondering if I can leverage this with Metaflow somehow? TIA for any hints!
a
@adventurous-author-25628 it depends on the use cases that you may have for metaflow. you can definitely use metaflow in local mode within the EC2 instances
a
@square-wire-39606 thanks for getting back to me! Can I somehow distribute tasks among the instances?
Would a custom decorator similar to batch work to distribute tasks among the machines?