What could be the main reason for our AWS metaflow environment’s AWS batch to only being able to run one job at the time - i.e. sequentially? So when I look at a the queue I only see one job running and the others are Runnable. From what I can see the provisioning model is EC2 - not sure if this is the root cause? Thanks.
✅ 1
s
square-wire-39606
11/11/2024, 8:33 PM
you might be getting bottlenecked on compute configured within AWS Batch
h
happy-wolf-7852
11/12/2024, 8:58 AM
Thanks. Would you know what the devops guys may need to change to fix this?
a
ancient-application-36103
11/12/2024, 9:26 AM
Hard to say without knowing your setup, but I would recommend looking at your compute environment configuration
h
happy-wolf-7852
01/10/2025, 3:30 PM
Sorry about very late reply. We figured it, it was related to the (minimum?) number of CPUs in the original metaflow terraform