Hi all, This may be more of a Batch/EC2 question,...
# ask-metaflow
s
Hi all, This may be more of a Batch/EC2 question, but how does swap work when running MF steps in AWS batch? We have a step with (very brief) ~35GB memory use. When specifying
@batch(memory=40000)
, the step runs fine. With
@batch(memory=10000, max_swap=40000, swappiness=50)
, we get an out of memory error. Is there anything else that needs to be set up for Batch actually allocating swap or is there a cap on the amount of swap that can be used regardless of the MF decorator?
1