Hi Team, Im trying to limit parallelism (limit pod...
# ask-metaflow
h
Hi Team, Im trying to limit parallelism (limit pods that spinup when using
foreach
) when running on k8s via argo-workflows. The cli one works fine:
Copy code
uv run example_flow.py --branch dev --environment=uv --with retry argo-workflows create --max-workers 2
but the env/config.json is not not working:
Copy code
# /home/sln/.metaflowconfig/config.json:
METAFLOW_ARGO_WORKFLOWS_CREATE_MAX_WORKERS=2

# Tries these aswell:
METAFLOW_ARGO_WORKFLOWS_MAX_WORKERS
METAFLOW_ARGO_CREATE_MAX_WORKERS
1
a
The first value will work as an env variable and not in metaflow config
h
Thanks Savin Is there a way to specify it in the metaflow config?
a
Not today
h
Cool, Thanks!