Metaflow has a reserved parameter --max-workers that can assist in parallelizing steps. Is there a way within a running flow to retrieve the value of this reserved parameter value?
Thanks
✅ 1
j
jolly-afternoon-77975
07/04/2023, 3:25 PM
this can only be set from the run command, if its not set the default value: 8 is used.
this 1
v
victorious-lawyer-58417
07/04/2023, 5:18 PM
right, no way to retrieve the value during runtime. Note that it sets the maximum number of parallel executions - Metaflow will always parallelize execution for branches up to that limit