Hi Everyone!
Is there a way to make the `python m...
# dev-metaflowl
little-magazine-49412
06/11/2021, 2:22 PMHi Everyone!
Is there a way to make the
python metaflow.py runs
straight-shampoo-11124
06/11/2021, 4:32 PMwhat would you like to see?
straight-shampoo-11124
06/11/2021, 4:33 PMwhile you can’t make the run command more verbose, there might be another way depending on what you need
l
little-magazine-49412
06/16/2021, 11:55 AMIt's actually related to another question I asked on Gitter.
My metaflow script is taking way too long to run, and I'd like to know exactly what step is taking that long.
The metaflow is almost empty, just to test really. It seems to take too long in the beginning, before the steps are executed.
s
straight-shampoo-11124
06/16/2021, 2:45 PMare you using Conda and/or S3 datastore?
straight-shampoo-11124
06/16/2021, 2:46 PMand do you test it on your laptop?
l
little-magazine-49412
06/16/2021, 5:45 PMYes, actually I'm using Minio as datastore. Not using conda.
I'm testing it on my laptop, but the Minio server is in the same network. It shouldn't be taking this long.
little-magazine-49412
06/16/2021, 6:07 PMI'm not configuring anything related to the metadata, however.
maybe this could be the reason?
s
square-wire-39606
06/19/2021, 5:54 PMAre you trying to use AWS Batch for any of your steps?