Hi! I am currently using `argo-workflows create` ...
# ask-metaflow
h
Hi! I am currently using
argo-workflows create
to deploy a metaflow flow onto our k8 cluster. I have noticed that it takes quite a bit of time for each step to download the code package from S3 and for flows with lots of steps this can add quite a lot of time to the duration of the flow. Is there any way to bypass this and instead make it use the code package from the image provided via the kubernetes decorator?
a
@handsome-ocean-90256 - you can execute
python flow.py package list
to check the contents of the code package. By default, we package your current working directory - I wouldn't expect the package download step to take any appreciable amount of time
In most cases, it's a few KBs of data moving between s3 and ec2 which is plenty quick