Hello, I have a question about Argo integration --...
# dev-metaflow
s
Hello, I have a question about Argo integration -- the
@kubernetes
decorator has to request some amount of disk storage. If not provided, the default value would be 10GB. But because of this issue, cluster autoscaler would get stuck waiting for new node. Does it make sense to change it to not requesting ephemeral volume if not specified? Or having an option to set it to
None
? I'd be happy to open PR for it.
2
a
Are you scaling from 0?
s
Yes. Especially for GPU nodes, it's not feasible to have a node always running.
a
Are you using EKS? I am reading through the issue and they claim that the problem is resolved in a later version of autoscaler (but requires a custom tag).
s
I am using latest version of EKS and CA. Let me try to apply the tag to ASG and let you know. Thanks for the quick reply!
👍 1
a
@some-ghost-45692 did it work?
s
Haven't got the chance to do it yet. Will let you know later today or tomorrow!
👍 1
@square-wire-39606 It works as expected after adding the tag. Thank you so much for the help!
🙌 1