Hi All, We noticed that some steps in our metaflow pipelines appear to be using a lot of disk space. The flows are running on EKS via Argo Workflows. The steps don't seem to be writing anything to disk directly, but it does use Metaflow artifact functionality,

self.x = ....

. I was wondering, if these artefacts are large does Metaflow use some disk space during the process of saving this data to S3? Thanks

Hi! Yes, indeed - that is expected

ok, thanks.

yes - it currently uses cwd - you can switch it out using

METAFLOW_TEMPDIR

here

Perfect, thanks