Hi again, I just realized this so I’m going to play around with it, but does anyone know if files downloaded using

use_tmpfs=True

can be shared between steps? I have a flow where I’d like to download some images in one step then process them in the following step.

no, by nature tmpfs is ephemeral so it doesn't persist across steps. Crucially, loading from S3 can be faster than using local disk, so it's not obvious that caching locally would help

Ok, I figured as much. Thanks for the response. Maybe saving to s3 temporarily is a solution.

let us know if it doesn’t perform well enough. There are a number of knobs to turn