Hi there! Does anyone have any input on how to best handle sharing of large files between steps, such as videos (sometimes more than 100 gb each) and bigger amount of images in an automatic way. I suppose they wouldn't fit in memory, and as such can't store them directly in

self

. I've stumbled upon metaflow-magicdir, which looks like a fit in principle, but this particular package seems to be stuck in alpha state, and source is no longer available. I've tried using it, but I stumbled upon some issues, assumingly related to its immatureness. Thanks! (I'm new in Metaflow, so excuse me if I'm missing something obvious or don't know all the terms well 🙂 )