Hey Metaflow devs, what's the dialogue around specifying ephemeral volumes / volume mounts for Metaflow steps in the

kubernetes

decorator? We have a use case where we want to mount node directories. I know that there's PVC support, not sure if people are open to ephemeral too

Out of curiosity, what’s your use case? I recently saw a engineering blog by Shopify where they mentioned that they mount their hugging face model, and data set caches as a volume to minimize startup time in case training an inference jobs happen to use the same models or data sets

I have a bit of a different scenario, I want to mount the host's

tracefs

at

/sys/kernel/tracing

. So not sure that this is super data-oriented, but it sounds like it would be valuable for a variety of users