Hi there. We use Metaflow and it works great for spinning up hundreds of machines to prepare big datasets. One flow goes through a series of steps and scales out horizontally to produce one dataset or one model. What I think we are lacking is to effectively tie these flows together in dependency graphs like you would with Luigi or DVC (automatically computing the missing artifacts in your dependency graph).
Does anyone have experience combining pipelining tools with Metaflow?