Is it possible to nest flows?
# ask-metaflows
square-accountant-83677
04/07/2023, 8:09 PMIs it possible to nest flows?
✅ 1
square-accountant-83677
04/07/2023, 8:11 PMI want to train a model in a rolling setup (so re run the flow every quarter historically and stitch together the results). I’d like to do that from within another flow
square-accountant-83677
04/07/2023, 8:11 PMIs that a thing?
c
crooked-jordan-29960
04/07/2023, 8:21 PMA few ways to approach it..
• Somewhat of a workaround to your question would be one big flow, that does nested foreach steps to build each model in parallel.
• The direct answer to the "flows within flows" question is not really at the moment, but there are plans for addressing this directly. I think timeline is on the order of months for that though, so probably won't unblock you now.
Do you think you could do it all in one flow?
s
square-accountant-83677
04/07/2023, 8:23 PMYeah I can try that. It’ll run the steps in parallel, anyway, right?
square-accountant-83677
04/07/2023, 8:23 PMYeah I can do that
c
crooked-jordan-29960
04/07/2023, 8:29 PMya, assuming that step has a remote instance decorator like
@batch@kubernetess
square-accountant-83677
04/07/2023, 8:30 PMYeah. I think it might actually be easier to loop in bash and stitch the outputs together that way