The human-centric platform for production ML & AI

Outerbounds

Hello everyone. I'm sorry if the question has been asked already but after few searches I couldn't find any info about this topic: pausing/resuming a step. I was looking at <https://catalog.workshops.aws/stepfunctions/en-US/module-4/step-3> and would like to achieve kind of the same flow. Would it be like an example in metaflow somewhere i can look at ?

Hi Vladimir :wave:

Metaflow doesn't support pausing and resuming in that manner currently. All flows on Step Functions execute from start to finish as quickly as possible

there's an upcoming feature, event-triggering, which allows you to trigger executions when an event occurs outside the flow, which can be used to construct a similar "callback"'ish mechanism

<@U01UL7YFXDE> thank you a lot for the info! this event-triggering is related to this task? <https://github.com/Netflix/metaflow/issues/280> or <https://github.com/Netflix/metaflow/issues/468>? Just for me to follow. Thank you!

yep, even more details here <https://docs.google.com/document/d/1liTvpACWKioCSQTUv5iO3g2AKuLu4x3EYFwEl43WAZU/edit#heading=h.lzd4f7btdmb6>

note that this will be only supported in Argo Workflows initially (in a few weeks)