Hey everyone, I was wondering if there is any prog...
# ask-metaflow
b
Hey everyone, I was wondering if there is any progress on https://github.com/Netflix/metaflow/issues/424 - we would like to build library of flows that would be called from our existing apps, but without programatic way to kick off flows, it’s impossible. Subprocess.run is pretty bad alternative, so I’d love to hear if it’s in plans or if there is any workaround?
1
s
we don't have a programmatic API yet (but your comments in this design memo are welcome) when it comes to triggering flows programmatically, we will have a solution for that soon through the event-triggering feature
do you use Step Functions or Argo?
b
argo/raw k8s
either mode would work for us
thanks, I’m glad it’s still planned. Do you have any issues or PRs I could follow for event triggers?
s
yep, then event triggering should work well for you - take a look at this memo
@square-wire-39606 can share PRs if you want to give it a try
🙏 1
s
@billowy-article-38691 you can follow the work on event-triggering in this PR . Also, you can use the Argo SDK (and the Kubernetes SDK) to explicitly trigger workflows deployed on Argo Workflows. All Metaflow flows on Argo Workflows are native WorkflowTemplates and can be (re)used as needed within the Argo/K8s context.
b
hmm, ok, that’s good to know
I may do that
s
documentation and templates to deploy it will be available in a month or so
🙌 2
b
thanks, I’ll keep an eye
frankly, just using argo events may be enough
or even just workign with argo itself, I have a lot of experience with argo, so that’s not an issue for me
still, I’ll keep an eye on this, thank you!
s
great!
s
@billowy-article-38691 argo events support is now publicly available