Am curious if this feature coming soon this month/...
# ask-metaflow
a
Am curious if this feature coming soon this month/next month, am eagerly waiting for sometime? šŸ™‚ https://outerbounds-community.slack.com/archives/C020U025QJK/p1668793150048639?thread_ts=1668768421.346539&cid=C020U025QJK
āœ… 1
v
hopefully this month finally - early next month at the latest šŸ™
šŸ™ 1
if you feel adventurous, we are happy to help you test the PR šŸ™‚
a
yes we are adventurous !!
how do we go about the test šŸ™‚
v
awesome! Btw, initially events work with Argo Workflows only. Is it ok?
a
hm... we're not using the kubernetes approach
guess we're not able to test it
our setup was purely aws batch and step-functions
does that mean this feature releasing end of this month/early next month is only available for those who uses Argo Workflows only ?
v
correct, sadly. An AWS-native approach would most likely need to rely on EventBridge which is a trickier beast. We wanted to start with a platform we can control better and then based on those learnings expand the footprint, if there's demand for it
šŸ‘Œ 2
a
thanks for clarifying, this helps us reconsider a kubernetes setup of using metaflow
šŸ‘ 1
v
if you want to create a small test deployment using EKS, we can help get event triggering running on it
h
I can safely and confidently say that we have a demand for this :-)
yay 4
f
+1 super excited for this feature and I'm sure there will tons of demand across the infra flavors! For those currently using the AWS-native stack, I'm curious how feasible the following might be: • Deploy the EKS stack side-by-side with the existing AWS infra, allowing people to gradually shift workflows from using
@batch
to
@kubernetes
and likewise from SFN to Argo. • Features like event triggering would only be available to workflows using/migrated onto the EKS stack of tools • Hopefully can point both stacks to the same metadata service / UI for shared lineage Would this be doable or would shifting to EKS require a more substantial one-time migration?
s
@fresh-laptop-72652 - yep - this approach will totally work
f
excellent
nice, I'll set aside some time soon to read up on EKS and take this dual setup for a spin šŸš€
yayfox 2