Is it possible to use airflow operators with metaf...
# ask-metafloww
wooden-dusk-90720
03/15/2024, 7:08 AMIs it possible to use airflow operators with metaflow, if I'm deploying my flow to airflow? Or if I'm deploying to SFN can I use native SFN bindings eg submitting EMR tasks or writing to DynamoDB?
Seems like using metaflow to specify the flow loses such support from the underlying orchestrators?
✅ 1
v
victorious-lawyer-58417
03/15/2024, 11:51 PMright, the mindset is to orchestrate Metaflow with those orchestrators rather than integrate Metaflow flows/steps as a part of SFN/Airflow workflows
victorious-lawyer-58417
03/15/2024, 11:53 PMin general event-triggering is a great way to integrate external workflows (Airflow, SFN, Dagster etc.) to Metaflow workflows, but as of today it requires that you run Metaflow on Argo Workflows since that's the only environment that supports event triggering currently
w
wooden-dusk-90720
03/20/2024, 7:04 PMSo in what cases should folks choose metaflow vs those other orchestrators, assuming starting from scratch?
10 Views