For once in Airflow’s life, they have a feature Me...
# ask-metaflowl
lively-lunch-9285
05/15/2025, 1:41 AMFor once in Airflow’s life, they have a feature Metaflow doesn’t: asset graph
(although: it’s still airflow, so it’s “goodness” should probably be taken with a grain of salt)
Keeping track of which datasets/columns/artifacts are fed into which flows—and which of those feed into which output columns is hard to do. At my last place we had a tangled mess of flows after 5 years which made us really motivated to focus on data lineage next time around
✅ 1
lively-lunch-9285
05/15/2025, 1:42 AMI know metaflow is working to make artifacts more of a first class citizen. Super excited for that.
lively-lunch-9285
05/15/2025, 1:43 AMcc: @bored-vr-66208 , @fancy-vr-43603
b
bored-vr-66208
05/15/2025, 1:57 AMThis would be the chef’s kiss for Metaflow!!!
chef kiss 1
h
hundreds-rainbow-67050
05/15/2025, 2:04 AMDoes this work with xcom?
l
lively-lunch-9285
05/15/2025, 2:07 AMI’m not sure. I know they redid their SDK to have an @asset decorator. I THINK you have assets subscribe to outputs of other assets (if you want to pass context btw tasks) with an API more similar to Dagster. But haven’t looked into it much.
lively-lunch-9285
05/15/2025, 2:08 AMIf we update to airflow 3.0 at work I’ll check it out
v
victorious-lawyer-58417
05/15/2025, 5:00 PMyep, there are a few features on the roadmap (even at the PR stage) which will help track lineage excited monkey
b
bored-vr-66208
05/15/2025, 5:56 PM🚀🤘 👏