Hello team, How do we delete old pipeline runs on...
# ask-metaflow
a
Hello team, How do we delete old pipeline runs on Metaflow and remove the data from s3?
1
s
you can scrub the data from the metadata db so that the ui no longer references it. re: data in s3 - you would want to delete the files referenced in the rows deleted in the metadata db that are not referenced in any other rows that are not deleted.
a
But sounds like there's no easy way for a user to do this through metaflow api commands
s
since we use content addressed storage to reduce the overall storage footprint in blob store, there are a bunch of gymnastics folks need to do to clean up the s3 bucket. however, in practice, just leaning on tiered storage offerings usually drops the cost profile significantly
we do have work underway to tag assets for lifecycle management, but hard to pin point if/when it will land in oss
👌 1
thankyou 1