I have a flow that has 2 steps. The first steps do...
# ask-metaflow
s
I have a flow that has 2 steps. The first steps does some compute expensive work and writes the results to S3. The second step does work on the files written by Step 1. I would like to use the
resume
feature so as to not re-run Step 1 again while I tinker and play around with Step 2. However when I try to resume a failed flow and access the file in Step using
Copy code
input_file = S3(run=self).get("my_file_from_step1.json")
I get an error saying no such file “my_file_from_step1.json” because in this new run there isn’t this file. But I would like to access this file from the successful Step 1 task which belonged to a previous run. Any suggestions on how to do this in a clean way without a bunch of if/else statements for various success/failure scenarios.
1