Someone else in my organization has deployed a flow to AWS Step Functions, and I would like to reproduce the run locally as closely as possible.

metaflow environment resolve --from-pathspec $FLOW_NAME/$ID/$STEP_NAME

gives me an error of

metaflow.exception.CommandException: No known environment

, for a flow/id/step that I can see just fine via the web UI. What am I doing wrong here? I don't think I'm trying to do anything fancy, just reproduce all of the dependencies and deployed code as closely as possible, for something that someone else ran in the cloud. I'm aware that there are platform/architecture differences that may result in non-deterministic execution across machines, and this is actually exactly what I'm trying to quantify

that is a feature of the metaflow-nflx-extensions package, think there are some restrictions in what can be resolved https://github.com/Netflix/metaflow-nflx-extensions?tab=readme-ov-file#environments-that-can-be-resolved

what does

metaflow environment show --pathspec <flowname>/<id>/<stepname>

show?

We are using the metaflow-nflx-extensions package.

metaflow environment show --pathspec

shows plenty of information about the environment.

Ok. And what are you trying to do with the resolve command?

There are a couple of things that I'm hoping to do: 1. Generate a lock file for dependencies for a particular deployed/resolved environment, that can be checked into a git repo to help people perform local runs in a more reproducible way (

metaflow environment show

seems like it may do the trick) 2. Also grab the exact code which was used, to be able to re-run the flow locally, and compare differences in results between the local invocation and the AWS one

Ok. For the first one, we don’t currently export to a format like uv.lock or stuff like that though I do have some partial work on that. The solution would be to alias it using environment alias command and then used named_env as the decorator (technically you can get away without the alias but this is clearer).

Thank you! I'll play around with these. Have a good weekend!

Anytime. Let me know if you have more questions.