Hi everyone, I wanted to ask if there’s an updated CloudFormation template for deployment on AWS? Also, if anyone can help with writing or customizing it, I’d really appreciate it. Thanks.

Hello! This one is the base template. What customizations do you have in mind?

Thanks for the reply. Yes, I’m using this one as well. What I have in mind is whether it’s possible to run this service with fewer or different AWS services — either to reduce costs or to minimize the number of components we need to troubleshoot in the future.

This page will help in distinguishing required from optional services. Can you share more about the cost dimensions you are observing and optional functionality you want to cut? Another angle to approach from is https://docs.metaflow.org/getting-started/devstack. The devstack is the fast and hands-on way to see how Metaflow services interoperate.

Hi Eddie, Thanks a lot for your guidance earlier — and sorry for the late reply. I went through the documentation you shared and it was really helpful. I also disabled the SageMaker and UI services in the template. it seems like there isn’t much more room to reduce AWS resources beyond that I had another question while setting things up. When I create the Step Function on AWS, I consistently hit this error:

An error occurred while executing the state 'start' (entered at the event id #2).  
The JSONPath '$.Parameters' specified for the field 'Value.$' could not be found in the input '{}'

To get it working, I have to manually remove this part from the generated configuration:

json
{
  "Name": "METAFLOW_PARAMETERS",
  "Value.$": "$.Parameters"
}

Is this expected behavior, or am I missing something in the setup? (For context, I’m using uv) Thanks again for your help!