The human-centric platform for production ML & AI

Outerbounds

Hey :wave: I am building a POC for my company to demo an Analytics Processing Workflow using Metaflow. The Steps in the flow require access to an existing S3. If I run the flow by just doing `aws sso login`  and then run the flow; Metaflow is able to pickup the AWS credentials ok.

But I am having trouble when trying to run the same flow using the `metaflow-dev` stack. Because the pods can't pickup the aws credentials from the process when I run the flow in `metaflow-dev shell` . Wondering if anyone has been able to mount aws credential Secrets from a local shell into pods spun up by `metaflow-dev` . I am trying to set up a good DevExp for the engineering org. Thanks!

I'm thinking I can make it work by doing this inside `metaflow-dev shell`:
1. aws sso login
2. exporting credentials to .env in the project
3. creating a kubernetes secret using kubectl
4. accessing these in the `@kubernetes(secret=)` decorator
But happy to learn of better ways to do the same