Hi Everyone, I have configure metaflow kubernetes ...
# ask-metaflow
h
Hi Everyone, I have configure metaflow kubernetes to run the flows in kubernetes. Im getting the error - S3 access denied. How can i configure it to use s3 secrets? This is how im running -
python metaflow_pipeline.py --datastore=s3 run --with kubernetes
Below is my Metaflow config:
Copy code
❯ cat ~/.metaflowconfig/config.json
{
    "METAFLOW_KUBERNETES_NAMESPACE": "metaflow-poc",
    "METAFLOW_KUBERNETES_SERVICE_ACCOUNT": "default",
    "METAFLOW_SERVICE_INTERNAL_URL": "<http://localhost:8083/api/metadata>",
    "METAFLOW_SERVICE_URL": "<http://localhost:3001>",
    "METAFLOW_DATASTORE_SYSROOT_S3": "<s3://mf-bucket-x123/d1>",
    "METAFLOW_DATATOOLS_SYSROOT_S3": "<s3://mf-bucket-x123/d1>",
    "METAFLOW_DEFAULT_DATASTORE": "s3"
}