Hello, I am trying to configure Metaflow on Kuberenetes and reading up about the different environment variables that can be set in a ConfigMap. I have 2 questions: 1. I saw that the Datastore for metaflow can be S3 or local, for a local datastore, is it the

METAFLOW_DEFAULT_DATASTORE

which I should set to “local” or to a local path ? (For S3, I have understood it needs to be set to “s3") 2. For using an S3 Datastore, I would then set

METAFLOW_DEFAULT_DATASTORE

to S3,

METAFLOW_S3_ENDPOINT_URL

to my MinIO service endpoint, but do I still need to set other S3 variables such as

METAFLOW_DATASTORE_SYSROOT_S3

to a specific s3 bucket url? The fine-tuning of these env parameters is not very clear to me and any help would be much appreciated! thanks 🙂

I asked something similar previously https://outerbounds-community.slack.com/archives/C02116BBNTU/p1673465902664139?thread_ts=1673465217.321149&cid=C02116BBNTU

yes you'd need

METAFLOW_DATASTORE_SYSROOT_S3

and

METAFLOW_DATATOOLS_S3ROOT

to be set to an s3 path

@better-cat-13994 - these config variables need to be set on the user's workstation (their laptops) and not the kubernetes configmap

thank you all very much for your inputs ! 🤗