Hi! I setup Kubernetes and I run a test project in...
# ask-metaflow
c
Hi! I setup Kubernetes and I run a test project in AWS. Now I am updating the project locally, I run
python recommenderflow.py --datastore=local --metadata=local run
and the flow runs without problems locally. When I try to review the artifacts generated by the flow in a local jupyter notebook I get error as the client is trying to connect to AWS (none of the resources exist now after destroyed the env with terraform). How do I setup an environment variable to enforce using the local datastore and metadata when a kubernetes configuration is present?
1
So far I tried setting up
METAFLOW_PROFILE=local
and also created an empty
config_local.json
but in the notebook the client is still trying to access AWS
a
There's "METAFLOW_DEFAULT_DATASTORE" and "METAFLOW_DEFAULT_METADATA" in the
~/.metaflowconfig/config.json
config which are probably getting loaded if you try to read data in the notebook
💯 1
Have you set those to local?
and in code you can do this without editing configs https://docs.metaflow.org/metaflow/client#metadata-provider
1
💯 1
c
Thank you for the help Mikko!
As per the doc, in my notebook I run:
metadata('/path/to/flow_folder/')
and I was able to access the metadata
🙌 1