Hi community, i ran into issues when running metaflow

--with batch

on AWS. i have installed

metaflow==2.11.4

. I ran

metaflow configure aws

it created a config in

~/.metaflowconfig/config.json

when run this command

python 00-helloworld.py run
Metaflow 2.11.4 executing HelloFlow for user:ctran
Validating your flow...
    The graph looks good!
Running pylint...
    Pylint not found, so extra checks are disabled.

then it hanged without any error So i copied the

~/.metaflowconfig/config.json

to my

/path/folder/config.json

, and removed the

~/.metaflowconfig

. When run the above, it got success output. However, when run with batch, i got error

Metaflow 2.11.4 executing HelloFlow for user:ctran
Validating your flow...
    The graph looks good!
Running pylint...
    Pylint not found, so extra checks are disabled.
    AWS Batch error:
    The @batch decorator requires --datastore=s3.

I confirm that i have

"METAFLOW_DEFAULT_DATASTORE": "s3"

in my config.json. Another twist, when adding this to my

00-helloworld.py

from metaflow.metaflow_config import DATASTORE_SYSROOT_S3
print("metaflow_config: %s" % DATASTORE_SYSROOT_S3)
# metaflow_config: None

Somehow the metaflow won't pick up the

path/folder/config.json

but when setup the config in

~/.metaflowconfig

, it hanged. ⁉️ Thanks for your help.