Hi, we see some transient errors when deploying mu...
# ask-metaflowf
fast-vr-44972
02/05/2025, 9:58 AMHi, we see some transient errors when deploying multiple argo workflows in parallel on AWS in our ci-cd pipeline. See 🧵
This is with metaflow version == 2.12.38
Copy code
JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting✅ 1
fast-vr-44972
02/05/2025, 9:58 AM Copy code
(most recent call last):
File "/opt/venv/lib/python3.8/site-packages/metaflow/cli.py", line 554, in main
start(auto_envvar_prefix="METAFLOW", obj=state)
File "/opt/venv/lib/python3.8/site-packages/metaflow/_vendor/click/core.py", line 829, in __call__
return self.main(args, kwargs)
File "/opt/venv/lib/python3.8/site-packages/metaflow/_vendor/click/core.py", line 782, in main
rv = self.invoke(ctx)
File "/opt/venv/lib/python3.8/site-packages/metaflow/cli_components/utils.py", line 69, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/opt/venv/lib/python3.8/site-packages/metaflow/_vendor/click/core.py", line 1259, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/opt/venv/lib/python3.8/site-packages/metaflow/_vendor/click/core.py", line 1066, in invoke
return ctx.invoke(self.callback, ctx.params)
File "/opt/venv/lib/python3.8/site-packages/metaflow/_vendor/click/core.py", line 610, in invoke
return callback(args, kwargs)
File "/opt/venv/lib/python3.8/site-packages/metaflow/_vendor/click/decorators.py", line 33, in new_func
return f(get_current_context().obj, args, kwargs)
File "/opt/venv/lib/python3.8/site-packages/metaflow/plugins/argo/argo_workflows_cli.py", line 248, in create
token = resolve_token(
File "/opt/venv/lib/python3.8/site-packages/metaflow/plugins/argo/argo_workflows_cli.py", line 611, in resolve_token
store_token(token_prefix, token)
File "/opt/venv/lib/python3.8/site-packages/metaflow/plugins/aws/step_functions/production_token.py", line 68, in store_token
config = _load_config(path)
File "/opt/venv/lib/python3.8/site-packages/metaflow/plugins/aws/step_functions/production_token.py", line 35, in _load_config
return json.load(f)
File "/usr/local/lib/python3.8/json/__init__.py", line 293, in load
return loads(fp.read(),
File "/usr/local/lib/python3.8/json/__init__.py", line 357, in loads
return _default_decoder.decode(s)
File "/usr/local/lib/python3.8/json/decoder.py", line 337, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "/usr/local/lib/python3.8/json/decoder.py", line 355, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting
value: line 1 column 1 (char 0)a
ancient-application-36103
02/05/2025, 4:45 PMare you able to replicate the issue with the latest version of metaflow?
f
fast-vr-44972
02/05/2025, 9:10 PMwill give it a try tomorrow.
👍🏼 1
a
ancient-application-36103
02/11/2025, 4:44 PM@fast-vr-44972 checking in here - did the upgrade resolve the issue?
f
fast-vr-44972
02/11/2025, 4:46 PMHey we haven't updated it since we haven't seen it recently.
👍🏼 1
a
ancient-application-36103
02/11/2025, 4:46 PMi will close the thread - in case you run into this, feel free to ping us!
👍 1
5 Views