Hi today i updated metaflow to version 2.12.17 and tried to deploy using

argo-workflow

which worked previously without problems now fails as follows: Any ideas? (FYI 2.12.10 worked as expected / 2.12.13 is the first version where deployment seems to break )

2024-08-28 09:32:32.499 Bootstrapping virtual environment(s) ...
2024-08-28 09:32:34.772 Virtual environment(s) bootstrapped!
    Internal error
Traceback (most recent call last):
  File "/home/vscode/.local/lib/python3.12/site-packages/metaflow/cli.py", line 1134, in main
    start(auto_envvar_prefix="METAFLOW", obj=state)
  File "/home/vscode/.local/lib/python3.12/site-packages/metaflow/tracing/__init__.py", line 27, in wrapper_func
    return func(args, kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/home/vscode/.local/lib/python3.12/site-packages/metaflow/_vendor/click/core.py", line 829, in __call__
    return self.main(args, kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/vscode/.local/lib/python3.12/site-packages/metaflow/_vendor/click/core.py", line 782, in main
    rv = self.invoke(ctx)
         ^^^^^^^^^^^^^^^^
  File "/home/vscode/.local/lib/python3.12/site-packages/metaflow/_vendor/click/core.py", line 1259, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/vscode/.local/lib/python3.12/site-packages/metaflow/_vendor/click/core.py", line 1259, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/vscode/.local/lib/python3.12/site-packages/metaflow/_vendor/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, ctx.params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/vscode/.local/lib/python3.12/site-packages/metaflow/_vendor/click/core.py", line 610, in invoke
    return callback(args, kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/vscode/.local/lib/python3.12/site-packages/metaflow/_vendor/click/decorators.py", line 33, in new_func
    return f(get_current_context().obj, args, kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/vscode/.local/lib/python3.12/site-packages/metaflow/plugins/argo/argo_workflows_cli.py", line 257, in create
    flow = make_flow(
           ^^^^^^^^^^
  File "/home/vscode/.local/lib/python3.12/site-packages/metaflow/plugins/argo/argo_workflows_cli.py", line 486, in make_flow
    return ArgoWorkflows(
           ^^^^^^^^^^^^^^
  File "/home/vscode/.local/lib/python3.12/site-packages/metaflow/plugins/argo/argo_workflows.py", line 174, in __init__
    self._workflow_template = self._compile_workflow_template()
                              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/vscode/.local/lib/python3.12/site-packages/metaflow/plugins/argo/argo_workflows.py", line 858, in _compile_workflow_template
    .templates(self._dag_templates())
               ^^^^^^^^^^^^^^^^^^^^^
  File "/home/vscode/.local/lib/python3.12/site-packages/metaflow/plugins/argo/argo_workflows.py", line 1280, in _dag_templates
    for daemon_template in self._daemon_templates()
                           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/vscode/.local/lib/python3.12/site-packages/metaflow/plugins/argo/argo_workflows.py", line 2157, in _daemon_templates
    templates.append(self._heartbeat_daemon_template())
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/vscode/.local/lib/python3.12/site-packages/metaflow/plugins/argo/argo_workflows.py", line 2510, in _heartbeat_daemon_template
    executable = self.environment.executable("_parameters")
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/vscode/.local/lib/python3.12/site-packages/metaflow/plugins/pypi/conda_environment.py", line 188, in executable
    step = next(step for step in self.flow if step.name == step_name)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
StopIteration

we are triaging this issue - meanwhile, you can work around this issue by setting the

--no-enable-heartbeat-daemon

flag for

argo-workflows create

Blazingly fast 💫