@User @straight-shampoo-11124 I have one pipeline that always runs into this issue

bash: line 1: metaflow_SampleFlow_linux-64_2baa982ca7df8a31823ae7a84ba9e28d8b8f2285/bin/python: No such file or directory

even with using mamba on

Metaflow 2.9.3

. I tried pinpointing the issue and it seems that it always happens when I install

scikit-learn

as a dependency. This Flow will always throw the same error at the

start

step:

from metaflow import FlowSpec, conda, conda_base, step

@conda_base(
    python="3.9.16",
    libraries={
        "pandas": "2.0.2",
        "pyyaml": "6.0",
        "loguru": "0.6.0",
        "pyarrow": "12.0.0",
        "psutil": "5.9.5",
        "snowflake-connector-python": "3.0.4",
    },
)
class SampleFlow(FlowSpec):
    @conda(libraries={"scikit-learn": "1.2.2"})
    @step
    def start(self):
        self.next(self.end)

    @step
    def end(self):
        ...


if __name__ == "__main__":
    SampleFlow()

This Flow will work which uses `@pip`:

from metaflow import FlowSpec, conda, conda_base, project, step

@conda_base(
    python="3.9.16",
    libraries={
        "pandas": "2.0.2",
        "pyyaml": "6.0",
        "loguru": "0.6.0",
        "pyarrow": "12.0.0",
        "psutil": "5.9.5",
        "snowflake-connector-python": "3.0.4",
    },
)
class SampleFlow(FlowSpec):
    @pip(libraries={"scikit-learn": "1.2.2"})
    @step
    def start(self):
        self.next(self.end)

    @step
    def end(self):
        ...


if __name__ == "__main__":
    SampleFlow()

Any idea why this is happening?