Hello, Flow that I could run yesterday, is now al...
# ask-metaflow
a
Hello, Flow that I could run yesterday, is now al of a sudden now working anymore. Seems to happen because of the pypi_base decorator, which to to bootstrap the virtual environment, which is unable to download certain packages. Are more people having this issue, or is just me? I am asking because I haven't changed anything.
Copy code
from metaflow import FlowSpec, pypi_base, step

@pypi_base(python="3.10")
class LinearFlow(FlowSpec):


    @step
    def start(self):
        self.my_var = 'hello world'
        self.next(self.a)

    @step
    def a(self):
        print('the data artifact is: %s' % self.my_var)
        self.next(self.end)

    @step
    def end(self):
        print('the data artifact is still: %s' % self.my_var)

if __name__ == '__main__':
    LinearFlow()
Copy code
Validating your flow...
    The graph looks good!
Running pylint...
    Pylint not found, so extra checks are disabled.
Bootstrapping virtual environment(s) ...
    Micromamba ran into an error while setting up environment:
    command '/Users/alper/.metaflowconfig/micromamba/bin/micromamba create --yes --no-deps --download-only --safety-checks=disabled --no-extra-safety-checks --repodata-ttl=86400 --prefix=/var/folders/my/bv04f6xs1cx1kw73h2ng99mw0000gn/T/tmpko0_hlpd/prefix --quiet <https://conda.anaconda.org/conda-forge/noarch/tzdata-2023c-h71feb2d_0.conda> <https://conda.anaconda.org/conda-forge/osx-64/bzip2-1.0.8-h10d778d_5.conda> <https://conda.anaconda.org/conda-forge/osx-64/libffi-3.4.2-h0d85af4_5.tar.bz2> <https://conda.anaconda.org/conda-forge/osx-64/libzlib-1.2.13-h8a1eda9_5.conda> <https://conda.anaconda.org/conda-forge/osx-64/ncurses-6.4-h93d8f39_2.conda> <https://conda.anaconda.org/conda-forge/osx-64/xz-5.2.6-h775f41a_0.tar.bz2> <https://conda.anaconda.org/conda-forge/osx-64/ca-certificates-2023.11.17-h8857fd0_0.conda> <https://conda.anaconda.org/conda-forge/osx-64/tk-8.6.13-h1abcd95_1.conda> <https://conda.anaconda.org/conda-forge/osx-64/libsqlite-3.44.2-h92b6c6a_0.conda> <https://conda.anaconda.org/conda-forge/osx-64/readline-8.2-h9e318b2_1.conda> <https://conda.anaconda.org/conda-forge/osx-64/openssl-3.2.0-hd75f5a5_1.conda> <https://conda.anaconda.org/conda-forge/osx-64/sqlite-3.44.2-h7461747_0.conda> <https://conda.anaconda.org/conda-forge/osx-64/python-3.10.0-h38b4d05_3_cpython.tar.bz2> <https://conda.anaconda.org/conda-forge/noarch/wheel-0.42.0-pyhd8ed1ab_0.conda> <https://conda.anaconda.org/conda-forge/noarch/setuptools-68.2.2-pyhd8ed1ab_0.conda> <https://conda.anaconda.org/conda-forge/noarch/pip-23.3.2-pyhd8ed1ab_0.conda>' returned error (1)
    critical libmamba The package "<https://conda.anaconda.org/conda-forge/noarch/tzdata-2023c-h71feb2d_0.conda::tzdata==2023c=h71feb2d_0>" is not found in any loaded channels. Try adding more channels or subdirs.
m
I'm having a similar issue
Copy code
Bootstrapping virtual environment(s) ...
    Micromamba ran into an error while setting up environment:
    command '/root/.metaflowconfig/micromamba/bin/micromamba create --yes --no-deps --download-only --safety-checks=disabled --no-extra-safety-checks --repodata-ttl=86400 --prefix=/tmp/tmpmqil3qww/prefix --quiet <https://conda.anaconda.org/conda-forge/linux-64/_libgcc_mutex-0.1-conda_forge.tar.bz2> <https://conda.anaconda.org/conda-forge/linux-64/ld_impl_linux-64-2.40-h41732ed_0.conda> <https://conda.anaconda.org/conda-forge/linux-64/libstdcxx-ng-13.2.0-h7e041cc_3.conda> <https://conda.anaconda.org/conda-forge/linux-64/python_abi-3.10-4_cp310.conda> <https://conda.anaconda.org/conda-forge/linux-64/ca-certificates-2023.11.17-hbcca054_0.conda> <https://conda.anaconda.org/conda-forge/linux-64/libgomp-13.2.0-h807b86a_3.conda> <https://conda.anaconda.org/conda-forge/linux-64/_openmp_mutex-4.5-2_gnu.tar.bz2> <https://conda.anaconda.org/conda-forge/linux-64/libgcc-ng-13.2.0-h807b86a_3.conda> <https://conda.anaconda.org/conda-forge/linux-64/c-ares-1.24.0-hd590300_0.conda> <https://conda.anaconda.org/conda-forge/linux-64/openssl-3.2.0-hd590300_1.conda> <https://conda.anaconda.org/conda-forge/linux-64/libzlib-1.2.13-hd590300_5.conda> <https://conda.anaconda.org/conda-forge/linux-64/libffi-3.4.2-h7f98852_5.tar.bz2> <https://conda.anaconda.org/conda-forge/linux-64/bzip2-1.0.8-hd590300_5.conda> <https://conda.anaconda.org/conda-forge/linux-64/ncurses-6.4-h59595ed_2.conda> <https://conda.anaconda.org/conda-forge/linux-64/libabseil-20230802.1-cxx17_h59595ed_0.conda> <https://conda.anaconda.org/conda-forge/linux-64/libcrc32c-1.1.2-h9c3ff4c_0.tar.bz2> <https://conda.anaconda.org/conda-forge/linux-64/libuuid-2.38.1-h0b41bf4_0.conda> <https://conda.anaconda.org/conda-forge/linux-64/libnsl-2.0.1-hd590300_0.conda> <https://conda.anaconda.org/conda-forge/linux-64/xz-5.2.6-h166bdaf_0.tar.bz2> <https://conda.anaconda.org/conda-forge/linux-64/tk-8.6.13-noxft_h4845f30_101.conda> <https://conda.anaconda.org/conda-forge/linux-64/libsqlite-3.44.2-h2797004_0.conda> <https://conda.anaconda.org/conda-forge/linux-64/readline-8.2-h8228510_1.conda> <https://conda.anaconda.org/conda-forge/linux-64/libre2-11-2023.06.02-h7a70373_0.conda> <https://conda.anaconda.org/conda-forge/linux-64/libprotobuf-4.24.4-hf27288f_0.conda> <https://conda.anaconda.org/conda-forge/linux-64/re2-2023.06.02-h2873b5e_0.conda> <https://conda.anaconda.org/conda-forge/linux-64/libgrpc-1.60.0-hd6c4280_0.conda> <https://conda.anaconda.org/conda-forge/noarch/tzdata-2023c-h71feb2d_0.conda> <https://conda.anaconda.org/conda-forge/linux-64/python-3.10.13-hd12c33a_0_cpython.conda> <https://conda.anaconda.org/conda-forge/noarch/wheel-0.42.0-pyhd8ed1ab_0.conda> <https://conda.anaconda.org/conda-forge/noarch/setuptools-68.2.2-pyhd8ed1ab_0.conda> <https://conda.anaconda.org/conda-forge/noarch/pip-23.3.2-pyhd8ed1ab_0.conda> <https://conda.anaconda.org/conda-forge/noarch/typing_extensions-4.9.0-pyha770c72_0.conda> <https://conda.anaconda.org/conda-forge/noarch/pysocks-1.7.1-pyha2e5f31_6.tar.bz2> <https://conda.anaconda.org/conda-forge/noarch/attrs-23.1.0-pyh71513ae_1.conda> <https://conda.anaconda.org/conda-forge/noarch/pycparser-2.21-pyhd8ed1ab_0.tar.bz2> <https://conda.anaconda.org/conda-forge/noarch/six-1.16.0-pyh6c4a22f_0.tar.bz2> <https://conda.anaconda.org/conda-forge/noarch/pyasn1-0.5.1-pyhd8ed1ab_0.conda> <https://conda.anaconda.org/conda-forge/noarch/cachetools-5.3.2-pyhd8ed1ab_0.conda> <https://conda.anaconda.org/conda-forge/noarch/charset-normalizer-3.3.2-pyhd8ed1ab_0.conda> <https://conda.anaconda.org/conda-forge/noarch/idna-3.6-pyhd8ed1ab_0.conda> <https://conda.anaconda.org/conda-forge/noarch/certifi-2023.11.17-pyhd8ed1ab_0.conda> <https://conda.anaconda.org/conda-forge/noarch/typing-extensions-4.9.0-hd8ed1ab_0.conda> <https://conda.anaconda.org/conda-forge/noarch/pyu2f-0.1.5-pyhd8ed1ab_0.tar.bz2> <https://conda.anaconda.org/conda-forge/noarch/pyasn1-modules-0.3.0-pyhd8ed1ab_0.conda> <https://conda.anaconda.org/conda-forge/noarch/rsa-4.9-pyhd8ed1ab_0.tar.bz2> <https://conda.anaconda.org/conda-forge/noarch/async-timeout-4.0.3-pyhd8ed1ab_0.conda> <https://conda.anaconda.org/conda-forge/linux-64/brotli-python-1.1.0-py310hc6cd4ac_1.conda> <https://conda.anaconda.org/conda-forge/linux-64/multidict-6.0.4-py310h2372a71_1.conda> <https://conda.anaconda.org/conda-forge/linux-64/frozenlist-1.4.1-py310h2372a71_0.conda> <https://conda.anaconda.org/conda-forge/linux-64/grpcio-1.60.0-py310h1b8f574_0.conda> <https://conda.anaconda.org/conda-forge/linux-64/protobuf-4.24.4-py310h620c231_0.conda> <https://conda.anaconda.org/conda-forge/linux-64/cffi-1.16.0-py310h2fee648_0.conda> <https://conda.anaconda.org/conda-forge/linux-64/yarl-1.9.3-py310h2372a71_0.conda> <https://conda.anaconda.org/conda-forge/linux-64/cryptography-41.0.7-py310hb8475ec_1.conda> <https://conda.anaconda.org/conda-forge/linux-64/google-crc32c-1.1.2-py310hc5c09a0_5.conda> <https://conda.anaconda.org/conda-forge/noarch/urllib3-2.1.0-pyhd8ed1ab_0.conda> <https://conda.anaconda.org/conda-forge/noarch/aiosignal-1.3.1-pyhd8ed1ab_0.tar.bz2> <https://conda.anaconda.org/conda-forge/noarch/googleapis-common-protos-1.62.0-pyhd8ed1ab_0.conda> <https://conda.anaconda.org/conda-forge/noarch/pyopenssl-23.3.0-pyhd8ed1ab_0.conda> <https://conda.anaconda.org/conda-forge/noarch/google-resumable-media-2.7.0-pyhd8ed1ab_0.conda> <https://conda.anaconda.org/conda-forge/noarch/requests-2.31.0-pyhd8ed1ab_0.conda> <https://conda.anaconda.org/conda-forge/linux-64/aiohttp-3.9.1-py310h2372a71_0.conda> <https://conda.anaconda.org/conda-forge/noarch/google-auth-2.25.2-pyhca7485f_0.conda> <https://conda.anaconda.org/conda-forge/noarch/google-api-core-2.15.0-pyhd8ed1ab_0.conda> <https://conda.anaconda.org/conda-forge/noarch/google-cloud-core-2.4.1-pyhd8ed1ab_0.conda> <https://conda.anaconda.org/conda-forge/noarch/google-cloud-storage-2.14.0-pyhca7485f_0.conda>' returned error (1)
    critical libmamba The package "<https://conda.anaconda.org/conda-forge/linux-64/_libgcc_mutex-0.1-conda_forge.tar.bz2::_libgcc_mutex==0.1=conda_forge>" is not found in any loaded channels. Try adding more channels or subdirs.
b
I fixed this by downgrading Micromamba / installing an older Micromamba version separately, e.g.
Copy code
curl -Ls <https://micro.mamba.pm/api/micromamba/linux-64/1.5.1> | tar -xvj bin/micromamba
in your working directory Not sure what changed in Micromamba since yesterday, their releases page still shows 1.5.5 as the latest version but the one Metaflow automatically downloads in a fresh environment is 2.0.0
👀 2
👍 1
🙌 3
Asked in Mamba Gitter about this, no response yet https://app.gitter.im/#/room/#mamba-org_Lobby:gitter.im
f
also seeing this
m
Downgrading mamba works @fancy-chef-63734
b
still the long command Metaflow sends may be incomatible with Micromamba 2