hey all, running into a couple of issues that have to do with conda and batch mode (with AWS). first one: trying to use the pytorch-blessed conda install-with-cuda method. am specifying

"nvidia::pytorch-cuda": "11.7"

in the

@conda

decorator, but am getting this error when metaflow tries to build the conda env:

Bootstrapping conda environment...(this could take a few minutes)
    Conda ran into an error while setting up environment.:
    Step: start, Error: PackagesNotFoundError: The following packages are not available from current channels:

      - nvidia::pytorch-cuda==11.7

    Current channels:

      - <https://conda.anaconda.org/pytorch/linux-64>
      - <https://conda.anaconda.org/pytorch/noarch>
      - <https://conda.anaconda.org/conda-forge/linux-64>
      - <https://conda.anaconda.org/conda-forge/noarch>
      - <https://repo.anaconda.com/pkgs/main/linux-64>
      - <https://repo.anaconda.com/pkgs/main/noarch>
      - <https://repo.anaconda.com/pkgs/r/linux-64>
      - <https://repo.anaconda.com/pkgs/r/noarch>

if I try to use conda directly to do the same thing, conda is able to find the package:

CONDA_SUBDIR=linux-64 conda install pytorch==1.13.1 torchvision==0.14.1 torchaudio==0.13.1 pytorch-cuda=11.7 -c pytorch -c nvidia

finds

pytorch-cuda       pytorch/linux-64::pytorch-cuda-11.7-h778d358_5

i feel like i'm missing something. any clues?