Any idea why I get the following error when trying...
# ask-metafloww
wooden-solstice-50536
05/16/2024, 8:56 PMAny idea why I get the following error when trying to use the
@batch()batch Copy code
@batch(image='huggingface/transformers-pytorch-gpu', cpu=16, memory=2**16, gpu=1)✅ 1
wooden-solstice-50536
05/16/2024, 8:57 PM Copy code
2024-05-16T20:54:03.112Z Setting up task environment.
2024-05-16T20:54:03.112Z bash: python: command not found
2024-05-16T20:54:03.112Z bash: line 0: [: -le: unary operator expected
2024-05-16T20:54:03.112Z bash: line 0: [: -gt: unary operator expected
2024-05-16T20:54:03.113Z tar: job.tar: Cannot open: No such file or directory
2024-05-16T20:54:03.113Z tar: Error is not recoverable: exiting now
2024-05-16T20:54:03.114Z bash: python: command not foundwooden-solstice-50536
05/16/2024, 8:58 PMIf I run the docker image provided locally, I see these versions of python installed
wooden-solstice-50536
05/16/2024, 8:58 PM Copy code
root@48dd99a6c126:/# which python
root@48dd99a6c126:/# python --version
bash: python: command not found
root@48dd99a6c126:/# which python3
/usr/bin/python3
root@48dd99a6c126:/# python3 --version
Python 3.8.10wooden-solstice-50536
05/16/2024, 8:59 PMSo, python is NOT a recognized command but python3 is. Any way I can get the remote task to use
python3pythonc
crooked-jordan-29960
05/16/2024, 9:18 PMUnfortunately this LOC is hardcoded. A quick hack is it to change that line to python3. An alternate route that doesn't require messing with Metaflow is to make your own image, using this HF image as the base image, and then symlink python to python3.
w
wooden-solstice-50536
05/16/2024, 9:23 PMAhh gotcha, I saw that bit of code going through the metaflow repo earlier and was hoping there was some flag I didn't see that could fix it. I'll change out the image on my end as that seems easiest but thanks for the fast reply @crooked-jordan-29960!!
c
crooked-jordan-29960
05/16/2024, 9:24 PMNo prob!
14 Views