rhythmic-beach-70913
11/08/2023, 8:57 AM@conda_base(
python="~=3.9",
and on the step
@batch(cpu=4, memory=18432, image="public.ecr.aws/docker/library/python:3.9")
Our error message looks like this:
...d/lib/python3.10/site-packages/...
We have DEFAULT and BATCH CONTAINER_REGISTRY set to public.ecr.aws/docker/library
Looking at the step definition without the batch decorator it has
--with batch:cpu=1,gpu=0,memory=4096,image=public.ecr.aws/docker/library/python:3.11
So it's using 3.10 which isn't mentioned anywhere
(I realise that the container image doesn't necessarily match the conda/python version)
This seems to work when it's invoked with --batch rather than via a step function
(we have a dependency which only works with 3.9)