Hi I wonder if anyone can explain this We are ins...
# ask-metaflow
r
Hi I wonder if anyone can explain this We are installing our flow as a step function from a python 3.11 environment In the flow we have:
Copy code
@conda_base(
    python="~=3.9",
and on the step
Copy code
@batch(cpu=4, memory=18432, image="public.ecr.aws/docker/library/python:3.9")
Our error message looks like this:
Copy code
...d/lib/python3.10/site-packages/...
We have DEFAULT and BATCH CONTAINER_REGISTRY set to public.ecr.aws/docker/library Looking at the step definition without the batch decorator it has
--with batch:cpu=1,gpu=0,memory=4096,image=public.ecr.aws/docker/library/python:3.11
So it's using 3.10 which isn't mentioned anywhere (I realise that the container image doesn't necessarily match the conda/python version) This seems to work when it's invoked with --batch rather than via a step function (we have a dependency which only works with 3.9)