Hello, Is it possible to use Metaflow with a private image registry? In our case, it is a Gitlab registry and I can’t find docs for such a case.. I’m trying to run the flow on remote Kubernetes cluster:

METAFLOW_KUBERNETES_SECRETS=docker-secret METAFLOW_DEFAULT_CONTAINER_REGISTRY=<http://registry.domain.com|registry.domain.com> python flow.py --with kubernetes:image=<image:tag> --datastore=s3 run

docker-secret

created with command:

kubectl create secret docker-registry docker-secret --docker-username=USERNAME --docker-password=PASSWORD --docker-server=<http://registry.domain.com|registry.domain.com>

And the output from `kubectl describe pod ...`:

Failed to pull image "<http://registry.domain.com/image:tag|registry.domain.com/image:tag>": rpc error: code = Unknown desc = failed to pull and unpack image "<http://registry.domain.com/image:tag|registry.domain.com/image:tag>": failed to resolve reference "<http://registry.domain.com/image:tag|registry.domain.com/image:tag>": failed to authorize: failed to fetch anonymous token: unexpected status: 403 Forbidden

Any ideas how to fix this? Thanks in advance

@refined-country-53341 you can add the

image pull secrets

to your kubernetes service account so that the pod has the right creds to pull from docker registry. here is a link for the instructions - https://kubernetes.io/docs/tasks/configure-pod-container/configure-service-account/#add-imagepullsecrets-to-a-service-account

it works! thanks :)

yay!