My team defines our dependencies in a Docker conta...
# ask-metaflow
g
My team defines our dependencies in a Docker container when working with Metaflow. The
python -m pip install requests -qqq && python -m pip install awscli boto3 -qqq
command in the AWS Batch command is causing a transitive dependency to drift that's causing failures. Is there any guidance from the Outerbounds team on mitigating these types of failures?
1
a
Do those images have these packages already installed?
If so, I think there is a config flag that can skip installing these deps
Let me dig that up
g
It does. Amazing! Thank you so much for the quick response.
s
if you add
@environment(vars={"METAFLOW_SKIP_INSTALL_DEPENDENCIES": 1})
- that should do the trick. we can also make it a config variable.
cc @bulky-afternoon-92433
g
Should I see
if [ -z $METAFLOW_SKIP_INSTALL_DEPENDENCIES ];
in the Docker command?
s
correct - what version of metaflow are you on?
g
2.11.5
s
that's a really old version - likely it doesn't have support for
METAFLOW_SKIP_INSTALL_DEPENDENCIES
- can you upgrade to the latest outerbounds?
g
Yeah, I've been meaning to upgrade anyways. This is a good forcing function. 🙂
among us party 1
This has unblocked me. Thank you so much! 🙇
💯 1