Hi! I have issue bootstrapping conda env in sagema...
# ask-metaflow
g
Hi! I have issue bootstrapping conda env in sagemaker. I have image in registry with base necessary libs and I want to add one lib in one of the steps. Once I try to add --environment=conda in command line and define via @conda decorator necessary new lib , I’m getting error with all the other libs importing in other steps: ModuleNotFoundError: No module named “X”. Question, how can I use image in registry and add new additional libs in specific steps, without rebuilding a new docker? Thank you in advance!
a
@gifted-helicopter-98777 the step will run inside a pristine conda environment with only the lib that you have specified - that's the reason why you wouldn't see any other dependencies from your docker image. Our recommendation would be to use
@conda
for defining all the dependencies
g
thank you for your response. Can you please tell me whether there’s some technique to easily resolve dependencies conflicts once using conda or conda_base decorator?
as well there’s am issue to import libs that needs to be downloaded from some index, in the image those libs are installed, but via conda_base or conda they cannot be downloaded