:question: how do i speed up local development wit...
# dev-metaflow
a
how do i speed up local development with the conda environment? i was previously using poetry and it was a lot faster before i realized that i'm constrained to conda for reproducible flows in AWS with step functions
1
v
hey Emily! For starters, how slow is slow, i.e. how long it takes roughly before it starts executing your tasks? Just to want to make sure it's behaving correctly
👀 1
a
does it matter how many deps i have in
condabase
vs on a single step? i threw a lot of the deps in
condabase
out and i'm trying to only use
conda
on a single step. when i did that, it sped up.
v
larger environments take more time to set up, so having fewer dependencies can make it faster
1
the thing is that it should cache the environments after the first execution, so it shouldn't be super slow locally
that's why I was asking about the execution time - just to make sure it's actually caching properly
a
now that i'm using
conda
and not conda base it is sub 5 seconds - that works for me, thanks
👍 1
v
also make sure you are using
mamba
instead of
conda
and set
"METAFLOW_DEPENDENCY_RESOLVER": "mamba"
in your
~/.metaflowconfig/config.json
👀 1
ok, a few seconds sounds normal
a
oh, i will fix the deps resolver! thanks!
👍 1