Why isn't mamba used in the batch bootstrap step: ...
# dev-metaflowb
breezy-art-4081
07/18/2022, 10:58 PMWhy isn't mamba used in the batch bootstrap step: GitHub link?
✅ 1
breezy-art-4081
07/18/2022, 10:59 PMAsking because I'm seeing 3.5 minute conda installs per step and hoping to speed it up with mamba
a
ancient-application-36103
07/18/2022, 11:02 PMIn the batch bootstrap - we are simply downloading the s3 packages and pointing conda towards the downloaded packages to install them. Mamba wouldn't really provide much speedup and up until very recently there wasn't a standalone micro-installer for mamba (it seems now there is one). Would you like to benchmark the performance and submit a PR?
b
breezy-art-4081
07/18/2022, 11:09 PMOh nice! sure I'll give this a shot
❤️ 1
breezy-art-4081
07/19/2022, 12:04 AMRan a comparison on Batch installing ~130 packages and mamba is not faster. It takes a bit longer to download and install mambaforge as well
Copy code
Download and install miniforge: 8.637s
conda install packages: 3min 26.335s
Download and install mambaforge: 12.812s
mamba install packages: 3min 26.934sa
ancient-application-36103
07/19/2022, 12:06 AMGreat - the results are as per expectations
👍 1
2 Views