Looking for debugging ideas! Running Metaflow in A...
# dev-metaflow
a
Looking for debugging ideas! Running Metaflow in Azure Kubernetes service. I have a flow class decorated with conda-base. It runs fine locally and in Kubernetes, until I add a specific package (dask-kubernetes) to conda libraries:
libraries={"dask-kubernetes": "2022.10.1"}
. With this package I get a
Bootstrapping conda environment...(this could take a few minutes)
Internal error:
Azure error: ('Connection aborted.', timeout('The write operation timed out'))
even if running without Kubernetes, just remote datastore and service. I can run fine with
--datastore=local
so that's where the timeout happens. If I remove this package all is fine 🤷 Happens with older versions of this package too. Any ideas?
✅ 1
Upgrading to 2.7.14 seemed to fix this