Hi folks, I saw some issues discussing Azure support. Is there any active work on that front? if not, do you have any recommendations for implementing it?

hey Ammar! We tested our Kubernetes integration on Azure AKS and it works. The last missing piece is support for an Azure-native datastore to replace AWS S3. Technically you can use Metaflow on Azure with S3 or in a limited fashion by using the local datastore

Hi Ville! Is that support documented somewhere? does it come with an

@azure

decorator like the

@batch

one?

we will be releasing the Kubernetes support officially in a week, but you can give it a try today. It is included in the latest release, besides some final polish ✨ It will be

@kubernetes

which works with AKS. However, it is not a first-class support for Azure yet because a Azure-native datastore is missing. Hopefully we can add it over the coming months

That is awesome to hear!! Was thinking we’d need to fork and implement that, thank you! I added the decorator and it seems to exist but I haven’t set any settings there. I’m assuming I don’t have the full implementation cuz my metaflow isn’t built from source. I saw some mentions in the documentation about kubernetes, is more coming with the release?

yep, more docs for K8S coming soon!

Awesome, thanks again!