hey guys, I have a few metaflow infrastructure related question. We are currently building our own GPU based instance and trying to use our own instance instead of AWS EC2 instance, we wonder if metaflow supports self hosted instance? if so, what do we need to do? if not, why? thanks!

the easiest approach is to use Kubernetes with your internal instances and then burst to AWS e.g. with

@batch

I have a pipeline that only two steps run on GPU, can I have these two steps run on local GPU and rest steps on aws?

yep. Just annotate the steps that you want to run on AWS with

@batch

(or

@kubernetes

depending on your deployment). The rest will be run on your local instance

cool, good to know that, thanks!

let us know what you end up doing (successfully or not). As you see, other folks are curious about this setup too 🙂