The human-centric platform for production ML & AI

Outerbounds

Hi all,

Was wondering if Metaflow was compatible with the new AWS `trn1` instances. I do see support for inferentia. Our use case is we want to try refactoring one of our customer's models to leverage AWS neuron sdk just to see what the performance gain is.

Looking through these <https://awsdocs-neuron.readthedocs-hosted.com/en/latest/general/quick-start/torch-neuron.html|docs>, it appears like there would be some retooling involved to get Metaflow's Batch decorator compatible with `trn1` .

Hey :wave: - yes inf1 support is out of the box. We can look into the tranium instances. 

Should be straightforward for us to enable. I will follow up here once we have it live.

Thanks Savin! :pray:

That would be great! Are there are any special considerations you anticipate the user would need to be concerned about to get `trn1` compatibility? Would we need to modify the launch template to use the DLAMI compatible with `trn1`? Do we need to install the drivers (i.e. efa) and tools into the image?