Hello team, Is there a `@tensorflow_parallel` exa...
# ask-metaflow
a
Hello team, Is there a
@tensorflow_parallel
example flow I could follow to play around with it? I tried perusing the slack history but they all had broken links
1
v
since it's an experimental undocumented feature, we don't have the usual docs / examples / tutorials for it
it piggybacks on the
@parallel
function, which is already out (as an experimental feature)
what do you have in mind for it? Would you like to try Horovod or TF-native distributed?
a
Are
@parallel
and
@pytorch_parallel
experimental? They're released in the main metaflow package out of the box. We are actually planning to test both Horovod and TF-native distributed. But probably will start with Horovod first. By the way, we battle-tested
@pytorch_parallel
, and it looks good so far. No customer has used it yet, but I played around with it and used it to do distributed training on a few examples.
v
that's great to hear! We have wanted to gather a bit more real-world experiences with it before finalizing the API, so what you are doing is super helpful! 🙌
🙂 1
we have tested it quite a bit internally and with a private testers
let me know if you need help getting Horovod set up
a
Okay thanks so much Ville. :)
🙌 1
f
Hi @straight-shampoo-11124 since
@tensorflow_parallel
haven't been released, is there anyway to install it through an experimental plugin? I would like to play around it