acoustic-van-30942
06/05/2023, 11:12 PM@tensorflow_parallel example flow I could follow to play around with it? I tried perusing the slack history but they all had broken linksvictorious-lawyer-58417
06/06/2023, 1:34 AMvictorious-lawyer-58417
06/06/2023, 1:34 AM@parallel function, which is already out (as an experimental feature)victorious-lawyer-58417
06/06/2023, 1:35 AMacoustic-van-30942
06/06/2023, 1:59 AM@parallel and @pytorch_parallel experimental? They're released in the main metaflow package out of the box.
We are actually planning to test both Horovod and TF-native distributed. But probably will start with Horovod first.
By the way, we battle-tested @pytorch_parallel , and it looks good so far. No customer has used it yet, but I played around with it and used it to do distributed training on a few examples.victorious-lawyer-58417
06/06/2023, 2:17 AMvictorious-lawyer-58417
06/06/2023, 2:18 AMvictorious-lawyer-58417
06/06/2023, 2:18 AMacoustic-van-30942
06/06/2023, 2:21 AMfast-dog-88545
06/06/2023, 11:20 PM@tensorflow_parallel haven't been released, is there anyway to install it through an experimental plugin? I would like to play around it