train on multi gpu cluster

[kaphleamrit2]

I want to train it on multi GPU cluster. How can I train it?

[Haozhe Xie]

DataParallel can only be trained on a single machine with multiple GPUs. If you want to use multiple machines, you can use DistributedDataParallel.