Giters

zgcr / SimpleAICV_pytorch_training_examples

SimpleAICV:pytorch training and testing examples.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Difference between DataParallel and DistributedDataParallel?

zpge opened this issue · comments

commented

Hi,
Nice work. I have a question. What is the difference between resnet_imagenet_DataParallel_train_example and resnet_imagenet_DistributedDataParallel_train_example?

commented

Hi,
Nice work. I have a question. What is the difference between resnet_imagenet_DataParallel_train_example and resnet_imagenet_DistributedDataParallel_train_example?

Non-distributed training mode and distributed training mode.