Synchronized-BatchNorm-PyTorch-Horovod Synchronized Batch Normalization implementation in PyTorch by Horovod.