There are 1 repository under collective-communication topic.
Distributed training (multi-node) of a Transformer model
Blink+: Increase GPU group bandwidth by utilizing across tenant NVLink.
collectives library for upc++
A reduction algorithm for MPI using only peer to peer communication
This repository contains simple programs of MPI_Bcast, MPI_Reduce, MPI_Scatter and MPI_Gather. Download the repository and test your self.