BaguaSys's repositories
bagua-core
Core communication lib for Bagua.
Megatron-LM
Ongoing research training transformer language models at scale, including: BERT & GPT-2
Core communication lib for Bagua.
Ongoing research training transformer language models at scale, including: BERT & GPT-2