There are 2 repositories under billion-parameters topic.
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
