Zhenghui Jin's repositories
nccl
Optimized primitives for collective multi-GPU communication
pytorch
Tensors and Dynamic neural networks in Python with strong GPU acceleration
xla
Enabling PyTorch on XLA Devices (e.g. Google TPU)
NeMo
NeMo: a toolkit for conversational AI
python-etcd
A python client for etcd
apex
A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
pytorch-lightning
The lightweight PyTorch wrapper for high-performance AI research. Scale your models, not the boilerplate.
xformers
Hackable and optimized Transformers building blocks, supporting a composable construction.
gluon-nlp
NLP made easy
transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
amazon-eks-ami
Packer configuration for building a custom EKS AMI
aws-efa-nccl-baseami-pipeline
EFA/NCCL base AMI build Packer and CodeBuild/Pipeline files. Also base Docker build files to enable EFA/NCCL in containers
elastic
PyTorch elastic training
training-operator
Training operators on Kubernetes.
alpa
Auto parallelization for large-scale neural networks
dcgm-exporter
NVIDIA GPU metrics exporter for Prometheus leveraging DCGM
incubator-mxnet
Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more
DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.
torchx
TorchX is a library containing standard DSLs for authoring and running PyTorch related components for an E2E production ML pipeline
array-api-tests
Test suite for the PyData Array APIs standard
arrow
Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing
ray_lightning
Pytorch Lightning Distributed Accelerators using Ray
horovod
Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
aws-efa-eks
Deploying P4d in EKS utilizing GPUDirectRDMA over EFA
mxnet_recipes
MXNet conda recipes
staged-recipes
A place to submit conda recipes before they become fully fledged conda-forge feedstocks
jax
Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more
d2l-en
Interactive deep learning book with multi-framework code, math, and discussions. Adopted at 175 universities.
kaldi
kaldi-asr/kaldi is the official location of the Kaldi project.