zhisbug

Cavs

Cavs: An Efficient Runtime System for Dynamic Neural Networks

ray-scalable-ml-design

Some microbenchmarks and design docs before commencement

ray

An open source framework that provides a simple, universal API for building distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning library.

Megatron-LM

Ongoing research training transformer language models at scale, including: BERT & GPT-2

AutoLossRelease

caffe

Caffe: a fast open framework for deep learning.

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

lm

ludwig

Ludwig is a toolbox that allows to train and evaluate deep learning models without the need to write code.

metaseq

Repo for external large-scale work

models

Models and examples built with TensorFlow

RC

My dev configurations

RFC

Community Documents

tensorflow

Computation using data flow graphs for scalable machine learning

test-alpa-ci

test-alpa-ci-runner