powergiant

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Megatron-LM

Ongoing research training transformer models at scale

gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

nanoGPT

The simplest, fastest repository for training/finetuning medium-sized GPTs.

open_llama

OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset

EasyLM

Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.

deeplearningtheory

information-bottleneck

demonstration of the information bottleneck theory for deep learning

mean-field-theory-deep-learning

paper lists and information on mean-field theory of deep learning

Compositional_Deep_Learning

Deep learning via category theory and functional programming

RL-Theory-book

Reinforcement learning theory book about foundations of deep RL algorithms with proofs.

AutoGPT

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.