leuchine

CLIP

CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image

openai-python

The official Python library for the OpenAI API

ml-visuals

🎨 ML Visuals contains figures and templates which you can reuse and customize to improve your scientific writing.

spinningup

An educational resource to help anyone learn deep reinforcement learning.

Megatron-LM

Ongoing research training transformer models at scale

cleanlab

The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

speechbrain

A PyTorch-based Speech Toolkit

jukebox

Code for the paper "Jukebox: A Generative Model for Music"

gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

snorkel

A system for quickly generating training data with weak supervision

YaLM-100B

Pretrained language model with 100B parameters

fairscale

PyTorch extensions for high performance and large scale training.

huggingface_hub

The official Python client for the Huggingface Hub.

the-pile

deepmd-kit

A deep learning package for many-body potential energy representation and molecular dynamics

diplomacy_cicero

Code for Cicero, an AI agent that plays the game of Diplomacy with open-domain natural language negotiation.

mup

maximal update parametrization (µP)

safe-rlhf

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

perceiver-pytorch

Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch

bigscience

Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.

NL-Augmenter

NL-Augmenter 🦎 → 🐍 A Collaborative Repository of Natural Language Transformations

tabular-benchmark

data-preparation

Code used for sourcing and cleaning the BigScience ROOTS corpus

olm-datasets

Pipeline for pulling and processing online language model pretraining data from the web

private-transformers

A codebase that makes differentially private training of transformers easy.

CausalMediationAnalysis

Code for the paper "Causal Mediation Analysis for Interpreting Neural NLP: The Case of Gender Bias"

gold-off-policy-text-gen-iclr21

nessie

Automatically detect errors in annotated corpora.

pile-cc

dataperf

Data Benchmarking