thomasw21

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

datasets

🤗 The largest hub of ready-to-use NLP datasets for ML models with fast, easy-to-use and efficient data manipulation tools

apex

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

bigscience

Codebase for the engineering/scaling WG

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.

drjit

Dr.Jit — A Just-In-Time-Compiler for Differentiable Rendering

eval_t0_deepspeed

Evaluate T0 with DeepSpeed

FlexFlow

A distributed deep learning framework that supports flexible parallelization strategies.

lm-evaluation-harness

A framework for few-shot evaluation of autoregressive language models.

lxmls-toolkit

Machine Learning applied to Natural Language Processing Toolkit used in the Lisbon Machine Learning Summer School

Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2

Megatron-LM

Ongoing research training transformer models at scale

metaseq

Repo for external large-scale work

nerfacc

A General NeRF Acceleration Toolbox in PyTorch.

nerfstudio

A collaboration friendly studio for NeRFs

promptsource

Toolkit for collecting and applying templates of prompting instances

ReinforcementLearningMVAProject

Self-Paced IRL

scripts

Dump of all the scripts that are not part of any specific project.

seqio

Task-based datasets, preprocessing, and evaluation for sequence models.

svox2

Plenoxels: Radiance Fields without Neural Networks, Code release WIP

text-to-text-transfer-transformer

Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"

thomasw21

transformers

🤗 Transformers: State-of-the-art Natural Language Processing for Pytorch, TensorFlow, and JAX.

trl

Train transformer language models with reinforcement learning.