Vasudev Gupta's repositories
speech-jax
Speech in Flax/JAX
ds-toolkit
Some useful stuff for a software/ML engineer
transformers
🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.
biobigbird
BigBird for bio-medical domain
accelerate
A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision
data-centric-ai
Resources for Data Centric AI
datatrove
Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
diffusers
🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch
FastChat
An open platform for training, serving, and evaluating large languages. Release repo for Vicuna and FastChat-T5.
fm-cheatsheet
Website for hosting the Open Foundation Models Cheat Sheet.
fms-fsdp
Demonstrate throughput of PyTorch FSDP
gpt-fast
Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
grok
Grok open release
hyperpod
Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.
ImageBind
ImageBind One Embedding Space to Bind Them All
ml-engineering
Machine Learning Engineering Open Book
nanotron
Minimalistic large language model 3D-parallelism training
OLMo
Modeling, training, eval, and inference code for OLMo
peft
Parameter-Efficient Fine-Tuning
pytorch-image-models
PyTorch image models, scripts, pretrained weights -- ResNet, ResNeXT, EfficientNet, EfficientNetV2, NFNet, Vision Transformer, MixNet, MobileNet-V3/V2, RegNet, DPN, CSPNet, and more
RedPajama-Data
The RedPajama-Data repository contains code for preparing large datasets for training large language models.
text-generation-inference
Large Language Model Text Generation Inference
transformers-bloom-inference
Fast Inference Solutions for BLOOM
tuning_playbook
A playbook for systematically maximizing the performance of deep learning models.
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs