pacman100

t-few

Code for T-Few from "Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning"

RWKV-LM

RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

natural-instructions

Expanding natural instructions

hh-rlhf

Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"

pandarallel

A simple and efficient tool to parallelize Pandas operations on all available CPUs

bigcode-dataset

cc2dataset

Easily convert common crawl to a dataset of caption and document. Image/text Audio/text Video/text, ...

annotated_deep_learning_paper_implementations

🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

deep-rl-class

This repo contains the syllabus of the Hugging Face Deep Reinforcement Learning Course.

P-tuning-v2

An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks

fashion-iq

ml-stable-diffusion

Stable Diffusion with Core ML on Apple Silicon

diffusion-models-class

Materials for the Hugging Face Diffusion Models Course

flash-attention

Fast and memory-efficient exact attention

torchscale

Foundation Architecture for (M)LLMs

PromptPapers

Must-read papers on prompt-based tuning for pre-trained language models.

LoRA

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

electra

ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators

DeBERTa

The implementation of DeBERTa

parallelformers

Parallelformers: An Efficient Model Parallelization Toolkit for Deployment

galai

Model API for GALACTICA

ZerO-initialization

E.T.

Episodic Transformer (E.T.) is a novel attention-based architecture for vision-and-language navigation. E.T. is based on a multimodal transformer that encodes language inputs and the full episode history of visual observations and actions.

teach

TEACh is a dataset of human-human interactive dialogues to complete tasks in a simulated household environment.

text-generation-inference

Large Language Model Text Generation Inference

torchdynamo-tests

triton

Development repository for the Triton language and compiler

pytorch_geometric

Graph Neural Network Library for PyTorch