louaaron

audiocraft

Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

flash-attention

Fast and memory-efficient exact attention

mamba

Mamba SSM architecture

RWKV-LM

RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

DiT

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

esm

Evolutionary Scale Modeling (esm): Pretrained language models for proteins

consistencydecoder

Consistency Distilled Diff VAE

gpt-2-output-dataset

Dataset of GPT-2 outputs for research in detection, biases, and more

score_sde_pytorch

PyTorch implementation for Score-Based Generative Modeling through Stochastic Differential Equations (ICLR 2021, Oral)

CUDALibrarySamples

CUDA Library Samples

the-pile

cramming

Cramming the training of a (BERT-type) language model into limited compute.

gpt-2-Pytorch

Simple Text-Generator with OpenAI gpt-2 Pytorch Implementation

U-ViT

A PyTorch implementation of the paper "All are Worth Words: A ViT Backbone for Diffusion Models".

VQ-Diffusion

Official implementation of VQ-Diffusion

openwebtext

Open clone of OpenAI's unreleased WebText dataset scraper. This version uses pushshift.io files instead of the API for speed.

ringattention

Transformers with Arbitrarily Large Context

magvit2-pytorch

Implementation of MagViT2 Tokenizer in Pytorch

DNA-Diffusion

🧬 Generative modeling of regulatory DNA sequences with diffusion probabilistic models 💨

vdm

mauve

Package to compute Mauve, a similarity score between neural text and human text. Install with `pip install mauve-text`.

multinomial_diffusion

DiS

Scalable Diffusion Models with State Space Backbone

riemannian-score-sde

Score-based generative models for compact manifolds

reparam-discrete-diffusion

Reparameterized Discrete Diffusion Models for Text Generation

l2hmc-qcd

Application of the L2HMC algorithm to simulations in lattice QCD.

plaid

cider

PyTorch implementation of CIDER (How to exploit hyperspherical embeddings for out-of-distribution detection), ICLR 2023

Riemannian-Residual-Neural-Networks

[NeurIPS 2023] Riemannian Residual Neural Networks (https://arxiv.org/abs/2006.10254)