w00zie

ect

Consistency Models Made Easy

a-unet

A toolbox that provides hackable building blocks for generic 1D/2D/3D UNets, in PyTorch.

CLAP

Contrastive Language-Audio Pretraining

audiocraft

Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.

descript-audio-codec

State-of-the-art audio codec with 90x compression factor. Supports 44.1kHz, 24kHz, and 16kHz mono/stereo audio.

RWKV-LM

RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

vector-quantize-pytorch

Vector (and Scalar) Quantization, in Pytorch

eindex

Multidimensional indexing for tensors

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

audio-diffusion-pytorch

Audio generation using diffusion models, in PyTorch.

msprior

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

encodec

State-of-the-art deep learning based audio codec supporting both mono 24 kHz audio and stereo 48 kHz audio.

whisper

Robust Speech Recognition via Large-Scale Weak Supervision

uvadlc_notebooks

Repository of Jupyter notebook tutorials for teaching the Deep Learning Course at the University of Amsterdam (MSc AI), Fall 2023

micrograd

A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API

nn-zero-to-hero

Neural Networks: Zero to Hero

creative_ml

Creative Machine Learning course and notebook tutorials in JAX, PyTorch and Numpy

fairseq

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

pyloudnorm

Flexible audio loudness meter in Python with implementation of ITU-R BS.1770-4 loudness algorithm

flow_synthesizer

Universal audio synthesizer control learning with normalizing flows

oobleck

open soundstream-ish VAE codecs for downstream neural audio synthesis

opt_einsum

⚡️Optimizing einsum functions in NumPy, Tensorflow, Dask, and more with contraction order optimization.

torchinfo

View model summaries in PyTorch!

panel

Panel: The powerful data exploration & web app framework for Python

acids_transforms

A bunch of scriptable audio transforms based on the torchaudio backend

s3prl

Self-Supervised Speech Pre-training and Representation Learning Toolkit

gdown

Google Drive Public File Downloader when Curl/Wget Fails

musiclm-pytorch

Implementation of MusicLM, Google's new SOTA model for music generation using attention networks, in Pytorch

nanoGPT

The simplest, fastest repository for training/finetuning medium-sized GPTs.