MlWoo

llama

Inference code for LLaMA models

bark

🔊 Text-Prompted Generative Audio Model

tuning_playbook

A playbook for systematically maximizing the performance of deep learning models.

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

DALLE2-pytorch

Implementation of DALL-E 2, OpenAI's updated text-to-image synthesis neural network, in Pytorch

seamless_communication

Foundational Models for State-of-the-Art Speech and Text Translation

pyAudioAnalysis

Python Audio Analysis Library: Feature Extraction, Classification, Segmentation and Applications

Pretrained-Language-Model

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

vall-e

An unofficial PyTorch implementation of the audio LM VALL-E

audio-ai-timeline

A timeline of the latest AI models for audio generation, starting in 2023!

wer_are_we

Attempt at tracking states of the arts and recent results (bibliography) on speech recognition.

FlexFlow

FlexFlow Serve: Low-Latency, High-Performance LLM Serving

descript-audio-codec

State-of-the-art audio codec with 90x compression factor. Supports 44.1kHz, 24kHz, and 16kHz mono/stereo audio.

versatile_audio_super_resolution

Versatile audio super resolution (any -> 48kHz) with AudioSR.

conditional-flow-matching

TorchCFM: a Conditional Flow Matching library

lhotse

Tools for handling speech data in machine learning projects.

tortoise-tts-fast

Fast TorToiSe inference (5x or your money back!)

fairseq2

FAIR Sequence Modeling Toolkit 2

Meta-voicebox

Implementation of Meta-Voicebox : The first generative AI model for speech to generalize across tasks with state-of-the-art performance.

deep-vector-quantization

VQVAEs, GumbelSoftmaxes and friends

Awesome-LLM-System-Papers

SpeechTokenizer

This is the code for the SpeechTokenizer presented in the SpeechTokenizer: Unified Speech Tokenizer for Speech Language Models. Samples are presented on

speechbox

Comprehensive-Transformer-TTS

A Non-Autoregressive Transformer based Text-to-Speech, supporting a family of SOTA transformers with supervised and unsupervised duration modelings. This project grows with the research community, aiming to achieve the ultimate TTS

DL-Art-School

TorToiSe fine-tuning with DLAS

RAM-multiprocess-dataloader

Demystify RAM Usage in Multi-Process Data Loaders

USLM

Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)

d2c

PyTorch implementation of D2C: Diffuison-Decoding Models for Few-shot Conditional Generation.

ASR-Benchmarks

An effort to track benchmarking results over widely-used datasets for ASR.

DistSup

Representation learning for NLP @ JSALT19