MlWoo

ASR-Benchmarks

An effort to track benchmarking results over widely-used datasets for ASR.

wer_are_we

Attempt at tracking states of the arts and recent results (bibliography) on speech recognition.

DALLE2-pytorch

Implementation of DALL-E 2, OpenAI's updated text-to-image synthesis neural network, in Pytorch

versatile_audio_super_resolution

Versatile audio super resolution (any -> 48kHz) with AudioSR.

speechbox

tuning_playbook

A playbook for systematically maximizing the performance of deep learning models.

pyAudioAnalysis

Python Audio Analysis Library: Feature Extraction, Classification, Segmentation and Applications

deep-vector-quantization

VQVAEs, GumbelSoftmaxes and friends

descript-audio-codec

State-of-the-art audio codec with 90x compression factor. Supports 44.1kHz, 24kHz, and 16kHz mono/stereo audio.

fairseq2

FAIR Sequence Modeling Toolkit 2

vall-e

An unofficial PyTorch implementation of the audio LM VALL-E

FlexFlow

FlexFlow Serve: Low-Latency, High-Performance LLM Serving

Awesome-LLM-System-Papers

seamless_communication

Foundational Models for State-of-the-Art Speech and Text Translation

RAM-multiprocess-dataloader

Demystify RAM Usage in Multi-Process Data Loaders

lhotse

Tools for handling speech data in machine learning projects.

Meta-voicebox

Implementation of Meta-Voicebox : The first generative AI model for speech to generalize across tasks with state-of-the-art performance.

conditional-flow-matching

TorchCFM: a Conditional Flow Matching library

Pretrained-Language-Model

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

DL-Art-School

TorToiSe fine-tuning with DLAS

tortoise-tts-fast

Fast TorToiSe inference (5x or your money back!)

d2c

PyTorch implementation of D2C: Diffuison-Decoding Models for Few-shot Conditional Generation.

Comprehensive-Transformer-TTS

A Non-Autoregressive Transformer based Text-to-Speech, supporting a family of SOTA transformers with supervised and unsupervised duration modelings. This project grows with the research community, aiming to achieve the ultimate TTS

bark

🔊 Text-Prompted Generative Audio Model

audio-ai-timeline

A timeline of the latest AI models for audio generation, starting in 2023!

declarativedtw

Reference implementation of DecDTW in PyTorch (ICLR 2023)

naturalspeech2-pytorch

Implementation of Natural Speech 2, Zero-shot Speech and Singing Synthesizer, in Pytorch

Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2

stable-diffusion-webui

Stable Diffusion web UI