kunsung

AAR

[Official Implementation] Acoustic Autoregressive Modeling 🔥

SimpleSpeech

The open source code for SimpleSpeech series

speech-to-speech

Speech To Speech: an effort for an open-sourced and modular GPT4-o

contrastive-predictive-coding

PyTorch implementation of Representation Learning with Contrastive Predictive Coding by Van den Oord et al. (2018)

Matcha-TTS

[ICASSP 2024] 🍵 Matcha-TTS: A fast TTS architecture with conditional flow matching

CPC_audio

An implementation of the Contrast Predictive Coding (CPC) method to train audio features in an unsupervised fashion.

LlamaVoice

LlamaVoice is a llama-based large voice generation model, providing inference and training ability.

mar

PyTorch implementation of MAR+DiffLoss https://arxiv.org/abs/2406.11838

llama-models

Utilities intended for use with Llama models.

e2-tts-pytorch

Implementation of E2-TTS, "Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTS", in Pytorch

HierSpeechpp

The official implementation of HierSpeech++

tortoise-tts-fast

Fast TorToiSe inference (5x or your money back!)

CosyVoice

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

NeMo

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

AudioMAE

This repo hosts the code and models of "Masked Autoencoders that Listen".

VQGAN-LC

SRVQ

Spherical residual vector quantization (SRVQ)

SpeechT5

Unified-Modal Speech-Text Pre-Training for Spoken Language Processing

LLM-Codec

The open source code for LLM-Codec

MARS5-TTS

MARS5 speech model (TTS) from CAMB.AI

LibriTTS-P

LibriTTS-P: A Corpus with Speaking Style and Speaker Identity Prompts for Text-to-Speech and Style Captioning

valle-audiodec

Inference code for Audiodec-Valle-Wenetspeech4TTS

ChatTTS

A generative speech model for daily dialogue.

vector-quantize-pytorch

Vector (and Scalar) Quantization, in Pytorch

fairseq2

FAIR Sequence Modeling Toolkit 2

llama

Inference code for Llama models

TTS-arxiv-daily

Automatically Update Text-to-speech (TTS) Papers Daily using Github Actions (Update Every 12th hours)

UniAudio

The Open Source Code of UniAudio

MQTTS

awesome-RLHF

A curated list of reinforcement learning with human feedback resources (continually updated)