pan310

flash-attention

Fast and memory-efficient exact attention

speech-to-speech

CosyVoice

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

fish-speech

Brand new TTS solution

detail_tts

All generative model in one for better TTS model

NAST

Official repository for NAST: Noise Aware Speech Tokenization for Speech Language Models (Interspeech 2024) https://arxiv.org/abs/2406.11037

Amphion

Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audio, music, and speech generation research and development.

emotion2vec

[ACL 2024] Official PyTorch code for extracting features and training downstream models with emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representation

voicefixer

General Speech Restoration

ChatTTS

ChatTTS is a generative speech model for daily dialogue.

direct-preference-optimization

Reference implementation for DPO (Direct Preference Optimization)

OpenVoice

Instant voice cloning by MyShell.

Montreal-Forced-Aligner

Command line utility for forced alignment using Kaldi

audiocraft

Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.

demucs

Code for the paper Hybrid Spectrogram and Waveform Source Separation

parler-tts

Inference and training library for high-quality TTS models.

UniSpeech

UniSpeech - Large Scale Self-Supervised Learning for Speech

KazEmoTTS

An open-source Kazakh Emotional Text-to-Speech Dataset

descript-audio-codec

State-of-the-art audio codec with 90x compression factor. Supports 44.1kHz, 24kHz, and 16kHz mono/stereo audio.

grok-1

Grok open release

UniCATS-CTX-txt2vec

[AAAI 2024] CTX-txt2vec, the acoustic model in UniCATS

brouhaha-vad

Predicts the level of noise and reverberation on your audiofiles

AnyGPT

Code for "AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling"

Neural-Transducers-for-Two-Stage-Text-to-Speech-via-Semantic-Token-Prediction

Unofficial pytorch reproduction for the paper "Utilizing Neural Transducers for Two-Stage Text-to-Speech via Semantic Token Prediction" (arXiv:2401.01498)

AudioSR-Upsampling

AudioSR-Upsampling (any -> 48kHz)

VALL-E-X

An open source implementation of Microsoft's VALL-E X zero-shot TTS model. Demo is available in https://plachtaa.github.io

MahaTTS

PL-BERT

Phoneme-Level BERT for Enhanced Prosody of Text-to-Speech with Grapheme Predictions

megatts2

Unoffical implementation of Megatts2

GPT-SoVITS

1 min voice data can also be used to train a good TTS model! (few shot voice cloning)