panpanpan's repositories
flash-attention
Fast and memory-efficient exact attention
CosyVoice
Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.
fish-speech
Brand new TTS solution
detail_tts
All generative model in one for better TTS model
NAST
Official repository for NAST: Noise Aware Speech Tokenization for Speech Language Models (Interspeech 2024) https://arxiv.org/abs/2406.11037
Amphion
Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audio, music, and speech generation research and development.
emotion2vec
[ACL 2024] Official PyTorch code for extracting features and training downstream models with emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representation
voicefixer
General Speech Restoration
ChatTTS
ChatTTS is a generative speech model for daily dialogue.
direct-preference-optimization
Reference implementation for DPO (Direct Preference Optimization)
OpenVoice
Instant voice cloning by MyShell.
Montreal-Forced-Aligner
Command line utility for forced alignment using Kaldi
audiocraft
Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.
demucs
Code for the paper Hybrid Spectrogram and Waveform Source Separation
parler-tts
Inference and training library for high-quality TTS models.
UniSpeech
UniSpeech - Large Scale Self-Supervised Learning for Speech
KazEmoTTS
An open-source Kazakh Emotional Text-to-Speech Dataset
descript-audio-codec
State-of-the-art audio codec with 90x compression factor. Supports 44.1kHz, 24kHz, and 16kHz mono/stereo audio.
grok-1
Grok open release
UniCATS-CTX-txt2vec
[AAAI 2024] CTX-txt2vec, the acoustic model in UniCATS
brouhaha-vad
Predicts the level of noise and reverberation on your audiofiles
AnyGPT
Code for "AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling"
Neural-Transducers-for-Two-Stage-Text-to-Speech-via-Semantic-Token-Prediction
Unofficial pytorch reproduction for the paper "Utilizing Neural Transducers for Two-Stage Text-to-Speech via Semantic Token Prediction" (arXiv:2401.01498)
AudioSR-Upsampling
AudioSR-Upsampling (any -> 48kHz)
VALL-E-X
An open source implementation of Microsoft's VALL-E X zero-shot TTS model. Demo is available in https://plachtaa.github.io
PL-BERT
Phoneme-Level BERT for Enhanced Prosody of Text-to-Speech with Grapheme Predictions
megatts2
Unoffical implementation of Megatts2
GPT-SoVITS
1 min voice data can also be used to train a good TTS model! (few shot voice cloning)