amanteur

muchomusic

MuChoMusic is a benchmark for evaluating music understanding in multimodal audio-language models.

Speech-Editing-Toolkit

It's a repository for implementations of neural speech editing algorithms.

FluxMusic

Text-to-Music Generation with Rectified Flow Transformers

SEMamba

This is the official implementation of the SEMamba paper. (Accepted to IEEE SLT 2024)

matchering

🎚️ Open Source Audio Matching and Mastering

audio-flamingo

PyTorch implementation of Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dialogue Abilities.

ruff

An extremely fast Python linter and code formatter, written in Rust.

NeMo

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

VISinger2

VISinger 2: High-Fidelity End-to-End Singing Voice Synthesis Enhanced by Digital Signal Processing Synthesizer

seed-vc

zero-shot voice conversion with in context learning

Fast-GeCo

Source code and demo for INTERSPEECH 2024 paper: Noise-robust Speech Separation with Fast Generative Correction

mini-omni

open-source multimodal large language model that can hear, talk while thinking. Featuring real-time end-to-end speech input and streaming audio output conversational capabilities.

StyleTTS2

StyleTTS 2: Towards Human-Level Text-to-Speech through Style Diffusion and Adversarial Training with Large Speech Language Models

MeloTTS

High-quality multi-lingual text-to-speech library by MyShell.ai. Support English, Spanish, French, Chinese, Japanese and Korean.

HiFTNet-sr

HiFTNet wav/audio super-resolution 16/24 kHz to 48 kHz

Stable-Hybrid-Auditory-Filterbanks

Official Implementation of Interspeech 2024 Paper "Hold Me Tight: Stable Encoder-Decoder Design for Speech Enhancement"

YOLOPitch

stable-audio-controlnet

Fine-tune Stable Audio Open with DiT ControlNet.

voice_datasets

🔊 A comprehensive list of open-source datasets for voice and sound computing (95+ datasets).

WavTokenizer

SOTA discrete acoustic codec models with 40 tokens per second for audio language modeling

BSSE-SE

Boosting Self-Supervised Embeddings for Speech Enhancement

AFX-Research

Scientific literature about Audio Effects

HierSpeechpp

The official implementation of HierSpeech++

Respiro-en

Official implementation of paper: Frame-Wise Breath Detection with Self-Training: An Exploration of Enhancing Breath Naturalness in Text-to-Speech

LAFMA

PeriodWave

The official Implementation of PeriodWave and PeriodWave-Turbo

nnsvs

Neural network-based singing voice synthesis library for research

promonet

Prosody and Pronunciation Modification Network

edm

Elucidating the Design Space of Diffusion-Based Generative Models (EDM)

music2latent

Encode and decode audio samples to/from compressed latent representations!