seastar105

supabase

The open source Firebase alternative.

mlx

MLX: An array framework for Apple silicon

marker

Convert PDF to markdown quickly with high accuracy

video-retalking

[SIGGRAPH Asia 2022] VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wild

pyAudioAnalysis

Python Audio Analysis Library: Feature Extraction, Classification, Segmentation and Applications

DiT

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

gpt-fast

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

Amphion

Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audio, music, and speech generation research and development.

FreeU

FreeU: Free Lunch in Diffusion U-Net (CVPR2024 Oral)

stable-ts

Transcription, forced alignment, and audio indexing with OpenAI's Whisper

Qwen-Audio

The official repo of Qwen-Audio (通义千问-Audio) chat & pretrained large audio language model proposed by Alibaba Cloud.

HierSpeechpp

The official implementation of HierSpeech++

Real-Time-Latent-Consistency-Model

App showcasing multiple real-time diffusion models pipelines with Diffusers

NeumAI

Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.

speech-denoising-wavenet

A neural network for end-to-end speech denoising

normalizing-flows

PyTorch implementation of normalizing flow models

soft-dtw

Python implementation of soft-DTW.

ZeroSpeech

VQ-VAE for Acoustic Unit Discovery and Voice Conversion

stopes

A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB team.

paura

Python AUdio Recording and Analysis (paura)

ai-audio-datasets-list

This is a list of datasets consisting of speech, music, and sound effects, which can provide training data for Generative AI, AIGC, AI model training, intelligent audio tool development, and audio applications. It is mainly used for speech recognition, speech synthesis, singing voice synthesis, music information retrieval, music generation, etc.

pflowtts_pytorch

Unofficial implementation of NVIDIA P-Flow TTS paper

awesome-voice-conversion

A curated list of awesome voice conversion, projects and communities.

HPMDubbing

[CVPR 2023] Official code for paper: Learning to Dub Movies via Hierarchical Prosody Models.

character-factory

Generate characters for SillyTavern, TavernAI, TextGenerationWebUI using LLM and Stable Diffusion

Algorithms

APNet2

Source code of APNet2, a vocoder

LaDiffCodec

EDMSound

Codebase and project page for EDMSound

VISinger

Use VITS and Opencpop to develop singing voice synthesis; Different from VISinger.