liuxubo717

log-wmse-audio-quality

logWMSE, an audio quality metric with support for digital silence target. Useful for evaluating audio source separation systems, even when there are many audio tracks or stems.

Diff-Foley

Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models

agc

Audiogen Codec

mamba

Mamba SSM architecture

Amphion

Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audio, music, and speech generation research and development.

descript-audio-codec

State-of-the-art audio codec with 90x compression factor. Supports 44.1kHz, 24kHz, and 16kHz mono/stereo audio.

APT

resemble-enhance

AI powered speech denoising and enhancement

Qwen-Audio

The official repo of Qwen-Audio (通义千问-Audio) chat & pretrained large audio language model proposed by Alibaba Cloud.

musicfm

distil-whisper

Distilled variant of Whisper for speech recognition. 6x faster, 50% smaller, within 1% word error rate.

StylerDALLE

Code for ICCV 2023 paper ✨ "StylerDALLE: Language-Guided Style Transfer Using a Vector-Quantized Tokenizer of a Large-Scale Generative Model".

LLM-groundedVideoDiffusion

[ICLR 2024] LLM-grounded Video Diffusion Models (LVD): official implementation for the LVD paper

U-FFIA

The audio-visual fusion method for FFIA

seamless_communication

Foundational Models for State-of-the-Art Speech and Text Translation

lam4fsl

An official repo for the paper "Adapting Language-Audio Models as Few-Shot Audio Learners"

AudioSep

Official implementation of "Separate Anything You Describe"

AudioLDM2

Text-to-Audio/Music Generation

WavJourney

WavJourney: Compositional Audio Creation with LLMs

visprog

Official code for VisProg (CVPR 2023 Best Paper!)

Speech-Prompts-Adapters

This Repository surveys the paper focusing on Prompting and Adapters for Speech Processing.

ltu

Code, Dataset, and Pretrained Models for Audio and Speech Large Language Model "Listen, Think, and Understand".

CLIPSep

co-separation

Co-Separating Sounds of Visual Objects (ICCV 2019)

AudioGPT

AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head

ReAtt

Retrieval as Attention

VALOR

Codes and Models for VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset

WavCaps

This reporsitory contains metadata of WavCaps dataset and codes for downstream tasks.

distributed-system

Creative and educational project for distributed system

AudioLDM

AudioLDM: Generate speech, sound effects, music and beyond, with text.