yinyxl

audiocaps

🔊 Repository for our NAACL-HLT 2019 paper: AudioCaps

open_flamingo

An open-source framework for training large multimodal models.

UTMOS22

UT-Sarulab MOS prediction system using SSL models

sigsep-mus-db

Python parser and tools for MUSDB18 Music Separation Dataset

WritingAIPaper

Writing AI Conference Papers: A Handbook for Beginners

tango

A family of diffusion models for text-to-audio generation.

llm-tse

Typing to Listen at the Cocktail Party: Text-Guided Target Speaker Extraction (LLM-TSE)

audio-retrieval-benchmark

Implementation of "Audio Retrieval with Natural Language Queries: A Benchmark Study".

versatile_audio_super_resolution

Versatile audio super resolution (any -> 48kHz) with AudioSR.

audio-flamingo

PyTorch implementation of Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dialogue Abilities.

LLM101n

LLM101n: Let's build a Storyteller

AudioEditingCode

GESS

Code for GeSS: Benchmarking Geometric Deep Learning under Scientific Applications with Distribution Shifts

Codec-SUPERB

Audio Codec Speech processing Universal PERformance Benchmark

AcademiCodec

AcademiCodec: An Open Source Audio Codec Model for Academic Research

mtg-jamendo-dataset

Metadata, scripts and baselines for the MTG-Jamendo dataset

DiT

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

AudioSep

Official implementation of "Separate Anything You Describe"

EnCLAP

Official Implementation of EnCLAP (ICASSP 2024)

VGGSound

VGGSound: A Large-scale Audio-Visual Dataset

Zero_Shot_Audio_Source_Separation

The official code repo for "Zero-shot Audio Source Separation through Query-based Learning from Weakly-labeled Data", in AAAI 2022

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

ustcthesis

LaTeX template for USTC thesis

ACT

Source code for the paper 'Audio Captioning Transformer'

AudioLDM-training-finetuning

AudioLDM training, finetuning, evaluation and inference.

unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

melgan-neurips

GAN-based Mel-Spectrogram Inversion Network for Text-to-Speech Synthesis

WavCraft

Official repo for WavCraft, an AI agent for audio creation and editing

visqol

Perceptual Quality Estimator for speech and audio

AudioLDM2

Text-to-Audio/Music Generation