yzyouzhang

generative-models

Generative Models by Stability AI

audiocraft

Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.

pydub

Manipulate audio with a simple and easy high level interface

neuralangelo

Official implementation of "Neuralangelo: High-Fidelity Neural Surface Reconstruction" (CVPR 2023)

docta

A Doctor for your data

ijepa

Official codebase for I-JEPA, the Image-based Joint-Embedding Predictive Architecture. First outlined in the CVPR paper, "Self-supervised learning from images with a joint-embedding predictive architecture."

AudioLDM2

Text-to-Audio/Music Generation

awesome-python-scientific-audio

Curated list of python software and packages related to scientific research in audio

CLAP

Contrastive Language-Audio Pretraining

music_source_separation

Audio-driven-TalkingFace-HeadPose

Code for "Audio-driven Talking Face Video Generation with Learning-based Personalized Head Pose" (Arxiv 2020) and "Predicting Personalized Head Movement From Short Video and Speech Signal" (TMM 2022)

MICA

MICA - Towards Metrical Reconstruction of Human Faces [ECCV2022]

LLaSM

第一个支持中英文双语语音-文本多模态对话的开源可商用对话模型。便捷的语音输入将大幅改善以文本为输入的大模型的使用体验，同时避免了基于 ASR 解决方案的繁琐流程以及可能引入的错误。

Awesome-Diffusion-Personalization

A collection of resources on personalization with diffusion models.

CLAP

Learning audio concepts from natural language supervision

emotion-classification-from-audio-files

Understanding emotions from audio files using neural networks and multiple datasets.

Point-Bind_Point-LLM

Align 3D Point Cloud with Multi-modalities for Large Language Models

torchsynth

A GPU-optional modular synthesizer in pytorch, 16200x faster than realtime, for audio ML researchers.

VAST

Code and Model for VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Dataset

OTK

A Pytorch implementation of the optimal transport kernel embedding

OGNet

Code for the CVPR 2020 paper 'Old is Gold: Redefining the Adversarially Learned One-Class Classifier Training Paradigm'

Synthetic-Voice-Detection-Vocoder-Artifacts

This repository is related to our Dataset and Detection code from the paper: AI-Synthesized Voice Detection Using Neural Vocoder Artifacts accepted in CVPR Workshop on Media Forensic 2023.

multimodal-decoding

Code associated with the paper titled "A high-performance neuroprosthesis for speech decoding and avatar control" , published in Nature in 2023.

ScalableFHVAE

This repository contains the code to reproduce the core results from the paper "Scalable Factorized Hierarchical Variational Autoencoders"

Audio_Research_in_US

For students who would like to apply for RA, PhD, postdoc in audio research.

T-EER

Official PyTorch implementation of "t-EER: Parameter-Free Tandem Evaluation Metric of Countermeasures and Biometric Comparators"

Breaking-Security-Critical-Voice-Authentication

Source code for paper "Breaking Security-Critical Voice Authentication".

ntools_elec

Intracranial Electrode Localization

PhaseAntispoofing_INTERSPEECH

Official repository of the paper "Phase perturbation improves channel robustness for speech spoofing countermeasures"

HRTF-SCNN