YuanGongND

ast

Code for the Interspeech 2021 paper "AST: Audio Spectrogram Transformer".

ssast

Code for the AAAI 2022 paper "SSAST: Self-Supervised Audio Spectrogram Transformer".

ltu

Code, Dataset, and Pretrained Models for Audio and Speech Large Language Model "Listen, Think, and Understand".

whisper-at

Code and Pretrained Models for Interspeech 2023 Paper "Whisper-AT: Noise-Robust Automatic Speech Recognizers are Also Strong Audio Event Taggers"

cav-mae

Code and Pretrained Models for ICLR 2023 Paper "Contrastive Audio-Visual Masked Autoencoder".

gopt

Code for the ICASSP 2022 paper "Transformer-Based Multi-Aspect Multi-Granularity Non-native English Speaker Pronunciation Assessment".

psla

Code for the TASLP paper "PSLA: Improving Audio Tagging With Pretraining, Sampling, Labeling, and Aggregation".

vocalsound

Dataset and baseline code for the VocalSound dataset (ICASSP2022).

uavm

Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".

python-compute-eer

Simple Python script to compute equal error rate (EER) for machine learning model evaluation.

ReMASC

ReMASC: Realistic Replay Attack Corpus for Voice Controlled Systems

realtime-adversarial-attack

Code for IJCAI 2019 paper "Real-time Adversarial Attack".

llm_speech_emotion_challenge

multichannel-antispoof

Code for SPL paper "Detecting Replay Attacks Using Multi-Channel Audio: A Neural Network-Based Method"

awesome-whisper

🔊 Awesome list for Whisper — an open-source AI-powered speech recognition system developed by OpenAI

efficient-voice-antispoof

Awesome-Multimodal-Large-Language-Models

Latest Papers and Datasets on Multimodal Large Language Models

ESC-50

ESC-50: Dataset for Environmental Sound Classification

kaldi-abbr

kaldi name convention note

yuangongnd.github.io

SincNet

SincNet is a neural architecture for efficiently processing raw audio samples.

audioset_tagging_cnn

Autoregressive-Predictive-Coding

Autoregressive Predictive Coding: An unsupervised autoregressive model for speech representation learning

docs

TensorFlow documentation

espnet

End-to-End Speech Processing Toolkit

kaldi

This is the official location of the Kaldi project.

kaldi-io-for-python

Python functions for reading kaldi data formats. Useful for rapid prototyping with python.

pyroomacoustics

Pyroomacoustics is a package for audio signal processing for indoor applications. It was developed as a fast prototyping platform for beamforming algorithms in indoor scenarios.

skynet-ddp-slurm-example

Example of using PyTorch DistributedDataParallel and SLURM on skynet

tutorials

PyTorch tutorials.