xjchenGit

GPT-SoVITS

1 min voice data can also be used to train a good TTS model! (few shot voice cloning)

leedl-tutorial

《李宏毅深度学习教程》（李宏毅老师推荐👍），PDF下载地址：https://github.com/datawhalechina/leedl-tutorial/releases

jukebox

Code for the paper "Jukebox: A Generative Model for Music"

awesome-pretrained-chinese-nlp-models

Awesome Pretrained Chinese NLP Models，高质量中文预训练模型&大模型&多模态模型&大语言模型集合

encodec

State-of-the-art deep learning based audio codec supporting both mono 24 kHz audio and stereo 48 kHz audio.

s3prl

Self-Supervised Speech Pre-training and Representation Learning Toolkit

omnizart

Omniscient Mozart, being able to transcribe everything in the music, including vocal, drum, chord, beat, instruments, and more.

mt3

MT3: Multi-Task Multitrack Music Transcription

madmom

Python audio and music signal processing library

ast

Code for the Interspeech 2021 paper "AST: Audio Spectrogram Transformer".

descript-audio-codec

State-of-the-art audio codec with 90x compression factor. Supports 44.1kHz, 24kHz, and 16kHz mono/stereo audio.

TruthfulQA

TruthfulQA: Measuring How Models Imitate Human Falsehoods

mixup

Implementation of the mixup training method

awesome-large-audio-models

Collection of resources on the applications of Large Language Models (LLMs) in Audio AI.

DoLa

Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"

all-in-one

All-In-One Music Structure Analyzer

TrustLLM

[ICML 2024] TrustLLM: Trustworthiness in Large Language Models

midi-ddsp

Synthesis of MIDI with DDSP (https://midi-ddsp.github.io/)

audioldm_eval

This toolbox aims to unify audio generation model evaluation for easier comparison.

ML_Practice

ML Records in 1110 Lab of BUPT. Some detailed information can be referenced on: https://mathpretty.com/10388.html

Efficient_Foundation_Model_Survey

Survey Paper List - Efficient LLM and Foundation Models

Beat-Transformer

Codes for ISMIR 2022 paper: Beat Transformer: Demixed Beat and Downbeat Tracking with Dilated Self-Attention

MARBLE-Benchmark

Music Audio Representation Benchmark for Universal Evaluation

FactualityPrompt

TONet

The official implementation of "TONet: Tone-Octave Network for Singing Melody Extraction from Polyphonic Music"

benadar293.github.io

Unaligned Supervision for Automatic Music Transcription in The Wild

SMC-Bench

[ICLR 2023] "Sparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together!" Shiwei Liu, Tianlong Chen, Zhenyu Zhang, Xuxi Chen, Tianjin Huang, AJAY KUMAR JAISWAL, Zhangyang Wang

MTDVocaLiST

Official repository for the paper Multimodal Transformer Distillation for Audio-Visual Synchronization.

LLMs-fall-23

awesome-audio-visual-deepfake

awesome-audio-visual-robustness