hbwu-ntu

whisper

Robust Speech Recognition via Large-Scale Weak Supervision

google-research

Google Research

ChatGPT

Reverse engineered ChatGPT API

tuning_playbook

A playbook for systematically maximizing the performance of deep learning models.

From-0-to-Research-Scientist-resources-guide

Detailed and tailored guide for undergraduate students or anybody want to dig deep into the field of AI with solid foundation.

accelerate

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

RepDistiller

[ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods

awesome_lists

Awesome Lists for Tenure-Track Assistant Professors and PhD students. (助理教授/博士生生存指南)

sherpa-ncnn

Real-time speech recognition using next-gen Kaldi with ncnn without Internet connection. Support iOS, Android, Raspberry Pi, VisionFive2, LicheePi4A etc.

torch-audiomentations

Fast audio data augmentation in PyTorch. Inspired by audiomentations. Useful for deep learning.

PromptCLUE

PromptCLUE, 全中文任务支持零样本学习模型

pytorch-domain-adaptation

A collection of implementations of adversarial domain adaptation algorithms

gpuRIR

Python library for Room Impulse Response (RIR) simulation with GPU acceleration

ssast

Code for the AAAI 2022 paper "SSAST: Self-Supervised Audio Spectrogram Transformer".

AudioClassification-Pytorch

The Pytorch implementation of sound classification supports EcapaTdnn, PANNS, TDNN, Res2Net, ResNetSE and other models, as well as a variety of preprocessing methods.

PaSST

Efficient Training of Audio Transformers with Patchout

panns_inference

beamformers

Easy to use Beamformers for multi-channel speech separation/enhancement

GradTTS

Pytorch implementation of "Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speech"

interspeech2022

MSMC-TTS

Official Implement of Multi-Stage Multi-Codebook (MSMC) TTS

audioset-processing

Toolkit for downloading and processing Google's AudioSet dataset.

psla

Code for the TASLP paper "PSLA: Improving Audio Tagging With Pretraining, Sampling, Labeling, and Aggregation".

DCCRN-with-various-loss-functions

DCCRN with various loss functions

Mockingjay-Speech-Representation

Official Implementation of Mockingjay in Pytorch

SpeakerGuard

a Pytorch library for security research on speaker recognition, released in "Towards Understanding and Mitigating Audio Adversarial Examples for Speaker Recognition" accepted by TDSC

SpecAugment-plus

A Pytorch implementation of the paper : SpecAugment++: A Hidden Space Data Augmentation Method for Acoustic Scene Classification

AVCleanse

ICASSP 2023: 'Speaker recognition with two-step multi-modal deep cleansing'

s3prl-private

neiwen.github.io

Neiwen's homepage