wxy1988

SenseVoice

Multilingual Voice Understanding Model

CosyVoice

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

SLAM-LLM

Speech, Language, Audio, Music Processing with Large Language Model

silero-vad

Silero VAD: pre-trained enterprise-grade Voice Activity Detector

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

speech-synthesis-paper

List of speech synthesis papers.

TeleSpeech-ASR

LoRA

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

Whisper-Finetune

Fine-tune the Whisper speech recognition model to support training without timestamp data, training with timestamp data, and training without speech data. Accelerate inference and support Web deployment, Windows desktop deployment, and Android deployment

sanitizers

AddressSanitizer, ThreadSanitizer, MemorySanitizer

MMCSG

This repository contains the baseline system for CHiME-8 MMCSG challenge focusing on transcribing both sides of a conversation where one participant is wearing smart glasses equipped with a microphone array and camera.

numpy_exercises

Numpy exercises.

RIR-Generator

Generating room impulse responses

faster-whisper

Faster Whisper transcription with CTranslate2

stable-ts

Transcription, forced alignment, and audio indexing with OpenAI's Whisper

jsalt2020_simulate

Training data simulation

Beamforming-for-speech-enhancement

simple delaysum, MVDR and CGMM-MVDR

makeMoE

From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's makemore :)

gss

A simple package for Guided source separation (GSS)

unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

flash-attention

Fast and memory-efficient exact attention

machine-learning-roadmap

A roadmap connecting many of the most important concepts in machine learning, how to learn them and what tools to use to perform them.

Modern-CPP-Programming

Modern C++ Programming Course (C++03/11/14/17/20/23/26)

GPT-SoVITS

1 min voice data can also be used to train a good TTS model! (few shot voice cloning)

ICASSP-2023-24-Papers

ICASSP 2023-2024 Papers: A complete collection of influential and exciting research papers from the ICASSP 2023-24 conferences. Explore the latest advancements in acoustics, speech and signal processing. Code included. Star the repository to support the advancement of audio and signal processing!

audiocraft

Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.

e2e_lfmmi

E2E system with LF-MMI; word N-gram for Mandarin

kaldifst

Python wrapper for OpenFST and its extensions from Kaldi. Also support reading/writing ark/scp files

BeamformIt

BeamformIt acoustic beamforming software

NotepadNext

A cross-platform, reimplementation of Notepad++