nshmyrev

Awesome-Multimodal-Large-Language-Models

:sparkles::sparkles:Latest Papers and Datasets on Multimodal Large Language Models, and Their Evaluation.

pipecat

Open Source framework for voice and multimodal conversational AI

audiolazy

Expressive Digital Signal Processing (DSP) package for Python

AnyGPT

Code for "AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling"

SLAM-LLM

Speech, Language, Audio, Music Processing with Large Language Model

penn

Pitch Estimating Neural Networks (PENN)

Vach

Real time streaming talking head

TalkingHead

Talking Head (3D): A JavaScript class for real-time lip-sync using Ready Player Me full-body 3D avatars.

audioset-processing

Toolkit for downloading and processing Google's AudioSet dataset.

TextyMcSpeechy

Easily create text-to-speech models in any voice for rhasspy/piper. Make a text-to-speech model with your own voice recordings, or use thousands of RVC voices. Works offline on a Raspberry pi.

ssr_eval

Evaluation and Benchmarking of Speech Super-resolution Methods

timething

Timething is a library for aligning text transcripts with their audio recordings.

audio-preprocessing-scripts

数据集自动化制作脚本

Multi-Singer.github.io

UnitySpeechToText

A native Unity plugin to convert speech to text on Android & iOS

bandit

BandIt: Cinematic Audio Source Separation

StyleTalk

Official release of StyleTalk dataset.

FlashSpeech

FlashSpeech: Efficient Zero-Shot Speech Synthesis

audio_diarization_annotation

Audio Diarization Annotation tool

gazelle-train

Joint speech-language model - respond directly to audio!

nlp-rus-zaliz

Processing the grammar dictionary of A. A. Zaliznyak for morphological inflection

Lightvoc

LIGHTVOC AN UPSAMPLING-FREE GAN VOCODER BASED ON CONFORMER AND INVERSE SHORT-TIME FOURIER TRANSFORM

MINETrans-IWSLT23

Official implementation of our IWSLT 2023 paper "The MineTrans Systems for IWSLT 2023 Offline Speech Translation and Speech-to-Speech Translation Tasks"

Mamba-TasNet

supervoice-enhance

Supervoice diffusion enhance

minTorToiSe

A minimal PyTorch re-implementation of TorToiSe-tts inference

SSTC2024_baseline_system

StreamVC

An unofficial pytorch implementation of "STREAMVC: REAL-TIME LOW-LATENCY VOICE CONVERSION".

speech_evaluation

A toolkit dedicate for speech evaluation.

tortoise-tts

A multi-voice TTS system trained with an emphasis on quality