Maoshuiyang

qa-mdt

OpenMusic: SOTA Text-to-music (TTM) Generation

webdataset

pytorch大规模数据读取dataset

webdataset

A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.

OmniSenseVoice

Omni SenseVoice: High-Speed Speech Recognition with words timestamps 🗣️🎯

MusicGen-colab

RSTnet

Real-time Speech-Text Foundation Model Toolkit (wip)

FluxMusic

Text-to-Music Generation with Rectified Flow Transformer

FireRedTTS

An Open-Sourced LLM-empowered Foundation TTS System

MPP-LLaVA

Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conversations}. Don't let the poverty limit your imagination! Train your own 8B/14B LLaVA-training-like MLLM on RTX3090/4090 24GB.

zero_nlp

中文nlp解决方案(大模型、数据、模型、训练、推理)

Awesome-Multimodal-Large-Language-Models

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

VITA

✨✨VITA: Towards Open-Source Interactive Omni Multimodal LLM

audiocraft

Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.

Amphion

Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audio, music, and speech generation research and development.

naturalspeech3_facodec

FACodec: Speech Codec with Attribute Factorization used for NaturalSpeech 3

seed-tts-eval

WenetSpeechSpeakerCluster

RepCodec

Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization

Speech-Editing-Toolkit

It's a repository for implementations of neural speech editing algorithms.

open-speech-corpora

💎 A list of accessible speech corpora for ASR, TTS, and other Speech Technologies

trl

Train transformer language models with reinforcement learning.

litgpt

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Make-A-Scene

Pytorch implementation of Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priors

SpeechT5

Unified-Modal Speech-Text Pre-Training for Spoken Language Processing

pyllama

LLaMA: Open and Efficient Foundation Language Models

SpeechGen

《SpeechGen: Unlocking the Generative Power of Speech Language Models with Prompts》

TTS-TextAnalyzer

TTS Text Analyzer

Text-to-sound-Synthesis

The source code of our paper "Diffsound: discrete diffusion model for text-to-sound generation"

lyra

A Very Low-Bitrate Codec for Speech Compression

chinese_speech_pretrain

chinese speech pretrained models