Mickey-Stone

FDRL-MHAD

Dataset

cc_net

Tools to download and cleanup Common Crawl data

arthas

Alibaba Java Diagnostic Tool Arthas/Alibaba Java诊断利器Arthas

moshi

LLaMA-Omni

LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve speech capabilities at the GPT-4o level.

UnsupervisedMT

Phrase-Based & Neural Unsupervised Machine Translation

fairseq

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

ConST

code for paper "Cross-modal Contrastive Learning for Speech Translation" (NAACL 2022)

MooER

MooER: Open-sourced LLM for audio understanding trained on 80,000 hours of data

simul_whisper

Code for our INTERSPEECH paper Simul-Whisper: Attention-Guided Streaming Whisper with Truncation Detection

whisper_streaming

Whisper realtime streaming for long speech-to-text transcription and translation

CosyVoice

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

SenseVoice

Multilingual Voice Understanding Model

TeleSpeech-ASR

SLAM-LLM

Speech, Language, Audio, Music Processing with Large Language Model

SpeechGen

《SpeechGen: Unlocking the Generative Power of Speech Language Models with Prompts》

seamless_communication

Foundational Models for State-of-the-Art Speech and Text Translation

asrp

ASR text preprocessing utility

LLaMA-Factory

Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

axolotl

Go ahead and axolotl questions

EMO

Emote Portrait Alive: Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditions

Qwen-Audio

The official repo of Qwen-Audio (通义千问-Audio) chat & pretrained large audio language model proposed by Alibaba Cloud.

Qwen2.5

Qwen2.5 is the large language model series developed by Qwen team, Alibaba Cloud.

ms-swift

Use PEFT or Full-parameter to finetune 350+ LLMs or 100+ MLLMs. (LLM: Qwen2.5, Llama3.2, GLM4, Internlm2.5, Yi1.5, Mistral, Baichuan2, DeepSeek, Gemma2, ...; MLLM: Qwen2-VL, Qwen2-Audio, Llama3.2-Vision, Llava, InternVL2, MiniCPM-V-2.6, GLM4v, Xcomposer2.5, Yi-VL, DeepSeek-VL, Phi3.5-Vision, ...)

TransformerCompression

For releasing code related to compression methods for transformers, accompanying our publications

silero-models

Silero Models: pre-trained speech-to-text, text-to-speech and text-enhancement models made embarrassingly simple

silero-vad

Silero VAD: pre-trained enterprise-grade Voice Activity Detector

unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

bolt

Bolt is a deep learning library with high performance and heterogeneous flexibility.

bark

🔊 Text-Prompted Generative Audio Model