qiaolinwang

LlamaVoice

LlamaVoice is a llama-based large voice generation model, providing inference and training ability.

Summer2025-Internships

Collection of Summer 2025 tech internships!

NeMo

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

SpeechGPT

SpeechGPT Series: Speech Large Language Models

trl

Train transformer language models with reinforcement learning.

llama-trl

LLaMA-TRL: Fine-tuning LLaMA with PPO and LoRA

LLM-RLHF-Tuning

LLM Tuning with PEFT (SFT+RM+PPO+DPO with LoRA)

PPO-for-Beginners

A simple and well styled PPO implementation. Based on my Medium series: https://medium.com/@eyyu/coding-ppo-from-scratch-with-pytorch-part-1-4-613dfc1b14c8.

LLMSurvey

The official GitHub page for the survey paper "A Survey of Large Language Models".

libriheavy

Libriheavy: a 50,000 hours ASR corpus with punctuation casing and context

VoiceCraft

Zero-Shot Speech Editing and Text-to-Speech in the Wild

LLMs-from-scratch

Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step

MELD

MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversation

RL-EMO

LLaMA-Factory

Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)

UniMSE

UniSA

UniSA: Unified Generative Framework for Sentiment Analysis

Video-LLaMA

[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding

OneLLM

[CVPR 2024] OneLLM: One Framework to Align All Modalities with Language

Awesome-Multimodal-Large-Language-Models

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

awesome-multimodal-ml

Reading list for research topics in multimodal machine learning

awesome-emotion-recognition-in-conversations

A comprehensive reading list for Emotion Recognition in Conversations

WeChatMsg

提取微信聊天记录，将其导出成HTML、Word、Excel文档永久保存，对聊天记录进行分析生成年度聊天报告，用聊天数据训练专属于个人的AI聊天助手

mimalloc

mimalloc is a compact general purpose allocator with excellent performance.

EmotiVoice

EmotiVoice 😊: a Multi-Voice and Prompt-Controlled TTS Engine

elevenlabs-python

The official Python API for ElevenLabs Text to Speech.

Diff-HierVC

Official Pytorch Implementation of "Diff-HierVC: Diffusion-based Hierarchical Voice Conversion with Robust Pitch Generation and Masked Prior for Zero-shot Speaker Adaptation"

NaturalSpeech2

SpeechMOS

Easy-to-Use Speech MOS predictors

DTTNet-Pytorch

An official implementation of the ICASSP 2024 paper: Dual-Path TFC-TDF UNet for Music Source Separation