DeLaiQiu's starred repositories
LlamaVoice
LlamaVoice is a llama-based large voice generation model, providing inference and training ability.
HierSpeechpp
The official implementation of HierSpeech++
metavoice-src
Foundational model for human-like, expressive TTS
Online-RLHF
A recipe for online RLHF.
UMOE-Scaling-Unified-Multimodal-LLMs
The codes about "Uni-MoE: Scaling Unified Multimodal Models with Mixture of Experts"
long-context-attention
Sequence Parallel Attention for Long Context LLM Model Training and Inference
ring-flash-attention
Ring attention implementation with flash attention
Megatron-DeepSpeed
Ongoing research training transformer language models at scale, including: BERT & GPT-2
nbdev_template
Template for nbdev projects
Skywork
Skywork series models are pre-trained on 3.2TB of high-quality multilingual (mainly Chinese and English) and code data. We have open-sourced the model, training data, evaluation data, evaluation methods, etc. 天工系列模型在3.2TB高质量多语言和代码数据上进行预训练。我们开源了模型参数,训练数据,评估数据,评估方法。
NeMo-Aligner
Scalable toolkit for efficient model alignment