zhaoyinglia's repositories
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
FlagScale
FlagScale is a Large Language Model (LLM) toolkit based on open-sourced projects.
Megatron-LM
Ongoing research training transformer models at scale
Paddle
PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）
PaddleNLP
An NLP library with Awesome pre-trained Transformer models and easy-to-use interface, supporting wide-range of NLP tasks from research to industrial applications.
PaddleFleetX
Paddle Distributed Training Examples. 飞桨分布式训练示例 Resnet Bert GPT MOE DataParallel ModelParallel PipelineParallel HybridParallel AutoParallel Zero Sharding Recompute GradientMerge Offload AMP DGC LocalSGD Wide&Deep
PaddleCustomDevice
PaddlePaddle custom device implementaion. (『飞桨』自定义硬件接入实现)
docs
Documentations for PaddlePaddle
PaddleSlim
PaddleSlim is an open-source library for deep model compression and architecture search.
PaddleScience
PaddleScience is SDK and library for developing AI-driven scientific computing applications based on PaddlePaddle.