gongweibao / FleetX

Paddle Distributed Training Examples. 飞桨分布式训练示例 Resnet Bert GPT MOE DataParallel ModelParallel PipelineParallel HybridParallel AutoParallel Zero Sharding Recompute GradientMerge Offload AMP DGC LocalSGD Wide&Deep

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool


Features

PaddleFleetX is an open source repo for ...

TODO: A GIF showing the tasks supported by PaddleFleetX.

Top News 🔥

Update (2022-09-16): PaddleFleetX v0.1 is released.

Installation

From Pip Install

git clone https://github.com/PaddlePaddle/PaddleFleetX.git
cd PaddleFleetX
pip install -r requirements.txt

Use Docker

See Docker Install.

Tutorials

Model Zoo

To download more useful pre-trained models see model zoo.

Performance

TODO: Chart showing PaddleFleetX performance benefits.

For more performance see

Industrial Application

Coming soon.

License

This project is released under the Apache 2.0 license.

Citation

@misc{paddlefleetx,
    title={PaddleFleetX: An Easy-to-use and High-Performance One-stop Tool for Deep Learning},
    author={PaddleFleetX Contributors},
    howpublished = {\url{https://github.com/PaddlePaddle/PaddleFleetX}},
    year={2022}
}

About

Paddle Distributed Training Examples. 飞桨分布式训练示例 Resnet Bert GPT MOE DataParallel ModelParallel PipelineParallel HybridParallel AutoParallel Zero Sharding Recompute GradientMerge Offload AMP DGC LocalSGD Wide&Deep

License:Apache License 2.0


Languages

Language:Python 93.7%Language:C++ 3.6%Language:Shell 2.6%Language:Dockerfile 0.1%Language:Makefile 0.0%