KepingYan

ray

An open source framework that provides a simple, universal API for building distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning library.

llm-on-ray

Pretrain, finetune and serve LLMs on Intel platforms with Ray

accelerate

🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision

raydp

RayDP: Distributed data processing library that provides simple APIs for running Spark on Ray and integrating Spark with distributed deep learning and machine learning frameworks.

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Test

horovod

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.