Liang Bowen's repositories
colossalai-DQN
A DQN implement using colossalai
ColossalAI-Examples
Examples of training models with hybrid parallelism using ColossalAI
Language:PythonApache-2.0000
gpt-neox-colossalai
using colossalai for training gpt-neox
PaLM-colossalai
Scalable PaLM implementation of PyTorch
000
ColossalAI
Colossal-AI: A Unified Deep Learning System for Large-Scale Parallel Training
Apache-2.0000
Language:Python000
swoole-src
🚀 Coroutine-based concurrency library for PHP
Apache-2.0000
SkyComputing
Sky Computing: Accelerating Geo-distributed Computing in Federated Learning
Apache-2.0000
000
ColossalAI-Benchmark
Performance benchmarking with ColossalAI
Apache-2.0000
gpt-neox
An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
Apache-2.0000
LAMB_Optimizer_TF
LAMB Optimizer for Large Batch Training (TensorFlow version)
Apache-2.0000