Panlichen

DeathStarBench

Open-source benchmark suite for cloud microservices

nccl-tests

NCCL Tests

cascade-docker

cascade-operator

conda-env

DeepSpeedExamples

Example models using DeepSpeed

DLPerf

DeepLearning Framework Performance Profiling Toolkit

GPU_deadlock_sim

kf-benchmarks

Distributed TensorFlow ImageNet with KungFu

KungFu

Fast and Adaptive Distributed Machine Learning for TensorFlow, PyTorch and MindSpore.

libai

LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training

markdown-pics

Megatron-LM

Ongoing research training transformer models at scale

mlc-notebooks

mlc-zh

models

Models and examples built with OneFlow

ms-operator

MyBlog

nccl

Optimized primitives for collective multi-GPU communication

occl-tests

occl_plot

oneflow

OneFlow is a performance-centered and open-source deep learning framework.

OneFlow-Benchmark

OneFlow models for benchmarking.

pkuthss

LaTeX template for dissertations in Peking University

powersgd

Practical low-rank gradient compression for distributed optimization: https://arxiv.org/abs/1905.13727

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

pytorch_examples

A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.

Sparse_Sketch_Reducer

try_cuda

typora-nord-theme

A port of the popular Nord theme for Typora!