HeyangQin

RRL

Code for paper Swift Machine Learning Model Serving Scheduling: A Region Based Reinforcement Learning Approach

SimiGrad

Public Code for NIPS submission SimiGrad: Fine-Grained Adaptive Batching for Large ScaleTraining using Gradient Similarity Measurement

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.

DeepSpeedExamples

Example models using DeepSpeed

FasterTransformer-cutlass_kernels

HeyangQin.github.io

tfevent_merger

A helper script to merge tfevent files and correct the relative time. Useful when the training was interrupted and restarted.