mrshenli

dummy_collectives

A minimum demo for PyTorch c10d extension APIs

ptd_benchmark

fx_test

slurm-gcp

AdaBound

An optimizer that trains as fast as Adam and as good as SGD.

benchmark-1

TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.

commfuser

Distributed-training

elastic

PyTorch elastic training

examples

A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.

fairscale

PyTorch extensions for high performance and large scale training.

FBGEMM

FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/

fsdp_1T

gcp_test

grpc

The C based gRPC (C++, Python, Ruby, Objective-C, PHP, C#)

grpc_benchmark

Lean

Lean Algorithmic Trading Engine by QuantConnect (C#, Python, F#)

machin

Reinforcement learning library

minGPT

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

mrshenli.github.io

Github Pages template for academic personal websites, forked from mmistakes/minimal-mistakes

pipeline_experiments

PyTorch pipeline parallelism experiments

PySpace

GLSL Fractal Ray Marcher in Python

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

pytorchviz

A small package to create visualizations of PyTorch execution graphs

reinforcement-learning

Personal experiments on Reinforcement Learning

rpc-rl-experiments

tau

Pipeline Parallelism for PyTorch

trec

tutorials

yfinance

Yahoo! Finance market data downloader (+faster Pandas Datareader)