Beast code in Giters

liuhatry's repositories

Aluminum GPU-aware Communication Library

Language:C++NOASSERTION000

Language:C++000

Language:C++010

A fast MoE impl for PyTorch

Language:PythonApache-2.0000

Language:PythonApache-2.0010

Language:C++010

LASSO is a parallel regression model learning system

Language:C++010

liuhatry's Blog

Language:CSS010

Language:HTML000

Ongoing research training transformer language models at scale, including: BERT & GPT-2

Language:PythonNOASSERTION000

Language:C++000

Language:C++000

Language:Python010

Language:Shell010

Tutel MoE: An Optimized Mixture-of-Experts Implementation

Language:PythonMIT000

Bagua tutorials.

Language:ShellMIT000

Distributed LR、 FM model on Parameter Server. FTRL and SGD Optimization Algorithm.

Language:C++000