wZuck

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

GPU-Puzzles

Solve puzzles. Learn CUDA.

light-llm-grad

This is a lightweight training framework for LLM (Language Model).

Megatron-LM

Ongoing research training transformer models at scale

wZuck