Yijia Diao's starred repositories
nccl-tests
NCCL Tests
llm-analysis
Latency and Memory Analysis of Transformer Models for Training and Inference
distrifuser
[CVPR 2024 Highlight] DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models
GPU-scheduler-for-deep-learning
GPU-scheduler-for-deep-learning
gemma_pytorch
The official PyTorch implementation of Google's Gemma models
multi-gpu-programming-models
Examples demonstrating available options to program multiple GPUs in a single node or a cluster
PipeSwitch
PipeSwitch: Fast Pipelined Context Switching for Deep Learning Applications
mig-parted
MIG Partition Editor for NVIDIA GPUs
MIGProfiler
Multi-Instance-GPU profiling tool
flashinfer
FlashInfer: Kernel Library for LLM Serving
nvidia-container-toolkit
Build and run containers leveraging NVIDIA GPUs