yy-space's starred repositories
ktransformers
A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations
sarathi-serve
A low-latency & high-throughput serving engine for LLMs
cuda-training-series
Training materials associated with NVIDIA's CUDA Training Series (www.olcf.ornl.gov/cuda-training-series/)
TransformerEngine
A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilization in both training and inference.
xcpc-algorithm-templates
XCPC/ICPC/CCPC 算法模板
CUDATutorial
A CUDA tutorial to make people learn CUDA program from 0
How_to_optimize_in_GPU
This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several basic kernel optimizations, including: elementwise, reduce, sgemv, sgemm, etc. The performance of these kernels is basically at or near the theoretical limit.
Skywork-MoE
Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
flashinfer
FlashInfer: Kernel Library for LLM Serving
MatmulTutorial
A Easy-to-understand TensorOp Matmul Tutorial
CUDATutorial
A self-learning tutorail for CUDA High Performance Programing.