Leon Lu's repositories
Triton-Compiler
Triton Compiler related materials.
llvm-project
The LLVM Project is a collection of modular and reusable compiler and toolchain technologies. Note: the repository does not accept github pull requests at this moment. Please submit your patches at http://reviews.llvm.org.
AISystem
AISystem 主要是指AI系统,包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术
awesome-tensor-compilers
A list of awesome compiler projects and papers for tensor computation and deep learning.
triton
Development repository for the Triton language and compiler
triton-shared
Shared Middle-Layer for Triton Compilation
Building-llama3-from-scratch
LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.
cmake_example
Example pybind11 module built with a CMake-based build system
FlagGems
FlagGems is an operator library for large language models implemented in Triton Language.
gfvvz.github.io
Build a Jekyll blog in minutes, without touching the command line.
gpt-2-output-dataset
Dataset of GPT-2 outputs for research in detection, biases, and more
lectures
Material for cuda-mode lectures
llama2.c
Inference Llama 2 in one file of pure C
llama3-from-scratch
llama3 implementation one matrix multiplication at a time
llm-from-scratch
llama3 implementation one matrix multiplication at a time
llm.c
LLM training in simple, raw C/CUDA
md-blogs
A blog where I write about research papers and blog posts I read.
minbpe
Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
mlir-tutorial
Hands-On Practical MLIR Tutorial
mojo
The Mojo Programming Language
pytorch-transformer
Attention is all you need implementation
resource-stream
CUDA related news and material links
tiny-gpu
A minimal GPU design in Verilog to learn how GPUs work from the ground up
triton-cpu
An experimental CPU backend for Triton (https//github.com/openai/triton)
Triton-Puzzles
Puzzles for learning Triton
tvm-cn
TVM Documentation in Chinese Simplified / TVM 中文文档