triton-kernels

There are 4 repositories under triton-kernels topic.

linkedin / Liger-Kernel
Efficient Triton Kernels for LLM Training
finetuning gemma2 hacktoberfest llama llama3 llm-training llms mistral phi3 triton triton-kernels
Language:Python 5809
harleyszhang / llm_note
LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.
llm llm-inference triton-kernels vllm cuda-programming kv-cache transformer-models
Language:Python 839
FlagOpen / FlagGems
FlagGems is an operator library for large language models implemented in the Triton Language.
pytorch triton triton-kernels
Language:Python 749
flash-dmattn
SmallDoges / flash-dmattn
Trainable fast and memory-efficient sparse attention
attention-is-all-you-need attention-mechanism chinese cuda-kernels cutlass dynamic-mask-attention english flash-attention pytorch pytorch-implementation self-attention transformer transformers triton triton-kernels
Language:Python 433
harleyszhang / lite_llama
A light llama-like llm inference framework based on the triton kernel.
attention llama llama3 llava-llama3 llm llm-inference python3 qwen2-5 triton-kernels
Language:Python 152
NX-AI / mlstm_kernels
Tiled Flash Linear Attention library for fast and efficient mLSTM Kernels.
deep-learning llm rnn triton-kernels xlstm
Language:Jupyter Notebook 70
stackav-oss / conch
A "standard library" of Triton kernels.
amd bitsandbytes cuda inference nvidia rocm triton-kernels triton-lang vllm
Language:Python 14
kyolebu / triton-misadventures
Educational resource demonstrating common GPU programming pitfalls and solutions using Triton kernels.
gpu-acceleration triton-kernels triton-lang
Language:Jupyter Notebook 4
debashishc / kernelheim
KernelHeim – development ground of custom Triton and CUDA kernel functions designed to optimize and accelerate machine learning workloads on NVIDIA GPUs. Inspired by the mythical stronghold of the gods, KernelHeim is a forge where high-performance kernels are crafted to unlock the full potential of the hardware.
cuda-kernels triton-kernels parallel-programming
Language:Python 3
jhuang265 / Calibrating-LLMs-with-Label-Smoothing
Code to our ICML 2025 Paper "Calibrated Language Models and How to Find Them with Label Smoothing"
deep-learning huggingface-transformers natural-language-processing triton
Language:Python 3
xmc-aalto / elmo
Official Code for the paper ELMO : Efficiency via Low-precision and Peak Memory Optimization in Large Output Spaces (in ICML 2025)
chunking extreme-classification large-output-space low-precision-training multi-label-classification triton-kernels gradient-fusion float8
Language:Python 2
ayoussf / Triton-Hub
A container of various PyTorch neural network modules written in Triton.
cuda triton pytorch triton-lang deep-learning openai machine-learning triton-language deep-learning-algorithms torch triton-kernels triton-openai
Language:Python 1

triton-kernels

linkedin / Liger-Kernel

harleyszhang / llm_note

FlagOpen / FlagGems

SmallDoges / flash-dmattn

harleyszhang / lite_llama

NX-AI / mlstm_kernels

stackav-oss / conch

kyolebu / triton-misadventures

debashishc / kernelheim

jhuang265 / Calibrating-LLMs-with-Label-Smoothing

xmc-aalto / elmo

ayoussf / Triton-Hub