188zzoon

Triton-Puzzles

Puzzles for learning Triton

llm.c

LLM training in simple, raw C/CUDA

flash-attention

Fast and memory-efficient exact attention

TritonTransformer

Transformer Implementation in Triton

unsloth

Finetune Llama 3, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

BitDelta

BitMat

An efficent implementation of the method proposed in "The Era of 1-bit LLMs"

triton

Development repository for the Triton language and compiler

triton

Development repository for the Triton language and compiler

SGEMM_CUDA

Fast CUDA matrix multiplication from scratch

coding-interview-university

A complete computer science study plan to become a software engineer.

AutoGPTQ

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

AutoAWQ

AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:

aphrodite-engine

PygmalionAI's large-scale inference engine

Awesome-LLM-Inference

📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

optimum-quanto

A pytorch quantization backend for optimum

llm-awq

[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

smoothquant

[ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

Awesome-Quantization-Papers

List of papers related to neural network quantization in recent AI conferences and journals.

GPTQ-triton

GPTQ inference Triton kernel

gpu_kernels

cuda_tensorflow_opencv

DockerFile with GPU support for TensorFlow and OpenCV

LibTorch-ResNet-CIFAR

ResNet Implementation, Training, and Inference Using LibTorch C++ API

awesome-deep-text-detection-recognition

A curated list of resources for text detection/recognition (optical character recognition ) with deep learning methods.

TensorFlow-Examples

TensorFlow Tutorial and Examples for Beginners (support TF v1 & v2)

gans-2.0

Generative Adversarial Networks in TensorFlow 2.0

retinanet-tensorflow2.x

TensorFlow2.x implementation of RetinaNet

TensorFlow2.0_ResNet

A ResNet(ResNet18, ResNet34, ResNet50, ResNet101, ResNet152) implementation using TensorFlow-2.0.

gluon-cv

Gluon CV Toolkit

carrier-of-tricks-for-classification-pytorch

carrier of tricks for image classification tutorials using pytorch.