zeroine

cutlass-cute-sample

aimet

AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.

flash-attention

Fast and memory-efficient exact attention

MQBench

Model Quantization Benchmark

ppq

PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.

silkflow

TensorRT

NVIDIA® TensorRT™, an SDK for high-performance deep learning inference, includes a deep learning inference optimizer and runtime that delivers low latency and high throughput for inference applications.