fuochii

dspy

DSPy: The framework for programming—not prompting—foundation models

ASPLOS24-Korch-AE

LLMCompiler

[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

openvino

OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference

nncf

Neural Network Compression Framework for enhanced OpenVINO™ inference

mlir-aie

An MLIR-based toolchain for AMD AI Engine-enabled devices.

Enzyme

High-performance automatic differentiation of LLVM and MLIR.

mlir-tutorial

MLIR For Beginners tutorial

iree

A retargetable MLIR-based machine learning compiler and runtime toolkit.

llvm-project

The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.

torch-mlir

The Torch-MLIR project aims to provide first class support from the PyTorch ecosystem to the MLIR ecosystem.

rocMLIR

mlir-extensions

Intel® Extension for MLIR. A staging ground for MLIR dialects and tools for Intel devices using the MLIR toolchain.

awesome-tensor-compilers

A list of awesome compiler projects and papers for tensor computation and deep learning.

flashinfer

FlashInfer: Kernel Library for LLM Serving

KVQuant

KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs