EzioZz

triton

Development repository for the Triton language and compiler

TensorRT

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

LLMsPracticalGuide

A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)

TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

ROCm

AMD ROCm™ Software - GitHub Home

ucasthesis

LaTeX Thesis Template for the University of Chinese Academy of Sciences

iree

A retargetable MLIR-based machine learning compiler and runtime toolkit.

starcoder2

Home of StarCoder2!

torch-mlir

The Torch-MLIR project aims to provide first class support from the PyTorch ecosystem to the MLIR ecosystem.

lagent

A lightweight framework for building LLM-based agents

maxas

Assembler for NVIDIA Maxwell architecture

PatrickStar

PatrickStar enables Larger, Faster, Greener Pretrained Models for NLP and democratizes AI for everyone.

buddy-mlir

An MLIR-based compiler framework bridges DSLs (domain-specific languages) to DSAs (domain-specific architectures).

rocBLAS

Next generation BLAS implementation for ROCm platform

composable_kernel

Composable Kernel: Performance Portable Programming Model for Machine Learning Tensor Operators

xdsl

A Python Compiler Design Toolkit

relax

LightSeq

Official repository for LightSeq: Sequence Level Parallelism for Distributed Training of Long Context Transformers

InfiniTensor

ppcg

Polyhedral Parallel Code Generation (source repository: http://repo.or.cz/ppcg.git)

rocSPARSE

Next generation SPARSE implementation for ROCm platform

flash-attention

Fast and memory-efficient exact attention

isl

Integer Set Library (source repository: http://repo.or.cz/w/isl.git)

MISA

Machine Intelligence Shader Autogen. AMDGPU ML shader code generator. (previously iGEMMgen)

Triton-Compiler

Triton Compiler related materials.

tvm-gdb-commands

Small set of gdb commands for useful tasks in tvm

swDNN

a highly-efficient library for deep neural networks based on Sunway TaihuLight supercomputer.

swGEMM

A highly efficient library for GEMM operations on Sunway TaihuLight

isl_learn

antlr-4

learn Antlr 4 (with c++ examples & cmake)