EzioZz

triton

Development repository for the Triton language and compiler

TensorRT

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

ROCm

AMD ROCm™ Software - GitHub Home

ucasthesis

LaTeX Thesis Template for the University of Chinese Academy of Sciences

lagent

A lightweight framework for building LLM-based agents

starcoder2

Home of StarCoder2!

torch-mlir

The Torch-MLIR project aims to provide first class support from the PyTorch ecosystem to the MLIR ecosystem.

PatrickStar

PatrickStar enables Larger, Faster, Greener Pretrained Models for NLP and democratizes AI for everyone.

Wrapper_VideoStation

Synology VideoStation and DLNA FFmpeg Wrapper with AAC, DTS, EAC3 and TrueHD support via pipes (now with GStreamer support). It enables full hardware transcoding from Synology´s FFmpeg for video and transcoding DTS, EAC3, TrueHD and AAC from the SynoCommunity's FFmpeg only when necessary.

buddy-mlir

An MLIR-based compiler framework bridges DSLs (domain-specific languages) to DSAs (domain-specific architectures).

BitBLAS

BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.

rocBLAS

Next generation BLAS implementation for ROCm platform

composable_kernel

Composable Kernel: Performance Portable Programming Model for Machine Learning Tensor Operators

FlagGems

FlagGems is an operator library for large language models implemented in Triton Language.

xdsl

A Python Compiler Design Toolkit

relax

LightSeq

Official repository for LightSeq: Sequence Level Parallelism for Distributed Training of Long Context Transformers

InfiniTensor

flash-attention

Fast and memory-efficient exact attention

ppcg

Polyhedral Parallel Code Generation (source repository: http://repo.or.cz/ppcg.git)

rocSPARSE

Next generation SPARSE implementation for ROCm platform

isl

Integer Set Library (source repository: http://repo.or.cz/w/isl.git)

MISA

Machine Intelligence Shader Autogen. AMDGPU ML shader code generator. (previously iGEMMgen)

Triton-Compiler

Triton Compiler related materials.

isl_learn

tvm-gdb-commands

Small set of gdb commands for useful tasks in tvm

swDNN

a highly-efficient library for deep neural networks based on Sunway TaihuLight supercomputer.

swGEMM

A highly efficient library for GEMM operations on Sunway TaihuLight

antlr-4

learn Antlr 4 (with c++ examples & cmake)