xxzh12

llama.cpp

LLM inference in C/C++

llvm-project

The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.

triton

Development repository for the Triton language and compiler

FlexGen

Running large language models on a single GPU for throughput-oriented scenarios.

AutoGPTQ

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

chisel

Chisel: A Modern Hardware Design Language

CUDALibrarySamples

CUDA Library Samples

stable-fast

Best inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.

firrtl

Flexible Intermediate Representation for RTL

Pyverilog

Python-based Hardware Design Processing Toolkit for Verilog HDL

buddy-mlir

An MLIR-based compiler framework bridges DSLs (domain-specific languages) to DSAs (domain-specific architectures).

nvbench

CUDA Kernel Benchmarking Library

timeloop

Timeloop performs modeling, mapping and code-generation for tensor algebra workloads on various accelerator architectures.

nimble

Lightweight and Parallel Deep Learning Framework

soDLA

Chisel implementation of the NVIDIA Deep Learning Accelerator (NVDLA), with self-driving accelerated

dsptools

A Library of Chisel3 Tools for Digital Signal Processing

inter-operator-scheduler

[MLSys 2021] IOS: Inter-Operator Scheduler for CNN Acceleration

dora-from-scratch

LoRA and DoRA from Scratch Implementations

treadle

Chisel/Firrtl execution engine

minimalloc

A lightweight memory allocator for hardware-accelerated machine learning

bit

Code repo for the paper BiT Robustly Binarized Multi-distilled Transformer

zigzag

HW Architecture-Mapping Design Space Exploration Framework for Deep Learning Accelerators

cutlass_fpA_intB_gemm

A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer

accelergy-timeloop-infrastructure

Linux docker for the DNN accelerator exploration infrastructure composed of Accelergy and Timeloop

EventQueue

EQueue Dialect

Open-Source-IPs

ksim

chisel-formal

open-source-formal-verification-for-chisel

opencv-samples-perf-analysis