LeiWang1999

ZYNQ-NVDLA

NVDLA (An Opensource DL Accelerator Framework) implementation on FPGA.

tvm_gpu_gemm

play gemm with tvm

AutoGPTQ.tvm

GPTQ inference TVM kernel

VehicleFlowDetection

Implement of vehicle flow statistics based on tensorflow and yolo3 with pyqt5 GUI.

leiblog.wang

My New Blog Powered by HEXO http://leiblog.wang

rocblas-benchmark

BitBLAS

memfusion_artifact

cv

resume.

tvm

Open deep learning compiler stack for cpu, gpu and specialized accelerators

cutlass

Ladder

@DataStructures_Cbased I'm Coming！

mlc-benchmark

Roller

Build and Train AlexNet with PyTorch and Predict with TVM and Pytorch, compare the performance between them

_cutlass

CUDA Templates for Linear Algebra Subroutines

MSBitBLAS

BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.

nnfusion

A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.

vLLM

apex

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

AutoGPTQ

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

AutoGPTQ_nf

gptq_faster

Faster 3bit CUDA Kernel for gptq.

LeiWang1999

mlc-llm

Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.

nmsparse

nni

An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.

ppq

PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.

relax

vllm-bitblas

A high-throughput and memory-efficient inference and serving engine for LLMs

Welder_artifacts

OSDI 2023 WElder artifacts