zheng-ningxin

brp-nas

SparTA

nmsparse

nni

An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.

SparseOP

compression_exp

cuda-tensorcore-hgemm

CUDALibrarySamples

CUDA Library Samples

CustomizeOP

cutlass

CUDA Templates for Linear Algebra Subroutines

FasterTransformer

Transformer related optimization, including BERT, GPT

flux

A fast communication-overlapping library for tensor parallelism on GPUs.

gpu-sparsert

latency_raw_data

LeViT

LeViT a Vision Transformer in ConvNet's Clothing for Faster Inference

linux

Linux kernel source tree

Mkl-Sparse

MLPruning

MLPruning, PyTorch, NLP, BERT, Structured Pruning

nn_pruning

Prune a model while finetuning or training.

nnfusion

A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.

pytorch_block_sparse

Fast Block Sparse Matrices for Pytorch

sparsednn

Fast sparse deep learning on CPUs

SparTA_Fork

sputnik

A library of GPU kernels for sparse matrix operations.

test_pip

transformers

🤗 Transformers: State-of-the-art Natural Language Processing for Pytorch, TensorFlow, and JAX.

TurboTransformers

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

tvm

Open deep learning compiler stack for cpu, gpu and specialized accelerators

Utils

zheng-ningxin.github.io