wejoncy

QLLM

A general 2-8 bits quantization toolbox with GPTQ/AWQ/HQQ, and export to onnx/onnx-runtime easily.

XbitOps

[X] bit GEMV/DQ support for quantized LLM

12306cpp

12306 自动订票工具c++实现版

onnxKapok

An AOT compiler for onnx model, for accelerating transformers on Mobile/Server/GPUs. One Line of code, 30% faster at most on ARM/INTEL CPU

vllm-backup

A high-throughput and memory-efficient inference and serving engine for LLMs

winograd_study

a easy understand python implementation

AiLearning

AiLearning: 机器学习 - MachineLearning - ML、深度学习 - DeepLearning - DL、自然语言处理 NLP

awesome-tensor-compilers

A list of awesome compiler projects and papers for tensor computation and deep learning.

deeplearningbook-chinese

Deep Learning Book Chinese Translation

kernl

Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackable.

machine-learning-cheat-sheet

Classical equations and diagrams in machine learning

mapreduce

C++ MapReduce Library for efficient multi-threading on single-machine

neural-networks-and-deep-learning

Code samples for my book "Neural Networks and Deep Learning"

onnx

Open standard for machine learning interoperability

EAGLE

EAGLE: Lossless Acceleration of LLM Decoding by Feature Extrapolation

onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

onnxruntime-extensions

The pre- and post processing library for ONNX Runtime

opensift_vs2013

string-splitting

String splitting benchmarks

Tensor2TensorPermute

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

tvm

Open deep learning compiler stack for cpu, gpu and specialized accelerators

XNNPACK

High-efficiency floating-point neural network inference operators for mobile, server, and Web