qiuhan's repositories
excalidraw
Virtual whiteboard for sketching hand-drawn like diagrams
arm-gcc-inline-assembler
ARM GCC 内联汇编参考手册 - 中文版
cnpy
library to read/write .npy and .npz files in C/C++
cpptrace
Lightweight, zero-configuration-required, and cross-platform stacktrace library for C++
cpu_features
A cross platform C99 library to get cpu features at runtime.
How_to_optimize_in_GPU
This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several basic kernel optimizations, including: elementwise, reduce, sgemv, sgemm, etc. The performance of these kernels is basically at or near the theoretical limit.
inferflow
Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
libassert
The most over-engineered and overpowered C++ assertion library.
libleak
detect memory leak by LD_PRELOAD, without changing the target program
lmdeploy
LMDeploy is a toolkit for compressing, deploying, and serving LLM
memory
STL compatible C++ memory allocator library using a new RawAllocator concept that is similar to an Allocator but easier to use and write.
mio
Cross-platform C++11 header-only library for memory mapped file IO
MPMCQueue
A bounded multi-producer multi-consumer concurrent queue written in C++11
nomacs
nomacs is a free image viewer for windows, linux, and mac systems.
onnx-modifier
A tool to modify ONNX models in a visualization fashion, based on Netron and Flask.
onnxruntime
ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
perf-book
The book "Performance Analysis and Tuning on Modern CPU"
PhotoLab
AI-Powered Photo Editor (Python, PyQt6, PyTorch)
predef
Pre-defined Compiler Macros wiki
scnlib
scanf for modern C++
sentry-native
Sentry SDK for C, C++ and native applications.
simdutf
Unicode routines (UTF8, UTF16, UTF32): billions of characters per second using SSE2, AVX2, NEON, AVX-512. Part of Node.js.
spconv
Spatial Sparse Convolution Library
tabulate
Table Maker for Modern C++
text
What a c++ standard Unicode library might look like.
tiny-utf8
Unicode (UTF-8) capable std::string
tokenizers-cpp
Universal cross-platform tokenizers binding to HF and sentencepiece
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs