tuanhe's repositories
TinyChatEngine
TinyChatEngine: On-Device LLM Inference Library
llama.cpp
LLM inference in C/C++
TensorRT-LLM
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
Awesome-LLM-Inference
📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
annotated-transformer
An annotated implementation of the Transformer paper.
transformer
Transformer: PyTorch Implementation of "Attention Is All You Need"
Install-OpenCV-Jetson-Orin
OpenCV installation script with CUDA and cuDNN support
Tengine
Tengine is a lite, high performance, modular inference engine for embedded device
tuanhe.github.io
machine learning way
awesome-cpp
A curated list of awesome C++ (or C) frameworks, libraries, resources, and shiny things. Inspired by awesome-... stuff.
taskflow
A General-purpose Parallel and Heterogeneous Task Programming System
awesome-c
A curated list of awesome C frameworks, libraries, resources and other shiny things. Inspired by all the other awesome-... projects out there.
threadpool-1
based on C++11 , a mini threadpool , accept variable number of parameters 基于C++11的线程池,简洁且可以带任意多的参数
ThreadPool
A simple C++11 Thread Pool implementation
deepstream-test1-usb-camera
deepstream test1 with usb camera input
PINTO_model_zoo
A repository that shares tuning results of trained models generated by TensorFlow / Keras. Post-training quantization (Weight Quantization, Integer Quantization, Full Integer Quantization, Float16 Quantization), Quantization-aware training. TensorFlow Lite. OpenVINO. CoreML. TensorFlow.js. TF-TRT. MediaPipe. ONNX. [.tflite,.h5,.pb,saved_model,tfjs,tftrt,mlmodel,.xml/.bin, .onnx]
NetAssist_PyQt
一个用PyQt5实现的网络调试助手工具。TCP UDP WebServer三种模式
gst-deepstream-plugin-demo
Deepstream plugin demo
deepstream-6.1
resource comes from deepstream-6.1_6.1.0-1_amd64.deb
gst-MyProject
gstreamer plugin study based on 1.16, code from gst-plugins-bad template
GObjectTutorial
Example code on how to use GObject in C programming language
gst-project-template
This is gstreamer project template which including plugin and app
gst-plugins-bad
'Bad' GStreamer plugins and helper libraries. This module has been merged into the main GStreamer repo for further development.
vector_c
implement the vector by plain C
ArmnnBackendFramework
This is the Framework used for developing ArmNN backend. It can compiled without error under armnn_21_05
armnn
Arm NN ML Software. The code here is a read-only mirror of https://review.mlplatform.org/admin/repos/ml/armnn
ML-zoo
machine learning model zoo
Paddle-Lite
Multi-platform high performance deep learning inference engine (『飞桨』多平台高性能深度学习预测引擎）