Zheng.Deng's repositories
competition_compute
hom many situations TES will meet.
cuda_holiday_draft
happy qingming festival, totally cuda draft
llama.cpp
LLM inference in C/C++
Language:C++MIT000
llama2.c
Inference Llama 2 in one file of pure C
Language:CMIT000
MNN
MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba
Language:C++000
TensorRT
TensorRT is a C++ library for high performance inference on NVIDIA GPUs and deep learning accelerators.
Language:C++Apache-2.0000
trt-samples-for-hackathon-cn
Simple samples for TensorRT programming
Language:Jupyter NotebookApache-2.0000
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Language:PythonApache-2.0000