tensorrt

There are 30 repositories under tensorrt topic.

NVIDIA / TensorRT
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
deep-learning gpu-acceleration inference nvidia tensorrt
Language:C++ 12339
YOLOX
Megvii-BaseDetection / YOLOX
YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documentation: https://yolox.readthedocs.io/
yolox yolov3 onnx tensorrt ncnn openvino pytorch megengine object-detection yolo deep-learning
Language:Python 10154
jetson-inference
dusty-nv / jetson-inference
Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.
deep-learning inference computer-vision embedded image-recognition object-detection segmentation jetson jetson-tx1 jetson-tx2 jetson-xavier nvidia tensorrt digits caffe video-analytics robotics machine-learning jetson-nano jetson-xavier-nx
Language:C++ 8576
mikel-brostrom / boxmot
BoxMOT: Pluggable SOTA multi-object tracking modules modules for segmentation, object detection and pose estimation models
boosttrack botsort bytetrack clip deep-learning deepocsort improvedassociation machine-learning mot mots multi-object-tracking multi-object-tracking-segmentation ocsort oriented-bounding-box-tracking osnet segmentation strongsort tensorrt tracking-by-detection yolo
Language:Python 7777
wang-xinyu / tensorrtx
Implementation of popular deep learning networks with TensorRT network definition API
tensorrt mnasnet resnet squeezenet yolov3 mobilenetv2 mobilenetv3 yolov3-spp retinaface yolov4 arcface yolov5 crnn swin-transformer detr yolov7 yolov8 yolov9 yolo11
Language:C++ 7554
NVIDIA-AI-IOT / torch2trt
An easy to use PyTorch to TensorRT converter
classification inference jetson-nano jetson-tx2 jetson-xavier pytorch tensorrt
Language:Python 4826
Tencent / TNN
TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts. TNN has been deployed in multiple Apps from Tencent, such as Mobile QQ, Weishi, Pitu, etc. Contributions are welcome to work in collaborative with us and make TNN a better framework.
coreml deep-learning face-detection hairsegmentaion inference mnn ncnn ocr openvino pytorch tengine tensorflow tensorrt
Language:C++ 4590
Tianxiaomo / pytorch-YOLOv4
PyTorch ,ONNX and TensorRT implementation of YOLOv4
darknet2onnx darknet2pytorch onnx pytorch pytorch-yolov4 tensorrt yolov3 yolov4 yolov4-tiny
Language:Python 4525
OAID / Tengine
Tengine is a lite, high performance, modular inference engine for embedded device
arm machine-learning artificial-intelligence cnn tensorflow pytorch onnx x86-64 mips cuda tensorrt acl npu riscv supperedge container nvdla
Language:C++ 4494
xlite-dev / lite.ai.toolkit
🛠A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion, etc.🎉
yolox onnxruntime robustvideomatting mnn ncnn tnn yolov6 onnx yolov5 yolov8 tensorrt mnn-model facefusion stable-diffusion
Language:C++ 4285
TingsongYu / PyTorch-Tutorial-2nd
《Pytorch实用教程》（第二版）无论是零基础入门，还是CV、NLP、LLM项目应用，或是进阶工程化部署落地，在这里都有。相信在本书的帮助下，读者将能够轻松掌握 PyTorch 的使用，成为一名优秀的深度学习工程师。
computer-vision deepsort diffusion-models llm onnx pytorch pytorch-tutorial qwen tensorrt yolov5
Language:Jupyter Notebook 4216
NVIDIA / GenerativeAIExamples
Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.
gpu-acceleration large-language-models llm llm-inference microservice nemo rag retrieval-augmented-generation tensorrt triton-inference-server
Language:Jupyter Notebook 3567
collabora / WhisperLive
A nearly-live implementation of OpenAI's Whisper.
dictation obs openai openvino openvino-intel tensorrt tensorrt-llm text-to-speech translation voice-recognition whisper whisper-tensorrt
Language:Python 3549
lucasjinreal / yolov7_d2
🔥🔥🔥🔥 (Earlier YOLOv7 not official one) YOLO with Transformers and Instance Segmentation, with TensorRT acceleration! 🔥🔥🔥
yolo yolox detection detextron2 tensorrt yolov6 yolov7 face transformers detr instance-segmentation onnx object-detection
Language:Python 3124
tinyvision / DAMO-YOLO
DAMO-YOLO: a fast and accurate object detection method with some new techs, including NAS backbones, efficient RepGFPN, ZeroHead, AlignedOTA, and distillation enhancement.
damo-yolo deep-learning imagenet nas object-detection onnx pytorch tensorrt yolo yolov5
Language:Python 3112
open-mmlab / mmdeploy
OpenMMLab Model Deployment Framework
model-converter sdk deployment tensorrt ncnn pplnn openvino onnxruntime onnx mmdetection mmsegmentation computer-vision deep-learning pytorch
Language:Python 3060
pytorch / TensorRT
PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
tensorrt libtorch machine-learning pytorch deep-learning jetson nvidia cuda
Language:Python 2879
shouxieai / tensorRT_Pro
C++ library based on tensorrt integration
pytorch tensorrt object-detection deep-learning yolov5 yolox
Language:C++ 2826
jolibrain / deepdetect
Deep Learning API and Server in C++14 support for PyTorch,TensorRT, Dlib, NCNN, Tensorflow, XGBoost and TSNE
deep-learning machine-learning caffe xgboost rest-api tsne object-detection image-segmentation image-classification neural-nets gpu ncnn tensorrt time-series pytorch tensorrt-conversion tensorrt-inference image-search
Language:C++ 2545
enpeizhao / CVprojects
computer vision projects | 计算机视觉相关好玩的AI项目（Python、C++、embedded system）
computer-vision machine-learning deep-learning python cpp cuda tensorrt embedded-systems
Language:Jupyter Notebook 2514
ppogg / YOLOv5-Lite
🍅🍅🍅YOLOv5-Lite: Evolved from yolov5 and the size of model is only 900+kb (int8) and 1.7M (fp16). Reach 15 FPS on the Raspberry Pi 4B~
ncnn yolov5 android-app mnn shufflenetv2 repvgg transformer tensorrt pplcnet openvivo mobilenet tflite pytorch picodet onnxruntime
Language:C++ 2445
deepcam-cn / yolov5-face
YOLO5Face: Why Reinventing a Face Detector (https://arxiv.org/abs/2105.12931) ECCV Workshops 2022)
yolov5 tensorrt retinaface scrfd tinaface yolo pytorch arcface shufflenet blazeface yolov7
Language:Python 2349
hunglc007 / tensorflow-yolov4-tflite
YOLOv4, YOLOv4-tiny, YOLOv3, YOLOv3-tiny Implemented in Tensorflow 2.0, Android. Convert YOLO v4 .weights tensorflow, tensorrt and tflite
yolov4 yolov3 tflite object-detection tensorflow tf2 tensorrt yolov3-tiny android
Language:Python 2264
666DZY666 / micronet
micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、regular and group convolutional channel pruning; 3、 group convolution structure; 4、batch-normalization fuse for quantization. deploy: tensorrt, fp32/fp16/int8(ptq-calibration)、op-adapt(upsample)、dynamic_shape
quantization pruning dorefa twn bnn xnor-net pytorch model-compression group-convolution network-slimming neuromorphic-computing convolutional-networks network-in-network integer-arithmetic-only quantization-aware-training post-training-quantization tensorrt onnx tensorrt-int8-python batch-normalization-fuse
Language:Python 2263
inference
roboflow / inference
Turn any computer or edge device into a command center for your computer vision projects.
agents classification computer-vision deployment docker inference inference-api inference-server instance-segmentation jetson machine-learning object-detection onnx python tensorrt vit yolo11 yolov12 yolov5 yolov8
Language:Python 2032
marcoslucianops / DeepStream-Yolo
NVIDIA DeepStream SDK 8.0 / 7.1 / 7.0 / 6.4 / 6.3 / 6.2 / 6.1.1 / 6.1 / 6.0.1 / 6.0 / 5.1 implementation for YOLO models
nvidia-deepstream-sdk deepstream object-detection yolo darknet tensorrt pytorch nvidia ultralytics ppyoloe paddle mmyolo rtdetr rtmdet cuda
Language:C++ 1831
jkjung-avt / tensorrt_demos
TensorRT MODNet, YOLOv4, YOLOv3, SSD, MTCNN, and GoogLeNet
tensorrt yolov4 yolov3 ssd-mobilenet mtcnn googlenet modnet object-detection jetson
Language:Python 1782
triple-Mu / YOLOv8-TensorRT
YOLOv8 using TensorRT accelerate !
tensorrt yolov8 onnx deepstream segment jetson detection pose
Language:C++ 1698
coderonion / awesome-yolo-object-detection
🚀🚀🚀 A collection of some awesome public YOLO object detection series projects and the related object detection datasets.
yolo yolov5 tensorrt object-detection snn yolov8 spiking-neural-network cuda llm llama vlm datasets deepseek gui rknn object-detection-datasets mllm open-world-object-detection qwen few-shot-object-detection
1626
DT42 / BerryNet
Deep learning gateway on Raspberry Pi and other edge devices
raspberry-pi deep-learning tensorflow iot mqtt aiot edge-devices edge-ai openvino tensorrt edge-computing
Language:Python 1616
PaddlePaddle / PaddleSlim
PaddleSlim is an open-source library for deep model compression and architecture search.
bert compression detection distillation ernie nas pruning quantization segmentation sparsity tensorrt transformer yolov5 yolov6 yolov7
Language:Python 1610
CoinCheung / BiSeNet
Add bisenetv2. My implementation of BiSeNet
ade20k bisenet cityscapes cocostuff ncnn openvino pytorch tensorrt triton-inference-server
Language:Python 1572
TensorRT-YOLO
laugh12321 / TensorRT-YOLO
🚀 Easier & Faster YOLO Deployment Toolkit for NVIDIA 🛠️
tensorrt tensorrt-inference tensorrt10 computer-vision image-classification instance-segmentation object-detection pose-estimation rotated-object-detection ultralytics yolo yolo11 yolo12 yolov10 yolov3 yolov5 yolov6 yolov7 yolov8 yolov9
Language:C++ 1519
FeiYull / TensorRT-Alpha
🔥🔥🔥TensorRT for YOLOv8、YOLOv8-Pose、YOLOv8-Seg、YOLOv8-Cls、YOLOv7、YOLOv6、YOLOv5、YOLONAS......🚀🚀🚀CUDA IS ALL YOU NEED.🍎🍎🍎
cuda efficientdet libfacedetection rt-detr tensorrt u2net yolonas yolor yolov3 yolov4 yolov5 yolov6 yolov7 yolov8 yolov8-pose yolov8-seg yolox
Language:C++ 1392
tensorlayer / HyperPose
Library for Fast and Flexible Human Pose Estimation
tensorlayer tensorflow openpose pose-estimation computer-vision distributed-training tensorrt mobilenet neural-networks
Language:Python 1262
GeekAlexis / FastMOT
High-performance multiple object tracking based on YOLO, Deep SORT, and KLT 🚀
jetson multi-object-tracking tensorrt real-time reid object-detection deep-sort computer-vision yolov4 ssd yolov3 people-counter scaledyolov4 edge-computing lucas-kanade video-analysis deep-learning
Language:Python 1196

tensorrt

NVIDIA / TensorRT

Megvii-BaseDetection / YOLOX

dusty-nv / jetson-inference

mikel-brostrom / boxmot

wang-xinyu / tensorrtx

NVIDIA-AI-IOT / torch2trt

Tencent / TNN

Tianxiaomo / pytorch-YOLOv4

OAID / Tengine

xlite-dev / lite.ai.toolkit

TingsongYu / PyTorch-Tutorial-2nd

NVIDIA / GenerativeAIExamples

collabora / WhisperLive

lucasjinreal / yolov7_d2

tinyvision / DAMO-YOLO

open-mmlab / mmdeploy

pytorch / TensorRT

shouxieai / tensorRT_Pro

jolibrain / deepdetect

enpeizhao / CVprojects

ppogg / YOLOv5-Lite

deepcam-cn / yolov5-face

hunglc007 / tensorflow-yolov4-tflite

666DZY666 / micronet

roboflow / inference

marcoslucianops / DeepStream-Yolo

jkjung-avt / tensorrt_demos

triple-Mu / YOLOv8-TensorRT

coderonion / awesome-yolo-object-detection

DT42 / BerryNet

PaddlePaddle / PaddleSlim

CoinCheung / BiSeNet

laugh12321 / TensorRT-YOLO

FeiYull / TensorRT-Alpha

tensorlayer / HyperPose

GeekAlexis / FastMOT