tensorrt

There are 25 repositories under tensorrt topic.

NVIDIA / TensorRT
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
tensorrt nvidia deep-learning inference gpu-acceleration
Language:C++ 9208
YOLOX
Megvii-BaseDetection / YOLOX
YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documentation: https://yolox.readthedocs.io/
deep-learning megengine ncnn object-detection onnx openvino pytorch tensorrt yolo yolov3 yolox
Language:Python 9049
jetson-inference
dusty-nv / jetson-inference
Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.
caffe computer-vision deep-learning digits embedded image-recognition inference jetson jetson-nano jetson-tx1 jetson-tx2 jetson-xavier jetson-xavier-nx machine-learning nvidia object-detection robotics segmentation tensorrt video-analytics
Language:C++ 7402
wang-xinyu / tensorrtx
Implementation of popular deep learning networks with TensorRT network definition API
tensorrt mnasnet resnet squeezenet yolov3 inceptionv3 mobilenetv2 mobilenetv3 yolov3-spp retinaface yolov4 arcface yolov5 crnn swin-transformer detr yolov7 yolov8 yolov9
Language:C++ 6619
mikel-brostrom / yolo_tracking
BoxMOT: pluggable SOTA tracking modules for segmentation, object detection and pose estimation models
strongsort bytetrack ocsort osnet deep-learning segmentation tensorrt tracking-by-detection yolo botsort deepocsort multi-object-tracking mot mots multi-object-tracking-segmentation
Language:Python 6174
OAID / Tengine
Tengine is a lite, high performance, modular inference engine for embedded device
arm machine-learning artificial-intelligence cnn tensorflow pytorch onnx x86-64 mips cuda tensorrt acl npu riscv supperedge container nvdla
Language:C++ 4562
Tianxiaomo / pytorch-YOLOv4
PyTorch ,ONNX and TensorRT implementation of YOLOv4
yolov4 pytorch darknet2pytorch darknet2onnx tensorrt onnx pytorch-yolov4 yolov4-tiny yolov3
Language:Python 4439
NVIDIA-AI-IOT / torch2trt
An easy to use PyTorch to TensorRT converter
jetson-nano jetson-tx2 jetson-xavier pytorch tensorrt inference classification
Language:Python 4411
Tencent / TNN
TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts. TNN has been deployed in multiple Apps from Tencent, such as Mobile QQ, Weishi, Pitu, etc. Contributions are welcome to work in collaborative with us and make TNN a better framework.
deep-learning mnn ncnn inference pytorch tensorflow coreml tensorrt tengine openvino face-detection hairsegmentaion ocr
Language:C++ 4297
tinyvision / DAMO-YOLO
DAMO-YOLO: a fast and accurate object detection method with some new techs, including NAS backbones, efficient RepGFPN, ZeroHead, AlignedOTA, and distillation enhancement.
deep-learning nas object-detection onnx pytorch tensorrt yolo yolov5 imagenet damo-yolo
Language:Python 3682
lucasjinreal / yolov7_d2
🔥🔥🔥🔥 (Earlier YOLOv7 not official one) YOLO with Transformers and Instance Segmentation, with TensorRT acceleration! 🔥🔥🔥
yolo yolox detection detextron2 tensorrt yolov6 yolov7 face transformers detr instance-segmentation onnx object-detection
Language:Python 3129
PaddlePaddle / FastDeploy
⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.
android jetson tensorrt onnxruntime object-detection yolov5 openvino picodet uie graphcore intel kunlun rockchip serving onnx stable-diffusion yolov8
Language:C++ 2741
open-mmlab / mmdeploy
OpenMMLab Model Deployment Framework
model-converter sdk deployment tensorrt ncnn pplnn openvino onnxruntime onnx mmdetection mmsegmentation computer-vision deep-learning pytorch
Language:Python 2545
jolibrain / deepdetect
Deep Learning API and Server in C++14 support for Caffe, PyTorch,TensorRT, Dlib, NCNN, Tensorflow, XGBoost and TSNE
deep-learning machine-learning caffe xgboost rest-api tsne object-detection image-segmentation image-classification neural-nets gpu ncnn tensorrt time-series pytorch tensorrt-conversion tensorrt-inference image-search
Language:C++ 2501
shouxieai / tensorRT_Pro
C++ library based on tensorrt integration
pytorch tensorrt object-detection deep-learning yolov5 yolox
Language:C++ 2408
pytorch / TensorRT
PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
tensorrt libtorch machine-learning pytorch deep-learning jetson nvidia cuda
Language:Python 2352
hunglc007 / tensorflow-yolov4-tflite
YOLOv4, YOLOv4-tiny, YOLOv3, YOLOv3-tiny Implemented in Tensorflow 2.0, Android. Convert YOLO v4 .weights tensorflow, tensorrt and tflite
yolov4 yolov3 tflite object-detection tensorflow tf2 tensorrt yolov3-tiny android
Language:Python 2225
666DZY666 / micronet
micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、regular and group convolutional channel pruning; 3、 group convolution structure; 4、batch-normalization fuse for quantization. deploy: tensorrt, fp32/fp16/int8(ptq-calibration)、op-adapt(upsample)、dynamic_shape
quantization pruning dorefa twn bnn xnor-net pytorch model-compression group-convolution network-slimming neuromorphic-computing convolutional-networks network-in-network integer-arithmetic-only quantization-aware-training post-training-quantization tensorrt onnx tensorrt-int8-python batch-normalization-fuse
Language:Python 2183
ppogg / YOLOv5-Lite
🍅🍅🍅YOLOv5-Lite: Evolved from yolov5 and the size of model is only 900+kb (int8) and 1.7M (fp16). Reach 15 FPS on the Raspberry Pi 4B~
ncnn yolov5 android-app mnn shufflenetv2 repvgg transformer tensorrt pplcnet openvivo mobilenet tflite pytorch picodet onnxruntime
Language:C++ 2122
enpeizhao / CVprojects
computer vision projects | 计算机视觉相关好玩的AI项目（Python、C++、embedded system）
computer-vision cpp cuda deep-learning embedded-systems machine-learning python tensorrt
Language:Jupyter Notebook 1984
deepcam-cn / yolov5-face
YOLO5Face: Why Reinventing a Face Detector (https://arxiv.org/abs/2105.12931) ECCV Workshops 2022)
arcface blazeface pytorch retinaface scrfd shufflenet tensorrt tinaface yolo yolov5 yolov7
Language:Python 1961
jkjung-avt / tensorrt_demos
TensorRT MODNet, YOLOv4, YOLOv3, SSD, MTCNN, and GoogLeNet
tensorrt yolov4 yolov3 ssd-mobilenet mtcnn googlenet modnet object-detection jetson
Language:Python 1728
DT42 / BerryNet
Deep learning gateway on Raspberry Pi and other edge devices
raspberry-pi deep-learning tensorflow iot mqtt aiot edge-devices edge-ai openvino tensorrt edge-computing
Language:Python 1594
NVIDIA / GenerativeAIExamples
Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.
gpu-acceleration large-language-models llm llm-inference microservice nemo rag retrieval-augmented-generation tensorrt triton-inference-server
Language:Python 1582
PaddlePaddle / PaddleSlim
PaddleSlim is an open-source library for deep model compression and architecture search.
pruning quantization nas bert compression detection distillation ernie segmentation sparsity tensorrt transformer yolov6 yolov5 yolov7
Language:Python 1526
CoinCheung / BiSeNet
Add bisenetv2. My implementation of BiSeNet
bisenet cityscapes pytorch cocostuff tensorrt ncnn openvino triton-inference-server ade20k
Language:Python 1366
marcoslucianops / DeepStream-Yolo
NVIDIA DeepStream SDK 7.0 / 6.4 / 6.3 / 6.2 / 6.1.1 / 6.1 / 6.0.1 / 6.0 / 5.1 implementation for YOLO models
nvidia-deepstream-sdk deepstream object-detection yolo darknet tensorrt yolov4 yolov3 yolov5 yolor pytorch nvidia ultralytics yolov7 yolov8 yolox ppyoloe paddlepaddle paddle yolov6
Language:C++ 1330
collabora / WhisperLive
A nearly-live implementation of OpenAI's Whisper.
dictation obs openai text-to-speech translation voice-recognition whisper tensorrt tensorrt-llm whisper-tensorrt
Language:Python 1280
tensorlayer / HyperPose
Library for Fast and Flexible Human Pose Estimation
tensorlayer tensorflow openpose pose-estimation computer-vision distributed-training tensorrt mobilenet neural-networks
Language:Python 1241
FeiYull / TensorRT-Alpha
🔥🔥🔥TensorRT for YOLOv8、YOLOv8-Pose、YOLOv8-Seg、YOLOv8-Cls、YOLOv7、YOLOv6、YOLOv5、YOLONAS......🚀🚀🚀CUDA IS ALL YOU NEED.🍎🍎🍎
yolov8 yolov7 cuda libfacedetection tensorrt u2net yolor yolov3 yolov4 yolov5 yolov6 yolox efficientdet rt-detr yolonas yolov8-pose yolov8-seg
Language:C++ 1192
GeekAlexis / FastMOT
High-performance multiple object tracking based on YOLO, Deep SORT, and KLT 🚀
jetson multi-object-tracking tensorrt real-time reid object-detection deep-sort computer-vision yolov4 ssd yolov3 people-counter scaledyolov4 edge-computing lucas-kanade video-analysis deep-learning
Language:Python 1102
triple-Mu / YOLOv8-TensorRT
YOLOv8 using TensorRT accelerate !
tensorrt yolov8 onnx deepstream segment jetson detection pose
Language:C++ 1102
codingonion / awesome-yolo-object-detection
🚀🚀🚀 A collection of some awesome public YOLO object detection series projects.
yolo yolov5 onnx tensorrt object-detection snn attention yolov8 autonomous-driving spiking-neural-network gui awesome-list sora gpt yolov9 qt cuda llm ultralytics llama3
1064
inference
roboflow / inference
A fast, easy-to-use, production-ready inference server for computer vision supporting deployment of many popular model architectures and fine-tuned models.
classification computer-vision deployment docker inference inference-api inference-server instance-segmentation jetson machine-learning object-detection onnx python server tensorrt vit yolact yolov5 yolov7 yolov8
Language:Python 1052
Radiata
ddPn08 / Radiata
Stable diffusion webui based on diffusers.
stable-diffusion stable-diffusion-webui tensorrt text-to-image
Language:Python 981
Gumpest / YOLOv5-Multibackbone-Compression
YOLOv5 Series Multi-backbone(TPH-YOLOv5, Ghostnet, ShuffleNetv2, Mobilenetv3Small, EfficientNetLite, PP-LCNet, SwinTransformer YOLO), Module(CBAM, DCN), Pruning (EagleEye, Network Slimming), Quantization (MQBench) and Deployment (TensorRT, ncnn) Compression Tool Box.
tph-yolov5 ghostnet-yolov5 shufflenetv2-yolov5 mobilenetv3small-yolov5 efficientnetlite-yolov5 eagleeye mqbench pplcnet swin-transformer network-slimming cbam ncnn tensorrt
Language:Python 969

tensorrt

NVIDIA / TensorRT

Megvii-BaseDetection / YOLOX

dusty-nv / jetson-inference

wang-xinyu / tensorrtx

mikel-brostrom / yolo_tracking

OAID / Tengine

Tianxiaomo / pytorch-YOLOv4

NVIDIA-AI-IOT / torch2trt

Tencent / TNN

tinyvision / DAMO-YOLO

lucasjinreal / yolov7_d2

PaddlePaddle / FastDeploy

open-mmlab / mmdeploy

jolibrain / deepdetect

shouxieai / tensorRT_Pro

pytorch / TensorRT

hunglc007 / tensorflow-yolov4-tflite

666DZY666 / micronet

ppogg / YOLOv5-Lite

enpeizhao / CVprojects

deepcam-cn / yolov5-face

jkjung-avt / tensorrt_demos

DT42 / BerryNet

NVIDIA / GenerativeAIExamples

PaddlePaddle / PaddleSlim

CoinCheung / BiSeNet

marcoslucianops / DeepStream-Yolo

collabora / WhisperLive

tensorlayer / HyperPose

FeiYull / TensorRT-Alpha

GeekAlexis / FastMOT

triple-Mu / YOLOv8-TensorRT

codingonion / awesome-yolo-object-detection

roboflow / inference

ddPn08 / Radiata

Gumpest / YOLOv5-Multibackbone-Compression