tensorrt

There are 17 repositories under tensorrt topic.

YOLOX
Megvii-BaseDetection / YOLOX
YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documentation: https://yolox.readthedocs.io/
deep-learning megengine ncnn object-detection onnx openvino pytorch tensorrt yolo yolov3 yolox
Language:Python 6441
dusty-nv / jetson-inference
Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.
caffe computer-vision deep-learning digits embedded image-recognition inference jetson jetson-nano jetson-tx1 jetson-tx2 jetson-xavier jetson-xavier-nx machine-learning nvidia object-detection robotics segmentation tensorrt video-analytics
Language:C++ 5599
NVIDIA / TensorRT
TensorRT is a C++ library for high performance inference on NVIDIA GPUs and deep learning accelerators.
deep-learning nvidia tensorrt
Language:C++ 5332
wang-xinyu / tensorrtx
Implementation of popular deep learning networks with TensorRT network definition API
tensorrt mnasnet resnet squeezenet vgg yolov3 inceptionv3 mobilenetv2 shufflenetv2 mobilenetv3 resnext senet yolov3-spp retinaface yolov4 arcface yolov5 crnn swin-transformer detr
Language:C++ 4104
Tianxiaomo / pytorch-YOLOv4
PyTorch ,ONNX and TensorRT implementation of YOLOv4
darknet2onnx darknet2pytorch onnx pytorch pytorch-yolov4 tensorrt yolov3 yolov4 yolov4-tiny
Language:Python 3968
OAID / Tengine
Tengine is a lite, high performance, modular inference engine for embedded device
acl arm artificial-intelligence cnn container cuda machine-learning mips npu nvdla onnx pytorch riscv supperedge tensorflow tensorrt x86-64
Language:C++ 3935
Tencent / TNN
TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts. TNN has been deployed in multiple Apps from Tencent, such as Mobile QQ, Weishi, Pitu, etc. Contributions are welcome to work in collaborative with us and make TNN a better framework.
deep-learning mnn ncnn inference pytorch tensorflow coreml tensorrt tengine openvino face-detection hairsegmentaion ocr
Language:C++ 3513
NVIDIA-AI-IOT / torch2trt
An easy to use PyTorch to TensorRT converter
classification inference jetson-nano jetson-tx2 jetson-xavier pytorch tensorrt
Language:Python 3340
jolibrain / deepdetect
Deep Learning API and Server in C++14 support for Caffe, PyTorch,TensorRT, Dlib, NCNN, Tensorflow, XGBoost and TSNE
caffe deep-learning gpu image-classification image-search image-segmentation machine-learning ncnn neural-nets object-detection pytorch rest-api tensorrt tensorrt-conversion tensorrt-inference time-series tsne xgboost
Language:C++ 2364
hunglc007 / tensorflow-yolov4-tflite
YOLOv4, YOLOv4-tiny, YOLOv3, YOLOv3-tiny Implemented in Tensorflow 2.0, Android. Convert YOLO v4 .weights tensorflow, tensorrt and tflite
android object-detection tensorflow tensorrt tf2 tflite yolov3 yolov3-tiny yolov4
Language:Python 2007
666DZY666 / micronet
micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、regular and group convolutional channel pruning; 3、 group convolution structure; 4、batch-normalization fuse for quantization. deploy: tensorrt, fp32/fp16/int8(ptq-calibration)、op-adapt(upsample)、dynamic_shape
quantization pruning dorefa twn bnn xnor-net pytorch model-compression group-convolution network-slimming neuromorphic-computing convolutional-networks network-in-network integer-arithmetic-only quantization-aware-training post-training-quantization tensorrt onnx tensorrt-int8-python batch-normalization-fuse
Language:Python 1758
DT42 / BerryNet
Deep learning gateway on Raspberry Pi and other edge devices
raspberry-pi deep-learning tensorflow iot mqtt aiot edge-devices edge-ai openvino tensorrt edge-computing
Language:Python 1552
jkjung-avt / tensorrt_demos
TensorRT MODNet, YOLOv4, YOLOv3, SSD, MTCNN, and GoogLeNet
googlenet jetson modnet mtcnn object-detection ssd-mobilenet tensorrt yolov3 yolov4
Language:Python 1451
pytorch / TensorRT
PyTorch/TorchScript compiler for NVIDIA GPUs using TensorRT
tensorrt libtorch machine-learning pytorch deep-learning jetson nvidia cuda
Language:Jupyter Notebook 1421
tensorlayer / hyperpose
Library for Fast and Flexible Human Pose Estimation
tensorlayer tensorflow openpose pose-estimation computer-vision distributed-training tensorrt mobilenet neural-networks
Language:Python 1154
nebuly-ai / nebullvm
Easy-to-use library to boost AI inference leveraging state-of-the-art optimization techniques.
compiler computing deep-learning huggingface inference machine-learning onnx openvino pytorch tensorflow tensorrt tvm
Language:Jupyter Notebook 1133
deepcam-cn / yolov5-face
YOLO5Face: Why Reinventing a Face Detector (https://arxiv.org/abs/2105.12931)
yolov5 tensorrt retinaface scrfd tinaface yolo pytorch arcface shufflenet blazeface
Language:Python 1038
ppogg / YOLOv5-Lite
🍅🍅🍅YOLOv5-Lite: lighter, faster and easier to deploy. Evolved from yolov5 and the size of model is only 930+kb (int8) and 1.7M (fp16). It can reach 10+ FPS on the Raspberry Pi 4B when the input size is 320×320~
ncnn yolov5 android-app mnn shufflenetv2 repvgg transformer tensorrt pplcnet openvivo mobilenet tflite pytorch picodet onnxruntime
Language:Python 1035
CoinCheung / BiSeNet
Add bisenetv2. My implementation of BiSeNet
bisenet cityscapes pytorch bisenetv2 cocostuff tensorrt ncnn openvino triton-inference-server
Language:Python 950
jinfagang / yolov7
🔥🔥🔥🔥 YOLO with Transformers and Instance Segmentation, with TensorRT acceleration! 🔥🔥🔥
detection detextron2 detr face instance-segmentation object-detection onnx tensorrt transformers yolo yolov6 yolov7 yolox
Language:Python 937
shouxieai / tensorRT_Pro
C++ library based on tensorrt integration
deep-learning object-detection pytorch tensorrt yolov5 yolox
Language:C++ 913
open-mmlab / mmdeploy
OpenMMLab Model Deployment Framework
computer-vision deep-learning deployment mmdetection mmsegmentation model-converter ncnn onnx onnxruntime openvino pplnn pytorch sdk tensorrt
Language:Python 879
GeekAlexis / FastMOT
High-performance multiple object tracking based on YOLO, Deep SORT, and KLT 🚀
jetson multi-object-tracking tensorrt real-time reid object-detection deep-sort computer-vision yolov4 ssd yolov3 people-counter scaledyolov4 edge-computing lucas-kanade video-analysis deep-learning
Language:Python 868
NVIDIA / retinanet-examples
Fast and accurate object detection with end-to-end GPU optimization
deep-learning object-detection python neural-network retinanet pytorch tensorrt
Language:Python 813
NVIDIA-AI-IOT / trt_pose
Real-time pose estimation accelerated with NVIDIA TensorRT
human-pose-estimation human-pose tensorrt pytorch torch2trt jetson jetson-nano jetson-xavier real-time live-demo pretrained-models
Language:Python 736
NVIDIA-AI-IOT / tf_trt_models
TensorFlow models accelerated with NVIDIA TensorRT
tensorflow tensorrt nvidia jetson tx1 tx2 models neural-network object-detection image-classification train inference realtime optimize
Language:Python 664
zerollzeng / tiny-tensorrt
Deploy your model with TensorRT quickly. 快速使用TensorRT来部署模型
deep-learning onnx tensorrt
Language:C++ 577
Adlik / Adlik
Adlik: Toolkit for Accelerating Deep Learning Inference
deep-learning inference tensorflow-serving openvino tensorrt compiler inference-engine model-optimizer docker-images
Language:C++ 532
JDAI-CV / centerX
This repo is implemented based on detectron2 and centernet
centernet detectron2 deep-learning object-detection fast-reid caffe onnx tensorrt centerx
Language:Python 522
grimoire / mmdetection-to-tensorrt
convert mmdetection model to tensorrt, support fp16, int8, batch input, dynamic shape etc.
tensorrt mmdetection inference object-detection faster-rcnn cascade-rcnn ssd retinanet yolov3
Language:Python 517
marcoslucianops / DeepStream-Yolo
NVIDIA DeepStream SDK 6.0.1 configuration for YOLO models
nvidia-deepstream-sdk deepstream deep-neural-networks object-detection yolo darknet deep-learning tensorrt yolov4 yolov3 yolov5 yolor pytorch nvidia ultralytics
Language:C++ 507
Forward
Tencent / Forward
A library for high performance deep learning inference on NVIDIA GPUs.
cuda deep-learning forward gpu inference inference-engine keras neural-network onnx pytorch tensorflow tensorrt
Language:C++ 500
VITA-Group / FasterSeg
[ICLR 2020] "FasterSeg: Searching for Faster Real-time Semantic Segmentation" by Wuyang Chen, Xinyu Gong, Xianming Liu, Qian Zhang, Yuan Li, Zhangyang Wang
pytorch neural-architecture-search semantic-segmentation latency tensorrt cityscapes
Language:Python 499
lewes6369 / TensorRT-Yolov3
TensorRT for Yolov3
tensorrt yolov3 caffe
Language:C++ 484
pythonlessons / TensorFlow-2.x-YOLOv3
YOLOv3 implementation in TensorFlow 2.3.1
yolo yolov4 tracking detection yolov3 pretrained-weights darknet tensorflow2 yolov4-training tensorrt
Language:Jupyter Notebook 482
Syencil / tensorRT
TensorRT-7 Network Lib 包括常用目标检测、关键点检测、人脸检测、OCR等可训练自己数据
tensorrt yolov5 retinaface psenet yolov3 retinanet hourglass fcos
Language:C++ 473

ezoic increase your site revenue

Related Topics

deep-learning pytorch object-detection tensorflow computer-vision