optimal16 / TensorRT-For-YOLO-Series

tensorrt for yolo series, nms plugin support

YOLO Series TensorRT Python/C++

简体中文

Support

YOLOv7、YOLOv6、 YOLOX、 YOLOV5、YOLOv3

Update

• 2022.11.29 fix some bug thanks JiaPai12138
• 2022.8.13 rename reop、 public new version、 C++ for end2end
• 2022.8.11 nms plugin support ==> Now you can set --end2end flag while use export.py get a engine file
• 2022.7.8 support YOLOV7
• 2022.7.3 support TRT int8 post-training quantization

Prepare TRT Env

Python

pip install --upgrade setuptools pip --user
pip install nvidia-pyindex
pip install --upgrade nvidia-tensorrt
pip install pycuda

C++

By Docker

Examples

Python

show in Examples.ipynb

C++

support NMS plugin show in C++ Demo

Citing

If you use this repo in your publication, please cite it by using the following BibTeX entry.

@Misc{yolotrt2022,
  author =       {Jian Lin},
  title =        {YOLOTRT: tensorrt for yolo series, nms plugin support},
  howpublished = {\url{[https://github.com/Linaom1214/TensorRT-For-YOLO-Series]}},
  year =         {2022}
}

Old version

v0.0.1 v0.0.2

Sponsor

Buy me a cup of coffee