How to get a tensorrt model?

Question

muse1835 opened this issue 9 months ago · comments

Hi,

I want to get the RT-DETR tensorrt models.

But I can't find any code about loading model or custom trained weights.
(I use pytorch.)

Could you explain?

lyuwenyu · Answer 1 · Tue Nov 14 2023 16:05:41 GMT+0800 (China Standard Time)

You find some resources for deployment in #95

star this repo to follow updates

muse1835 · Answer 2 · Tue Nov 14 2023 16:19:28 GMT+0800 (China Standard Time)

You find some resources for deployment in #95

star this repo to follow updates

thanks for reply.

Is there any code about converting torch model to engine??...

I already saw the link but I couldn't convert my .pth model to .engine.

I want to convert my .pth to .engine.

could you give me some refer or python codes?

(I tried converting but some error about 'state_dict' was ocurred after torch2trt, torch.load(".pth")
I will upload my error message 12h later.)

lyuwenyu · Answer 3 · Tue Nov 14 2023 17:21:21 GMT+0800 (China Standard Time)

You can use nv tensorrt tool trtexec.

trtexec --onnx=xxx.onnx --saveEngine=xxx.engine --buildOnly --fp16