Giters
rmccorm4
/
tensorrt-utils
⚡ Useful scripts when using TensorRT
Geek Repo:
Geek Repo
Github PK Tool:
Github PK Tool
Stargazers:
235
Watchers:
14
Issues:
31
Forks:
55
rmccorm4/tensorrt-utils Issues
Tensorrt fp32 to int8 convertion error on model that has 2 inputs
Updated
a year ago
Cifar100 calibrator
Updated
a year ago
Attribute error _enter_ when running int8 compilation
Updated
2 years ago
Comments count
2
onnx to trt,choose int8 mode
Updated
2 years ago
Output of inference with an engine converted using "onnx_to_tensorrt.py"
Updated
2 years ago
Is the inference for int8 the same as for fp16?
Updated
2 years ago
Vague error.
Updated
2 years ago
The indentation maybe excessive
Updated
3 years ago
How to save the calibration.bin files?
Updated
3 years ago
how build engine with dynamic shape to exectue INT8 calibration
Updated
3 years ago
converting scaled yolov4-scp from onnx to tensorrt
Updated
3 years ago
Some questions about int8 quat
Updated
3 years ago
Comments count
1
How to do inference with the saved int8 trt engine file?
Updated
3 years ago
int8 calibration build engine with RuntimeErrpr: Drive error:
Closed
3 years ago
Comments count
2
int8 calibration for batch > 1
Updated
3 years ago
Comments count
3
WARNING: Missing dynamic range for tensor 1316, expect fall back to non-int8 implementation for any layer consuming or producing given tensor
Updated
3 years ago
Comments count
1
get wrongresult using infer_tensorrr_imagenet.py for multi-batch inference
Closed
4 years ago
Comments count
2
Add an ONNX model with dynamic shape for the example
Updated
4 years ago
Comments count
1
int8 engine for **DETECTOR models(onnx)
Updated
4 years ago
infer_tensorrt_imagenet.py: Not Predicting The Correct Classes
Updated
4 years ago
Comments count
1
Unnamed Layers in Sample ResNet-50 Cache File
Closed
4 years ago
Comments count
3
Infinity scale in calibration cache file
Closed
4 years ago
Generating int8 Calibration File for ResNet-18 Caffe Model
Updated
4 years ago
Comments count
16
calibration with files get error
Closed
4 years ago
Comments count
3
Add ONNX checker by default, and maybe onnx-simplifier as option?
Updated
4 years ago
Add TRTIS dynamic shape engine example/doc
Updated
4 years ago
Add tool to iterate through TRT versions with/without OSS to parse models
Updated
4 years ago
Change default opt profile behavior to be more like implicit batch
Updated
4 years ago
TensorRt 7.0 python API can't infer shape of IResizeLayer
Closed
4 years ago
End-to-end simple plugin example
Updated
4 years ago
Script to validate converting Fixed -> Dynamic shape ONNX model
Updated
4 years ago