NVIDIA-AI-IOT / torch2trt

An easy to use PyTorch to TensorRT converter

NVIDIA-AI-IOT/torch2trt Issues

ROOT CAUSE? `InstanceNorm3D` with tensorRT result consistency with nn.Instance_norm3d
Updated 2 days ago
Failed to 'sudo python3 setup.py install --plugins'
Updated 3 days ago
AttributeError when using torch.nn.functional.pad
Updated 4 days ago
ONNX export mode is set to TrainingMode.EVAL, but operator 'instance_norm' is set to train=True
Updated 5 days ago
Inconsistent inference results between PyTorch and converted TensorRT model with BatchNorm or InstanceNorm operator
Updated 5 days ago1
Is that available on orin nano?
Updated 7 days ago
Unable to convert SigLIP text transformer due to missing model input when exporting model to onnx
Updated 15 days ago
SyntaxWarning of dataset.py:61
Updated 15 days ago1
_trt.shape overflow when converting from pytorch to TRT
Updated 17 days ago5
How to save a model to TRT file? Not covered in the docs
Updated 24 days ago1
OSS-Fuzz Integration
Updated 24 days ago
Segmentation fault on nn.Linear
Updated a month ago1
There are questions about the parameters needed for forward propagation in model transformation
Updated a month ago2
AttributeError: 'DataParallel' object has no attribute 'img_size'
Closed a month ago2
AttributeError: 'tensorrt_bindings.tensorrt.INetworkDefinition' object has no attribute 'add_convolution'. Did you mean: 'add_convolution_nd'?
Updated 2 months ago2
Package is not PEP 517 compliant, making it incompatible with package managing tools
Updated 3 months ago
ValueError: len() should return >= 0 with LPPool2d operator
Updated 3 months ago3
Error in converting hybridnets model using torch2trt
Updated 4 months ago
[Question & FeatureRequest] Is that possible to convert a torch.nn.Module to TRTMoudle?
Updated 4 months ago1
torch2trt shows error when converting a model, even though regular pytorch -> onnx -> tensorrt and inference is successful
Closed 6 months ago
python model successfully tested on polygraphy tensorrt, but failed, when loading on torch2trt
Updated 6 months ago
'tensorrt.tensorrt.Builder' object has no attribute 'build_cuda_engine'
Updated 6 months ago
UnboundLocalError when using torch2trt with MultiLabelSoftMarginLoss
Updated 6 months ago1
Inconsistent inference results between PyTorch and converted TensorRT model with ConvTranspose2d operator
Updated 6 months ago
Inconsistent inference results between PyTorch and converted TensorRT model with Interpolate operator
Updated 6 months ago
Inconsistent inference results between PyTorch and converted TensorRT model with MaxPool2d operator
Updated 6 months ago
Inconsistent inference results between PyTorch and converted TensorRT model with Selu operator
Updated 6 months ago
Inconsistent inference results with ConstantPad2d operator
Updated 6 months ago1
repvggblock in torch2trt
Updated 7 months ago
Inconsistent inference results between PyTorch and converted TensorRT model with Pad operator
Updated 7 months ago
Inconsistent inference results with AdaptiveMaxPool3d operator
Updated 7 months ago1
Inconsistent inference results between PyTorch and converted TensorRT model with AvgPool2d operator
Updated 7 months ago
TypeError: 'int' object is not iterable when using torch2trt to convert a PyTorch model with Transformer operator
Updated 7 months ago1
Inconsistent inference results between PyTorch and converted TensorRT model using with Linear operator
Updated 7 months ago
Inconsistent inference results between PyTorch and converted TensorRT model using with Normalize operator
Updated 7 months ago
Inconsistent inference results between PyTorch and converted TensorRT model using with Silu operator
Updated 7 months ago
Inconsistent inference results between PyTorch and converted TensorRT model using with Softplus operator
Updated 7 months ago
Inconsistent inference results between PyTorch and converted TensorRT model using with LogSoftmax operator
Updated 7 months ago
Inconsistent inference results between PyTorch and converted TensorRT model using with GumbelSoftmax operator
Updated 7 months ago
torch_dim_to_trt_axes does not handle dim=-1 correctly
Updated 7 months ago
IndexError when converting torch pad operator to TensorRT
Closed 7 months ago2
Inconsistent inference results between PyTorch and TensorRT using torch2trt with ELU operator
Updated 7 months ago1
Inconsistent inference results with Conv3d operator
Updated 7 months ago
Inconsistent inference results with avg_pool3d operator
Updated 7 months ago
Inconsistent inference results with AdaptiveAvgPool2d operator
Updated 7 months ago
How to save trt.engine file to disk to run in xavior plateform?
Closed 7 months ago1
What's the differnece of converters and plugins?
Closed 7 months ago1
Is there a plan to support python 3.10?
Updated 8 months ago1
Can't convert Vision Transformer from timm - TypeError: add_constant(): incompatible function arguments.
Updated 8 months ago2
Cannot load the 'resnet18_baseline_att_224x224_A_epoch_249_trt.pth' model anymore
Updated 9 months ago