Deep Learning (Training & Inference)   TensorRT


Topic Replies Views Activity
TensorRT 8.2 and Framework Integrations are out now!
tensorrt

The latest release of TensorRT, 8.2 GA, and TensorRT Integrations for PyTorch and TensorFlow, is now available for download. Highlight includes: TensorRT 8.2 Optimizations for T5 and GPT-2 deliver real time translati…

2 1392 April 22, 2022
Best practices for reporting an issue or bug relating to TensorRT
0 5252 September 21, 2018
The engine plan file is not compatible with this version of TensorRT 8.4.1.5 got 8.4.2.4, please rebuild
0 25 August 12, 2022
Error Code 2: OutOfMemory Error during INT8 calibration
4 46 August 12, 2022
Torch_tensorrt compile doesn't support pretrained torchvision Mask_RCNN model
tensorrt ,  pytorch
3 53 August 12, 2022
Unable to parse custom pytorch UNET onnx model with python deepstream-segmentation-app
3 43 August 12, 2022
Int8 Calibration Implementation( PTQ) using Int8EntropyCalibrator2 needs DLA mendatory
7 146 August 12, 2022
Expose additional ONNX protobuf model properties via nvonnxparser::IParser
tensorrt ,  onnx
0 37 August 12, 2022
IUnaryLayer cannot be used to compute a shape tensor
tensorrt
6 791 August 12, 2022
[TensorRT] ERROR: [graph.cpp::computeInputExecutionUses::510]
tensorrt
10 1575 August 12, 2022
Issue with elementwise operation in dynamic batch mode using explicit batch mode
tensorrt
2 41 August 11, 2022
Try to convert onnx to dynamic shape engine via trtexec,while not work
6 319 August 11, 2022
TRT is not working as expected, in contrast to torch and onnxruntime
2 56 August 11, 2022
Can't access TensorRT from a python venv
tensorrt ,  python
3 67 August 10, 2022
Invalid resource handle when doing inference with TensorRT
3 105 August 10, 2022
TensorRT get different result in python and c++
20 434 August 10, 2022
Assertion failed: (axes.allValuesKnown())
deepstream61
5 69 August 10, 2022
Cannot convert SSD ONNX model to TensorRT
tensorrt
5 60 August 9, 2022
Error Code 2: Internal Error (Assertion matchPattern(context, first) && matchBackend(first) failed. )
3 72 August 9, 2022
Trtexec ConvTranspose cost to much time when inference
1 50 August 9, 2022
AttributeError: 'tensorrt.tensorrt.Builder' object has no attribute 'max_workspace_size'
tensorrt
1 93 August 9, 2022
Building a engine takes too long
2 88 August 9, 2022
AttributeError: 'NoneType' object has no attribute 'create_execution_context'
29 10435 August 8, 2022
The same model consumes different sizes of GPU memory in different GPU
8 532 August 8, 2022
2.5GB of video memory missing in TensorFlow on both Linux and Windows [RTX 3080]
cuda ,  tensorflow ,  python ,  gpu
9 1038 August 6, 2022
Tensortrt AttributeError: '_UserObject' object has no attribute 'add_slot'
5 1935 August 5, 2022
Trtexec error converting onnx
onnx
5 154 August 5, 2022
Internal Error: GPU error during getBestTactic: PWN(LeakyRelu_4) : misaligned address
tensorrt
5 233 August 5, 2022
Missing cub/cub.h when installing TensorRT OSS
4 75 August 4, 2022
Inference on png images
tensorrt
1 83 August 4, 2022