Deep Learning (Training & Inference)   TensorRT


Topic Replies Views Activity
Best practices for reporting an issue or bug relating to TensorRT
0 3353 September 21, 2018
TensorRT 8.0: What’s New

The latest release of high performance deep learning inference SDK, TensorRT 8 GA is now available for download. This version of TensorRT includes: BERT Inference in 1.2 ms with new transformer optimizations Achieve ac…

2 119 July 20, 2021
TensorRT parse onnx failed with AveragePool layer
2 16 August 5, 2021
TensorRT getBindingVectorizedDim API
tensorrt
2 20 August 5, 2021
trtexec set input shape not working with
2 1597 August 5, 2021
How to monitor tensor cores utilization?
5 50 August 5, 2021
TensorRT only supports input K as an initializer
7 84 August 5, 2021
Getting "Segmentation Fault" when converting RetinaNet model to TensorRT Engine File
3 41 August 5, 2021
How is it possible what DLSS is so fast?
8 112 August 5, 2021
TensorRT 8 convert UNET ERROR
3 20 August 5, 2021
Convert onnx to trt format using trtexec
tensorrt
3 23 August 5, 2021
The converted model is too large!
3 11 August 5, 2021
TensorRT
1 25 August 5, 2021
Assertion failed: (inputs.at(1).is_weights()) && "This version of TensorRT only supports input K as an initializer
tensorrt ,  cuda
3 35 August 5, 2021
What's the default quantization mode for TensorRT PTQ
1 58 August 5, 2021
ONNX to TRT Engine conversion Error
tensorrt
5 109 August 5, 2021
TensorRT Optimization for Tensorflow-Unet-Image-segmentation
tensorrt ,  tensorflow ,  nano
1 23 August 4, 2021
The engine plan file is not compatible with this version of TensorRT, expecting library version 5.1....
7 533 August 4, 2021
Is it possible to install TensorRT 7.2.2 on Ubuntu 20.04?
tensorrt
4 2726 March 24, 2021
Correct way for reload engine for save memory
1 59 August 4, 2021
Pytorch-quantization install error with pip install
2 62 August 4, 2021
Multiple Celery Worker: cuStreamSynchronize failed: an illegal memory access was encountered
1 20 August 4, 2021
Does trt 8.0 support Bidirectional LSTM？
2 44 August 4, 2021
TensorRT С++ optimization profile
tensorrt ,  opencv ,  cuda
27 404 August 3, 2021
Low utilization of Tensor RT cores
8 124 August 3, 2021
Inference time becomes longer when doing non-continuous fp16 or int8 inference
tensorrt ,  jetson-inference
9 145 August 3, 2021
TRT8 engine creation from onnx fails due to AssertionError
tensorrt ,  onnx
7 106 August 3, 2021
Inference time speed up?
1 29 August 3, 2021
Parsing Maskrcnn output with TensorRT in python
1 28 August 2, 2021
Onnx with dynamic batch cannot be parsed
tensorrt
11 139 August 2, 2021