TensorRT

Topic	Replies	Views	Activity
TensorRT 8.2 and Framework Integrations are out now! tensorrt The latest release of TensorRT, 8.2 GA, and TensorRT Integrations for PyTorch and TensorFlow, is now available for download. Highlight includes: TensorRT 8.2 Optimizations for T5 and GPT-2 deliver real time translati…	4	2152	October 4, 2022
Best practices for reporting an issue or bug relating to TensorRT	0	5808	September 21, 2018
Is it ever reasonable to have ONNX Runtime with CUDAExecutionProvider faster than native TensorRT?	1	26	February 3, 2023
How to check my TensorRT version kb	12	62583	February 3, 2023
Can't use TensorRT in Ubuntu 20.04 with Python3.8 tensorrt , cuda , tensorflow , ubuntu , jetson-inference , python	1	27	February 3, 2023
Problems with converting Einsum operations to the tensorrt tensorrt , pytorch , python , onnx	6	585	February 2, 2023
ONNX model and TensorRT engine works differently	4	64	February 2, 2023
Trtexec --layerPrecision and --precisionConstraints not respected when converting onnx model	2	51	February 2, 2023
Inference time increases in for loop	0	22	February 2, 2023
Missing Dependency for python3-libnvinfer	10	6678	February 2, 2023
Expose additional ONNX protobuf model properties via nvonnxparser::IParser tensorrt , onnx	2	256	February 1, 2023
Dynamic Input. IShuffleLayer applied to shape tensor must have 0 or 1 reshape dimensions tensorrt	1	43	February 1, 2023
A typo in TensorRT 8.5.3 release notes	1	46	February 1, 2023
TRT 8.2.0.6 - 'NoneType' object has no attribute 'serialize'	2	747	February 1, 2023
Missing dependencies for python-liibnvinfer. TensorRT 7.2	7	2411	February 1, 2023
How to optimise attention OCR model for jetson nano using tensor-rt	19	1538	January 31, 2023
TensorRT inference time extremely slow	2	58	January 31, 2023
How to directly convert a trained Pytorch model into TensorRT model？There are already. pth files ready after training	5	74	January 31, 2023
[hardwareContext.cpp::configure::92] Error Code 1: Cudnn (CUDNN_STATUS_MAPPING_ERROR) tensorrt , cuda	5	153	January 31, 2023
How to read TensorRT source code？	2	55	January 31, 2023
Multiple tensorrt engine contexts for different models	1	95	January 30, 2023
Cannot Deploy PyTorch Model on DeepStream	7	116	January 30, 2023
Triton Model Navigator failing during "optimize" API inference-server-triton	2	75	January 31, 2023
IConvolutionLayer cannot be used to compute a shape tensor	2	118	January 31, 2023
TRT engine file bigger than original Darknet YOLO V3 model tensorrt , deepstream	3	104	January 30, 2023
Strange CNN inference latency behavior with CUDA and TensorRT cuda	11	306	January 30, 2023
TensorRT EfficientNMS plugin FP16 inconsistent(but valid) results tensorrt	2	108	January 27, 2023
Error while loading shared libraries: libnvinfer.so.7: cannot open shared object file: No such file or directory	3	6030	January 27, 2023
Format specification of .trt / .engine?	1	73	January 26, 2023
Host two or more Nvflare servers in the same physical workstation python	1	62	January 26, 2023

TensorRT 8.2 and Framework Integrations are out now!

tensorrt

The latest release of TensorRT, 8.2 GA, and TensorRT Integrations for PyTorch and TensorFlow, is now available for download. Highlight includes: TensorRT 8.2 Optimizations for T5 and GPT-2 deliver real time translati…