TensorRT

Topic	Replies	Views	Activity
TensorRT 8.2 and Framework Integrations are out now! tensorrt The latest release of TensorRT, 8.2 GA, and TensorRT Integrations for PyTorch and TensorFlow, is now available for download. Highlight includes: TensorRT 8.2 Optimizations for T5 and GPT-2 deliver real time translati…	6	5971	January 10, 2025
Best practices for reporting an issue or bug relating to TensorRT	0	8847	September 21, 2018
[ir_graph_builder.cpp:myelinGraphSetInputShapeProfile:254] Called with invalid shape profile, expect min <= common <= max on input 8) cudnn	0	3	May 22, 2025
Trtexec execution fails tensorrt	0	6	May 21, 2025
CAN NOT TRAIN a simple CNN by using tensorflow-gpu for RTX5070 on Ubuntu 25.04 with driver 570-open cuda , python , cudnn	0	21	May 21, 2025
You have exhausted the lab time provided with your course enrollment. If you believe this message is in error, please contact support. Please help	7	22	May 20, 2025
Unable to get output tensor shape using IExecutionContext::getTensorShape in TensorRT 10.x tensorrt , ubuntu , cudnn	0	11	May 20, 2025
Building RAG Agents with LLMs	4	24	May 19, 2025
EP error when using python REMBG[GPU]-missing TensorRT librariest tensorrt , cuda , tensorflow , python	2	303	May 19, 2025
Deprecation of TensorRT static libraries on Linux tensorrt	0	9	May 19, 2025
Nvshmem3.2.5+doca2.9.1failed to detect nvidia-peermem.ko	1	10	May 19, 2025
Dynamic Engine files	1	9	May 19, 2025
TensorRT for combined encoder/decoder model	0	28	May 14, 2025
Deepseek Resources requirements ( Deepseek-R1 7B) ubuntu	1	25	May 12, 2025
Big difference between infer results of onnxruntime and tensorrt cudnn	3	96	May 8, 2025
Onnx2trt --fp16 error cudnn	2	22	May 8, 2025
Trtexec exports engine with error (out of memory) cudnn	0	22	May 8, 2025
Rapid Application Development with Large Language Models (LLMs) code not working, won't connect to llms	1	10	May 6, 2025
Trtexec Segfault at PointWiseFusion tensorrt , nvbugs , cudnn	0	13	May 5, 2025
Optimizing Rendering with AI: Reducing GPU Load for Faster Processing tensorrt , cuda , ai , gpu	1	41	May 3, 2025
High GPU usage during simple model inference on Tensorrt cudnn	1	23	May 2, 2025
TensorRT engine fails to deserialize, despite being built with the same version on the same machine cudnn , deepstream	3	46	May 1, 2025
Tensor RT engine to faster rcnn model tensorrt , cudnn	2	21	May 1, 2025
Where to download libnvinfer.so.10 for aarch64-Linux cudnn , llama	0	38	May 1, 2025
Quantization of D-FINE in tensorrt 10.8 fails tensorrt , cudnn , onnx	3	64	April 30, 2025
Slow inference on custom model cuda , tensorflow , cudnn , jetson	3	26	April 30, 2025
Windows systems perfomance issue tensorrt , inference-server-triton	1	26	April 30, 2025
TensorRT engine execution return all 0 due to warning[ScatterND with reduction=='none' only guarantees to be correct if indices are not duplicated.]	1	19	April 30, 2025
Failed to convert the SAM2.1 decoder onnx model due to Error Code 4: Internal Error	1	37	April 30, 2025
How to deploy Grad-CAM using TensorRT tensorrt , cudnn	1	36	April 30, 2025

TensorRT 8.2 and Framework Integrations are out now!

tensorrt

The latest release of TensorRT, 8.2 GA, and TensorRT Integrations for PyTorch and TensorFlow, is now available for download. Highlight includes: TensorRT 8.2 Optimizations for T5 and GPT-2 deliver real time translati…

6

5971

January 10, 2025

Best practices for reporting an issue or bug relating to TensorRT

0

8847

September 21, 2018

[ir_graph_builder.cpp:myelinGraphSetInputShapeProfile:254] Called with invalid shape profile, expect min <= common <= max on input 8)

cudnn

0

3

May 22, 2025

Trtexec execution fails

tensorrt

0

6

May 21, 2025

CAN NOT TRAIN a simple CNN by using tensorflow-gpu for RTX5070 on Ubuntu 25.04 with driver 570-open

cuda , python , cudnn

0

21

May 21, 2025

You have exhausted the lab time provided with your course enrollment. If you believe this message is in error, please contact support. Please help

7

22

May 20, 2025

Unable to get output tensor shape using IExecutionContext::getTensorShape in TensorRT 10.x

tensorrt , ubuntu , cudnn

0

11

May 20, 2025

Building RAG Agents with LLMs

4

24

May 19, 2025

EP error when using python REMBG[GPU]-missing TensorRT librariest

tensorrt , cuda , tensorflow , python

2

303

May 19, 2025

Deprecation of TensorRT static libraries on Linux

tensorrt

0

9

May 19, 2025

Nvshmem3.2.5+doca2.9.1failed to detect nvidia-peermem.ko

1

10

May 19, 2025

Dynamic Engine files

1

9

May 19, 2025

TensorRT for combined encoder/decoder model

0

28

May 14, 2025

Deepseek Resources requirements ( Deepseek-R1 7B)

ubuntu

1

25

May 12, 2025

Big difference between infer results of onnxruntime and tensorrt

cudnn

3

96

May 8, 2025

Onnx2trt --fp16 error

cudnn

2

22

May 8, 2025

Trtexec exports engine with error (out of memory)

cudnn

0

22

May 8, 2025

Rapid Application Development with Large Language Models (LLMs) code not working, won't connect to llms

1

10

May 6, 2025

Trtexec Segfault at PointWiseFusion

tensorrt , nvbugs , cudnn

0

13

May 5, 2025

Optimizing Rendering with AI: Reducing GPU Load for Faster Processing

tensorrt , cuda , ai , gpu

1

41

May 3, 2025

High GPU usage during simple model inference on Tensorrt

cudnn

1

23

May 2, 2025

TensorRT engine fails to deserialize, despite being built with the same version on the same machine

cudnn , deepstream

3

46

May 1, 2025

Tensor RT engine to faster rcnn model

tensorrt , cudnn

2

21

May 1, 2025

Where to download libnvinfer.so.10 for aarch64-Linux

cudnn , llama

0

38

May 1, 2025

Quantization of D-FINE in tensorrt 10.8 fails

tensorrt , cudnn , onnx

3

64

April 30, 2025

Slow inference on custom model

cuda , tensorflow , cudnn , jetson

3

26

April 30, 2025

Windows systems perfomance issue

tensorrt , inference-server-triton

1

26

April 30, 2025

TensorRT engine execution return all 0 due to warning[ScatterND with reduction=='none' only guarantees to be correct if indices are not duplicated.]

1

19

April 30, 2025

Failed to convert the SAM2.1 decoder onnx model due to Error Code 4: Internal Error

1

37

April 30, 2025

How to deploy Grad-CAM using TensorRT

tensorrt , cudnn

1

36

April 30, 2025

Deep Learning (Training & Inference) TensorRT