TensorRT

Topic	Replies	Views	Activity
TensorRT 8.2 and Framework Integrations are out now! tensorrt The latest release of TensorRT, 8.2 GA, and TensorRT Integrations for PyTorch and TensorFlow, is now available for download. Highlight includes: TensorRT 8.2 Optimizations for T5 and GPT-2 deliver real time translati…	4	3937	October 4, 2022
Best practices for reporting an issue or bug relating to TensorRT	0	7358	September 21, 2018
Error while linking sampleOnnxMNIST tutorial tensorrt	2	31	September 27, 2023
Unmet dependencies while installing TensorRT with CUDA 12.2 tensorrt	1	42	September 27, 2023
Can not convert onnx model to TensorRT format on the Nvidia AGX Orin dev kit tensorrt	5	65	September 27, 2023
Tensorrt error: cuMemFree failed: misaligned address tensorrt , jetson	2	62	September 27, 2023
How to do two different inference with TensorRT on two different GPU on same machine or PC	1	62	September 27, 2023
Inference time mismatch between same configuration on Windows and Ubuntu tensorrt , windows-driver	2	80	September 27, 2023
When use refit and dynamic shape feature, the inference time consuming will rasie and unstable tensorrt , ubuntu , python	2	77	September 27, 2023
CUDA Surfaces as input for TensorRT model tensorrt	2	89	September 27, 2023
TensorRT inference time issues with different driver version	2	118	September 27, 2023
TensorRT Engine Creation Methods’ Differences tensorrt	1	91	September 27, 2023
NVFUSER? can someone tell me when to use?	2	111	September 27, 2023
Python Builder API doesn't work for conv3d	3	90	September 27, 2023
How to use tensorrt loop to add to tensor?	3	83	September 27, 2023
Segmentation fault. Softmax+Split+Concat+TopK+Gather jetson	1	13	September 27, 2023
What are the available algorithms of TensorRT? tensorrt	2	20	September 27, 2023
Unable to Perform Inference After Deserializing CUDA Engine tensorrt , cuda	1	33	September 27, 2023
TensorRT for aarch64.whl tensorrt , camera , jetson-inference , python	3	52	September 26, 2023
TensorRT installation problem	2	132	September 26, 2023
Error Code 4: Miscellaneous (IElementWiseLayer Add_430: broadcast dimensions must be conformable) tensorrt , cuda , ubuntu	6	159	September 26, 2023
[TensorRT] batch vs shapes tensorrt , onnx	1	103	September 25, 2023
Trtexec Error: only activation types allowed as input to this layer tensorrt	6	398	September 25, 2023
TensorRT encountered issues when converting weights between types and that could affect accuracy	7	224	September 22, 2023
[graphOptimizer.cpp::nvinfer1::builder::SliceConcatFusion::calcSliceGroupSize::2724]ErrorCode2:InternalError(Assertion slice->inputs.size()==1failed.)	1	96	September 22, 2023
Error Code 7: Internal Error (Add_430: dimensions not compatible for elementwise. Condition '==' violated: 5376 != 4725 tensorrt , cuda , ubuntu	4	152	September 21, 2023
Peak memory usage during TensorRT execution	1	91	September 21, 2023
Tensorrt 8.6 GA : C++ Inference gives diffrence results compared to onnx \|\| pt model python inference	3	158	September 20, 2023
Getting weird internel error tensorrt , cuda	6	215	September 20, 2023
[TRT] [E] 2: [graphOptimizer.cpp::calcSliceGroupSize::2724] Error Code 2: Internal Error (Assertion slice->inputs.size() == 1 failed	4	185	September 20, 2023

TensorRT 8.2 and Framework Integrations are out now!

tensorrt

The latest release of TensorRT, 8.2 GA, and TensorRT Integrations for PyTorch and TensorFlow, is now available for download. Highlight includes: TensorRT 8.2 Optimizations for T5 and GPT-2 deliver real time translati…

4

3937

October 4, 2022

Best practices for reporting an issue or bug relating to TensorRT

0

7358

September 21, 2018

Error while linking sampleOnnxMNIST tutorial

tensorrt

2

31

September 27, 2023

Unmet dependencies while installing TensorRT with CUDA 12.2

tensorrt

1

42

September 27, 2023

Can not convert onnx model to TensorRT format on the Nvidia AGX Orin dev kit

tensorrt

5

65

September 27, 2023

Tensorrt error: cuMemFree failed: misaligned address

tensorrt , jetson

2

62

September 27, 2023

How to do two different inference with TensorRT on two different GPU on same machine or PC

1

62

September 27, 2023

Inference time mismatch between same configuration on Windows and Ubuntu

tensorrt , windows-driver

2

80

September 27, 2023

When use refit and dynamic shape feature, the inference time consuming will rasie and unstable

tensorrt , ubuntu , python

2

77

September 27, 2023

CUDA Surfaces as input for TensorRT model

tensorrt

2

89

September 27, 2023

TensorRT inference time issues with different driver version

2

118

September 27, 2023

TensorRT Engine Creation Methods’ Differences

tensorrt

1

91

September 27, 2023

NVFUSER? can someone tell me when to use?

2

111

September 27, 2023

Python Builder API doesn't work for conv3d

3

90

September 27, 2023

How to use tensorrt loop to add to tensor?

3

83

September 27, 2023

Segmentation fault. Softmax+Split+Concat+TopK+Gather

jetson

1

13

September 27, 2023

What are the available algorithms of TensorRT?

tensorrt

2

20

September 27, 2023

Unable to Perform Inference After Deserializing CUDA Engine

tensorrt , cuda

1

33

September 27, 2023

TensorRT for aarch64.whl

tensorrt , camera , jetson-inference , python

3

52

September 26, 2023

TensorRT installation problem

2

132

September 26, 2023

Error Code 4: Miscellaneous (IElementWiseLayer Add_430: broadcast dimensions must be conformable)

tensorrt , cuda , ubuntu

6

159

September 26, 2023

[TensorRT] batch vs shapes

tensorrt , onnx

1

103

September 25, 2023

Trtexec Error: only activation types allowed as input to this layer

tensorrt

6

398

September 25, 2023

TensorRT encountered issues when converting weights between types and that could affect accuracy

7

224

September 22, 2023

[graphOptimizer.cpp::nvinfer1::builder::SliceConcatFusion::calcSliceGroupSize::2724]ErrorCode2:InternalError(Assertion slice->inputs.size()==1failed.)

1

96

September 22, 2023

Error Code 7: Internal Error (Add_430: dimensions not compatible for elementwise. Condition '==' violated: 5376 != 4725

tensorrt , cuda , ubuntu

4

152

September 21, 2023

Peak memory usage during TensorRT execution

1

91

September 21, 2023

Tensorrt 8.6 GA : C++ Inference gives diffrence results compared to onnx || pt model python inference

3

158

September 20, 2023

Getting weird internel error

tensorrt , cuda

6

215

September 20, 2023

[TRT] [E] 2: [graphOptimizer.cpp::calcSliceGroupSize::2724] Error Code 2: Internal Error (Assertion slice->inputs.size() == 1 failed

4

185

September 20, 2023

Deep Learning (Training & Inference) TensorRT