Deep Learning (Training & Inference)   TensorRT


Topic Replies Views Activity
TensorRT 7.2 GA is out now!
tensorrt

The latest release of TensorRT, 7.2 GA is now available for download. This version of TensorRT includes: Optimizations for high-quality video effects such as live virtual background, delivering 30X performance vs CPUs N…

0 537 October 22, 2020
TensorRT Issue Template
0 3158 September 21, 2018
Attaching Files to Forum Topics/Posts
0 1878 October 25, 2018
Convert pb to uff
tensorrt ,  jetson-inference
8 74 May 13, 2021
Switch tasks during infering
tensorrt
0 34 May 3, 2021
InferDeleter crash for dynamic netowrk
6 66 May 12, 2021
How to infer 1 input and 5 output model?
1 20 May 12, 2021
Tensorflow inference using TRT converted model
5 110 May 12, 2021
TensorRT customized plugin
4 60 May 12, 2021
Different inference time when loading engine from serialized file
tensorrt
4 47 May 12, 2021
Is it possible support Vietnamese in trtis_cpp?
tensorrt ,  inference-server-triton
1 12 May 12, 2021
Why we need to use setDynamicRange() for all layer data in TensorRT
tensorrt
0 11 May 12, 2021
JARVIS throwing errors for offline ASR when using own model
jarvis
2 47 May 11, 2021
[8] Assertion failed: ctx->network()->hasExplicitPrecision() && "TensorRT only supports multi-input conv for explicit precision QAT networks!"
3 94 May 11, 2021
AttributeError: 'NoneType' object has no attribute 'create_execution_context'
26 4847 May 11, 2021
TensorRT NCHW vs cuDNN NHWC
tensorrt
2 33 May 11, 2021
Batch inference parallelization on tensorrt
tensorrt ,  cuda
5 121 May 5, 2021
Build TensorRT Open Source on Windows
1 29 May 11, 2021
TensorRT 8.0.0 local repo file installation broken on Ubuntu18.04
2 38 May 11, 2021
Typo in Installation Guide
2 34 May 11, 2021
TensorRT 8.0.0 network installation issue
5 54 May 11, 2021
Trying to run TensorFlow 1.15 produced graphdefs with TF2 based tensorRT but TensorRT model is not building correctly
tensorrt ,  tensorflow ,  python ,  inference-server-triton ,  machine-learning
3 21 May 11, 2021
Error in Converting the h5 model to the UFF model （TensorRT\samples\opensource\sampleUffMaskRCNN\converted）
15 1165 May 11, 2021
Int8 problem
tensorrt
19 213 May 11, 2021
Multithread does not improve inference performance with tensorrt models
tensorrt
2 72 May 11, 2021
ERROR: Check failed: status == CUDNN_STATUS_SUCCESS (8 vs. 0) CUDNN_STATUS_EXECUTION_FAILED, device 0
cuda ,  tensorflow ,  jetson-inference
1 33 May 10, 2021
Custom TensorRT Container
tensorrt
2 31 May 10, 2021
ONNX parse problem with TopK
10 146 May 10, 2021
HeatMap GradCAM using TensorRT Engine
tensorrt
6 321 May 10, 2021
Trying jarvis ont the local docker
jarvis
11 220 May 10, 2021