Deep Learning (Training & Inference)   TensorRT


Topic Replies Views Activity
TensorRT 8.2 and Framework Integrations are out now!
tensorrt

The latest release of TensorRT, 8.2 GA, and TensorRT Integrations for PyTorch and TensorFlow, is now available for download. Highlight includes: TensorRT 8.2 Optimizations for T5 and GPT-2 deliver real time translati…

1 47 December 2, 2021
Best practices for reporting an issue or bug relating to TensorRT
0 3827 September 21, 2018
TorchPoints3D PointNet2 Deploy to TensorRT with Custom Plugin
jetson
0 34 December 3, 2021
In TensorRT, Is it possible to parse Caffe model using binarized deploy prototxt file instead of plain text prototxt?
caffe
1 40 December 3, 2021
Is it possible to share work load between GPU and CPU?
tensorrt
1 77 December 3, 2021
TensorRT 8.0 Refitting Verbosity
tensorrt
1 83 December 3, 2021
TensorRT with BART
0 39 December 2, 2021
Cuda transfer from device to host is extremely slow
cuda
2 58 December 2, 2021
Assertion failed: stride overflow
8 456 December 2, 2021
TRT8 - PTQ using integrated Q\DQ nodes inside the PyTorch model (Explicit) Vs. PTQ using calibration based IInt8EntropyCalibrator2 (Implicit))
2 75 December 2, 2021
Run inference on a batch of images & parallel inference using cuda on python threads
tensorrt ,  cuda
4 166 December 1, 2021
TensorRT 8.0.3 imagenet resnet model INT8 conversion identical output with different input after calibration
tensorrt
2 70 December 1, 2021
TensorRT Batch Inference: different results
4 525 December 1, 2021
RuntimeError: CUDA error: invalid configuration argument
tensorrt
1 74 December 1, 2021
Int8 get the same result, but in FP16 the result is correct
1 69 December 1, 2021
Is there any layer that fp16 supports but int8 does not？
5 119 December 1, 2021
TensorRT Parsing ONNX Model Error
tensorrt
5 251 December 1, 2021
Using latest tensorRT 8.2.1, but can't find EngineInspector API
3 87 November 30, 2021
What Object Detection model is better or most used with embedded Nvidia devices (Jetson Xavier NX)?
tensorrt ,  jetson-inference
1 72 November 30, 2021
TensorRT model giving constant output
deepstream
4 120 November 30, 2021
Low utilization of Tensor RT cores
20 593 November 30, 2021
Lstm model can not have more than one optimization profile
4 251 November 29, 2021
Comaptibility Of TensorRT with Windows 11 Professional
1 73 November 30, 2021
Is there any common way to check output dimensions of any layer?
1 68 November 30, 2021
[polygraphy + transformer model] mark all tensorrt nodes as output crashes
3 141 November 30, 2021
The model killed when I try to run torch2trt converted file
tensorrt
2 120 November 30, 2021
Set the model repository to S3
inference-server-triton
1 106 November 30, 2021
No symbol file loaded for cudnn64_8.dll (Could not load library cudnn_cnn_infer64_8.dll. Error code 126)
tensorrt
1 198 November 30, 2021
How to create DALI batch of combination of two different videos together
1 97 November 29, 2021
Does network pruning speed up inference speed?
3 111 November 29, 2021