TensorRT

Topic	Replies	Views	Activity
TensorRT 8.2 and Framework Integrations are out now! tensorrt The latest release of TensorRT, 8.2 GA, and TensorRT Integrations for PyTorch and TensorFlow, is now available for download. Highlight includes: TensorRT 8.2 Optimizations for T5 and GPT-2 deliver real time translati…	4	6244	January 10, 2025
Best practices for reporting an issue or bug relating to TensorRT	0	9019	September 21, 2018
Request for Eligibility Review — Inception application declined without a stated reason inception	4	29	July 16, 2026
INT8 Tensor Core corruption on Turing sm_75 cuBLAS llama.cpp BPE tokenizer tensorrt , cuda , cudnn , cublas , llama	0	14	July 16, 2026
AOT tensorrt.plugin reloads plugin PTX via cuModuleLoadData on every enqueue in dynamic-shape engines cudnn	0	23	July 13, 2026
TensorRT-RTX bugs	0	31	July 12, 2026
[Test] Hey There, Need some Help	7	76	July 7, 2026
Compute bottleneck evaluating multiple trajectories through a 7B VLM (VLA Architecture Design) tensorrt , cuda , nemo , llm	3	61	June 30, 2026
TensorRT Q/DQ: how to keep Gather in INT8	1	31	June 30, 2026
Dynamic shapes not dynamic at all tensorrt , cudnn	1	38	June 30, 2026
TensorRT inferior scalability on A10, L4 possibly due to locking issues	4	105	June 28, 2026
On Board Gpu cudnn	2	43	June 19, 2026
Latency Gains using TensorRT	1	60	June 19, 2026
2:4 sparsity doesnot improve inference performance on RTX 3090 tensorrt	15	3761	June 4, 2026
Request for NVIDIA NIM API Rate Limit Increase (40 → 200 RPM) nim , agentic-ai , deepseek	3	187	June 4, 2026
Tensorflow Container for use on H200? cudnn	4	116	June 2, 2026
Problem with accessing resources: TensorRT libraries not found. Check that current user has access to GPU camera	1	60	May 30, 2026
TensorRT Custom Plugin Produces Non-Deterministic Results with Identical Inputs Across 20 Iterations cuda , kernel , cudnn	1	59	May 30, 2026
Adivce regarding batch size, multiple cameras and large image buffers	3	69	May 30, 2026
ONNX model with less nodes or simplified runs slower	1	61	May 30, 2026
Strange changes in file size when deployed with tensorrt tensorrt	9	1010	May 30, 2026
Windows 11 + WSL2 Docker Desktop + RTX 5060 Ti 16GB: System GUI severe lag after idle hours with AI inference running (nvlddmkm.sys high DPC latency) cuda , kernel , ubuntu , gaming	3	254	May 30, 2026
Fail to Build the TRT Engine of a multi-GatherND ONNX Model for large input volume tensorrt , cudnn , onnx	1	67	May 30, 2026
Question Regarding INT8 Accuracy Degradation on Turing GPUs with TensorRT 10.11 tensorrt , yolo , cudnn	2	143	May 20, 2026
TRT 10.14: dynamic-shape InstanceNormalization crashes with CUDA 720 in __myl_Inor kernel cudnn , deepstream	4	106	May 11, 2026
Request to enable "Public API Endpoints" permission for my personal organization ai-training , chinese , nim	2	215	May 8, 2026
Missing Public API Endpoints permission in Personal Organization – 403 Forbidden on integrate.api.nvidia.com	1	358	April 30, 2026
Deploying spconv-based 3D detection model (PillarNet) with TensorRT on aarch64 GB10 — libspconv SM120 missing	5	260	April 30, 2026
Error Code: 9: Skipping tactic 0x001526e231ae2e51 due to exception Cask convolution execution tensorrt	3	397	April 30, 2026
[CUDA][WSL2][MPS] CUDA OOM with >14 MPI ranks under WSL2; MPS not starting cuda	2	237	April 30, 2026

TensorRT 8.2 and Framework Integrations are out now!

tensorrt

The latest release of TensorRT, 8.2 GA, and TensorRT Integrations for PyTorch and TensorFlow, is now available for download. Highlight includes: TensorRT 8.2 Optimizations for T5 and GPT-2 deliver real time translati…