Please provide complete information as applicable to your setup. • Hardware Platform (Jetson / GPU) Jetson Orin NX • DeepStream Version 6.1.1 • JetPack Version (valid for Jetson only) 5.0.2 • TensorRT Version 8.4.1 • NVIDIA GPU Driver Version (valid for GPU only) 35.1.0 • CUDA version CU…

Hello everyone, I feel I’ve learned more than I ever wanted to about TensorRT. Ultimately, TensorRT is finicky. It’s not guaranteed work with every PyTorch model because there are various network operations that TensorRT doesn’t know how to handle (e.g., bias=False, padding, views, etc.) You eit…

Hello, The failure happens in trtexec, let’s move this topic to TensorRT forum for better service, thanks.

Hi, Are you facing the same error on latest TensorRT version 8.5.2? Thank you.

Hello, I didn’t want to try TensorRT 8.5.2 because I’m using DeepStream 6.1.1; DeepStream 6.1.1 comes packaged with TensorRT 8.4.1. I’m not sure if an engine file created by TensorRT 8.5.2 would work with DeepStream 6.1.1. Please let me know if I am mistaken. Thank you.

Could you please share with us the minimal issue repro ONNX model here or via DM for better debugging. Thank you

Hello, Thank you for your help. The ONNX file is larger than the limit for uploaded files. However, you should be able to easily reproduce my error because none of the torchvision models have worked for me. In particular, a dummy retinanet model should give you the error in DeepStream and in Ten…

Cannot Deploy PyTorch Model on DeepStream

AI & Data Science Deep Learning (Training & Inference) TensorRT

system Closed February 27, 2023, 4:01pm 14

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
Unable to convert torchvision model to TRT engine compatible with latest version of deepstream on Jetson DeepStream SDK tensorrt , pytorch , jetson , deepstream	10	1074	June 6, 2023
Migrating DeepStream 5.0 competible model to 6.1/6.0.1/.6.0 TensorRT	1	388	August 22, 2022
Problem deploying trtpose on deepstream DeepStream SDK	3	104	August 27, 2024
Deepstream DeepStream SDK deepstream	7	66	January 19, 2026
Problem converting trt pose to onnx model TensorRT jetson , deepstream	1	131	July 31, 2024
Issue with Converting ONNX Model with different dimensions to TensorRT Engine for DeepStream DeepStream SDK deepstream	22	687	May 23, 2025
Torch-TensorRT with Deepstream 6.0 on Jetson DeepStream SDK tensorrt , jetson	2	1249	March 25, 2022
I have a custom trained pytorch model in .pt format, how can I give this as an input for deepstream python apps DeepStream SDK pytorch , python , deepstream61	6	885	October 8, 2022
Where can you set the Pytorch model function called by Triton for a Deepstream app? DeepStream SDK	2	388	March 16, 2023
Using Torch model without conversion DeepStream SDK	5	906	October 12, 2021

Cannot Deploy PyTorch Model on DeepStream

Related topics