Please provide complete information as applicable to your setup.
• Hardware Platform (Jetson / GPU)
Jetson Orin NX
• DeepStream Version
6.1.1
• JetPack Version (valid for Jetson only)
5.0.2
• TensorRT Version
8.4.1
• NVIDIA GPU Driver Version (valid for GPU only)
35.1.0
• CUDA version
CUDA 11.4
• Issue Type( questions, new requirements, bugs)
bugs
• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)
Hello,
I’m having trouble deploying a PyTorch model on DeepStream. I am using a Jetson Orin NX with Jetpack v. 5.0.2 (TensorRT v. 8.4.1 ) and DeepStream v. 6.1.1; I developed a retina_resnet50_fpn model in PyTorch v. 1.13 and exported it to an onnx model. However, I have not been able to get the onnx model to run on DeepStream; I also have not been able to convert the onnx model to a trt engine using trtexec.
I tried to resolve my issue by following the solution in IShuffleLayer applied to shape tensor must have 0 or 1 reshape dimensions: dimensions were [-1,2]) because I see the same error message after running trtexec. Unfortunately, I still could not convert my onnx model to a trt engine after running polygraph surgeon sanitize –fold-constants. I’ve tried using the DeepSteam container and using torch2trt and other PyTorch models (e.g., resnet50) with varying opset versions (11 and 13), but I have not had success so far. I would greatly appreciate your assistance. Thank you.
Please the see attached files for the complete error messages from DeepStream and trtexec. I’ve included the most relevant part of the error message from trtexec below for your convenience:
(Running trtexec)
[6] Invalid Node - /transform/Pad
[shuffleNode.cpp::symbolicExecute::392] Error Code 4: Internal Error (/transform/Reshape: IShuffleLayer applied to shape tensor must
have 0 or 1 reshape dimensions: dimensions were [-1,2])