Network has dynamic or shape inputs, but no optimization profile has been defined

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

Please provide the following info (check/uncheck the boxes after creating this topic):
Software Version
DRIVE OS Linux 5.2.6
[k] DRIVE OS Linux 5.2.6 and DriveWorks 4.0
DRIVE OS Linux 5.2.0
DRIVE OS Linux 5.2.0 and DriveWorks 3.5
NVIDIA DRIVE™ Software 10.0 (Linux)
NVIDIA DRIVE™ Software 9.0 (Linux)
other DRIVE OS version
other

Target Operating System
[k] Linux
QNX
other

Hardware Platform
[k] NVIDIA DRIVE™ AGX Xavier DevKit (E3550)
NVIDIA DRIVE™ AGX Pegasus DevKit (E3550)
other

SDK Manager Version
[k] 1.9.1.10844
other

Host Machine Version
[k] native Ubuntu 18.04
other

While using TesorRT Optimisation Tool. Getting error.
Converted keras tensorflow model to onnx model and trying to optimise onnx model.
Error and onnx model attached.

Error
Error1299×741 169 KB

Mar3_3.onnx (1.9 MB)

2

Hi,
Request you to share the ONNX model and the script if not shared already so that we can assist you better.
Alongside you can try few things:

  1. validating your model with the below snippet

check_model.py

import sys
import onnx
filename = yourONNXmodel
model = onnx.load(filename)
onnx.checker.check_model(model).
2) Try running your model with trtexec command.

In case you are still facing issue, request you to share the trtexec “”–verbose"" log for further debugging
Thanks!

5

How to share the trtexec “”–verbose"" log.
I am attaching screenshot of error.

Screenshot from 2023-03-10 16-19-46
Screenshot from 2023-03-10 16-19-461299×741 149 KB

6

Still facing the same issue.
Attaching the log file for debugging.
Check you help me for proceeding further.
log.txt (3.5 KB)

7

When using runtime dimensions, you must create at least one optimization profile at build time. Please refer below link:

https://github.com/NVIDIA/TensorRT/blob/master/samples/opensource/sampleDynamicReshape/sampleDynamicReshape.cpp#L153

Supported data format in TRT:

Thanks

8

Thanks @AakankshaS for information.
Could you help me how to create optimization profiles, if possible, share along with example model and optimization profile.

9

Hi @alksainath.medam ,
Please refer to the following link for better understanding

Thanks

1 Like