I have an Onnx model that was generated from PyTorch.
After parser successfully completion, while the TRT engine start its optimization the following runtime error is raised:
2: [optimizer.cpp::isPolymorphic::1018] Error Code 2: Internal Error (Assertion asCopyingLeafNode() ? candidateChoices.empty() : !candidateChoices.empty() failed.)
TensorRT Version: 8.0.1, c++ version
GPU Type: GeForce GTX 1080
Nvidia Driver Version: 460.32.03
CUDA Version: 11.2
CUDNN Version: 8.2.1
Operating System + Version: Linux Ubuntu 18.04
Python Version (if applicable): NA
TensorFlow Version (if applicable): NA
PyTorch Version (if applicable): 1.9
Baremetal or Container (if container which image + tag): Baremetal
ONNX IR version: 0.0.6
Opset version: 13
I couldn’t load the model, each time I tried I got an error.
Is there a size limitation of loadable files?
My model size is ~120MB.
You only need to load the onnx file into the TRT and set the following:
Input name - input.1
Output name - 1651
And activate the parser and buildEngineWithConfig.
Attached is all TRT runtime reports during the running:
LogFile0_Error.txt (707.7 KB)
I saw one strange report:
Setting dynamic range is only allowed when there are no Q/DQ layers in the Network
Please clarify it.
Is there any relation to the topic error?