I have an ONNX model created successfully from source algorithm, there are no errors in ONNX creation, I verified the ONNX model using ONNX checker.
Using this ONNX model I am able to create TRT engine and run inference successfully on Tesla T4, Quadro P1000 but, when I try to create the TRT engine on Jetson AGX Xavier board it fails with the error:
[TensorRT] ERROR: …/builder/cudnnBuilderBlockChooser.cpp (117) - Assertion Error in buildMemGraph: 0 (mg.nodes[mg.regionIndices[outputRegion]].size == mg.nodes[mg.regionIndices[inputRegion]].size)
- The ONNX model created, takes 2 inputs with dynamic shapes, the optimization profiles are defined for both the inputs
- When both the inputs are of fixed dimensions the TRT engine is created without any errors even on Jetson AGX Xavier
- TRT engine with 2 dynamic shape inputs is created successfully on Tesla T4, Quadro P1000 but fails on Jetson AGX Xavier
Jetson AGX Xavier with Jetpack 4.5.1 installed