In onnx2tensorrt conversion process, I found tensor volume error message
Error Code 4: Internal Error ((Unnamed Layer* 394) [LoopOutput]_output: tensor volume exceeds (2^31)-1, dimensions are [2147483647,1,256]) While parsing node
As I heard TRT supports tensor at most 2G elements.
I want to know how much size(volume) I have to reduce for my model
How can I check the exceeded volume size?
Request you to share the ONNX model and the script if not shared already so that we can assist you better.
Alongside you can try few things:
- validating your model with the below snippet
filename = yourONNXmodel
model = onnx.load(filename)
2) Try running your model with trtexec command.
In case you are still facing issue, request you to share the trtexec “”–verbose"" log for further debugging