Another issue I noticed is, I think polygraphy is not supported for Jetson Embedded Environment; I found that it failed to install its dependencies. Although I was able to install it on a host system. I need to deploy this model on one such Jetson device and I think Polygraphy wouldn’t suffice here.
Have you tried polygraphy tool mentioned above on your host and facing the same issue with new ONNX model ?
yes that’s exactly what I did and got the same errror.
Could you please share us issue repro new onnx model.
Here it is. Google Drive: Sign-in
Could you please provide access.
Sorry for the delay but done so. Please check
We could reproduce the same error after trying polygraphy tool as well,
I think the issue here is that the
K value is computed at runtime, which is not supported by TRT.
So TensorRT+ONNX isn’t capable of solving this ?
Its currently not supported by TRT.