Hi, I have converted my model from onnx to TensorRT using Onnx2trt successfully. However I found out that there are two kinds of surfixs can be used, which are .trt and .engine. I wonder is there any difference between them or they are just the same thing?
One more thing that I met is that when I transferred the model from one device to another(The environment and Graphic Card are exactly the same). Only the models with .engine surfix can be deserialized and the model with “.trt” surfix will return the Error like below:
Hi,
Request you to share the ONNX model and the script if not shared already so that we can assist you better.
Alongside you can try few things:
validating your model with the below snippet
check_model.py
import sys
import onnx
filename = yourONNXmodel
model = onnx.load(filename)
onnx.checker.check_model(model).
2) Try running your model with trtexec command. https://github.com/NVIDIA/TensorRT/tree/master/samples/opensource/trtexec
In case you are still facing issue, request you to share the trtexec “”–verbose"" log for further debugging
Thanks!
Hi, thank you for your reply.
However, the model files(either onnx models or TensorRT models) are the secrets of the company and has been encrypted.
So the only question is: How does the surfix(.trt and .engine) influence the structure or the behavior of the model?
TRT does not recognize the extension of file.
As long as it is TRT engine plan file, any extension can be used. Issue you’re facing could be different one.
Looks like you’re using older version, we recommend you to please try on latest TensorRT version 8.2 EA.
