Tensor rt confused about version

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

Description

I created a tensor rt engine on my pc using trt 6. I then tried to run it on my xavier agx also using trt 6. But the error I am getting is:

“the engine plan file is generated on an incompatible device, expecting compute 7.2 got compute 7.5, please rebuild”

at no point did I use trt 7. How do I fix this bug?

2

Hi @iviti,
The generated plan files are not portable across platforms or TensorRT versions. Plans are specific to the exact GPU model they were built on (in addition to the platforms and the TensorRT version) and must be re-targeted to the specific GPU in case you want to run them on a different GPU.
Thanks!