Thanks. I can’t test for now, since I upgraded to TensorRT 8.5.1 and got new problem :(
Still gpu memory though. Seems all my problems related to magic gpu mem.
Hi, there:
I upgraded my Orin32 box from 8.4.1 TensorRT to 8.5.1, somehow trtexec no longer works. I followed the steps in your website for the TensorRT:
After install, trtexec can’t determine GPU memory use. So I decided to follow the cuda install instruction in above link. However, the problem is still here.
I rebooted the box and it has the same issue.
It has the same problem for many models which works at earlier TensortRt8.4.1
Thanks!
Here is the log file when running TrtExec command…