Install TensorRt on Orin NX L4T 35.3.1

Hello,

I’m having trouble getting TensorRT to be recognized on my Jetson device and was hoping someone could offer some insight.

My Current Setup:

  • JetPack: 5.1
  • CUDA: 11.4.315
  • cuDNN: 8.6.0.166
  • OpenCV: 4.5 (compiled with CUDA support)

I attempted several different installation methods for TensorRT. I tried installing via the tar files and the deb packages, but I’m not completely sure if I did it correctly. In addition, when I run the following command:

sudo pip install tensorrt

the output shows it as being “already satisfied” (installed in /usr/lib/python3.8/dist-packages), and when I check the version using:

python3 -c "import tensorrt as trt; print(trt.__version__)"

I get the output: 8.5.2.2. However, when I inspect my system with jtop, it still seems to indicate that TensorRT is missing.

What is the correct procedure for installing TensorRT on a Jetson running JetPack 5.1?
Why does jtop not recognize TensorRT even though the Python check returns version 8.5.2.2?
Do I need to recompile OpenCV after installing TensorRT?

I would appreciate any help to resolve

Dear @andresjj252,

Do you see TensorRT installed using sudo dpkg -l | grep TensorRT ? This confirms the TRT package installation on target.

Could you please share the screenshot?