[Xavier] Can't find the TensorRT for Cuda11.8

[shehroz.khan1]

I’m currently running JetPack 5.1.1 with CUDA 11.4. I recently upgraded CUDA to version 11.8 following the official NVIDIA documentation. However, when I check the TensorRT version, it still shows 8.5.2.2-1+cuda11.4, indicating it’s tied to CUDA 11.4. I’d like to upgrade TensorRT to work with CUDA 11.8, but I haven’t been able to find the appropriate installation files.

Does anyone know where I can find the TensorRT installation package compatible with CUDA 11.8, or provide guidance on how to proceed?

[AastaLLL]

Hi,

Only CUDA can be upgraded on the JetPack 5.
We don’t have TensorRT, which is built for CUDA 11.8 for JetPack users.

Thanks.

[maximilian.schempp1]

I find that very frustrating.
Does that mean that if we want to use tensorrt on Xavier devices, we have to use CUDA 11.4?

Could you maybe explain the reason why that is? because there is tensorrt 10 for CUDA 11.8 for x86_64 platforms

[AastaLLL]

Hi,

Unfortunately, you will need to use the Orin series to get the TensorRT 10 support.
The latest TensorRT software for Xavier is 8.5.

Thanks.

[maximilian.schempp1]

Thats fine. I was just trying to understand why it is not possible to get TensorRT 8.5 with Cuda 11.8 on jetson Xavier, if its generally possible with CUDA 11.8 (even with tensorrt 10).

Its also generally possible for CUDA 11.8 and TensorRT 8.5 - see Log in | NVIDIA Developer

but not for Xavier - and that is what my question was about:

Why not for xavier?

[AastaLLL]

Hi,

We don’t have such a package.

On JetPack 5, all the packages are fixed and tested together. (CUDA is an experimental feature)
From JetPack 6, with some design changes, we start to support the upgradable AI software stack.

Thanks.