Tensorrt installation problem

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

Description

Hello NVIDIA Team,

I encountered a problem while installing TensorRT using the .deb package provided for local installation.

I followed the official instructions using the file:

nv-tensorrt-local-repo-ubuntu2004-8.5.3-cuda-11.8_1.0-1_amd64.deb

After running the installation steps:

sudo dpkg -i nv-tensorrt-local-repo-ubuntu2004-8.5.3-cuda-11.8_1.0-1_amd64.deb
sudo cp /var/nv-tensorrt-local-repo-/nv-tensorrt--keyring.gpg /usr/share/keyrings/
sudo apt update
sudo apt install tensorrt

I received unmet dependency errors for multiple packages such as:

libnvinfer8 (= 8.5.3-1+cuda11.8)

libnvinfer-plugin8

libnvonnxparsers8
and others.

The terminal output says:

E: Unable to correct problems, you have held broken packages.

I tried the same process twice after re-downloading the .deb file, but the result was the same.

Could you please help me identify the root cause of this issue or suggest any workaround?

Environment

TensorRT Version: nv-tensorrt-local-repo-ubuntu2004-8.5.3-cuda-11.8_1.0-1_amd64.deb
GPU Type:RTX 4000 ada
Nvidia Driver Version: 535.23.02
CUDA Version: 11.8
CUDNN Version: 8.6.0
Operating System + Version: ubuntu20.04
Python Version (if applicable):
TensorFlow Version (if applicable):
PyTorch Version (if applicable):
Baremetal or Container (if container which image + tag):

Relevant Files

Please attach or include links to any models, data, files, or scripts necessary to reproduce your issue. (Github repo, Google Drive, Dropbox, etc.)

Steps To Reproduce

Please include:

  • Exact steps/commands to build your repro
  • Exact steps/commands to run your repro
  • Full traceback of errors encountered

image
image925×400 82.1 KB

image
image878×689 105 KB

4

Hi @pmchelp512 ,

Here are a few potential causes and if you can help rule them out:

  1. Unmet dependencies: The deb package might be missing dependencies that are required for installation. You can try to resolve this by running sudo apt install -f to fix broken dependencies.

  2. Conflicting packages: There might be conflicting packages installed on your system that are preventing the installation of TensorRT. You can try to remove any conflicting packages using sudo apt remove <package_name>.

  3. Incorrect package version: The deb package might not be compatible with your system’s architecture or CUDA version. You can try to check the package version and architecture using dpkg -i nvtensorrtlocalrepoubuntu2004853cuda118101amd64.deb and verify that it matches your system’s configuration.

  4. Corrupted package: The deb package might be corrupted or incomplete. You can try to re-download the package from the official NVIDIA website and re-install it.

5

@pmchelp512, please take a look at item 3 at Installing TensorRT — NVIDIA TensorRT Documentation. While I know this is the latest TensorRT version installation guide not 8.5.3, the suggested steps are roughly the same for TensorRT 8.5.3 as well.

You will need to form the correct list of packages and then install the packages using their full versions. Here is an abbreviated example

version="8.5.3-1+cuda11.8"
sudo apt-get install \
libnvinfer-dev=${version} \
libnvinfer8=${version} \
...