[BUG] DOS 6081 docker missing nv-tensorrt-repo-ubuntu2004-cuda11.4-trt8.6.11.4-x86 debs

Required Info:

  • Software Version
    DRIVE OS 6.0.8.1
  • Target OS
    Linux
  • SDK Manager Version
    1.9.2.10884
  • Host Machine Version
    native Ubuntu Linux 20.04 Host installed with DRIVE OS DOCKER Containers

Describe the bug

The tensorrt host and cross development repo file has been detected in DOS 6081 docker, but some of the debs has been deleted and blocks the tensorrt development, debug and optimization. Typically we need

To Reproduce

there is a big repo files for host and cross development tools. but the debs has been deleted.

zs@in-sdk-docker:/gw_demo$ dpkg -l | grep tensorrt
ii  nv-tensorrt-repo-ubuntu2004-cuda11.4-trt8.6.11.4-d6l-cross-ga-20230615         1-1                               amd64        nv-tensorrt repository configuration files
ii  nv-tensorrt-repo-ubuntu2004-cuda11.4-trt8.6.11.4-x86-host-ga-20230615          1-1                               amd64        nv-tensorrt repository configuration files
ii  tensorrt                                                                       8.6.11.4-1+cuda11.4               amd64        Meta package for TensorRT
ii  tensorrt-cross-aarch64                                                         8.6.11.4-1+cuda11.4               all          Meta package for TensorRT cross enablement

zs@in-sdk-docker:/gw_demo$ ll /var/nv-tensorrt-repo-ubuntu2004-cuda11.4-trt8.6.11.4-x86-host-ga-20230615/
total 32
drwxr-xr-x 2 root root 4096 Aug 28 14:24 ./
drwxr-xr-x 1 root root 4096 Aug 28 14:21 ../
-rw-r--r-- 1 root root 1619 Jun 15  2023 7f9add6c.pub
-rw-r--r-- 1 root root 7749 Jun 15  2023 Packages.gz
-rw-r--r-- 1 root root  569 Jun 15  2023 Release
-rw-r--r-- 1 root root  801 Jun 15  2023 Release.gpg

Thus, we cannot install some of tensorrt tools.

zs@in-sdk-docker:/gw_demo$ apt-cache search onnx-graph
onnx-graphsurgeon - ONNX GraphSurgeon for TensorRT package

zs@in-sdk-docker:/gw_demo$ sudo apt install onnx-graphsurgeon
Reading package lists... Done
Building dependency tree       
Reading state information... Done
The following packages were automatically installed and are no longer required:
  gcc-9-multilib lib32asan5 lib32gcc-9-dev lib32ubsan1 libx32asan5 libx32gcc-9-dev libx32ubsan1
Use 'sudo apt autoremove' to remove them.
The following NEW packages will be installed:
  onnx-graphsurgeon
0 upgraded, 1 newly installed, 0 to remove and 91 not upgraded.
Need to get 0 B/28.6 kB of archives.
After this operation, 146 kB of additional disk space will be used.
Get:1 file:/var/nv-tensorrt-repo-ubuntu2004-cuda11.4-trt8.6.11.4-x86-host-ga-20230615  onnx-graphsurgeon 8.6.11.4-1+cuda11.4 [28.6 kB]
Err:1 file:/var/nv-tensorrt-repo-ubuntu2004-cuda11.4-trt8.6.11.4-x86-host-ga-20230615  onnx-graphsurgeon 8.6.11.4-1+cuda11.4
  File not found - /var/nv-tensorrt-repo-ubuntu2004-cuda11.4-trt8.6.11.4-x86-host-ga-20230615/./onnx-graphsurgeon_8.6.11.4-1+cuda11.4_amd64.deb (2: No such file or directory)
E: Failed to fetch file:/var/nv-tensorrt-repo-ubuntu2004-cuda11.4-trt8.6.11.4-x86-host-ga-20230615/./onnx-graphsurgeon_8.6.11.4-1+cuda11.4_amd64.deb  File not found - /var/nv-tensorrt-repo-ubuntu2004-cuda11.4-trt8.6.11.4-x86-host-ga-20230615/./onnx-graphsurgeon_8.6.11.4-1+cuda11.4_amd64.deb (2: No such file or directory)
E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?

Expected behavior

we can use all of tensorrt tools provided by nvidia, to develop deep learning apps in the DriveAGX Devkits.
Some of the tools include but not limited to the following:

  • graphsurgeon-tf_
  • onnx-graphsurgeon_
  • uff-converter

Actual behavior

there lacks of some tools in the DOS 6081 docker.

zs@in-sdk-docker:/gw_demo$ dpkg -l | grep graphsurgeon
zs@in-sdk-docker:/gw_demo$

Additional context

In DOS 6060, there can see the debs of tensorrt, which disappear in the DOS 6081.

Dear @lizhensheng,
I could reproduce the issue.

Could you share the missing debs and path to these debians on 6.0.6 docker?

Thank your for your confirmation of this issue.

the deb info is in the following:

PS E:\Downloads\nv-tensorrt-repo-ubuntu2004-cuda11.4-trt8.5.10.4-x86-host-ga-20221229> ls


    目录: E:\Downloads\nv-tensorrt-repo-ubuntu2004-cuda11.4-trt8.5.10.4-x86-host-ga-20221229


Mode                 LastWriteTime         Length Name
----                 -------------         ------ ----
-a----        2022-12-29     11:40           1619 91acf5b1.pub
-a----        2022-12-29     11:40          14620 graphsurgeon-tf_8.5.10-1+cuda11.4_amd64.deb
-a----        2022-12-29     11:40         174548 libnvinfer-bin_8.5.10-1+cuda11.4_amd64.deb
-a----        2022-12-29     11:40       16496054 libnvinfer-checker-dev_8.5.10-1+cuda11.4_amd64.deb
-a----        2022-12-29     11:40       11342086 libnvinfer-checker8_8.5.10-1+cuda11.4_amd64.deb
-a----        2022-12-29     11:40      168897896 libnvinfer-dev_8.5.10-1+cuda11.4_amd64.deb
-a----        2022-12-29     11:40        7656266 libnvinfer-plugin-dev_8.5.10-1+cuda11.4_amd64.deb
-a----        2022-12-29     11:40        7541902 libnvinfer-plugin8_8.5.10-1+cuda11.4_amd64.deb
-a----        2022-12-29     11:40        7459742 libnvinfer-safe-dev_8.5.10-1+cuda11.4_amd64.deb
-a----        2022-12-29     11:40         247858 libnvinfer-safe-samples_8.5.10-1+cuda11.4_all.deb
-a----        2022-12-29     11:40        6732150 libnvinfer-safe8_8.5.10-1+cuda11.4_amd64.deb
-a----        2022-12-29     11:40      446607280 libnvinfer-samples_8.5.10-1+cuda11.4_all.deb
-a----        2022-12-29     11:40      151687360 libnvinfer8_8.5.10-1+cuda11.4_amd64.deb
-a----        2022-12-29     11:40         461696 libnvonnxparsers-dev_8.5.10-1+cuda11.4_amd64.deb
-a----        2022-12-29     11:40         744392 libnvonnxparsers8_8.5.10-1+cuda11.4_amd64.deb
-a----        2022-12-29     11:40        1830606 libnvparsers-dev_8.5.10-1+cuda11.4_amd64.deb
-a----        2022-12-29     11:40         838260 libnvparsers8_8.5.10-1+cuda11.4_amd64.deb
-a----        2022-12-29     11:40          29432 onnx-graphsurgeon_8.5.10-1+cuda11.4_amd64.deb
-a----        2022-12-29     11:41           5628 Packages.gz
-a----        2022-12-29     11:40           3618 python3-libnvinfer-dev_8.5.10-1+cuda11.4_amd64.deb
-a----        2022-12-29     11:40         591288 python3-libnvinfer_8.5.10-1+cuda11.4_amd64.deb
-a----        2022-12-29     11:41            569 Release
-a----        2022-12-29     11:41            801 Release.gpg
-a----        2022-12-29     11:40           3606 tensorrt-dev_8.5.10.4-1+cuda11.4_amd64.deb
-a----        2022-12-29     11:40           3606 tensorrt-libs_8.5.10.4-1+cuda11.4_amd64.deb
-a----        2022-12-29     11:40           3618 tensorrt-safe_8.5.10.4-1+cuda11.4_amd64.deb
-a----        2022-12-29     11:40           3626 tensorrt_8.5.10.4-1+cuda11.4_amd64.deb
-a----        2022-12-29     11:40          27128 uff-converter-tf_8.5.10-1+cuda11.4_amd64.deb
PS E:\Downloads\nv-tensorrt-repo-ubuntu2004-cuda11.4-trt8.5.10.4-d6l-cross-ga-20221229> ls


    目录: E:\Downloads\nv-tensorrt-repo-ubuntu2004-cuda11.4-trt8.5.10.4-d6l-cross-ga-20221229


Mode                 LastWriteTime         Length Name
----                 -------------         ------ ----
-a----        2022-12-29     11:33           1619 91acf5b1.pub
-a----        2022-12-29     11:33       11246210 libnvinfer-checker-dev-cross-aarch64_8.5.10-1+cuda11.4_all.deb
-a----        2022-12-29     11:33        6760462 libnvinfer-checker8-cross-aarch64_8.5.10-1+cuda11.4_all.deb
-a----        2022-12-29     11:33       87418744 libnvinfer-dev-cross-aarch64_8.5.10-1+cuda11.4_all.deb
-a----        2022-12-29     11:33        5569490 libnvinfer-plugin-dev-cross-aarch64_8.5.10-1+cuda11.4_all.deb
-a----        2022-12-29     11:33        5449670 libnvinfer-plugin8-cross-aarch64_8.5.10-1+cuda11.4_all.deb
-a----        2022-12-29     11:33        4440666 libnvinfer-safe-dev-cross-aarch64_8.5.10-1+cuda11.4_all.deb
-a----        2022-12-29     11:33         247858 libnvinfer-safe-samples_8.5.10-1+cuda11.4_all.deb
-a----        2022-12-29     11:33        4028134 libnvinfer-safe8-cross-aarch64_8.5.10-1+cuda11.4_all.deb
-a----        2022-12-29     11:33      446624024 libnvinfer-samples_8.5.10-1+cuda11.4_all.deb
-a----        2022-12-29     11:33       76584550 libnvinfer8-cross-aarch64_8.5.10-1+cuda11.4_all.deb
-a----        2022-12-29     11:33         420036 libnvonnxparsers-dev-cross-aarch64_8.5.10-1+cuda11.4_all.deb
-a----        2022-12-29     11:33         633000 libnvonnxparsers8-cross-aarch64_8.5.10-1+cuda11.4_all.deb
-a----        2022-12-29     11:33        1774802 libnvparsers-dev-cross-aarch64_8.5.10-1+cuda11.4_all.deb
-a----        2022-12-29     11:33         732976 libnvparsers8-cross-aarch64_8.5.10-1+cuda11.4_all.deb
-a----        2022-12-29     11:34           4355 Packages.gz
-a----        2022-12-29     11:34            569 Release
-a----        2022-12-29     11:34            801 Release.gpg
-a----        2022-12-29     11:33           3650 tensorrt-cross-aarch64_8.5.10.4-1+cuda11.4_all.deb
-a----        2022-12-29     11:33           3666 tensorrt-dev-cross-aarch64_8.5.10.4-1+cuda11.4_all.deb
-a----        2022-12-29     11:33           3670 tensorrt-libs-cross-aarch64_8.5.10.4-1+cuda11.4_all.deb
-a----        2022-12-29     11:33           3650 tensorrt-safe-cross-aarch64_8.5.10.4-1+cuda11.4_all.deb

Dear @lizhensheng,
As I understand, you have shared the output from host and not in docker. Am I right? I could not find onnx surgeon deb in 6.0.6 docker as well.

The files can be found in the debs from sdk-manager.

The sdk-manager automatically downloads the debs.

For tensorrt debs, there are two debs named nv-tensorrt-repo-ubuntu2004-cuda11.4-trt8.5.10.4-x86-host-ga-20221229_1-1_amd64.deb and nv-tensorrt-repo-ubuntu2004-cuda11.4-trt8.5.10.4-d6l-cross-ga-20221229_1-1_amd64.deb

but as this topic said SDK Manager error: Access to APT repository and ability to install Debian packages with it: Your system is not ready for install , from DOS6081, the sdk-manager installation is no longer available.

So, I think the capability of installing these tools has been lost.

Could you clarify if it’s possible to provide these debs to nvidia drive agx developer?

@SivaRamaKrishnaNV

Yes. I am checking on this team and update you

1 Like

Dear @lizhensheng,
Please download nv-tensorrt-repo-ubuntu2004-cuda11.4-trt8.6.11.4-x86-host-ga-20230615_1-1_amd64.deb from https://registry.ngc.nvidia.com/orgs/drive/teams/driveos-sdk/resources/driveos_sdk/files and check installing

root@6.0.8.1-0006-build-linux-sdk:/home/nvidia# sudo dpkg -i nv-tensorrt-repo-ubuntu2004-cuda11.4-trt8.6.11.4-x86-host-ga-20230615_1-1_amd64.deb
(Reading database ... 65718 files and directories currently installed.)
Preparing to unpack nv-tensorrt-repo-ubuntu2004-cuda11.4-trt8.6.11.4-x86-host-ga-20230615_1-1_amd64.deb ...
Unpacking nv-tensorrt-repo-ubuntu2004-cuda11.4-trt8.6.11.4-x86-host-ga-20230615 (1-1) over (1-1) ...
Setting up nv-tensorrt-repo-ubuntu2004-cuda11.4-trt8.6.11.4-x86-host-ga-20230615 (1-1) ...
root@6.0.8.1-0006-build-linux-sdk:/home/nvidia# sudo apt install onnx-graphsurgeon
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following packages were automatically installed and are no longer required:
  gcc-9-multilib lib32asan5 lib32gcc-9-dev lib32ubsan1 libx32asan5 libx32gcc-9-dev libx32ubsan1
Use 'sudo apt autoremove' to remove them.
The following NEW packages will be installed:
  onnx-graphsurgeon
0 upgraded, 1 newly installed, 0 to remove and 129 not upgraded.
Need to get 0 B/28.6 kB of archives.
After this operation, 146 kB of additional disk space will be used.
Get:1 file:/var/nv-tensorrt-repo-ubuntu2004-cuda11.4-trt8.6.11.4-x86-host-ga-20230615  onnx-graphsurgeon 8.6.11.4-1+cuda11.4 [28.6 kB]
debconf: delaying package configuration, since apt-utils is not installed
Selecting previously unselected package onnx-graphsurgeon.
(Reading database ... 65718 files and directories currently installed.)
Preparing to unpack .../onnx-graphsurgeon_8.6.11.4-1+cuda11.4_amd64.deb ...
Unpacking onnx-graphsurgeon (8.6.11.4-1+cuda11.4) ...
Setting up onnx-graphsurgeon (8.6.11.4-1+cuda11.4) ...

root@6.0.8.1-0006-build-linux-sdk:/home/nvidia# sudo apt install graphsurgeon-tf
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following packages were automatically installed and are no longer required:
  gcc-9-multilib lib32asan5 lib32gcc-9-dev lib32ubsan1 libx32asan5 libx32gcc-9-dev libx32ubsan1
Use 'sudo apt autoremove' to remove them.
The following NEW packages will be installed:
  graphsurgeon-tf
0 upgraded, 1 newly installed, 0 to remove and 129 not upgraded.
Need to get 0 B/14.8 kB of archives.
After this operation, 80.9 kB of additional disk space will be used.
Get:1 file:/var/nv-tensorrt-repo-ubuntu2004-cuda11.4-trt8.6.11.4-x86-host-ga-20230615  graphsurgeon-tf 8.6.11.4-1+cuda11.4 [14.8 kB]
debconf: delaying package configuration, since apt-utils is not installed
Selecting previously unselected package graphsurgeon-tf.
(Reading database ... 65750 files and directories currently installed.)
Preparing to unpack .../graphsurgeon-tf_8.6.11.4-1+cuda11.4_amd64.deb ...
Unpacking graphsurgeon-tf (8.6.11.4-1+cuda11.4) ...
Setting up graphsurgeon-tf (8.6.11.4-1+cuda11.4) ...
root@6.0.8.1-0006-build-linux-sdk:/home/nvidia# sudo apt install uff-converter-tf
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following packages were automatically installed and are no longer required:
  gcc-9-multilib lib32asan5 lib32gcc-9-dev lib32ubsan1 libx32asan5 libx32gcc-9-dev libx32ubsan1
Use 'sudo apt autoremove' to remove them.
The following NEW packages will be installed:
  uff-converter-tf
0 upgraded, 1 newly installed, 0 to remove and 129 not upgraded.
Need to get 0 B/27.3 kB of archives.
After this operation, 220 kB of additional disk space will be used.
Get:1 file:/var/nv-tensorrt-repo-ubuntu2004-cuda11.4-trt8.6.11.4-x86-host-ga-20230615  uff-converter-tf 8.6.11.4-1+cuda11.4 [27.3 kB]
debconf: delaying package configuration, since apt-utils is not installed
Selecting previously unselected package uff-converter-tf.
(Reading database ... 65767 files and directories currently installed.)
Preparing to unpack .../uff-converter-tf_8.6.11.4-1+cuda11.4_amd64.deb ...
Unpacking uff-converter-tf (8.6.11.4-1+cuda11.4) ...
Setting up uff-converter-tf (8.6.11.4-1+cuda11.4) ...

Let us know if you notice any issue.

1 Like

Thanks for your info and resource!

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.