I am getting an error running on Jetpack 5.0.2 in a container (built by container_builder.
The error below appears to be related to the vpi version, so I tried installing the up to date VPI as part of the container build, that throws a bunch of version errors.
Error running image with “stock” container_builder yaml (download/install the reference graphs only)
Opening in BLOCKING MODE
gstnvtracker: Loading low-level lib at /opt/nvidia/deepstream/deepstream/lib/libnvds_nvmultiobjecttracker.so
gstnvtracker: Failed to open low-level lib at /opt/nvidia/deepstream/deepstream/lib/libnvds_nvmultiobjecttracker.so
dlopen error: /opt/nvidia/vpi2/lib64/priv/libcupva_host.so: undefined symbol: PvaQueueSubmit
gstnvtracker: Failed to initilaize low level lib.
2022-08-28 15:26:47.551 ERROR extensions/nvdsbase/nvds_scheduler.cpp@179: Failed to set GStreamer pipeline to PLAYING
Returned, stopping playback
This it the container builder logs from this build… Notice the issues with cuda and then version issues with VPI.
What is the right way to get a working jetson container for JP 5.0.2?
2022-08-28 11:53:18,682 - ContainerBuilder.container_builder.docker_manager.docker_manager - INFO - work folder: /home/pmsi/.cache/container_builder/.workfolder_393696 is ready
2022-08-28 11:53:18,682 - ContainerBuilder.container_builder.docker_manager.docker_manager - INFO - start build docker file /home/pmsi/.cache/container_builder/.dockerfile_393696
Step 1/12 : FROM nvcr.io/nvidia/deepstream-l4t:6.1-samples AS final_image
—> 6fc8884e47d9
Step 2/12 : ARG DEBIAN_FRONTEND=noninteractive
—> [Warning] The requested image’s platform (linux/arm64) does not match the detected host platform (linux/amd64) and no specific platform was requested
—> Running in a9bea9f13386
Removing intermediate container a9bea9f13386
—> f8fc1555e4a3
Step 3/12 : RUN set -xe; apt-get update && apt-get install -y --no-install-recommends rsync && rm -rf /var/lib/apt/lists/*
—> [Warning] The requested image’s platform (linux/arm64) does not match the detected host platform (linux/amd64) and no specific platform was requested
—> Running in 2749991d7a51
- apt-get update
Err:1 http://cuda-internal.nvidia.com/release-candidates/kitpicks/tensorrt-rel-8-4-tegra/8.4.0/004/repos/l4t/arm64 InRelease
Could not resolve ‘cuda-internal.nvidia.com’
Get:2 https://repo.download.nvidia.com/jetson/common r34.1 InRelease [2555 B]
Hit:3 Index of /ubuntu-ports focal InRelease
Get:4 Index of /ubuntu-ports focal-updates InRelease [114 kB]
Get:5 Index of /ubuntu-ports focal-backports InRelease [108 kB]
Get:6 Index of /ubuntu-ports focal-security InRelease [114 kB]
Get:7 https://repo.download.nvidia.com/jetson/common r34.1/main arm64 Packages [16.1 kB]
Get:8 Index of /ubuntu-ports focal-updates/multiverse arm64 Packages [9067 B]
Get:9 Index of /ubuntu-ports focal-updates/universe arm64 Packages [1118 kB]
Get:10 Index of /ubuntu-ports focal-updates/main arm64 Packages [1810 kB]
Get:11 Index of /ubuntu-ports focal-updates/restricted arm64 Packages [4571 B]
Get:12 Index of /ubuntu-ports focal-backports/main arm64 Packages [54.7 kB]
Get:13 Index of /ubuntu-ports focal-backports/universe arm64 Packages [27.4 kB]
Get:14 Index of /ubuntu-ports focal-security/restricted arm64 Packages [4330 B]
Get:15 Index of /ubuntu-ports focal-security/multiverse arm64 Packages [3253 B]
Get:16 Index of /ubuntu-ports focal-security/main arm64 Packages [1426 kB]
Get:17 Index of /ubuntu-ports focal-security/universe arm64 Packages [823 kB]
Fetched 5635 kB in 10s (550 kB/s)
Reading package lists… Done
W: Failed to fetch http://cuda-internal.nvidia.com/release-candidates/kitpicks/tensorrt-rel-8-4-tegra/8.4.0/004/repos/l4t/arm64/InRelease Could not resolve ‘cuda-internal.nvidia.com’
W: Some index files failed to download. They have been ignored, or old ones used instead. - apt-get install -y --no-install-recommends rsync
Reading package lists… Done
Building dependency tree
Reading state information… Done
The following packages were automatically installed and are no longer required:
cpp cpp-9 g+±9 gcc-9 gcc-9-base libasan5 libatomic1 libcc1-0 libgcc-9-dev
libisl22 libitm1 liblsan0 libmpc3 libmpfr6 libstdc+±9-dev libtsan0
libubsan1
Use ‘apt autoremove’ to remove them.
The following additional packages will be installed:
libpopt0
Suggested packages:
openssh-client openssh-server
The following NEW packages will be installed:
libpopt0 rsync
0 upgraded, 2 newly installed, 0 to remove and 113 not upgraded.
Need to get 328 kB of archives.
After this operation, 812 kB of additional disk space will be used.
Get:1 Index of /ubuntu-ports focal/main arm64 libpopt0 arm64 1.16-14 [25.1 kB]
Get:2 Index of /ubuntu-ports focal-updates/main arm64 rsync arm64 3.1.3-8ubuntu0.4 [303 kB]
Fetched 328 kB in 1s (386 kB/s)
debconf: delaying package configuration, since apt-utils is not installed
Selecting previously unselected package libpopt0:arm64.
(Reading database … 40246 files and directories currently installed.)
Preparing to unpack …/libpopt0_1.16-14_arm64.deb …
Unpacking libpopt0:arm64 (1.16-14) …
Selecting previously unselected package rsync.
Preparing to unpack …/rsync_3.1.3-8ubuntu0.4_arm64.deb …
Unpacking rsync (3.1.3-8ubuntu0.4) …
Setting up libpopt0:arm64 (1.16-14) …
Setting up rsync (3.1.3-8ubuntu0.4) …
invoke-rc.d: could not determine current runlevel
invoke-rc.d: policy-rc.d denied execution of start.
Created symlink /etc/systemd/system/multi-user.target.wants/rsync.service → /lib/systemd/system/rsync.service.
Processing triggers for systemd (245.4-4ubuntu3.16) …
Processing triggers for libc-bin (2.31-0ubuntu9.7) … - rm -rf /var/lib/apt/lists/auxfiles /var/lib/apt/lists/cuda-internal.nvidia.com_release-candidates_kitpicks_tensorrt-rel-8-4-tegra_8.4.0_004_repos_l4t_arm64_InRelease /var/lib/apt/lists/cuda-internal.nvidia.com_release-candidates_kitpicks_tensorrt-rel-8-4-tegra_8.4.0_004_repos_l4t_arm64_Packages.lz4 /var/lib/apt/lists/lock /var/lib/apt/lists/partial /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal-backports_InRelease /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal-backports_main_binary-arm64_Packages.lz4 /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal-backports_universe_binary-arm64_Packages.lz4 /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal-security_InRelease /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal-security_main_binary-arm64_Packages.lz4 /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal-security_multiverse_binary-arm64_Packages.lz4 /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal-security_restricted_binary-arm64_Packages.lz4 /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal-security_universe_binary-arm64_Packages.lz4 /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal-updates_InRelease /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal-updates_main_binary-arm64_Packages.lz4 /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal-updates_multiverse_binary-arm64_Packages.lz4 /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal-updates_restricted_binary-arm64_Packages.lz4 /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal-updates_universe_binary-arm64_Packages.lz4 /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal_InRelease /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal_main_binary-arm64_Packages.lz4 /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal_multiverse_binary-arm64_Packages.lz4 /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal_restricted_binary-arm64_Packages.lz4 /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal_universe_binary-arm64_Packages.lz4 /var/lib/apt/lists/repo.download.nvidia.com_jetson_common_dists_r34.1_InRelease /var/lib/apt/lists/repo.download.nvidia.com_jetson_common_dists_r34.1_main_binary-arm64_Packages.lz4
Removing intermediate container 2749991d7a51
—> 1a4962327d4a
Step 4/12 : COPY [“final_image”, “/”]
—> ec5568176841
Step 5/12 : RUN true
—> [Warning] The requested image’s platform (linux/arm64) does not match the detected host platform (linux/amd64) and no specific platform was requested
—> Running in 4e411de03bd1
Removing intermediate container 4e411de03bd1
—> 3e656bd95c11
Step 6/12 : ENV PATH=“/opt/nvidia/graph-composer/:$PATH”
—> [Warning] The requested image’s platform (linux/arm64) does not match the detected host platform (linux/amd64) and no specific platform was requested
—> Running in fe93a6bd4c1c
Removing intermediate container fe93a6bd4c1c
—> ad4344587a39
Step 7/12 : ENV LD_LIBRARY_PATH=“/opt/nvidia/graph-composer/:$LD_LIBRARY_PATH”
—> [Warning] The requested image’s platform (linux/arm64) does not match the detected host platform (linux/amd64) and no specific platform was requested
—> Running in 40c129cc5a59
Removing intermediate container 40c129cc5a59
—> 8c10c6e22af2
Step 8/12 : ENV DISPLAY=“:0”
—> [Warning] The requested image’s platform (linux/arm64) does not match the detected host platform (linux/amd64) and no specific platform was requested
—> Running in 3f6e90a7095b
Removing intermediate container 3f6e90a7095b
—> 07b4e821f214
Step 9/12 : WORKDIR /workspace/insight-test1/
—> [Warning] The requested image’s platform (linux/arm64) does not match the detected host platform (linux/amd64) and no specific platform was requested
—> Running in 7b24950de407
Removing intermediate container 7b24950de407
—> 84b2ce0d4695
Step 10/12 : RUN apt install -y /tmp/graph_composer-2.0.0_arm64.deb && rm -rf /tmp/graph_composer-2.0.0_arm64.deb
—> [Warning] The requested image’s platform (linux/arm64) does not match the detected host platform (linux/amd64) and no specific platform was requested
—> Running in 6aaf241c453f
Reading package lists… Done
Building dependency tree
Reading state information… Done
Note, selecting ‘graph-composer’ instead of ‘/tmp/graph_composer-2.0.0_arm64.deb’
The following packages were automatically installed and are no longer required:
cpp cpp-9 g+±9 gcc-9 libasan5 libatomic1 libcc1-0 libgcc-9-dev libisl22
libitm1 liblsan0 libmpc3 libmpfr6 libstdc+±9-dev libtsan0 libubsan1
Use ‘apt autoremove’ to remove them.
The following NEW packages will be installed:
graph-composer
0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
Need to get 0 B/28.7 MB of archives.
After this operation, 406 MB of additional disk space will be used.
Get:1 /tmp/graph_composer-2.0.0_arm64.deb graph-composer arm64 2.0.0 [28.7 MB]
debconf: delaying package configuration, since apt-utils is not installed
Selecting previously unselected package graph-composer.
(Reading database … 40282 files and directories currently installed.)
Preparing to unpack …/graph_composer-2.0.0_arm64.deb …
Unpacking graph-composer (2.0.0) …
Setting up graph-composer (2.0.0) …
update-alternatives: using /opt/nvidia/graph-composer/libgxf_core.so to provide /usr/lib/aarch64-linux-gnu/libgxf_core.so (gxf_core) in auto mode
update-alternatives: using /opt/nvidia/graph-composer/gxe to provide /usr/bin/gxe (gxe) in auto mode
update-alternatives: using /opt/nvidia/graph-composer/registry to provide /usr/bin/registry (registry) in auto mode
Processing triggers for libc-bin (2.31-0ubuntu9.7) …
Removing intermediate container 6aaf241c453f
—> 47c6129c5a97
Step 11/12 : RUN apt install -y /tmp/nvidia-vpi_5.0.2-b231_arm64.deb && rm -rf /tmp/nvidia-vpi_5.0.2-b231_arm64.deb
—> [Warning] The requested image’s platform (linux/arm64) does not match the detected host platform (linux/amd64) and no specific platform was requested
—> Running in 1d4f778b74a8
Reading package lists… Done
Building dependency tree
Reading state information… Done
Note, selecting ‘nvidia-vpi’ instead of ‘/tmp/nvidia-vpi_5.0.2-b231_arm64.deb’
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:
The following packages have unmet dependencies:
nvidia-vpi : Depends: python3.8-vpi2 (= 2.1.6) but it is not installable
Depends: python3.9-vpi2 (= 2.1.6) but it is not installable
Depends: libnvvpi2 (= 2.1.6) but 2.0.13 is to be installed
E: Unable to correct problems, you have held broken packages.
The command ‘/bin/sh -c apt install -y /tmp/nvidia-vpi_5.0.2-b231_arm64.deb && rm -rf /tmp/nvidia-vpi_5.0.2-b231_arm64.deb’ returned a non-zero code: 100
2022-08-28 11:53:55,897 - ContainerBuilder.container_builder.docker_manager.docker_builder - ERROR - docker build failed on file: /home/pmsi/.cache/container_builder/.dockerfile_393696, buildError:The command ‘/bin/sh -c apt install -y /tmp/nvidia-vpi_5.0.2-b231_arm64.deb && rm -rf /tmp/nvidia-vpi_5.0.2-b231_arm64.deb’ returned a non-zero code: 100
Traceback (most recent call last):
File “container_builder/docker_manager/docker_builder.py”, line 119, in build_from
File “container_builder/docker_manager/docker_builder.py”, line 73, in _internal_build
File “container_builder/docker_manager/docker_builder.py”, line 54, in _print_chunk
docker.errors.BuildError: The command ‘/bin/sh -c apt install -y /tmp/nvidia-vpi_5.0.2-b231_arm64.deb && rm -rf /tmp/nvidia-vpi_5.0.2-b231_arm64.deb’ returned a non-zero code: 100
Please provide complete information as applicable to your setup.
• Hardware Platform (Jetson / GPU)
• DeepStream Version
• JetPack Version (valid for Jetson only)
• TensorRT Version
• NVIDIA GPU Driver Version (valid for GPU only)
• Issue Type( questions, new requirements, bugs)
• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)
• Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)