Cuda

I am getting an error running on Jetpack 5.0.2 in a container (built by container_builder.
The error below appears to be related to the vpi version, so I tried installing the up to date VPI as part of the container build, that throws a bunch of version errors.

Error running image with “stock” container_builder yaml (download/install the reference graphs only)

Opening in BLOCKING MODE
gstnvtracker: Loading low-level lib at /opt/nvidia/deepstream/deepstream/lib/libnvds_nvmultiobjecttracker.so
gstnvtracker: Failed to open low-level lib at /opt/nvidia/deepstream/deepstream/lib/libnvds_nvmultiobjecttracker.so
dlopen error: /opt/nvidia/vpi2/lib64/priv/libcupva_host.so: undefined symbol: PvaQueueSubmit
gstnvtracker: Failed to initilaize low level lib.
2022-08-28 15:26:47.551 ERROR extensions/nvdsbase/nvds_scheduler.cpp@179: Failed to set GStreamer pipeline to PLAYING
Returned, stopping playback

This it the container builder logs from this build… Notice the issues with cuda and then version issues with VPI.
What is the right way to get a working jetson container for JP 5.0.2?

2022-08-28 11:53:18,682 - ContainerBuilder.container_builder.docker_manager.docker_manager - INFO - work folder: /home/pmsi/.cache/container_builder/.workfolder_393696 is ready
2022-08-28 11:53:18,682 - ContainerBuilder.container_builder.docker_manager.docker_manager - INFO - start build docker file /home/pmsi/.cache/container_builder/.dockerfile_393696
Step 1/12 : FROM nvcr.io/nvidia/deepstream-l4t:6.1-samples AS final_image
—> 6fc8884e47d9
Step 2/12 : ARG DEBIAN_FRONTEND=noninteractive
—> [Warning] The requested image’s platform (linux/arm64) does not match the detected host platform (linux/amd64) and no specific platform was requested
—> Running in a9bea9f13386
Removing intermediate container a9bea9f13386
—> f8fc1555e4a3
Step 3/12 : RUN set -xe; apt-get update && apt-get install -y --no-install-recommends rsync && rm -rf /var/lib/apt/lists/*
—> [Warning] The requested image’s platform (linux/arm64) does not match the detected host platform (linux/amd64) and no specific platform was requested
—> Running in 2749991d7a51

  • apt-get update
    Err:1 http://cuda-internal.nvidia.com/release-candidates/kitpicks/tensorrt-rel-8-4-tegra/8.4.0/004/repos/l4t/arm64 InRelease
    Could not resolve ‘cuda-internal.nvidia.com
    Get:2 https://repo.download.nvidia.com/jetson/common r34.1 InRelease [2555 B]
    Hit:3 Index of /ubuntu-ports focal InRelease
    Get:4 Index of /ubuntu-ports focal-updates InRelease [114 kB]
    Get:5 Index of /ubuntu-ports focal-backports InRelease [108 kB]
    Get:6 Index of /ubuntu-ports focal-security InRelease [114 kB]
    Get:7 https://repo.download.nvidia.com/jetson/common r34.1/main arm64 Packages [16.1 kB]
    Get:8 Index of /ubuntu-ports focal-updates/multiverse arm64 Packages [9067 B]
    Get:9 Index of /ubuntu-ports focal-updates/universe arm64 Packages [1118 kB]
    Get:10 Index of /ubuntu-ports focal-updates/main arm64 Packages [1810 kB]
    Get:11 Index of /ubuntu-ports focal-updates/restricted arm64 Packages [4571 B]
    Get:12 Index of /ubuntu-ports focal-backports/main arm64 Packages [54.7 kB]
    Get:13 Index of /ubuntu-ports focal-backports/universe arm64 Packages [27.4 kB]
    Get:14 Index of /ubuntu-ports focal-security/restricted arm64 Packages [4330 B]
    Get:15 Index of /ubuntu-ports focal-security/multiverse arm64 Packages [3253 B]
    Get:16 Index of /ubuntu-ports focal-security/main arm64 Packages [1426 kB]
    Get:17 Index of /ubuntu-ports focal-security/universe arm64 Packages [823 kB]
    Fetched 5635 kB in 10s (550 kB/s)
    Reading package lists… Done
    W: Failed to fetch http://cuda-internal.nvidia.com/release-candidates/kitpicks/tensorrt-rel-8-4-tegra/8.4.0/004/repos/l4t/arm64/InRelease Could not resolve ‘cuda-internal.nvidia.com
    W: Some index files failed to download. They have been ignored, or old ones used instead.
  • apt-get install -y --no-install-recommends rsync
    Reading package lists… Done
    Building dependency tree
    Reading state information… Done
    The following packages were automatically installed and are no longer required:
    cpp cpp-9 g+±9 gcc-9 gcc-9-base libasan5 libatomic1 libcc1-0 libgcc-9-dev
    libisl22 libitm1 liblsan0 libmpc3 libmpfr6 libstdc+±9-dev libtsan0
    libubsan1
    Use ‘apt autoremove’ to remove them.
    The following additional packages will be installed:
    libpopt0
    Suggested packages:
    openssh-client openssh-server
    The following NEW packages will be installed:
    libpopt0 rsync
    0 upgraded, 2 newly installed, 0 to remove and 113 not upgraded.
    Need to get 328 kB of archives.
    After this operation, 812 kB of additional disk space will be used.
    Get:1 Index of /ubuntu-ports focal/main arm64 libpopt0 arm64 1.16-14 [25.1 kB]
    Get:2 Index of /ubuntu-ports focal-updates/main arm64 rsync arm64 3.1.3-8ubuntu0.4 [303 kB]
    Fetched 328 kB in 1s (386 kB/s)
    debconf: delaying package configuration, since apt-utils is not installed
    Selecting previously unselected package libpopt0:arm64.
    (Reading database … 40246 files and directories currently installed.)
    Preparing to unpack …/libpopt0_1.16-14_arm64.deb …
    Unpacking libpopt0:arm64 (1.16-14) …
    Selecting previously unselected package rsync.
    Preparing to unpack …/rsync_3.1.3-8ubuntu0.4_arm64.deb …
    Unpacking rsync (3.1.3-8ubuntu0.4) …
    Setting up libpopt0:arm64 (1.16-14) …
    Setting up rsync (3.1.3-8ubuntu0.4) …
    invoke-rc.d: could not determine current runlevel
    invoke-rc.d: policy-rc.d denied execution of start.
    Created symlink /etc/systemd/system/multi-user.target.wants/rsync.service → /lib/systemd/system/rsync.service.
    Processing triggers for systemd (245.4-4ubuntu3.16) …
    Processing triggers for libc-bin (2.31-0ubuntu9.7) …
  • rm -rf /var/lib/apt/lists/auxfiles /var/lib/apt/lists/cuda-internal.nvidia.com_release-candidates_kitpicks_tensorrt-rel-8-4-tegra_8.4.0_004_repos_l4t_arm64_InRelease /var/lib/apt/lists/cuda-internal.nvidia.com_release-candidates_kitpicks_tensorrt-rel-8-4-tegra_8.4.0_004_repos_l4t_arm64_Packages.lz4 /var/lib/apt/lists/lock /var/lib/apt/lists/partial /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal-backports_InRelease /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal-backports_main_binary-arm64_Packages.lz4 /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal-backports_universe_binary-arm64_Packages.lz4 /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal-security_InRelease /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal-security_main_binary-arm64_Packages.lz4 /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal-security_multiverse_binary-arm64_Packages.lz4 /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal-security_restricted_binary-arm64_Packages.lz4 /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal-security_universe_binary-arm64_Packages.lz4 /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal-updates_InRelease /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal-updates_main_binary-arm64_Packages.lz4 /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal-updates_multiverse_binary-arm64_Packages.lz4 /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal-updates_restricted_binary-arm64_Packages.lz4 /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal-updates_universe_binary-arm64_Packages.lz4 /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal_InRelease /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal_main_binary-arm64_Packages.lz4 /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal_multiverse_binary-arm64_Packages.lz4 /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal_restricted_binary-arm64_Packages.lz4 /var/lib/apt/lists/ports.ubuntu.com_ubuntu-ports_dists_focal_universe_binary-arm64_Packages.lz4 /var/lib/apt/lists/repo.download.nvidia.com_jetson_common_dists_r34.1_InRelease /var/lib/apt/lists/repo.download.nvidia.com_jetson_common_dists_r34.1_main_binary-arm64_Packages.lz4
    Removing intermediate container 2749991d7a51
    —> 1a4962327d4a
    Step 4/12 : COPY [“final_image”, “/”]
    —> ec5568176841
    Step 5/12 : RUN true
    —> [Warning] The requested image’s platform (linux/arm64) does not match the detected host platform (linux/amd64) and no specific platform was requested
    —> Running in 4e411de03bd1
    Removing intermediate container 4e411de03bd1
    —> 3e656bd95c11
    Step 6/12 : ENV PATH=“/opt/nvidia/graph-composer/:$PATH”
    —> [Warning] The requested image’s platform (linux/arm64) does not match the detected host platform (linux/amd64) and no specific platform was requested
    —> Running in fe93a6bd4c1c
    Removing intermediate container fe93a6bd4c1c
    —> ad4344587a39
    Step 7/12 : ENV LD_LIBRARY_PATH=“/opt/nvidia/graph-composer/:$LD_LIBRARY_PATH”
    —> [Warning] The requested image’s platform (linux/arm64) does not match the detected host platform (linux/amd64) and no specific platform was requested
    —> Running in 40c129cc5a59
    Removing intermediate container 40c129cc5a59
    —> 8c10c6e22af2
    Step 8/12 : ENV DISPLAY=“:0”
    —> [Warning] The requested image’s platform (linux/arm64) does not match the detected host platform (linux/amd64) and no specific platform was requested
    —> Running in 3f6e90a7095b
    Removing intermediate container 3f6e90a7095b
    —> 07b4e821f214
    Step 9/12 : WORKDIR /workspace/insight-test1/
    —> [Warning] The requested image’s platform (linux/arm64) does not match the detected host platform (linux/amd64) and no specific platform was requested
    —> Running in 7b24950de407
    Removing intermediate container 7b24950de407
    —> 84b2ce0d4695
    Step 10/12 : RUN apt install -y /tmp/graph_composer-2.0.0_arm64.deb && rm -rf /tmp/graph_composer-2.0.0_arm64.deb
    —> [Warning] The requested image’s platform (linux/arm64) does not match the detected host platform (linux/amd64) and no specific platform was requested
    —> Running in 6aaf241c453f
    Reading package lists… Done
    Building dependency tree
    Reading state information… Done
    Note, selecting ‘graph-composer’ instead of ‘/tmp/graph_composer-2.0.0_arm64.deb’
    The following packages were automatically installed and are no longer required:
    cpp cpp-9 g+±9 gcc-9 libasan5 libatomic1 libcc1-0 libgcc-9-dev libisl22
    libitm1 liblsan0 libmpc3 libmpfr6 libstdc+±9-dev libtsan0 libubsan1
    Use ‘apt autoremove’ to remove them.
    The following NEW packages will be installed:
    graph-composer
    0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
    Need to get 0 B/28.7 MB of archives.
    After this operation, 406 MB of additional disk space will be used.
    Get:1 /tmp/graph_composer-2.0.0_arm64.deb graph-composer arm64 2.0.0 [28.7 MB]
    debconf: delaying package configuration, since apt-utils is not installed
    Selecting previously unselected package graph-composer.
    (Reading database … 40282 files and directories currently installed.)
    Preparing to unpack …/graph_composer-2.0.0_arm64.deb …
    Unpacking graph-composer (2.0.0) …
    Setting up graph-composer (2.0.0) …
    update-alternatives: using /opt/nvidia/graph-composer/libgxf_core.so to provide /usr/lib/aarch64-linux-gnu/libgxf_core.so (gxf_core) in auto mode
    update-alternatives: using /opt/nvidia/graph-composer/gxe to provide /usr/bin/gxe (gxe) in auto mode
    update-alternatives: using /opt/nvidia/graph-composer/registry to provide /usr/bin/registry (registry) in auto mode
    Processing triggers for libc-bin (2.31-0ubuntu9.7) …
    Removing intermediate container 6aaf241c453f
    —> 47c6129c5a97
    Step 11/12 : RUN apt install -y /tmp/nvidia-vpi_5.0.2-b231_arm64.deb && rm -rf /tmp/nvidia-vpi_5.0.2-b231_arm64.deb
    —> [Warning] The requested image’s platform (linux/arm64) does not match the detected host platform (linux/amd64) and no specific platform was requested
    —> Running in 1d4f778b74a8
    Reading package lists… Done
    Building dependency tree
    Reading state information… Done
    Note, selecting ‘nvidia-vpi’ instead of ‘/tmp/nvidia-vpi_5.0.2-b231_arm64.deb’
    Some packages could not be installed. This may mean that you have
    requested an impossible situation or if you are using the unstable
    distribution that some required packages have not yet been created
    or been moved out of Incoming.
    The following information may help to resolve the situation:

The following packages have unmet dependencies:
nvidia-vpi : Depends: python3.8-vpi2 (= 2.1.6) but it is not installable
Depends: python3.9-vpi2 (= 2.1.6) but it is not installable
Depends: libnvvpi2 (= 2.1.6) but 2.0.13 is to be installed
E: Unable to correct problems, you have held broken packages.
The command ‘/bin/sh -c apt install -y /tmp/nvidia-vpi_5.0.2-b231_arm64.deb && rm -rf /tmp/nvidia-vpi_5.0.2-b231_arm64.deb’ returned a non-zero code: 100
2022-08-28 11:53:55,897 - ContainerBuilder.container_builder.docker_manager.docker_builder - ERROR - docker build failed on file: /home/pmsi/.cache/container_builder/.dockerfile_393696, buildError:The command ‘/bin/sh -c apt install -y /tmp/nvidia-vpi_5.0.2-b231_arm64.deb && rm -rf /tmp/nvidia-vpi_5.0.2-b231_arm64.deb’ returned a non-zero code: 100
Traceback (most recent call last):
File “container_builder/docker_manager/docker_builder.py”, line 119, in build_from
File “container_builder/docker_manager/docker_builder.py”, line 73, in _internal_build
File “container_builder/docker_manager/docker_builder.py”, line 54, in _print_chunk
docker.errors.BuildError: The command ‘/bin/sh -c apt install -y /tmp/nvidia-vpi_5.0.2-b231_arm64.deb && rm -rf /tmp/nvidia-vpi_5.0.2-b231_arm64.deb’ returned a non-zero code: 100

Please provide complete information as applicable to your setup.

• Hardware Platform (Jetson / GPU)
• DeepStream Version
• JetPack Version (valid for Jetson only)
• TensorRT Version
• NVIDIA GPU Driver Version (valid for GPU only)
• Issue Type( questions, new requirements, bugs)
• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)
• Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)

Deepstream image not released for Jetpack 5.0.2

Ok, help me understand this…

I have Graph Composer 2.0.0 from May 19, 2022. I have created and tested working extensions and components for this platform. When we tried to deploy to Jetpack 4.6 it just fails out without a useful message like a version incompatibility (separate thread here, no solution). Also, registry from Graph composer 2.0.0 fails to run on Jetpack 4.6 because of a GlibC version compatibility with the 18.04 based linux on that system.

We then got a Test system that we could update to jetpack 5.0.2 for equivalency with the 20.04 library set in use on the newer graph composer… And you say that isn’t yet supported?

Exactly what combination of versions are we supposed to use to deploy a graph composer 2.0 based system to a jetson? I have been begging for the full working code and build examples referred to by the documentation, but noone from your staff has helped here…

Can you please give me some guidance? Can someone reach out in a private message with some direct contact information so we can move this forward?

@Amycao What combination of versions are we supposed to use to run graphs on the jetson?

@yingliu This is also a container built by graph composer…

Thanks for reminding, I had thought it is a pure container issue. tag added.

DS 6.1.1 with graph composer 2.0.1
DS 6.1 with graph composer 2.0
DS 6.0.1/6.0 with graph composer 1.0

We are able to repro the issue and are looking into it.

Thank you!!

I just got the 5.0.2 update in sdk manager and have installed it to a NX (0003) 16GB…
Once it got done I got an error trying to run deepstream-app --version-all

Error while loading shared libraries: libgstrtspserver-1.0.so.0: cannot open shared object file: No such file or directory

I ran the prerequisites apt-get from the manual install process and that seems to fix it. But that means that the sdkmanager isn’t completely installing the requirements.

I will be continuing to work on this today, so I may have more to report.

Hi,
Regarding the missing rtspserver libs, could you please create a new thread ?

Regarding the container builder error. Can you verify your setup once ? Ensure that you have installed graph-composer version 2.0.1 for generating any docker containers for jetpack5.0.2. It looks like you might have had graph composer 2.0.0 when you generated the container earlier.

Yes, updated to graph composer 2.0.1 Tuesday as part of the ds 6.1.1 update.

Rebuilt with the 6.1.1 samples nvcr.io base and Graph Composer 2.0.1.

Right now focusing on getting a functional Jetson 5.0.2 rev 1 install that can run the samples and simple custom graphs on the “metal”, then I’ll move back to the container. The container failed to run on the first try, but I found some dependencies didn’t upgrade correctly. I want to verify that things are healthy before adding the complexity of the container.

Looks like the base image used is from DS 6.1, can you update that to 6.1.1 ?

That was the previous build, I am now building from 6.1.1…

Sorry for the late reply, Is this still an issue to support? Thanks

There is no update from you for a period, assuming this is not an issue any more.
Hence we are closing this topic. If need further support, please open a new one.
Thanks

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.