Which DS version for Jetson Orin Nano/Jetpack 5.1.4/L4T 35.6.0?

Robotics & Edge Computing Jetson & Embedded Systems Jetson Orin Nano
1

Hi

I have searched Quickstart Guide — DeepStream 6.3 Release documentation

And noticed that, DS 6.3 for L4T Ubuntu 20.04/Jetpack 5.1.2 GA. And the time of writing, there is deepstream-7.1_7.1.0-1 available.

Latest guide here: Installation — DeepStream documentation suggests

Ubuntu 22.04

GStreamer 1.20.3

NVIDIA driver 535.183.06 (for Data Center GPUs) and 560.35.03 (for RTX GPUs)

CUDA 12.6

TensorRT 10.3.0.26

I’m NOT sure Which DS version for Jetson Orin Nano/Jetpack 5.1.4/L4T 35.6.0?
And Is there any guide(or similar setup steps) avaliable for Jetson Orin Nano/Jetpack 5.1.4/L4T 35.6.0?

2

See if this helps

https://docs.nvidia.com/jetson/archives/r35.6.0/DeveloperGuide/AR/JetsonSoftwareArchitecture.html#deep-learning-components

3

@nagesh_accord Thanks.

I didn’t find any direct/specific version related DeepStream TensorRT installation to Jetpack (Sorry)5.1.4 my latest flashed OS .

As NVIDIA jetson software is highly version dependent, especially on their priotery software. And if you installed other versions to try, might be broken some unknow version dependency, then stuck in a mess.

So I want to find their guide on steps first if possible.

4

See these general steps applicable for all versions probably

5

Yeah, @nagesh_accord If there is no specific answer. Then maybe I have to try 5.1.2GA steps, which is close to 5.1.4.

But I have met kind of issue on tensorflow, which is very strange, those installtion got my system a mess.

Currently, I’m doing another project, which environment is quite stable. So I’ll wait for a while to see if it’s a direct way to make it happen. If try, try try, then it will be a mess on jetson’s current environment.

Ah, I’m NOT sure if there is a way to dd NVM SSD live system to a usb storage?

6

You can always install complete jetpack which has cuda and other related packages with the command

Sudo apt-get install jetpack

7

But this command can’t install DS. Just like tensorflow, not only dependency and installation sequence, and even those installation might get system a mess. Then you will need to re-install the OS.

Especially those higly version dependent software deployment.

10

Please check the compatibility table. Installation — DeepStream documentation

You can run with DeepStream 6.3 version. If you install JetPack with SDKManager, the corresponding DeepStream SDK is also in the UI to be chosen.

11

The link also says up to 5.1.2GA / L4T 35.4

OK. I might be close to 5.1.4 /LT35.6

Hmmmm… Currently I don’t have a PC with SDK Manager required resources

Is there any simple way to install, or command line script?

12

There is no “up to” in the page. The versions between 5.1.2 GA and 6.0 DP are all 5.1.2+ which compatible to DeepStream 6.3.

SDKManager is the standard way to install JetPack.

@DaneLLL Is there any instruction for installing JetPack 5.1.4 and DeepStream 6.3 without SDKManager?

1 Like
13

Hi,
Please download the packages:

Jetson Linux | NVIDIA Developer
Driver Package (BSP)
Sample Root Filesystem

And follow the steps to extract and flash system image:

Quick Start — NVIDIA Jetson Linux Developer Guide 1 documentation

And install DeepStream SDK:

$ sudo apt update
$ sudo apt install deepstream-6.3
1 Like
14

I didn’t find any deepstream-6.3 by apt on Jetpack 5.1.4 L4t 35.6.

There are 6.3/6.4/7.x series.

@DaneLLL What do you suggest for my Jetpack 5.1.4 L4t 35.6 Jetson Orin 8GB board?

@Fiona.Chen I think 6.4 is a 6.x series, which might be more ultimate version for L4T 35.6 (ubuntu20.04) , am i right?

daniel@daniel-nvidia:~/Work/jetson-fpv$ sudo apt update
[sudo] password for daniel:
Hit:3 http://packages.ros.org/ros/ubuntu focal InRelease
Hit:5 http://ports.ubuntu.com/ubuntu-ports focal InRelease
Hit:1 https://repo.download.nvidia.cn/jetson/common r35.6 InRelease
Hit:2 https://repo.download.nvidia.cn/jetson/t234 r35.6 InRelease
Hit:4 https://repo.download.nvidia.cn/jetson/ffmpeg r35.6 InRelease
Get:6 http://ports.ubuntu.com/ubuntu-ports focal-updates InRelease [128 kB]
Get:7 http://ports.ubuntu.com/ubuntu-ports focal-backports InRelease [128 kB]
Get:8 http://ports.ubuntu.com/ubuntu-ports focal-security InRelease [128 kB]
Get:9 http://ports.ubuntu.com/ubuntu-ports focal-updates/main arm64 DEP-11 Metadata [276 kB]
Get:10 http://ports.ubuntu.com/ubuntu-ports focal-updates/restricted arm64 DEP-11 Metadata [212 B]
Get:11 http://ports.ubuntu.com/ubuntu-ports focal-updates/universe arm64 DEP-11 Metadata [445 kB]
Get:12 http://ports.ubuntu.com/ubuntu-ports focal-updates/multiverse arm64 DEP-11 Metadata [212 B]
Get:13 http://ports.ubuntu.com/ubuntu-ports focal-backports/main arm64 DEP-11 Metadata [5,236 B]
Get:14 http://ports.ubuntu.com/ubuntu-ports focal-backports/restricted arm64 DEP-11 Metadata [216 B]
Get:15 http://ports.ubuntu.com/ubuntu-ports focal-backports/universe arm64 DEP-11 Metadata [30.5 kB]
Get:16 http://ports.ubuntu.com/ubuntu-ports focal-backports/multiverse arm64 DEP-11 Metadata [212 B]
Get:17 http://ports.ubuntu.com/ubuntu-ports focal-security/main arm64 DEP-11 Metadata [65.3 kB]
Get:18 http://ports.ubuntu.com/ubuntu-ports focal-security/restricted arm64 DEP-11 Metadata [212 B]
Get:19 http://ports.ubuntu.com/ubuntu-ports focal-security/universe arm64 DEP-11 Metadata [159 kB]
Get:20 http://ports.ubuntu.com/ubuntu-ports focal-security/multiverse arm64 DEP-11 Metadata [212 B]
Fetched 1,366 kB in 8s (166 kB/s)
Reading package lists... Done
Building dependency tree
Reading state information... Done
12 packages can be upgraded. Run 'apt list --upgradable' to see them.
daniel@daniel-nvidia:~/Work/jetson-fpv$ sudo apt install deepstream-6.3
Reading package lists... Done
Building dependency tree
Reading state information... Done
E: Unable to locate package deepstream-6.3
E: Couldn't find any package by glob 'deepstream-6.3'
15

We can’t find any release info, but guess and try: (We DID follow the guide here: Quickstart Guide — DeepStream 6.3 Release documentation)

图片
图片2258×970 164 KB

6.4 on jetpack 5.1.4 has issue.

$ ldd /usr/bin/deepstream-app
/usr/bin/deepstream-app: /lib/aarch64-linux-gnu/libstdc++.so.6: version GLIBCXX_3.4.29' not found (required by /usr/bin/deepstream-app)
/usr/bin/deepstream-app: /lib/aarch64-linux-gnu/libc.so.6: version GLIBC_2.32' not found (required by /usr/bin/deepstream-app)
/usr/bin/deepstream-app: /lib/aarch64-linux-gnu/libc.so.6: version GLIBC_2.34' not found (required by /usr/bin/deepstream-app)
/usr/bin/deepstream-app: /lib/aarch64-linux-gnu/libc.so.6: version GLIBC_2.34' not found (required by /opt/nvidia/deepstream/deepstream-6.4/lib/libnvds_utils.so)
/usr/bin/deepstream-app: /lib/aarch64-linux-gnu/libstdc++.so.6: version GLIBCXX_3.4.29' not found (required by /opt/nvidia/deepstream/deepstream-6.4/lib/libnvds_msgbroker.so)
/usr/bin/deepstream-app: /lib/aarch64-linux-gnu/libc.so.6: version GLIBC_2.34' not found (required by /opt/nvidia/deepstream/deepstream-6.4/lib/libnvds_msgbroker.so)
        linux-vdso.so.1 (0x0000ffffaa55f000)
        libgstreamer-1.0.so.0 => /lib/aarch64-linux-gnu/libgstreamer-1.0.so.0 (0x0000ffffaa250000)
        libgstvideo-1.0.so.0 => /lib/aarch64-linux-gnu/libgstvideo-1.0.so.0 (0x0000ffffaa19b000)
        libglib-2.0.so.0 => /lib/aarch64-linux-gnu/libglib-2.0.so.0 (0x0000ffffaa060000)
        libgobject-2.0.so.0 => /lib/aarch64-linux-gnu/libgobject-2.0.so.0 (0x0000ffffa9fee000)
        libgstrtspserver-1.0.so.0 => /lib/aarch64-linux-gnu/libgstrtspserver-1.0.so.0 (0x0000ffffa9f7b000)
        libjson-glib-1.0.so.0 => /lib/aarch64-linux-gnu/libjson-glib-1.0.so.0 (0x0000ffffa9f42000)
        libyaml-cpp.so.0.7 => not found
        libnvdsgst_meta.so => /opt/nvidia/deepstream/deepstream-6.4/lib/libnvdsgst_meta.so (0x0000ffffa9f2c000)
        libnvdsgst_smartrecord.so => /opt/nvidia/deepstream/deepstream-6.4/lib/libnvdsgst_smartrecord.so (0x0000ffffa9f15000)
        libnvdsgst_helper.so => /opt/nvidia/deepstream/deepstream-6.4/lib/libnvdsgst_helper.so (0x0000ffffa9efc000)
        libnvdsgst_customhelper.so => /opt/nvidia/deepstream/deepstream-6.4/lib/libnvdsgst_customhelper.so (0x0000ffffa9ee2000)
        libnvds_meta.so => /opt/nvidia/deepstream/deepstream-6.4/lib/libnvds_meta.so (0x0000ffffa9eca000)
        libnvds_utils.so => /opt/nvidia/deepstream/deepstream-6.4/lib/libnvds_utils.so (0x0000ffffa95f9000)
        libnvds_msgbroker.so => /opt/nvidia/deepstream/deepstream-6.4/lib/libnvds_msgbroker.so (0x0000ffffa95de000)
        libX11.so.6 => /lib/aarch64-linux-gnu/libX11.so.6 (0x0000ffffa9499000)
        libstdc++.so.6 => /lib/aarch64-linux-gnu/libstdc++.so.6 (0x0000ffffa92b4000)
        libm.so.6 => /lib/aarch64-linux-gnu/libm.so.6 (0x0000ffffa9209000)
        libc.so.6 => /lib/aarch64-linux-gnu/libc.so.6 (0x0000ffffa9096000)
        /lib/ld-linux-aarch64.so.1 (0x0000ffffaa52f000)
        libgcc_s.so.1 => /lib/aarch64-linux-gnu/libgcc_s.so.1 (0x0000ffffa9072000)
        libgmodule-2.0.so.0 => /lib/aarch64-linux-gnu/libgmodule-2.0.so.0 (0x0000ffffa905e000)
        libdl.so.2 => /lib/aarch64-linux-gnu/libdl.so.2 (0x0000ffffa904a000)
        libpthread.so.0 => /lib/aarch64-linux-gnu/libpthread.so.0 (0x0000ffffa9019000)
        libgstbase-1.0.so.0 => /lib/aarch64-linux-gnu/libgstbase-1.0.so.0 (0x0000ffffa8f94000)
        liborc-0.4.so.0 => /lib/aarch64-linux-gnu/liborc-0.4.so.0 (0x0000ffffa8f05000)
        libpcre.so.3 => /lib/aarch64-linux-gnu/libpcre.so.3 (0x0000ffffa8e93000)
        libffi.so.7 => /lib/aarch64-linux-gnu/libffi.so.7 (0x0000ffffa8e7a000)
        libgstnet-1.0.so.0 => /lib/aarch64-linux-gnu/libgstnet-1.0.so.0 (0x0000ffffa8e53000)
        libgstrtp-1.0.so.0 => /lib/aarch64-linux-gnu/libgstrtp-1.0.so.0 (0x0000ffffa8e1d000)
        libgstrtsp-1.0.so.0 => /lib/aarch64-linux-gnu/libgstrtsp-1.0.so.0 (0x0000ffffa8de8000)
        libgstsdp-1.0.so.0 => /lib/aarch64-linux-gnu/libgstsdp-1.0.so.0 (0x0000ffffa8dbf000)
        libgstapp-1.0.so.0 => /lib/aarch64-linux-gnu/libgstapp-1.0.so.0 (0x0000ffffa8d9f000)
        libgio-2.0.so.0 => /lib/aarch64-linux-gnu/libgio-2.0.so.0 (0x0000ffffa8ba2000)
        libgstpbutils-1.0.so.0 => /lib/aarch64-linux-gnu/libgstpbutils-1.0.so.0 (0x0000ffffa8b56000)
        libnvinfer.so.8 => /lib/aarch64-linux-gnu/libnvinfer.so.8 (0x0000ffff9b9fb000)
        libnvds_logger.so => /opt/nvidia/deepstream/deepstream-6.4/lib/libnvds_logger.so (0x0000ffff9b9e9000)
        libxcb.so.1 => /lib/aarch64-linux-gnu/libxcb.so.1 (0x0000ffff9b9b2000)
        libz.so.1 => /lib/aarch64-linux-gnu/libz.so.1 (0x0000ffff9b988000)
        libmount.so.1 => /lib/aarch64-linux-gnu/libmount.so.1 (0x0000ffff9b918000)
        libselinux.so.1 => /lib/aarch64-linux-gnu/libselinux.so.1 (0x0000ffff9b8e0000)
        libresolv.so.2 => /lib/aarch64-linux-gnu/libresolv.so.2 (0x0000ffff9b8ba000)
        libgstaudio-1.0.so.0 => /lib/aarch64-linux-gnu/libgstaudio-1.0.so.0 (0x0000ffff9b836000)
        libgsttag-1.0.so.0 => /lib/aarch64-linux-gnu/libgsttag-1.0.so.0 (0x0000ffff9b7eb000)
        librt.so.1 => /lib/aarch64-linux-gnu/librt.so.1 (0x0000ffff9b7d1000)
        libnvdla_compiler.so => /usr/lib/aarch64-linux-gnu/tegra/libnvdla_compiler.so (0x0000ffff9b096000)
        libcudla.so.1 => /usr/local/cuda/targets/aarch64-linux/lib/libcudla.so.1 (0x0000ffff9b059000)
        libXau.so.6 => /lib/aarch64-linux-gnu/libXau.so.6 (0x0000ffff9b045000)
        libXdmcp.so.6 => /lib/aarch64-linux-gnu/libXdmcp.so.6 (0x0000ffff9b02f000)
        libblkid.so.1 => /lib/aarch64-linux-gnu/libblkid.so.1 (0x0000ffff9afc7000)
        libpcre2-8.so.0 => /lib/aarch64-linux-gnu/libpcre2-8.so.0 (0x0000ffff9af39000)
        libnvos.so => /usr/lib/aarch64-linux-gnu/tegra/libnvos.so (0x0000ffff9af19000)
        libnvdla_runtime.so => /usr/lib/aarch64-linux-gnu/tegra/libnvdla_runtime.so (0x0000ffff9a8c1000)
        libcuda.so.1 => /usr/lib/aarch64-linux-gnu/tegra/libcuda.so.1 (0x0000ffff9926a000)
        libbsd.so.0 => /lib/aarch64-linux-gnu/libbsd.so.0 (0x0000ffff99241000)
        libnvrm_host1x.so => /usr/lib/aarch64-linux-gnu/tegra/libnvrm_host1x.so (0x0000ffff99220000)
        libnvrm_mem.so => /usr/lib/aarch64-linux-gnu/tegra/libnvrm_mem.so (0x0000ffff99208000)
        libnvsocsys.so => /usr/lib/aarch64-linux-gnu/tegra/libnvsocsys.so (0x0000ffff991f4000)
        libnvrm_gpu.so => /usr/lib/aarch64-linux-gnu/tegra/libnvrm_gpu.so (0x0000ffff99187000)
        libnvrm_sync.so => /usr/lib/aarch64-linux-gnu/tegra/libnvrm_sync.so (0x0000ffff9916e000)
        libnvrm_chip.so => /usr/lib/aarch64-linux-gnu/tegra/libnvrm_chip.so (0x0000ffff9915a000)
        libnvsciipc.so => /usr/lib/aarch64-linux-gnu/tegra/libnvsciipc.so (0x0000ffff99135000)
16

No. I’ve post the platform compatibility table before, I can post it again. Installation — DeepStream documentation

We must follow the compatibility limitation strictly.

The release note of DeepStream 6.3: https://docs.nvidia.com/metropolis/deepstream/DeepStream_6.3_Release_Notes.pdf
The release note of DeepStream 6.4: https://docs.nvidia.com/metropolis/deepstream/DeepStream_6.4_Release_Notes.pdf

And the Historical DeepStream documents and package links may be useful for you. DeepStream SDK FAQ - Intelligent Video Analytics / DeepStream SDK - NVIDIA Developer Forums

17

I think I’ve post the answer in Which DS version for Jetson Orin Nano/Jetpack 5.1.4/L4T 35.6.0? - #10 by Fiona.Chen

18

Yeah, I have asked about 6.4/6.3 version difference. Since I can’t get release notes, just make a guess on the series.

Now, the release docs says:

图片
图片1633×517 55.7 KB

We’ll try 6.3, as DS is provided by binary release we can’t do much about it. Just have to follow the dependency or ask nvidia for help.

19

We must follow the compatibility limitation strictly.

20

Yes, that’s why I creat this topic. The information is quite scattered, making it difficult to locate the corresponding details. This is especially true since some versions do not clearly indicate the corresponding NVIDIA binary versions.

Now, I got 6.3 installed on Jetpack 5.1.4

$ deepstream-app -i 2024-11-21_11-54-24.mp4  -c /opt/nvidia/deepstream/deepstream-6.3/samples/configs/deepstream-app/config_infer_secondary_vehicletypes.txt
** ERROR: <main:716>: Failed to set pipeline to PAUSED
Quitting
ERROR from src_bin_muxer: Output width not set
Debug info: /dvs/git/dirty/git-master_linux/deepstream/sdk/src/gst-plugins/gst-nvmultistream/gstnvstreammux.cpp(3029): gst_nvstreammux_change_state (): /GstPipeline:pipeline/GstBin:multi_src_bin/GstNvStreamMux:src_bin_muxer
App run failed

The mp4 file can be played with video-viewer.

EDIT:

$ deepstream-app --version
deepstream-app version 6.3.0
DeepStreamSDK 6.3.0

system software stack info:

Software part of jetson-stats 4.2.12 - (c) 2024, Raffaello Bonghi
Model: NVIDIA Orin Nano Developer Kit - Jetpack 5.1.4 [L4T 35.6.0]
NV Power Mode[0]: 15W
Serial Number: [XXX Show with: jetson_release -s XXX]
Hardware:
 - P-Number: p3767-0005
 - Module: NVIDIA Jetson Orin Nano (Developer kit)
Platform:
 - Distribution: Ubuntu 20.04 focal
 - Release: 5.10.216-tegra
jtop:
 - Version: 4.2.12
 - Service: Active
Libraries:
 - CUDA: 11.4.315
 - cuDNN: 8.6.0.166
 - TensorRT: 8.5.2.2
 - VPI: 2.4.8
 - OpenCV: 4.9.0 - with CUDA: YES

Python Environment:
Python 3.8.10
    GStreamer:                   YES (1.16.3)
  NVIDIA CUDA:                   YES (ver 11.4, CUFFT CUBLAS FAST_MATH)
     OpenCV version: 4.9.0  CUDA True
       YOLO version: 8.3.33
      Torch version: 2.1.0a0+41361538.nv23.06
Torchvision version: 0.16.1+fdea156
21

Your command is wrong. This is nvinfer configuration file but not deepstream-app configuration file. DeepStream Reference Application - deepstream-app — DeepStream 6.3 Release documentation

You may try with the following steps if it is the first time to run DeepStream sample:

  1. make sure there is a physical monitor connected with your board.
  2. Run the following command in your boards’ ubuntu terminal.
sudo apt install \
libssl3 \
libssl-dev \
libgstreamer1.0-0 \
gstreamer1.0-tools \
gstreamer1.0-plugins-good \
gstreamer1.0-plugins-bad \
gstreamer1.0-plugins-ugly \
gstreamer1.0-libav \
libgstreamer-plugins-base1.0-dev \
libgstrtspserver-1.0-0 \
libjansson4 \
libyaml-cpp-dev

cd /opt/nvidia/deepstream/deepstream/samples/configs/deepstream-app/

deepstream-app -c source4_1080p_dec_infer-resnet_tracker_sgie_tiled_display_int8.yml
22

Please read the DeepStream user manual before you start to use DeepStream. Welcome to the DeepStream Documentation — DeepStream 6.3 Release documentation