Deepstream6.0-samples doesnt work. libnvinfer.so.8 cannot open shared object

Hello.I pulled Deepstream6.0-samples container by command docker pull nvcr.io/nvidia/deepstream:6.0-samples.
Also i did:
1.git clone GitHub - marcoslucianops/DeepStream-Yolo: NVIDIA DeepStream SDK 6.3 / 6.2 / 6.1.1 / 6.1 / 6.0.1 / 6.0 / 5.1 implementation for YOLO models
2.cd DeepStream-Yolo
3.I copied wts and cfg models in this folder, and changed names of the models in the
Config_infer_primary_yoloV5.txt
4.apt-get install build-essential

I tired to launch usb-detection, by the command:
deepstream-app -c deepstream_app_config_USB.txt
But i couldnt:

How can i fix that ?

Please provide complete information as applicable to your setup.
• Hardware Platform (Jetson / GPU)
• DeepStream Version
• JetPack Version (valid for Jetson only)
• TensorRT Version
• NVIDIA GPU Driver Version (valid for GPU only)
• Issue Type( questions, new requirements, bugs)
• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)
• Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)
• The pipeline being used

These problems are usually caused by incorrect installation of jetpack.

I need to know some information about your device before I can help you solve the problem.

Please fill out the form above first.

Or refer this link.

Hello.Information about my system will be provided in my second reply downstairs, but, it seems, i know source of my problem, so i want to discuss it first.

It seems, i need to install additional packages from here:
https://docs.nvidia.com/metropolis/deepstream/6.0/dev-guide/text/DS_Quickstart.html
I need to install these packages in the system or in the docker container with a deepstreem?

It seems i dont have TensorRT (or ahve the wrong version).How can i check if it exists ?And how can i check NVIDIA GPU Driver Version and cuda version ?

Package: nvidia-jetpack

Version: 4.6.4-b39

Priority: standard

Section: metapackages

Maintainer: NVIDIA Corporation

Installed-Size: 199 kB

Depends: nvidia-l4t-jetson-multimedia-api (>> 32.7-0), nvidia-l4t-jetson-multimedia-api (<< 32.8-0), nvidia-cuda (= 4.6.4-b39), nvidia-tensorrt (= 4.6.4-b39), nvidia-nsight-sys (= 4.6.4-b39), nvidia-cudnn8 (= 4.6.4-b39), nvidia-opencv (= 4.6.4-b39), nvidia-container (= 4.6.4-b39), nvidia-visionworks (= 4.6.4-b39), nvidia-vpi (= 4.6.4-b39)

Second reply with information:
All information about my system, thati could extract:

1.Jetson P3450.

2.Deepstream6.0-samples (docker container)

Package: nvidia-jetpack

Version: 4.6.4-b39

Priority: standard

Section: metapackages

Maintainer: NVIDIA Corporation

Installed-Size: 199 kB

Depends: nvidia-l4t-jetson-multimedia-api (>> 32.7-0), nvidia-l4t-jetson-multimedia-api (<< 32.8-0), nvidia-cuda (= 4.6.4-b39), nvidia-tensorrt (= 4.6.4-b39), nvidia-nsight-sys (= 4.6.4-b39), nvidia-cudnn8 (= 4.6.4-b39), nvidia-opencv (= 4.6.4-b39), nvidia-container (= 4.6.4-b39), nvidia-visionworks (= 4.6.4-b39), nvidia-vpi (= 4.6.4-b39)

Homepage: http://developer.nvidia.com/jetson

Download-Size: 29,4 kB

APT-Sources: https://repo.download.nvidia.com/jetson/t210 r32.7/main arm64 Packages

Description: NVIDIA Jetpack Meta Package

4/5.(I am not sure about TensorRT Version and NVIDIA GPU Driver Version,Pobably it is not installed.Could you explain me, please how to check it ?)

5.Issue type: question.

  1. I downloaded image for sd card from here https://developer.nvidia.com/jetson-nano-sd-card-image and installed it by these instructions: https://developer.nvidia.com/embedded/learn/get-started-jetson-nano-devkit#write. And i probably also installeed Jetpack 4.6.4 if it was not included.

So, to reproduce the bug you should do the same steps and after that :

1.pull Deepstream6.0-samples container by command docker pull nvcr.io/nvidia/deepstream:6.0-samples.

2.git clone GitHub - marcoslucianops/DeepStream-Yolo: NVIDIA DeepStream SDK 6.3 / 6.2 / 6.1.1 / 6.1 / 6.0.1 / 6.0 / 5.1 implementation for YOLO models

3.cd DeepStream-Yolo

4.Copy wts and cfg models in this folder, and changed names of the models in the

Config_infer_primary_yoloV5.txt

5.apt-get install build-essential

6.deepstream-app -c deepstream_app_config_USB.txt

let’s forget docker and deepstream first.

A complete installation of jetpack is the prerequisite for all this.

Now I know you use jetson nano, the highest supported jetpack is 4.6.1 GA and deepstream is 6.0.1

Tenorrt and CUDA are part of JetPack.

sudo apt update
sudo apt dist-upgrade
sudo apt install --fix-broken -o Dpkg::Options::="--force-overwrite"

For more information, please refer to this link

Hello.Now i have Jetpack 4.6.4 and i need to change it to the Jetpack 4.6.1, right ?

I tried to do the commands:
sudo apt update
sudo apt dist-upgrade
sudo apt install --fix-broken -o Dpkg::Options::=“–force-overwrite”
But it didnt change anything.Full log is here :
log2.txt (10.7 KB)

What did i do wrong and how can i install correct version of the Jetpack ?

Do i need to edit the etc/apt/sources.list.d/nvidia-l4t-apt-source.list ?If so, how can i find it or where can i download it?(I didnt find it on my jetson.I inserted the name of this file in the search and didnt find anything)

4.6.4 usually ok.

1.try install

sudo apt update
sudo apt install nvidia-jetpack

2.check the shared library is exist.

 ls -l  /lib/aarch64-linux-gnu/libnvinfer.so*

3.follow the link install the deepstream in host.

Part of the shared libraries on jetson is shared with the host.

So if you want to run docker on jetson, you must ensure that the host is working properly.

Hello.Sorry for the late reply.I have a problems with steps 1 and 2, so i didnt try to complete step 3.

As for the problems in step 1, these commands installed jetpack 4…6.4 (same version with the version that was already installed).So i still have jetpack 4.6.4.It seems, i need instruction for the instalaltion of the specific version of the jetpack.Or I can use very old backup as a last resort.

Also i executed this command ls -l /lib/aarch64-linux-gnu/libnvinfer.so*. This library doesnt exist.So, in my point of view, i dont have TensorRT.(Because i saw name of this library in the insturction about intallation of the TensroRT)

Full log is here (steps 1 and 2):

log2 (2).txt (6.7 KB)

If libnvinfer.so does not exist, you should try step 3. It is used to reinstall the JetPack-4.6.

Select your jetson nano model and try reinstalling jetpack. Until you can find libnvinfer.so

Hello.Unfortunatelly i couldnt solve the problem.

Sequence of my actions:
1.I followed this instruction: https://developer.nvidia.com/embedded/learn/get-started-jetson-nano-devkit#write
and TensorRT booted fresh jetson nano operational system
2.ls -l /lib/aarch64-linux-gnu/libnvinfer.so*
“No such file or directory”
3…ls -l /lib/aarch64-linux-gnu/libnvinfer.so
“No such file or directory”
4.sudo apt-cache show nvidia-jetpack
N: Unable to locate package nvidia-jetpack
E: No packages found
5.sudo apt update
6.sudo apt install nvidia-jetpack
7.sudo apt-cache show nvidia-jetpack
Package: nvidia-jetpack
Version: 4.6.4-b39
8.ls -l /lib/aarch64-linux-gnu/libnvinfer.so
“No such file or directory”
9…ls -l /lib/aarch64-linux-gnu/libnvinfer.so*
“No such file or directory”

In my point of view, i didnt do any mistakes during the installation process.If so, this library didnt install with default system and didnt install with JetPack 4.6.1., so i need additional instructions to install it.
(Probably i need to install TensorRT?)

Full log is here:
log4 (1).txt (14.6 KB)

If there is no problem with burning, can you see similar output if you execute the following command?

cd /

sudo find . -name "libnvinfer*"

result:

./usr/lib/aarch64-linux-gnu/libnvinfer_static.a
./usr/lib/aarch64-linux-gnu/libnvinfer_plugin.so.8
./usr/lib/aarch64-linux-gnu/libnvinfer.so
./usr/lib/aarch64-linux-gnu/libnvinfer_builder_resource.so.8.2.1
./usr/lib/aarch64-linux-gnu/libnvinfer_plugin_static.a
./usr/lib/aarch64-linux-gnu/libnvinfer_plugin.so
./usr/lib/aarch64-linux-gnu/libnvinfer.so.8
./usr/lib/aarch64-linux-gnu/libnvinfer.so.8.2.1
./usr/lib/aarch64-linux-gnu/libnvinfer_plugin.so.8.2.1

If the above results are normal, you can refer to this link to install deepstream sdk.

Then build and run the deepstream-test1 in /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-test1/ directory.

Hello.It seems, output is similar.

Could you explain me , please, some things about process of the instalaltion of the deepstream ?

1.Now i have all requremtns, right ?If so, should i start from here ?(I am going to use method 2).Or i need to install additional packages ?

2.Can i jsut pull the container by method 4 ?

If JetPack has been installed, I think method 4 is OK.

Thanks for your reply.Can i use : docker pull nvcr.io/nvidia/deepstream:6.0-samples instead of docker pull nvcr.io/nvidia/deepstream:6.0.1-samples ? [Is deepstream:6.0 supported ?]

it is no problem usually, you can try it.

Unfortunatelly i still have exactly the same problem:
deepstream-app: error while loading shared libraries: libnvinfer.so.8: cannot open shared object file: No such file or directory

Sequence of my actions:

1.I copied my edited container (based on nvcr.io/nvidia/deepstream:6.0-samples) on the fresh sd card, with JetPack 4.6.1, in which i received the same output.

2.I launched the container.

3.I tried to: deepstream-app -c deepstream_app_config_USB.txt

4.I got the same error.

Log is here:

log5.txt (2.1 KB)

  1. docker pull [nvcr.io/nvidia/deepstream-l4t:6.0-samples]

  2. docker pull [nvcr.io/nvidia/deepstream-l4t:6.0.1-samples]

7.In steps 5 and 6 i pulled 2 fresh containers.In this step i launched them and .I tried to: deepstream-app -c deepstream_app_config_USB.txt. Result was exactly the same:

deepstream-app: error while loading shared libraries: libnvinfer.so.8: cannot open shared object file: No such file or directory

8.$ sudo apt install
libssl1.0.0
libgstreamer1.0-0
gstreamer1.0-tools
gstreamer1.0-plugins-good
gstreamer1.0-plugins-bad
gstreamer1.0-plugins-ugly
gstreamer1.0-libav
libgstrtspserver-1.0-0
libjansson4=2.11-1
Install librdkafka (to enable Kafka

9.git clone GitHub - confluentinc/librdkafka: The Apache Kafka C/C++ library

10.$ cd librdkafka
$ git reset --hard 7101c2310341ab3f4675fc565f64f0967e135a6a
./configure
$ make
$ sudo make install

11.sudo mkdir -p /opt/nvidia/deepstream/deepstream-6.0/lib

12.sudo cp /home/atlas/librdkafka* /opt/nvidia/deepstream/deepstream-6.0/lib
(for some reason it was installed in: /home/atlas/ instead of /usr/local/lib/)
I changed this command, because original command didnt found the file:
Original command: sudo cp /usr/local/lib/librdkafka* /opt/nvidia/deepstream/deepstream-6.0/lib

I followed this instruction:

13.Step 7 repeated with the same result.

Log is here:

log6.txt (32.9 KB)

I dont know how to fix this error.Help me please.

Try the following command line start docker.

xhost +

sudo docker run -it --rm --net=host --runtime nvidia -e DISPLAY=$DISPLAY -w /opt/nvidia/deepstream/deepstream -v /tmp/.X11-unix/:/tmp/.X11-unix nvcr.io/nvidia/deepstream-l4t:6.0.1-samples

Hello.I used these commands to run new deepstream container and my deepstream container with customized settings.I got new error.(And it is the same for both of them)

cd /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-test1

make CUDA_VER=10.2

./deepstream-test1-app /opt/nvidia/deepstream/deepstream/samples/streams/sample_720p.h264 

What is deepstream_app_config_USB.txt?

If the above command line can see the results

I suggest you read the documentation of deepstream-app before trying to modify the configuration file.

Please refer to the source code and README in the /opt/nvidia/deepstream/deepstream-6.0/sources/apps/sample_apps/deepstream-app directory

I can’t help you solve all your problems