Why wouldn't nvinfer plugin be able to be created in a Deepstream pipeline?

• Hardware Platform (Jetson / GPU) : Jetson Orin Nano
• DeepStream Version : 7.1
• JetPack Version (valid for Jetson only) : 6.2
• TensorRT Version: 10.3

I faced an issue when running a simple test on a Deepstream pipeline on a particular Jetson. I downloaded the NGC container for Deepstream 7,1 and runned a test and in this part of the code, it printed it wasn’t able to create all pipeline elements

When I take out the pgie element, it is able to create all elements.

This happened in a particular Jetson I am trying to setup. I didn’t have a problem running the same code in same conditions on other ones.

I don’t know what is wrong in this particular one, maybe the Jetpack installation wasn’t done well.
Does anyone know what I can check on this Jetson and see what is causing this issue?What are the most likely causes?

are you testing in the docker? please refer to doc for how to start the docker. if it still can’t work, could you share the result of “gst-inspect-1.0 nvinfer” and “ldd /opt/nvidia/deepstream/deepstream/lib/gst-plugins/libnvdsgst_infer.so”?

Yeah, I am testing inside the container. Here are the the results of the commands you asked

As the screenshot shown, libnvdla_compiler.so can’t be found. can you find this lib in the host with find / -name “libnvdla_compiler*”? if yes, please start the docker with the following cmd. please refer to the doc in my last comment.

docker run -it --rm --runtime=nvidia --network=host -e NVIDIA_DRIVER_CAPABILITIES=compute,utility,video,graphics --gpus all --privileged -e DISPLAY=$DISPLAY -v /tmp/.X11-unix:/tmp/.X11-unix -v /etc/X11:/etc/X11 nvcr.io/nvidia/deepstream:7.1-triton-multiarch

I ran the command to check the compiler and got this output. It might be related to the company that provided the machine—we’re going to confirm that.
image

In the meantime, I noticed that the command you shared uses the triton-arm-sbsa container, while I was using the multi-arch one. Could there be any situation where the multi-arch container might fail, but the arm-sbsa one would work correctly?

one correction in my last comment. please use nvcr.io/nvidia/deepstream:7.1-triton-multiarch for Jetson. from the screenshot, libnvdla_compiler can’t be found. this so is a part of Jetpack. please make sure JetPack 6.1 GA is installed successfully according to the doc for DS7.1. could you share the result of “sudo apt-cache show nvidia-jetpack”?

Here are the results.
image

That is really strange because we installed the Jetpack using SDK Manager.

From this topic , the Jetson version should be showed after running the cmd.
Since this so is in Jetpack and not part of DeepStream. I suggested copying from other devices or reinstalling JetPack 6.1 GA with the method in my last comment, Thanks!

I also ran jtop command and it says it is installed, why would apt-cache show nvidia-jetpack command return me that jetpack is not installed but jtop would say it is installed?

can I install libnvdla_compiler.so separately?

From the screenshot, the Jetpack version is 6.2. From the compatibility table, DS7.1 requires 6.1 GA.

This says that Jetpack 6.2 supports Deepstream 7.1 .

And I made it work on the dev one with Jetpack 6.2 and Deepstream 7.1

you can copy the lib form the path /usr/lib/aarch64-linux-gnu/nvidia/libnvdla_compiler.so. then try “ldd /opt/nvidia/deepstream/deepstream/lib/gst-plugins/libnvdsgst_infer.so” again.

I’ve copied the missing .so file from one Jetson that had it and put it into the other that didn’t have it. Runned the command ldd /opt/nvidia/deepstream/deepstream/lib/gst-plugins/libnvdsgst_infer.so and this was the output.

it seems it found the libnvdla_compiler.so this time, but then I inspected the nvinfer component and it didn’t find it.

image

Any ideas of what I should do next?

Again, I am very thankful for the support you provided so far, I was stuck for weeks trying to find what I was missing.

  1. could you try rm -rf ~/.cache/gstreamer-1.0/ && gst-inspect-1.0 nvinfer?
  2. if still can’t work, could you share the 1.log after running “export GST_DEBUG=6 && gst-inspect-1.0 nvinfer >1.log 2>1.log”? wondering if there is any abnormal printing.

It worked!Thanks!

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.