Issue While running deepstream_python_apps on Nvidia Xavier NX with Deepstream 6.0

[steve7878]

Hello Nvidia Team,

I am trying to run deepstream_python_apps on Xavier NX with Deepstream 6.0 .
Using this link - GitHub - NVIDIA-AI-IOT/deepstream_python_apps: DeepStream SDK Python bindings and sample applications

Xavier NX installed versions -
Jetpack = 4.6
deepstream =6.0
cuda =10.2
Python=3.6.9
numpy=1.19.5
TensorRT=8.0.1.6

When, I am trying to run deepstream_python_apps test1 got this error -

File “deepstream_test_1.py”, line 55, in osd_sink_pad_buffer_probe
** batch_meta = pyds.gst_buffer_get_nvds_batch_meta(hash(gst_buffer))**
AttributeError: module ‘pyds’ has no attribute ‘gst_buffer_get_nvds_batch_meta’

When, I am trying to run deepstream_python_apps - deepstream-ssd-parser got this error -

Creating Pipeline

Creating Source
Creating H264Parser
Creating Decoder
Creating NvStreamMux
Creating Nvinferserver
Unable to create Nvinferserver
Creating Nvvidconv
Creating OSD (nvosd)
Creating Queue
Creating Converter 2 (nvvidconv2)
Creating capsfilter
Creating Encoder
Creating Code Parser
Creating Container
Creating Sink
Playing file /opt/nvidia/deepstream/deepstream-6.0/samples/streams/sample_720p.h264
Traceback (most recent call last):
File “deepstream_ssd_parser.py”, line 453, in
sys.exit(main(sys.argv))
File “deepstream_ssd_parser.py”, line 376, in main
pgie.set_property(“config-file-path”, “dstest_ssd_nopostprocess.txt”)
AttributeError: ‘NoneType’ object has no attribute ‘set_property’

[Amycao]

@steve7878

File “deepstream_test_1.py”, line 55, in osd_sink_pad_buffer_probe
** batch_meta = pyds.gst_buffer_get_nvds_batch_meta(hash(gst_buffer))**
AttributeError: module ‘pyds’ has no attribute 'gst_buffer_get_nvds_batch_meta’

We can run it well. did you compile the python bindings follow the doc https://github.com/NVIDIA-AI-IOT/deepstream_python_apps/blob/master/HOWTO.md? Part: Compiling Python Bindings

Unable to create Nvinferserver

Did you follow README under the sample dir to setup triton inference server?

[Raymond_456]

Hello Nvidia Team,

I have a similar problem in jetson AGX and I tried to follow this link(Quickstart Guide — DeepStream 6.1.1 Release documentation) to install Triton Inference Server:

but I still got the same error - :
python3 deepstream_ssd_parser.py ‘/opt/nvidia/deepstream/deepstream-6.0/samples/streams/sample_qHD.h264’

Creating Pipeline 
 
Creating Source
Creating H264Parser
Creating Decoder
Creating NvStreamMux
Creating Nvinferserver
Unable to create Nvinferserver 
Creating Nvvidconv
Creating OSD (nvosd)
Creating Queue
Creating Converter 2 (nvvidconv2)
Creating capsfilter
Creating Encoder
Creating Code Parser
Creating Container
Creating Sink
Playing file /opt/nvidia/deepstream/deepstream-6.0/samples/streams/sample_qHD.h264 
Traceback (most recent call last):
  File "deepstream_ssd_parser.py", line 453, in <module>
    sys.exit(main(sys.argv))
  File "deepstream_ssd_parser.py", line 376, in main
    pgie.set_property("config-file-path", "dstest_ssd_nopostprocess.txt")
AttributeError: 'NoneType' object has no attribute 'set_property'

[Amycao]

Can you find nvinferserver plugin?
gst-inspect-1.0 nvinferserver

[Raymond_456]

I can’t find gst-inspect-1.0 nvinferserver.

Are these two commands used to install Nvinferserver?

cd /opt/nvidia/deepstream/deepstream/samples/
sudo ./triton_backend_setup.sh

[Amycao]

triton_backend_setup.sh to install triton server.
Any error when run gst-inspect-1.0 nvinferserver

[Raymond_456]

There is no “gst-inspect-1.0 nvinferserver” now. I don’t know if it’s because of installation or other reasons

The information returned when I run sudo ./triton_backend_setup.sh

$ sudo ./triton_backend_setup.sh

[sudo] password for py:

Creating /tmp/triton_server_downloads directory …

Downloading https://github.com/triton-inference-server/server/releases/download/v2.13.0/tritonserver2.13.0-jetpack4.6.tgz to /tmp/triton_server_downloads …

–2021-11-17 13:29:27-- https://github.com/triton-inference-server/server/releases/download/v2.13.0/tritonserver2.13.0-jetpack4.6.tgz

Resolving github.com (github.com)… 20.205.243.166

Connecting to github.com (github.com)|20.205.243.166|:443… connected.

HTTP request sent, awaiting response… 302 Found

Location: https://github-releases.githubusercontent.com/151636194/ebd010fc-8f4f-475d-a78d-6237e00c8681?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20211117%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20211117T052928Z&X-Amz-Expires=300&X-Amz-Signature=910a8389461da72d0d84d65aaabc51c1fba32ccd75bf0fc6d959d0b2a8b686ea&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=151636194&response-content-disposition=attachment%3B%20filename%3Dtritonserver2.13.0-jetpack4.6.tgz&response-content-type=application%2Foctet-stream [following]

–2021-11-17 13:29:28-- https://github-releases.githubusercontent.com/151636194/ebd010fc-8f4f-475d-a78d-6237e00c8681?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20211117%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20211117T052928Z&X-Amz-Expires=300&X-Amz-Signature=910a8389461da72d0d84d65aaabc51c1fba32ccd75bf0fc6d959d0b2a8b686ea&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=151636194&response-content-disposition=attachment%3B%20filename%3Dtritonserver2.13.0-jetpack4.6.tgz&response-content-type=application%2Foctet-stream

Resolving github-releases.githubusercontent.com (github-releases.githubusercontent.com)… 185.199.110.154, 185.199.108.154, 185.199.109.154, …

Connecting to github-releases.githubusercontent.com (github-releases.githubusercontent.com)|185.199.110.154|:443… connected.

HTTP request sent, awaiting response… 200 OK

Length: 609205121 (581M) [application/octet-stream]

Saving to: ‘/tmp/triton_server_downloads/jetpack.tgz’

/tmp/triton_s 100% 580.98M 10.3MB/s in 56s

2021-11-17 13:30:24 (10.4 MB/s) - ‘/tmp/triton_server_downloads/jetpack.tgz’ saved [609205121/609205121]

Extracting the package …

/tmp/triton_server_downloads /opt/nvidia/deepstream/deepstream-6.0/samples

./

./backends/

./backends/identity/

###########
./xxx/xxx/xxx
###########

./include/tritonserver/model_config.pb.h

Creating /opt/nvidia/deepstream/deepstream/lib/triton_backends/ directory …

Copying the backends binaries …

/opt/nvidia/deepstream/deepstream-6.0/samples

cleaning up /tmp/triton_server_downloads directory …

[Amycao]

No. triton_backend_setup.sh to install triton server which will be called by nvinferserver plugin. the plugin not created in your error you pasted at the beginning. that’s why i asked about the output of gst-inspect-1.0 nvinferserver

[Raymond_456]

Thank you, but I still face the same problem.

Creating Pipeline 
 
Creating Source
Creating H264Parser
Creating Decoder
Creating NvStreamMux
Creating Nvinferserver
Unable to create Nvinferserver 
Creating Nvvidconv
Creating OSD (nvosd)
Creating Queue
Creating Converter 2 (nvvidconv2)
Creating capsfilter
Creating Encoder
Creating Code Parser
Creating Container
Creating Sink
Playing file /opt/nvidia/deepstream/deepstream-6.0/samples/streams/sample_qHD.h264 
Traceback (most recent call last):
  File "deepstream_ssd_parser.py", line 453, in <module>
    sys.exit(main(sys.argv))
  File "deepstream_ssd_parser.py", line 376, in main
    pgie.set_property("config-file-path", "dstest_ssd_nopostprocess.txt")
AttributeError: 'NoneType' object has no attribute 'set_property'```


Could you please help me?

[Amycao]

clean the cache, rm ~/.cache/gstreamer-1.0/ -rf and get the output of gst-inspect-1.0 nvinferserver