There is a error when run deepstream-mrcnn-app

Accelerated Computing Intelligent Video Analytics DeepStream SDK
#1

Please provide complete information as applicable to your setup.

**• Hardware Platform (Jetson / GPU) jetson Tx2
**• DeepStream Version 5.0
**• JetPack Version (valid for Jetson only) jetpack 4.4
• TensorRT Version
• NVIDIA GPU Driver Version (valid for GPU only)
• Sample application and the configuration file content
• Reproduce steps
• Reproducing rate and duration

when i run the sample of deepstream-mrcnn-app as below , i meet a error: unable to open the shared library, libnvds_amqp_proto.so.

would anyone like to give me help?

$ deepstream-mrcnn-app -c cfg_amqp.txt -i sample_720p.h264 -p /opt/nvidia/deepstream/deepstream-5.0/lib/libnvds_amqp_proto.so
Now playing: sample_720p.h264

Using winsys: x11

(deepstream-mrcnn-app:10007): GLib-CRITICAL **: 17:08:55.642: g_strrstr: assertion ‘haystack != NULL’ failed
Running…
ERROR from element nvmsg-broker: Could not initialize supporting library.
Error details: /dvs/git/dirty/git-master_linux/deepstream/sdk/src/gst-plugins/gst-nvmsgbroker/gstnvmsgbroker.c(359): legacy_gst_nvmsgbroker_start (): /GstPipeline:dsmrcnn-pipeline/GstNvMsgBroker:nvmsg-broker:
unable to open shared library
Returned, stopping playback
Deleting pipeline

How to run sample deepstream-mrcnn-app?
#3

please specify --conn-str
For Amqp - Connection string of format: host;port;username;password
–topic the topic you created

#4

Thanks for your reply.

there is still errors by --conn-str=localhost;5672;guest;guest

i set the " --con-str" according to the cfg_amqp.txt, am i right?

how to set the value of --conn-str?
would you like to give me a example of --conn-str?

below is the errors:
$ deepstream-mrcnn-app -i sample_720p.h264 -p libnvds_amqp_proto.so -c cfg_amqp.txt --conn-str=localhost;5672;gust;guest -topic=topicname
Now playing: sample_720p.h264

Using winsys: x11
Running…
ERROR from element nvmsg-broker: Could not initialize supporting library.
Error details: /dvs/git/dirty/git-master_linux/deepstream/sdk/src/gst-plugins/gst-nvmsgbroker/gstnvmsgbroker.c(359): legacy_gst_nvmsgbroker_start (): /GstPipeline:dsmrcnn-pipeline/GstNvMsgBroker:nvmsg-broker:
unable to open shared library
Returned, stopping playback
Deleting pipeline
bash: 5672: command not found
bash: gust: command not found
bash: guest: command not found

#5

that is correct if you not create user, queted the string “localhost;5672;gust;guest -topic=topicname” and try again.

#6

there is still a error by --conn-str=“localhost;5672;guest;guest” :
unable to open shared library.

should the port(5672) be like 192.168.1.2?
would you like to give me more suggestion?

below is the error:
$ deepstream-mrcnn-app -i sample_720p.h264 -p libnvds_amqp_proto.so -c cfg_amqp.txt --conn-str=“localhost;5672;guest;guest” -t “topicname”
Now playing: sample_720p.h264

Using winsys: x11
Running…
ERROR from element nvmsg-broker: Could not initialize supporting library.
Error details: gstnvmsgbroker.c(359): legacy_gst_nvmsgbroker_start (): /GstPipeline:dsmrcnn-pipeline/GstNvMsgBroker:nvmsg-broker:
unable to open shared library
Returned, stopping playback
Deleting pipeline

#7

make sure you can find the library in the current path you specified,
-p libnvds_amqp_proto.so
and make sure amqp server service running, check this,
sources/libs/amqp_protocol_adaptor/README

#8

according to the README, i have downloaded the rabbitmq-c.
but ,when cmake there is a error :
could NOT find OpenSSL.

would to like to give me a help again?

bellow the error:
djm@Hartai:~/rabbitmq-c/build$ cmake …
– The C compiler identification is GNU 7.5.0
– Check for working C compiler: /usr/bin/cc
– Check for working C compiler: /usr/bin/cc – works
– Detecting C compiler ABI info
– Detecting C compiler ABI info - done
– Detecting C compile features
– Detecting C compile features - done
– CMAKE_BUILD_TYPE not specified. Creating Release build
– Found C inline keyword: inline
– Looking for getaddrinfo
– Looking for getaddrinfo - found
– Looking for socket
– Looking for socket - found
– Looking for htonll
– Looking for htonll - not found
– Looking for poll
– Looking for poll - found
– Looking for clock_gettime in rt
– Looking for clock_gettime in rt - found
– Looking for posix_spawnp in rt
– Looking for posix_spawnp in rt - found
– Performing Test HAVE_GNU90
– Performing Test HAVE_GNU90 - Success
– Found POPT: /usr/include (found version “1.16”)
– Could NOT find XMLTO (missing: XMLTO_EXECUTABLE)
– Could NOT find Doxygen (missing: DOXYGEN_EXECUTABLE)
– Looking for pthread.h
– Looking for pthread.h - found
– Looking for pthread_create
– Looking for pthread_create - not found
– Looking for pthread_create in pthreads
– Looking for pthread_create in pthreads - not found
– Looking for pthread_create in pthread
– Looking for pthread_create in pthread - found
– Found Threads: TRUE
CMake Error at /usr/share/cmake-3.10/Modules/FindPackageHandleStandardArgs.cmake:137 (message):
Could NOT find OpenSSL, try to set the path to OpenSSL root folder in the
system variable OPENSSL_ROOT_DIR (missing: OPENSSL_CRYPTO_LIBRARY
OPENSSL_INCLUDE_DIR) (Required is at least version “0.9.8”)
Call Stack (most recent call first):
/usr/share/cmake-3.10/Modules/FindPackageHandleStandardArgs.cmake:378 (_FPHSA_FAILURE_MESSAGE)
/usr/share/cmake-3.10/Modules/FindOpenSSL.cmake:390 (find_package_handle_standard_args)
CMakeLists.txt:273 (find_package)

– Configuring incomplete, errors occurred!
See also “/home/djm/rabbitmq-c/build/CMakeFiles/CMakeOutput.log”.
See also “/home/djm/rabbitmq-c/build/CMakeFiles/CMakeError.log”.

#9

sudo apt-get install libssl-dev, try this.

#10

Thanks for your help!

according to your suggestion, it is correct .
after cmake , i can get the librabbitmq.so.4.2.0.

i will follow the further steps.

#11

i meet the “mask_rcnn_resnet50.etlt_b1_gpu0_int8.engine” open error,
when run deepstream-mrcnn-app.

i am using Tx2 with jetpack 4.4.

would you like to give me a help?

below the error:
djm@Hartai:/opt/nvidia/deepstream/deepstream-5.0/sources/apps/sample_apps/deepstream-mrcnn-test$ deepstream-mrcnn-app -i sample-720p.h264 -p libnvds_amqp_proto.so -c cfg_amqp.txt --conn-str=“localhost;5672;guest;guest” --topic=“topicname”
Now playing: sample-720p.h264

Using winsys: x11
Opening in BLOCKING MODE
ERROR: Deserialize engine failed because file path: /opt/nvidia/deepstream/deepstream-5.0/sources/apps/sample_apps/deepstream-mrcnn-test/…/…/…/…/samples/models/tlt_pretrained_models/mrcnn/mask_rcnn_resnet50.etlt_b1_gpu0_int8.engine open error
0:00:01.244412876 10486 0x2274ad30 WARN nvinfer gstnvinfer.cpp:616:gst_nvinfer_logger: NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1690> [UID = 1]: deserialize engine from file :/opt/nvidia/deepstream/deepstream-5.0/sources/apps/sample_apps/deepstream-mrcnn-test/…/…/…/…/samples/models/tlt_pretrained_models/mrcnn/mask_rcnn_resnet50.etlt_b1_gpu0_int8.engine failed
0:00:01.244489804 10486 0x2274ad30 WARN nvinfer gstnvinfer.cpp:616:gst_nvinfer_logger: NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:1797> [UID = 1]: deserialize backend context from engine from file :/opt/nvidia/deepstream/deepstream-5.0/sources/apps/sample_apps/deepstream-mrcnn-test/…/…/…/…/samples/models/tlt_pretrained_models/mrcnn/mask_rcnn_resnet50.etlt_b1_gpu0_int8.engine failed, try rebuild
0:00:01.244514828 10486 0x2274ad30 INFO nvinfer gstnvinfer.cpp:619:gst_nvinfer_logger: NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1715> [UID = 1]: Trying to create engine from model files
parseModel: Failed to open TLT encoded model file /opt/nvidia/deepstream/deepstream-5.0/sources/apps/sample_apps/deepstream-mrcnn-test/…/…/…/…/samples/models/tlt_pretrained_models/mrcnn/mask_rcnn_resnet50.etlt
ERROR: failed to build network since parsing model errors.
ERROR: Failed to create network using custom network creation function
ERROR: Failed to get cuda engine from custom library API
0:00:01.244985069 10486 0x2274ad30 ERROR nvinfer gstnvinfer.cpp:613:gst_nvinfer_logger: NvDsInferContext[UID 1]: Error in NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1735> [UID = 1]: build engine file failed
Segmentation fault (core dumped)

#12

You can get the models from here,

wget https://nvidia.box.com/shared/static/8k0zpe9gq837wsr0acoy4oh3fdf476gq.zip -O models.zip

which include mrcnn model.

#14

Thanks for your reply.

i will download it and try mrcnn agagin.

#15

i have downloaded the mrcnn model to the path:
/opt/nvidia/deepstream/deepstream-5.0/samples/models/tlt_pretrained_models/mrcnn.

there are two files: mask_rcnn_resnet50.etlt & cal.bin.
do not have the mask_rcnn_resnet50.etlt_b1_gpu0_int8.engine.

after download, i try to run deepstream-mrcnn-app again, there still have the error same as before.
that is “mask_rcnn_resnet50.etlt_b1_gpu0_int8.engine open error”.

how to get the engine file?
would you like to give me help again?

below is the error:

Using winsys: x11
Opening in BLOCKING MODE
ERROR: Deserialize engine failed because file path: /opt/nvidia/deepstream/deepstream-5.0/sources/apps/sample_apps/deepstream-mrcnn-test/…/…/…/…/samples/models/tlt_pretrained_models/mrcnn/mask_rcnn_resnet50.etlt_b1_gpu0_int8.engine open error
0:00:03.260159449 12232 0x2fc8db20 WARN nvinfer gstnvinfer.cpp:616:gst_nvinfer_logger: NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1690> [UID = 1]: deserialize engine from file :/opt/nvidia/deepstream/deepstream-5.0/sources/apps/sample_apps/deepstream-mrcnn-test/…/…/…/…/samples/models/tlt_pretrained_models/mrcnn/mask_rcnn_resnet50.etlt_b1_gpu0_int8.engine failed
0:00:03.260260248 12232 0x2fc8db20 WARN nvinfer gstnvinfer.cpp:616:gst_nvinfer_logger: NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:1797> [UID = 1]: deserialize backend context from engine from file :/opt/nvidia/deepstream/deepstream-5.0/sources/apps/sample_apps/deepstream-mrcnn-test/…/…/…/…/samples/models/tlt_pretrained_models/mrcnn/mask_rcnn_resnet50.etlt_b1_gpu0_int8.engine failed, try rebuild
0:00:03.260286936 12232 0x2fc8db20 INFO nvinfer gstnvinfer.cpp:619:gst_nvinfer_logger: NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1715> [UID = 1]: Trying to create engine from model files
ERROR: [TRT]: UffParser: Validator error: multilevel_propose_rois: Unsupported operation _MultilevelProposeROI_TRT
parseModel: Failed to parse UFF model
ERROR: failed to build network since parsing model errors.
ERROR: Failed to create network using custom network creation function
ERROR: Failed to get cuda engine from custom library API
0:00:04.334584996 12232 0x2fc8db20 ERROR nvinfer gstnvinfer.cpp:613:gst_nvinfer_logger: NvDsInferContext[UID 1]: Error in NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1735> [UID = 1]: build engine file failed

#17

Check this,

#19

I followed these instructions and am still receiving the following error:

ERROR: [TRT]: UffParser: Validator error: multilevel_propose_rois: Unsupported operation _MultilevelProposeROI_TRT
parseModel: Failed to parse UFF model
ERROR: failed to build network since parsing model errors.
ERROR: Failed to create network using custom network creation function
ERROR: Failed to get cuda engine from custom library API

I am on jetson nano using L4T 32.4.3 and DS5.0.

Previously I had /usr/lib/aarch64-linux-gnu/libnvinfer_plugin.so.7.1.3 installed and that didn’t work. So per the above instructions, I ran the following commands:

wget https://nvidia.box.com/shared/static/ezrjriq08q8fy8tvqcswgi0u6yn0bomg.1 -O libnvinfer_plugin.so.7.0.0.1
sudo mv /usr/lib/aarch64-linux-gnu/libnvinfer_plugin.so.7.1.3 ${HOME}/libnvinfer_plugin.so.7.1.3.bak
sudo cp libnvinfer_plugin.so.7.0.0.1 /usr/lib/aarch64-linux-gnu/libnvinfer_plugin.so.7.1.3
#20

does it means that TensorRT 7.1(Deepstream 5.0) is not suitable for running the deepstream-mrcnn-test?

if down to the TRT 7.0, what of the effect on other samples of deepstream-5.0 ?

#21

i am running the example of “deepstream-mrcnn-test”.
the “dsmrcnn_pgie_config.txt” should be used in that example ,i think.

in the “dsmrcnn_pgie_config.txt”,
the “model-engine-file” should be “mask_rcnn_resnet50.etlt-b1-gpu0-int8.engine”.

but, the error is not found “mask_rcnn_resnet50.etlt-b1-gpu0-int8.engine”.

how to get or download the “mask_rcnn_resnet50.etlt-b1-gpu0-int8.engine”?
should i change the libnvinfer_plugin.so from 7.1.3 to the 7.0.0.1?

below is a part of the “dsmrcnn_pgie_config.txt”:
[property]
net-scale-factor=0.017507
offsets=123.675;116.280;103.53
model-color-format=0
labelfile-path=…/…/…/…/samples/configs/tlt_pretrained_models/mrcnn_labels.txt
tlt-encoded-model=…/…/…/…/samples/models/tlt_pretrained_models/mrcnn/mask_rcnn_resnet50.etlt
tlt-model-key=nvidia_tlt
model-engine-file=…/…/…/…/samples/models/tlt_pretrained_models/mrcnn/mask_rcnn_resnet50.etlt_b1_gpu0_int8.engine
int8-calib-file=…/…/models/tlt_pretrained_models/mrcnn/cal.bin

#22

"I am on jetson nano using L4T 32.4.3 and DS5.0.

Previously I had /usr/lib/aarch64-linux-gnu/libnvinfer_plugin.so.7.1.3 installed and that didn’t work. So per the above instructions, I ran the following commands:"

–> clear the cache, and try again.
rm ~/.cache/gstreamer-1.0/ -rf

#23

it’s not an error, the engine will be built for the first time, after built, it will be saved, and you can use it next time.

#24

how to build the engine?