There is a error when run deepstream-mrcnn-app

Accelerated Computing Intelligent Video Analytics DeepStream SDK
#1

Please provide complete information as applicable to your setup.

**• Hardware Platform (Jetson / GPU) jetson Tx2
**• DeepStream Version 5.0
**• JetPack Version (valid for Jetson only) jetpack 4.4
• TensorRT Version
• NVIDIA GPU Driver Version (valid for GPU only)
• Sample application and the configuration file content
• Reproduce steps
• Reproducing rate and duration

when i run the sample of deepstream-mrcnn-app as below , i meet a error: unable to open the shared library, libnvds_amqp_proto.so.

would anyone like to give me help?

$ deepstream-mrcnn-app -c cfg_amqp.txt -i sample_720p.h264 -p /opt/nvidia/deepstream/deepstream-5.0/lib/libnvds_amqp_proto.so
Now playing: sample_720p.h264

Using winsys: x11

(deepstream-mrcnn-app:10007): GLib-CRITICAL **: 17:08:55.642: g_strrstr: assertion ‘haystack != NULL’ failed
Running…
ERROR from element nvmsg-broker: Could not initialize supporting library.
Error details: /dvs/git/dirty/git-master_linux/deepstream/sdk/src/gst-plugins/gst-nvmsgbroker/gstnvmsgbroker.c(359): legacy_gst_nvmsgbroker_start (): /GstPipeline:dsmrcnn-pipeline/GstNvMsgBroker:nvmsg-broker:
unable to open shared library
Returned, stopping playback
Deleting pipeline

How to run sample deepstream-mrcnn-app?
#3

please specify --conn-str
For Amqp - Connection string of format: host;port;username;password
–topic the topic you created

#4

Thanks for your reply.

there is still errors by --conn-str=localhost;5672;guest;guest

i set the " --con-str" according to the cfg_amqp.txt, am i right?

how to set the value of --conn-str?
would you like to give me a example of --conn-str?

below is the errors:
$ deepstream-mrcnn-app -i sample_720p.h264 -p libnvds_amqp_proto.so -c cfg_amqp.txt --conn-str=localhost;5672;gust;guest -topic=topicname
Now playing: sample_720p.h264

Using winsys: x11
Running…
ERROR from element nvmsg-broker: Could not initialize supporting library.
Error details: /dvs/git/dirty/git-master_linux/deepstream/sdk/src/gst-plugins/gst-nvmsgbroker/gstnvmsgbroker.c(359): legacy_gst_nvmsgbroker_start (): /GstPipeline:dsmrcnn-pipeline/GstNvMsgBroker:nvmsg-broker:
unable to open shared library
Returned, stopping playback
Deleting pipeline
bash: 5672: command not found
bash: gust: command not found
bash: guest: command not found

#5

that is correct if you not create user, queted the string “localhost;5672;gust;guest -topic=topicname” and try again.

#6

there is still a error by --conn-str=“localhost;5672;guest;guest” :
unable to open shared library.

should the port(5672) be like 192.168.1.2?
would you like to give me more suggestion?

below is the error:
$ deepstream-mrcnn-app -i sample_720p.h264 -p libnvds_amqp_proto.so -c cfg_amqp.txt --conn-str=“localhost;5672;guest;guest” -t “topicname”
Now playing: sample_720p.h264

Using winsys: x11
Running…
ERROR from element nvmsg-broker: Could not initialize supporting library.
Error details: gstnvmsgbroker.c(359): legacy_gst_nvmsgbroker_start (): /GstPipeline:dsmrcnn-pipeline/GstNvMsgBroker:nvmsg-broker:
unable to open shared library
Returned, stopping playback
Deleting pipeline

#7

make sure you can find the library in the current path you specified,
-p libnvds_amqp_proto.so
and make sure amqp server service running, check this,
sources/libs/amqp_protocol_adaptor/README

#8

according to the README, i have downloaded the rabbitmq-c.
but ,when cmake there is a error :
could NOT find OpenSSL.

would to like to give me a help again?

bellow the error:
djm@Hartai:~/rabbitmq-c/build$ cmake …
– The C compiler identification is GNU 7.5.0
– Check for working C compiler: /usr/bin/cc
– Check for working C compiler: /usr/bin/cc – works
– Detecting C compiler ABI info
– Detecting C compiler ABI info - done
– Detecting C compile features
– Detecting C compile features - done
– CMAKE_BUILD_TYPE not specified. Creating Release build
– Found C inline keyword: inline
– Looking for getaddrinfo
– Looking for getaddrinfo - found
– Looking for socket
– Looking for socket - found
– Looking for htonll
– Looking for htonll - not found
– Looking for poll
– Looking for poll - found
– Looking for clock_gettime in rt
– Looking for clock_gettime in rt - found
– Looking for posix_spawnp in rt
– Looking for posix_spawnp in rt - found
– Performing Test HAVE_GNU90
– Performing Test HAVE_GNU90 - Success
– Found POPT: /usr/include (found version “1.16”)
– Could NOT find XMLTO (missing: XMLTO_EXECUTABLE)
– Could NOT find Doxygen (missing: DOXYGEN_EXECUTABLE)
– Looking for pthread.h
– Looking for pthread.h - found
– Looking for pthread_create
– Looking for pthread_create - not found
– Looking for pthread_create in pthreads
– Looking for pthread_create in pthreads - not found
– Looking for pthread_create in pthread
– Looking for pthread_create in pthread - found
– Found Threads: TRUE
CMake Error at /usr/share/cmake-3.10/Modules/FindPackageHandleStandardArgs.cmake:137 (message):
Could NOT find OpenSSL, try to set the path to OpenSSL root folder in the
system variable OPENSSL_ROOT_DIR (missing: OPENSSL_CRYPTO_LIBRARY
OPENSSL_INCLUDE_DIR) (Required is at least version “0.9.8”)
Call Stack (most recent call first):
/usr/share/cmake-3.10/Modules/FindPackageHandleStandardArgs.cmake:378 (_FPHSA_FAILURE_MESSAGE)
/usr/share/cmake-3.10/Modules/FindOpenSSL.cmake:390 (find_package_handle_standard_args)
CMakeLists.txt:273 (find_package)

– Configuring incomplete, errors occurred!
See also “/home/djm/rabbitmq-c/build/CMakeFiles/CMakeOutput.log”.
See also “/home/djm/rabbitmq-c/build/CMakeFiles/CMakeError.log”.

#9

sudo apt-get install libssl-dev, try this.

#10

Thanks for your help!

according to your suggestion, it is correct .
after cmake , i can get the librabbitmq.so.4.2.0.

i will follow the further steps.

#11

i meet the “mask_rcnn_resnet50.etlt_b1_gpu0_int8.engine” open error,
when run deepstream-mrcnn-app.

i am using Tx2 with jetpack 4.4.

would you like to give me a help?

below the error:
djm@Hartai:/opt/nvidia/deepstream/deepstream-5.0/sources/apps/sample_apps/deepstream-mrcnn-test$ deepstream-mrcnn-app -i sample-720p.h264 -p libnvds_amqp_proto.so -c cfg_amqp.txt --conn-str=“localhost;5672;guest;guest” --topic=“topicname”
Now playing: sample-720p.h264

Using winsys: x11
Opening in BLOCKING MODE
ERROR: Deserialize engine failed because file path: /opt/nvidia/deepstream/deepstream-5.0/sources/apps/sample_apps/deepstream-mrcnn-test/…/…/…/…/samples/models/tlt_pretrained_models/mrcnn/mask_rcnn_resnet50.etlt_b1_gpu0_int8.engine open error
0:00:01.244412876 10486 0x2274ad30 WARN nvinfer gstnvinfer.cpp:616:gst_nvinfer_logger: NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1690> [UID = 1]: deserialize engine from file :/opt/nvidia/deepstream/deepstream-5.0/sources/apps/sample_apps/deepstream-mrcnn-test/…/…/…/…/samples/models/tlt_pretrained_models/mrcnn/mask_rcnn_resnet50.etlt_b1_gpu0_int8.engine failed
0:00:01.244489804 10486 0x2274ad30 WARN nvinfer gstnvinfer.cpp:616:gst_nvinfer_logger: NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:1797> [UID = 1]: deserialize backend context from engine from file :/opt/nvidia/deepstream/deepstream-5.0/sources/apps/sample_apps/deepstream-mrcnn-test/…/…/…/…/samples/models/tlt_pretrained_models/mrcnn/mask_rcnn_resnet50.etlt_b1_gpu0_int8.engine failed, try rebuild
0:00:01.244514828 10486 0x2274ad30 INFO nvinfer gstnvinfer.cpp:619:gst_nvinfer_logger: NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1715> [UID = 1]: Trying to create engine from model files
parseModel: Failed to open TLT encoded model file /opt/nvidia/deepstream/deepstream-5.0/sources/apps/sample_apps/deepstream-mrcnn-test/…/…/…/…/samples/models/tlt_pretrained_models/mrcnn/mask_rcnn_resnet50.etlt
ERROR: failed to build network since parsing model errors.
ERROR: Failed to create network using custom network creation function
ERROR: Failed to get cuda engine from custom library API
0:00:01.244985069 10486 0x2274ad30 ERROR nvinfer gstnvinfer.cpp:613:gst_nvinfer_logger: NvDsInferContext[UID 1]: Error in NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1735> [UID = 1]: build engine file failed
Segmentation fault (core dumped)

#12

You can get the models from here,

wget https://nvidia.box.com/shared/static/8k0zpe9gq837wsr0acoy4oh3fdf476gq.zip -O models.zip

which include mrcnn model.

#14

Thanks for your reply.

i will download it and try mrcnn agagin.

#15

i have downloaded the mrcnn model to the path:
/opt/nvidia/deepstream/deepstream-5.0/samples/models/tlt_pretrained_models/mrcnn.

there are two files: mask_rcnn_resnet50.etlt & cal.bin.
do not have the mask_rcnn_resnet50.etlt_b1_gpu0_int8.engine.

after download, i try to run deepstream-mrcnn-app again, there still have the error same as before.
that is “mask_rcnn_resnet50.etlt_b1_gpu0_int8.engine open error”.

how to get the engine file?
would you like to give me help again?

below is the error:

Using winsys: x11
Opening in BLOCKING MODE
ERROR: Deserialize engine failed because file path: /opt/nvidia/deepstream/deepstream-5.0/sources/apps/sample_apps/deepstream-mrcnn-test/…/…/…/…/samples/models/tlt_pretrained_models/mrcnn/mask_rcnn_resnet50.etlt_b1_gpu0_int8.engine open error
0:00:03.260159449 12232 0x2fc8db20 WARN nvinfer gstnvinfer.cpp:616:gst_nvinfer_logger: NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1690> [UID = 1]: deserialize engine from file :/opt/nvidia/deepstream/deepstream-5.0/sources/apps/sample_apps/deepstream-mrcnn-test/…/…/…/…/samples/models/tlt_pretrained_models/mrcnn/mask_rcnn_resnet50.etlt_b1_gpu0_int8.engine failed
0:00:03.260260248 12232 0x2fc8db20 WARN nvinfer gstnvinfer.cpp:616:gst_nvinfer_logger: NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:1797> [UID = 1]: deserialize backend context from engine from file :/opt/nvidia/deepstream/deepstream-5.0/sources/apps/sample_apps/deepstream-mrcnn-test/…/…/…/…/samples/models/tlt_pretrained_models/mrcnn/mask_rcnn_resnet50.etlt_b1_gpu0_int8.engine failed, try rebuild
0:00:03.260286936 12232 0x2fc8db20 INFO nvinfer gstnvinfer.cpp:619:gst_nvinfer_logger: NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1715> [UID = 1]: Trying to create engine from model files
ERROR: [TRT]: UffParser: Validator error: multilevel_propose_rois: Unsupported operation _MultilevelProposeROI_TRT
parseModel: Failed to parse UFF model
ERROR: failed to build network since parsing model errors.
ERROR: Failed to create network using custom network creation function
ERROR: Failed to get cuda engine from custom library API
0:00:04.334584996 12232 0x2fc8db20 ERROR nvinfer gstnvinfer.cpp:613:gst_nvinfer_logger: NvDsInferContext[UID 1]: Error in NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1735> [UID = 1]: build engine file failed

#17

Check this,