Please provide complete information as applicable to your setup.
• Hardware Platform (Jetson / GPU)
Jetson
• DeepStream Version
6.0
• JetPack Version (valid for Jetson only)
4.6
• TensorRT Version
8.0.1.6-1+cuda10.2
• Issue Type( questions, new requirements, bugs)
Question / Bug
• How to reproduce the issue? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)
- Download and flash sd-card with JetPack 4.6, configure system basics.
- Pull tag for docker: docker pull nvcr.io/nvidia/deepstream-l4t:6.0-triton
- Get into the docker container with this command
sudo docker run -it --rm --net=host --runtime nvidia -e DISPLAY=$DISPLAY -w /opt/nvidia/deepstream/deepstream-6.0 -v /tmp/.X11-unix/:/tmp/.X11-unix nvcr.io/nvidia/deepstream-l4t:6.0-triton
- Run application example, see output below.
• Description
I have been developing applications with dGPU x86-64 with DeepStream 6.0 EA and Triton Server inside a Docker container.
I’m having many troubles running the applications in the Jetson Nano, with Nvidia Docker DeepStream 6.0 + Triton Server. I would like to use the same python applications running on dGPU on the Jetson. Running PythonApps, can’t find nvinferserver plugins, streammux, etc.
So, I went to the deepstream-app C++ basic example. And it can’t find nvstreammux.
I noticed similar issues with 6.0 EA containers for Jetson. On x86-64 dGPU everything works fine.
What error I may have done? Step missed?
Why I can’t find nvstreammux or nvinferserver?
How do I check that Triton server is installed and reachable by DeepStream?
Things I’ve tried:
rm -rf gst cache stuff
check gst inspect: plugins are missing, blacklisted.
Also, in this container which has Triton tag, I don’t see any evidence that it is actually installed.
Check /opt for tritonserver: missing!
• Outputs
root@63c4c44f4010:/opt/nvidia/deepstream/deepstream-6.0/samples/configs/deepstream-app-triton# deepstream-app -c source1_primary_detector_nano.txt
0:00:00.000136879 81 0x22b29e00 INFO GST_INIT gst.c:586:init_pre: Initializing GStreamer Core Library version 1.14.5
0:00:00.000225422 81 0x22b29e00 INFO GST_INIT gst.c:587:init_pre: Using library installed in /usr/lib/aarch64-linux-gnu
0:00:00.000267246 81 0x22b29e00 INFO GST_INIT gst.c:607:init_pre: Linux 63c4c44f4010 4.9.253-tegra #1 SMP PREEMPT Mon Jul 26 12:13:06 PDT 2021 aarch64
0:00:00.000899136 81 0x22b29e00 INFO GST_INIT gstmessage.c:127:_priv_gst_message_initialize: init messages
0:00:00.002041559 81 0x22b29e00 INFO GST_INIT gstcontext.c:84:_priv_gst_context_initialize: init contexts
0:00:00.002474382 81 0x22b29e00 INFO GST_PLUGIN_LOADING gstplugin.c:317:_priv_gst_plugin_initialize: registering 0 static plugins
0:00:00.002736471 81 0x22b29e00 INFO GST_PLUGIN_LOADING gstplugin.c:225:gst_plugin_register_static: registered static plugin "staticelements"
0:00:00.002780795 81 0x22b29e00 INFO GST_PLUGIN_LOADING gstplugin.c:227:gst_plugin_register_static: added static plugin "staticelements", result: 1
0:00:00.002850276 81 0x22b29e00 INFO GST_REGISTRY gstregistry.c:1727:ensure_current_registry: reading registry cache: /root/.cache/gstreamer-1.0/registry.aarch64.bin
0:00:00.045395809 81 0x22b29e00 INFO GST_REGISTRY gstregistrybinary.c:621:priv_gst_registry_binary_read_cache: loaded /root/.cache/gstreamer-1.0/registry.aarch64.bin in 0.042467 seconds
0:00:00.045576647 81 0x22b29e00 INFO GST_REGISTRY gstregistry.c:1583:scan_and_update_registry: Validating plugins from registry cache: /root/.cache/gstreamer-1.0/registry.aarch64.bin
0:00:00.052244929 81 0x22b29e00 INFO GST_REGISTRY gstregistry.c:1685:scan_and_update_registry: Registry cache has not changed
0:00:00.052294149 81 0x22b29e00 INFO GST_REGISTRY gstregistry.c:1762:ensure_current_registry: registry reading and updating done, result = 1
0:00:00.052330296 81 0x22b29e00 INFO GST_INIT gst.c:807:init_post: GLib runtime version: 2.56.4
0:00:00.052353265 81 0x22b29e00 INFO GST_INIT gst.c:809:init_post: GLib headers version: 2.56.4
0:00:00.052369203 81 0x22b29e00 INFO GST_INIT gst.c:810:init_post: initialized GStreamer successfully
0:00:00.053548762 81 0x22b29e00 INFO GST_ELEMENT_FACTORY gstelementfactory.c:359:gst_element_factory_create: creating element "pipeline" named "pipeline"
0:00:00.053796268 81 0x22b29e00 INFO GST_ELEMENT_FACTORY gstelementfactory.c:359:gst_element_factory_create: creating element "bin" named "multi_src_bin"
0:00:00.053877572 81 0x22b29e00 WARN GST_ELEMENT_FACTORY gstelementfactory.c:456:gst_element_factory_make: no such element factory "nvstreammux"!
** ERROR: <create_multi_source_bin:1423>: Failed to create element 'src_bin_muxer'
** ERROR: <create_multi_source_bin:1516>: create_multi_source_bin failed
** ERROR: <create_pipeline:1323>: create_pipeline failed
** ERROR: <main:639>: Failed to create pipeline
Quitting
0:00:00.154257697 81 0x22b29e00 INFO GST_STATES gstelement.c:2676:gst_element_continue_state:<pipeline> completed state change to NULL
0:00:01.054291604 81 0x22b29e00 INFO GST_REFCOUNTING gstelement.c:3251:gst_element_dispose:<pipeline> 0x22d5e110 dispose
0:00:01.054462285 81 0x22b29e00 INFO GST_REFCOUNTING gstelement.c:3297:gst_element_dispose:<pipeline> 0x22d5e110 parent class dispose
0:00:01.054666040 81 0x22b29e00 INFO GST_REFCOUNTING gstelement.c:3328:gst_element_finalize:<pipeline> 0x22d5e110 finalize
0:00:01.054889222 81 0x22b29e00 INFO GST_REFCOUNTING gstelement.c:3334:gst_element_finalize:<pipeline> 0x22d5e110 finalize parent
App run failed
0:00:01.055415693 81 0x22b29e00 INFO GST_INIT gst.c:1083:gst_deinit: deinitializing GStreamer
0:00:01.069807021 81 0x22b29e00 INFO GST_INIT gst.c:1231:gst_deinit: deinitialized GStreamer
Infer server libs
# gst-inspect-1.0 libnvdsgst_inferserver.so
Plugin Details:
Name libnvdsgst_inferserver.so
Description Plugin for blacklisted file
Filename /usr/lib/aarch64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_inferserver.so
Version 0.0.0
License BLACKLIST
Source module BLACKLIST
Binary package BLACKLIST
Origin URL BLACKLIST
# ls /opt/nvidia/deepstream/deepstream-6.0/lib/
cvcore_libs libhiredis_ssl.a libnvds_azure_edge_proto.so libnvds_infer_server.so libnvds_msgconv.so.1.0.0 libnvds_utils.so
gst-plugins libhiredis_ssl.so libnvds_azure_proto.so libnvds_infercustomparser.so libnvds_msgconv_audio.so libnvdsgst_helper.so
libcustom_audioimpl.so libhiredis_ssl.so.1.0.0 libnvds_batch_jpegenc.so libnvds_inferlogger.so libnvds_msgconv_audio.so.1.0.0 libnvdsgst_inferbase.so
libcustom_videoimpl.so libiothub_client.so libnvds_csvparser.so libnvds_inferutils.so libnvds_nvmultiobjecttracker.so libnvdsgst_meta.so
libhiredis.a libiothub_client.so.1 libnvds_custom_sequence_preprocess.so libnvds_kafka_proto.so libnvds_nvtxhelper.so libnvdsgst_smartrecord.so
libhiredis.so libnvbufsurface.so libnvds_dewarper.so libnvds_logger.so libnvds_opticalflow_dgpu.so libnvdsgst_tensor.so
libhiredis.so.1.0.0 libnvbufsurftransform.so libnvds_dsanalytics.so libnvds_meta.so libnvds_opticalflow_jetson.so libtritonserver.so
libhiredis.so.1.0.1-dev libnvds_amqp_proto.so libnvds_infer.so libnvds_msgbroker.so libnvds_osd.so triton_backends
libhiredis.so.1.0.1-dev-ssl libnvds_audiotransform.so libnvds_infer_custom_parser_audio.so libnvds_msgconv.so libnvds_redis_proto.so