Please provide complete information as applicable to your setup.
Hardware Platform (Jetson / GPU) : NVIDIA A2
• DeepStream Version : 6.4
• JetPack Version (valid for Jetson only)
• TensorRT Version : 12.2
• NVIDIA GPU Driver Version (valid for GPU only) : 535.154.05
• Issue Type( questions, new requirements, bugs)
• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)
I am using deepstream_test3.py and added tracker and Sgie1 and Sgie2 models with triton
and I am getting below output
Output
[06-Feb-24 19:48:32][ERROR] Error: decodebin cannot be found
[06-Feb-24 19:48:32][ERROR] source not found in decodebin child
gstnvtracker: Loading low-level lib at /opt/nvidia/deepstream/deepstream/lib/libnvds_nvmultiobjecttracker.so
[NvMultiObjectTracker] Initialized
0:01:32.280886371 1 0x5653e6d474c0 WARN nvinferserver gstnvinferserver_impl.cpp:360:validatePluginConfig: warning: Configuration file batch-size reset to: 40
ERROR: infer_trtis_server.cpp:994 Triton: failed to create repo server, triton_err_str:Not found, err_msg:unable to load shared library: /opt/tritonserver/backends/pytorch/libtorchtrt_runtime.so: undefined symbol: _ZN3c106detail14torchCheckFailEPKcS2_jRKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE
ERROR: infer_trtis_server.cpp:840 failed to initialize trtserver on repo dir: root: “/opt/nvidia/deepstream/deepstream-6.4/samples/triton_model_repo”
strict_model_config: true
0:01:32.282805008 1 0x5653e6d474c0 ERROR nvinferserver gstnvinferserver.cpp:408:gst_nvinfer_server_logger: nvinferserver[UID 1]: Error in createNNBackend() <infer_trtis_context.cpp:256> [UID = 1]: model:peoplenet get triton server instance failed. repo:root: “/opt/nvidia/deepstream/deepstream-6.4/samples/triton_model_repo”
strict_model_config: true
0:01:32.282815648 1 0x5653e6d474c0 ERROR nvinferserver gstnvinferserver.cpp:408:gst_nvinfer_server_logger: nvinferserver[UID 1]: Error in initialize() <infer_base_context.cpp:79> [UID = 1]: create nn-backend failed, check config file settings, nvinfer error:NVDSINFER_TRITON_ERROR
0:01:32.282828018 1 0x5653e6d474c0 WARN nvinferserver gstnvinferserver_impl.cpp:592:start: error: Failed to initialize InferTrtIsContext
0:01:32.282832148 1 0x5653e6d474c0 WARN nvinferserver gstnvinferserver_impl.cpp:592:start: error: Config file path: /opt/nvidia/deepstream/deepstream-6.4/samples/triton_model_repo/peoplenet/config_triton_infer_primary_peoplenet.txt
0:01:32.282853438 1 0x5653e6d474c0 WARN nvinferserver gstnvinferserver.cpp:518:gst_nvinfer_server_start: error: gstnvinferserver_impl start failed
WARNING: infer_proto_utils.cpp:144 auto-update preprocess.network_format to IMAGE_FORMAT_RGB
[NvMultiObjectTracker] De-initialized
[06-Feb-24 19:48:33][INFO]
**PERF: {‘stream0’: 0.0, ‘stream1’: 0.0, ‘stream2’: 0.0, ‘stream3’: 0.0, ‘stream4’: 0.0, ‘stream5’: 0.0, ‘stream6’: 0.0, ‘stream7’: 0.0, ‘stream8’: 0.0, ‘stream9’: 0.0, ‘stream10’: 0.0, ‘stream11’: 0.0, ‘stream12’: 0.0, ‘stream13’: 0.0, ‘stream14’: 0.0, ‘stream15’: 0.0, ‘stream16’: 0.0, ‘stream17’: 0.0, ‘stream18’: 0.0, ‘stream19’: 0.0, ‘stream20’: 0.0, ‘stream21’: 0.0, ‘stream22’: 0.0, ‘stream23’: 0.0, ‘stream24’: 0.0, ‘stream25’: 0.0, ‘stream26’: 0.0, ‘stream27’: 0.0, ‘stream28’: 0.0, ‘stream29’: 0.0, ‘stream30’: 0.0, ‘stream31’: 0.0, ‘stream32’: 0.0, ‘stream33’: 0.0, ‘stream34’: 0.0, ‘stream35’: 0.0, ‘stream36’: 0.0, ‘stream37’: 0.0, ‘stream38’: 0.0, ‘stream39’: 0.0}
Warning: gst-library-error-quark: Configuration file batch-size reset to: 40 (5): gstnvinferserver_impl.cpp(360): validatePluginConfig (): /GstPipeline:pipeline0/GstNvInferServer:primary-inference
Warning: gst-library-error-quark: Configuration file batch-size reset to: 40 (5): gstnvinferserver_impl.cpp(360): validatePluginConfig (): /GstPipeline:pipeline0/GstNvInferServer:primary-inference
Warning: gst-library-error-quark: Configuration file batch-size reset to: 40 (5): gstnvinferserver_impl.cpp(360): validatePluginConfig (): /GstPipeline:pipeline0/GstNvInferServer:primary-inference
Warning: gst-library-error-quark: Configuration file batch-size reset to: 40 (5): gstnvinferserver_impl.cpp(360): validatePluginConfig (): /GstPipeline:pipeline0/GstNvInferServer:primary-inference
Error: gst-resource-error-quark: Failed to initialize InferTrtIsContext (1): gstnvinferserver_impl.cpp(592): start (): /GstPipeline:pipeline0/GstNvInferServer:primary-inference:
Config file path: /opt/nvidia/deepstream/deepstream-6.4/samples/triton_model_repo/peoplenet/config_triton_infer_primary_peoplenet.txt
Error: gst-resource-error-quark: Failed to initialize InferTrtIsContext (1): gstnvinferserver_impl.cpp(592): start (): /GstPipeline:pipeline0/GstNvInferServer:primary-inference:
Config file path: /opt/nvidia/deepstream/deepstream-6.4/samples/triton_model_repo/peoplenet/config_triton_infer_primary_peoplenet.txt
Error: gst-resource-error-quark: Failed to initialize InferTrtIsContext (1): gstnvinferserver_impl.cpp(592): start (): /GstPipeline:pipeline0/GstNvInferServer:primary-inference:
Config file path: /opt/nvidia/deepstream/deepstream-6.4/samples/triton_model_repo/peoplenet/config_triton_infer_primary_peoplenet.txt
Error: gst-resource-error-quark: Failed to initialize InferTrtIsContext (1): gstnvinferserver_impl.cpp(592): start (): /GstPipeline:pipeline0/GstNvInferServer:primary-inference:
Config file path: /opt/nvidia/deepstream/deepstream-6.4/samples/triton_model_repo/peoplenet/config_triton_infer_primary_peoplenet.txt
[06-Feb-24 19:48:33][INFO] Exiting app