Graph composer - multiple warnings and errors

Have you install the Graph Composer packages correctly? Getting Started — DeepStream 6.1.1 Release documentation. Can you run our sample graphs correctly?

Graph composer executes, my first graph runs remotely. Localy it does not run so far.

Can you run the reference graphs on the target machine? What is your target machine?

  1. It is a Jetson Xavier NX 16 GB with JP 5.0.2.
  2. Yes, i.e. “deepstream-test1” runs without a problem.

How did you get these errors? Can you elaborate your steps?

Here are error log entries of the local execution:

2022-09-08 10:19:14  [Error] [omni.kit.app.impl] [py stderr]: e[1;31m2022-09-08 12:19:14.283 ERROR extensions/nvdssource/nvurisrcbin.hpp@36: Could not create GStreamer element 'nvurisrcbin'e[0m
2022-09-08 10:19:14  [Error] [omni.kit.app.impl] [py stderr]: 
2022-09-08 10:19:14  [Error] [omni.kit.app.impl] 
2022-09-08 10:19:14  [Error] [omni.kit.app.impl] [py stderr]: e[1;31m2022-09-08 12:19:14.283 ERROR gxf/std/program.cpp@337: Couldn't run async. Deactivating...e[0m
2022-09-08 10:19:14  [Error] [omni.kit.app.impl] [py stderr]: 
2022-09-08 10:19:14  [Error] [omni.kit.app.impl] 
2022-09-08 10:19:14  [Error] [omni.kit.app.impl] [py stderr]: e[1;31m2022-09-08 12:19:14.283 ERROR gxf/core/runtime.cpp@1166: Graph run failed with error: GXF_FAILUREe[0m
2022-09-08 10:19:14  [Error] [omni.kit.app.impl] [py stderr]: 
2022-09-08 10:19:14  [Error] [omni.kit.app.impl] 
2022-09-08 10:19:14  [Error] [omni.kit.app.impl] [py stderr]: e[1;31m2022-09-08 12:19:14.283 ERROR gxf/gxe/gxe.cpp@301: GxfGraphRunAsync Error: GXF_FAILUREe[0m
2022-09-08 10:19:14  [Error] [omni.kit.app.impl] [py stderr]: 

In the meantime I have cleared the registry cache and did a sync of the repos.
But when the composer is started, these errors coming up until app is ready.

2022-09-08 10:30:14  [Warning] [omni.ext.plugin] [ext: omni_kit] Extensions config 'extension.toml' doesn't exist '/tmp/.tmpNvXgRaphComposer/run/composer/omni_kit' or '/tmp/.tmpNvXgRaphComposer/run/composer/omni_kit/config'
2022-09-08 10:30:14  [Warning] [carb] FrameworkImpl::setDefaultPlugin(client: omni.gpu_foundation_factory.plugin, desc : [carb::graphics::Graphics v2.4], plugin : carb.graphics-vulkan.plugin) failed. Plugin selection is locked, because the interface was previously acquired by: 
2022-09-08 10:30:14  [Error] [gpu.foundation.plugin] Failed opening shader cache version file: /home/stefan/.cache/ov/Kit/103.1/66b6689c/shadercache/release/version
2022-09-08 10:30:14  [Error] [gpu.foundation.plugin] Failed to process shader cache version file
2022-09-08 10:30:14  [Warning] [omni.ext.plugin] [ext: omni.usd-1.5.2] '/tmp/.tmpNvXgRaphComposer/run/kit/plugins' in '[[native.plugin]]' was not found.
2022-09-08 10:30:14  [Error] [omni.kit.app.impl] [py stderr]: /tmp/.tmpNvXgRaphComposer/run/kit/python/lib/python3.7/asyncssh/crypto/cipher.py:29: CryptographyDeprecationWarning: Blowfish has been deprecated
2022-09-08 10:30:14  [Error] [omni.kit.app.impl]   from cryptography.hazmat.primitives.ciphers.algorithms import Blowfish, CAST5
2022-09-08 10:30:14  [Error] [omni.kit.app.impl] 
2022-09-08 10:30:14  [Error] [omni.kit.app.impl] [py stderr]: /tmp/.tmpNvXgRaphComposer/run/kit/python/lib/python3.7/asyncssh/crypto/cipher.py:29: CryptographyDeprecationWarning: CAST5 has been deprecated
2022-09-08 10:30:14  [Error] [omni.kit.app.impl]   from cryptography.hazmat.primitives.ciphers.algorithms import Blowfish, CAST5
2022-09-08 10:30:14  [Error] [omni.kit.app.impl] 
2022-09-08 10:30:14  [Error] [omni.kit.app.impl] [py stderr]: /tmp/.tmpNvXgRaphComposer/run/kit/python/lib/python3.7/asyncssh/crypto/cipher.py:30: CryptographyDeprecationWarning: SEED has been deprecated
2022-09-08 10:30:14  [Error] [omni.kit.app.impl]   from cryptography.hazmat.primitives.ciphers.algorithms import SEED, TripleDES

Can you run “gst-inspect-1.0 nvurisrcbin” in your device?

stefan@ubuntu20:/tmp/deepstream-test1-jetson$ gst-inspect-1.0 nvurisrcbin
Kein solches Element oder Plugin »nvurisrcbin«

→ in english: no such element or plugin “nvurisrcbin”

Your DeepStream SDK is not installed correctly. Please follow Quickstart Guide — DeepStream 6.1.1 Release documentation.

I did that:

Method 2: Download the DeepStream tar package: https://developer.nvidia.com/deepstream_sdk_v6.1.1_x86_64.tbz2

Navigate to the location of the downloaded DeepStream package to extract and install the DeepStream SDK:

$ sudo tar -xvf deepstream_sdk_v6.1.1_x86_64.tbz2 -C /
$ cd /opt/nvidia/deepstream/deepstream-6.1/
$ sudo ./install.sh
$ sudo ldconfig

What should I do else?

Are the driver version, cuda version and TensorRT version correct?

have you remove previous DeepStream before install the new?

All steps are in Quickstart Guide — DeepStream 6.1.1 Release documentation

Hello!

I have uninstalled and installed like described on Quickstart Guide — DeepStream 6.1.1 Release documentation .
Rebooted.

Next, started deepstream-app via commandline, before removed cache. Resulting in errors:

stefan@ubuntu20:/opt/nvidia/deepstream/deepstream-6.1/samples/configs/deepstream-app$ rm ${HOME}/.cache/gstreamer-1.0/registry.x86_64.bin
stefan@ubuntu20:/opt/nvidia/deepstream/deepstream-6.1/samples/configs/deepstream-app$ deepstream-app -c config_infer_primary.txt

(gst-plugin-scanner:4260): GStreamer-WARNING **: 12:53:40.830: Failed to load plugin '/usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_udp.so': librivermax.so.0: cannot open shared object file: No such file or directory

(gst-plugin-scanner:4260): GStreamer-WARNING **: 12:53:40.857: Failed to load plugin '/usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_ucx.so': libucs.so.0: cannot open shared object file: No such file or directory

(gst-plugin-scanner:4260): GStreamer-WARNING **: 12:53:40.907: Failed to load plugin '/usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_inferserver.so': libtritonserver.so: cannot open shared object file: No such file or directory
** ERROR: <main:716>: Failed to set pipeline to PAUSED
Quitting
ERROR from src_bin_muxer: Output width not set
Debug info: gstnvstreammux.c(2809): gst_nvstreammux_change_state (): /GstPipeline:pipeline/GstBin:multi_src_bin/GstNvStreamMux:src_bin_muxer

Something is wrong.

ongoing with deepstream-test2 running locally:

2022-09-09 13:36:35,021 - Composer - INFO - Running graph /opt/nvidia/deepstream/deepstream-6.1/reference_graphs/deepstream-test2/deepstream-test2.yaml
Graphs: deepstream-test2.yaml
Target: /opt/nvidia/graph-composer/config/target_x86_64.yaml
===================================================================
Running deepstream-test2.yaml
===================================================================
[INFO] Writing manifest to /tmp/ds.deepstream-test2/manifest.yaml 
2022-09-09 13:36:37,965 - Registry - INFO - Installing graph ...
2022-09-09 13:36:38,006 - Registry - INFO - Extension update found for extension: NvDsVisualizationExt
2022-09-09 13:36:38,006 - Registry - INFO - Old version: 1.0.0 New version: 1.0.1
2022-09-09 13:36:38,006 - Registry - INFO - Extension update found for extension: NvDsVisualizationExt
2022-09-09 13:36:38,006 - Registry - INFO - Old version: 1.0.0 New version: 1.0.2
2022-09-09 13:36:38,011 - Registry - INFO -
Requested target configuration:
arch: x86_64 os: linux distribution: ubuntu_20.04 cuda: 11.6 cudnn: 8.2.2.26 tensorrt: 8.2.3.0 deepstream: 6.1 vpi: 2.0.7

Selected extension variants:
StandardExtension
Version: 2.0.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04 cuda: 11.6
MultimediaExtension
Version: 2.0.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04
NvDsInterfaceExt
Version: 1.0.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04 deepstream: 6.1
NvDsBaseExt
Version: 1.0.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04 deepstream: 6.1
NvDsInferenceExt
Version: 1.0.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04 deepstream: 6.1
NvDsInferenceUtilsExt
Version: 1.0.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04 deepstream: 6.1
NvDsSourceExt
Version: 1.0.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04 deepstream: 6.1
NvDsMuxDemuxExt
Version: 1.0.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04 deepstream: 6.1
NvDsOutputSinkExt
Version: 1.0.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04 deepstream: 6.1
NvDsSampleModelsExt
Version: 1.0.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04 deepstream: 6.1
NvDsTrackerExt
Version: 1.0.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04 deepstream: 6.1
NvDsVisualizationExt
Version: 1.0.2 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04 deepstream: 6.1.1

Graph installed to output directory
2022-09-09 13:37:22.332 INFO  gxf/gxe/gxe.cpp@230: Creating context
2022-09-09 13:37:22.349 INFO  gxf/gxe/gxe.cpp@107: Loading app: '/opt/nvidia/deepstream/deepstream-6.1/reference_graphs/deepstream-test2/deepstream-test2.yaml'
2022-09-09 13:37:22.349 INFO  gxf/std/yaml_file_loader.cpp@117: Loading GXF entities from YAML file '/opt/nvidia/deepstream/deepstream-6.1/reference_graphs/deepstream-test2/deepstream-test2.yaml'...
2022-09-09 13:37:22.353 INFO  gxf/gxe/gxe.cpp@291: Initializing...
2022-09-09 13:37:22.367 INFO  extensions/nvdsbase/nvds_scheduler.cpp@265: This program is linked against GStreamer 1.16.3

2022-09-09 13:37:22.368 INFO  extensions/nvdssource/nvurisrcbin.hpp@24: initialize: nvurisrcbin nv_ds_single_src_input4..3908

2022-09-09 13:37:22.368 INFO  extensions/nvdsmuxdemux/nvstreammux.hpp@27: initialize: nvstreammux nv_ds_stream_mux7..f8d0

2022-09-09 13:37:22.368 INFO  extensions/nvdsinference/nvinferbin.hpp@24: initialize: nvinferbin nv_ds_infer11..3860

2022-09-09 13:37:22.368 INFO  extensions/nvdstracker/nvtrackerbin.hpp@23: initialize: nvtrackerbin nv_ds_tracker15..f208

2022-09-09 13:37:22.368 INFO  extensions/nvdsinference/nvinferbin.hpp@24: initialize: nvinferbin nv_ds_infer19..6ba8

2022-09-09 13:37:22.368 INFO  extensions/nvdsinference/nvinferbin.hpp@24: initialize: nvinferbin nv_ds_infer23..3a20

2022-09-09 13:37:22.369 INFO  extensions/nvdsinference/nvinferbin.hpp@24: initialize: nvinferbin nv_ds_infer27..1f28

2022-09-09 13:37:22.369 INFO  extensions/nvdsvisualization/nvosdbin.hpp@24: initialize: nvosdbin nv_ds_osd31..5940

2022-09-09 13:37:22.369 INFO  extensions/nvdsoutputsink/nvvideorenderersinkbin.hpp@24: initialize: nvvideorenderersinkbin nv_ds_video_renderer35..f8d0

2022-09-09 13:37:22.369 INFO  gxf/gxe/gxe.cpp@298: Running...
2022-09-09 13:37:22.369 INFO  extensions/nvdsbase/nvds_scheduler.cpp@116: Scheduling 9 elements and 1 components
2022-09-09 13:37:22.369 INFO  extensions/nvdssource/nvurisrcbin.hpp@32: create_element: nvurisrcbin nv_ds_single_src_input4..3908

2022-09-09 13:37:22.435 INFO  extensions/nvdssource/nvurisrcbin.hpp@56: bin_add: nvurisrcbin nv_ds_single_src_input4..3908

2022-09-09 13:37:22.435 INFO  extensions/nvdsmuxdemux/nvstreammux.hpp@37: create_element: nvstreammux nv_ds_stream_mux7..f8d0

2022-09-09 13:37:22.436 INFO  extensions/nvdsmuxdemux/nvstreammux.hpp@61: bin_add: nvstreammux nv_ds_stream_mux7..f8d0

2022-09-09 13:37:22.436 INFO  extensions/nvdsinference/nvinferbin.hpp@32: create_element: nvinferbin nv_ds_infer11..3860

2022-09-09 13:37:22.437 INFO  extensions/nvdsinference/nvinferbin.hpp@56: bin_add: nvinferbin nv_ds_infer11..3860

2022-09-09 13:37:22.437 INFO  extensions/nvdstracker/nvtrackerbin.hpp@31: create_element: nvtrackerbin nv_ds_tracker15..f208

2022-09-09 13:37:22.437 INFO  extensions/nvdstracker/nvtrackerbin.hpp@55: bin_add: nvtrackerbin nv_ds_tracker15..f208

2022-09-09 13:37:22.437 INFO  extensions/nvdsinference/nvinferbin.hpp@32: create_element: nvinferbin nv_ds_infer19..6ba8

2022-09-09 13:37:22.437 INFO  extensions/nvdsinference/nvinferbin.hpp@56: bin_add: nvinferbin nv_ds_infer19..6ba8

2022-09-09 13:37:22.438 INFO  extensions/nvdsinference/nvinferbin.hpp@32: create_element: nvinferbin nv_ds_infer23..3a20

2022-09-09 13:37:22.438 INFO  extensions/nvdsinference/nvinferbin.hpp@56: bin_add: nvinferbin nv_ds_infer23..3a20

2022-09-09 13:37:22.439 INFO  extensions/nvdsinference/nvinferbin.hpp@32: create_element: nvinferbin nv_ds_infer27..1f28

2022-09-09 13:37:22.439 INFO  extensions/nvdsinference/nvinferbin.hpp@56: bin_add: nvinferbin nv_ds_infer27..1f28

2022-09-09 13:37:22.439 INFO  extensions/nvdsvisualization/nvosdbin.hpp@32: create_element: nvosdbin nv_ds_osd31..5940

2022-09-09 13:37:22.441 INFO  extensions/nvdsvisualization/nvosdbin.hpp@56: bin_add: nvosdbin nv_ds_osd31..5940

2022-09-09 13:37:22.441 INFO  extensions/nvdsoutputsink/nvvideorenderersinkbin.hpp@32: create_element: nvvideorenderersinkbin nv_ds_video_renderer35..f8d0

2022-09-09 13:37:22.441 INFO  extensions/nvdsoutputsink/nvvideorenderersinkbin.hpp@54: bin_add: nvvideorenderersinkbin nv_ds_video_renderer35..f8d0

2022-09-09 11:37:22 [1,389,812ms] [Error] [omni.kit.app.impl] [py stderr]: libEGL warning: DRI3: Screen seems not DRI3 capable
libEGL warning: DRI3: Screen seems not DRI3 capable2022-09-09 11:37:22 [1,389,812ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:37:22 [1,389,812ms] [Error] [omni.kit.app.impl] [py stderr]: libEGL warning: DRI2: failed to authenticate
libEGL warning: DRI2: failed to authenticate2022-09-09 11:37:22 [1,389,812ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:37:23 [1,391,227ms] [Error] [omni.kit.app.impl] [py stderr]: 0:00:01.508068645  6004 0x7f3a48002360 WARN                 nvinfer gstnvinfer.cpp:643:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 4]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1897> [UID = 4]: deserialize engine from file :/tmp/ds.deepstream-test2/gxf/sample_models/sec.vehicletypes.resnet18.caffemodel_b16_gpu0_int8.engine failed
0:00:01.508068645  6004 0x7f3a48002360 WARN                 nvinfer gstnvinfer.cpp:643:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 4]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1897> [UID = 4]: deserialize engine from file :/tmp/ds.deepstream-test2/gxf/sample_models/sec.vehicletypes.resnet18.caffemodel_b16_gpu0_int8.engine failed2022-09-09 11:37:23 [1,391,227ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:37:23 [1,391,227ms] [Error] [omni.kit.app.impl] [py stderr]: 0:00:01.508130807  6004 0x7f3a48002360 WARN                 nvinfer gstnvinfer.cpp:643:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 4]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2002> [UID = 4]: deserialize backend context from engine from file :/tmp/ds.deepstream-test2/gxf/sample_models/sec.vehicletypes.resnet18.caffemodel_b16_gpu0_int8.engine failed, try rebuild
0:00:01.508130807  6004 0x7f3a48002360 WARN                 nvinfer gstnvinfer.cpp:643:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 4]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2002> [UID = 4]: deserialize backend context from engine from file :/tmp/ds.deepstream-test2/gxf/sample_models/sec.vehicletypes.resnet18.caffemodel_b16_gpu0_int8.engine failed, try rebuild2022-09-09 11:37:23 [1,391,227ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:37:23 [1,391,227ms] [Error] [omni.kit.app.impl] [py stderr]: 0:00:01.508137854  6004 0x7f3a48002360 INFO                 nvinfer gstnvinfer.cpp:646:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 4]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1923> [UID = 4]: Trying to create engine from model files
0:00:01.508137854  6004 0x7f3a48002360 INFO                 nvinfer gstnvinfer.cpp:646:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 4]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1923> [UID = 4]: Trying to create engine from model files2022-09-09 11:37:23 [1,391,227ms] [Error] [omni.kit.app.impl] [py stderr]: 


WARNING: ../nvdsinfer/nvdsinfer_model_builder.cpp:1482 Deserialize engine failed because file path: /tmp/ds.deepstream-test2/gxf/sample_models/sec.vehicletypes.resnet18.caffemodel_b16_gpu0_int8.engine open error
WARNING: [TRT]: The implicit batch dimension mode has been deprecated. Please create the network with NetworkDefinitionCreationFlag::kEXPLICIT_BATCH flag whenever possible.
Warning: Flatten layer ignored. TensorRT implicitly flattens input to FullyConnected layers, but in other circumstances this will result in undefined behavior.
2022-09-09 11:37:33 [1,400,471ms] [Error] [omni.kit.app.impl] [py stderr]: 0:00:10.743317720  6004 0x7f3a48002360 INFO                 nvinfer gstnvinfer.cpp:646:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 4]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1955> [UID = 4]: serialize cuda engine to file: /tmp/ds.deepstream-test2/gxf/sample_models/sec.vehicletypes.resnet18.caffemodel_b16_gpu0_int8.engine successfully
0:00:10.743317720  6004 0x7f3a48002360 INFO                 nvinfer gstnvinfer.cpp:646:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 4]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1955> [UID = 4]: serialize cuda engine to file: /tmp/ds.deepstream-test2/gxf/sample_models/sec.vehicletypes.resnet18.caffemodel_b16_gpu0_int8.engine successfully2022-09-09 11:37:33 [1,400,471ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:37:33 [1,400,472ms] [Error] [omni.kit.app.impl] [py stderr]: 0:00:10.746400160  6004 0x7f3a48002360 INFO                 nvinfer gstnvinfer_impl.cpp:328:notifyLoadModelStatus:<nvinfer_bin_nvinfer> [UID 4]: Load new model:/tmp/ds.deepstream-test2/gxf/sample_models/config_infer_secondary_vehicletypes.txt sucessfully
0:00:10.746400160  6004 0x7f3a48002360 INFO                 nvinfer gstnvinfer_impl.cpp:328:notifyLoadModelStatus:<nvinfer_bin_nvinfer> [UID 4]: Load new model:/tmp/ds.deepstream-test2/gxf/sample_models/config_infer_secondary_vehicletypes.txt sucessfully2022-09-09 11:37:33 [1,400,472ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:37:34 [1,401,476ms] [Error] [omni.kit.app.impl] [py stderr]: 0:00:11.755528450  6004 0x7f3a48002360 WARN                 nvinfer gstnvinfer.cpp:643:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 3]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1897> [UID = 3]: deserialize engine from file :/tmp/ds.deepstream-test2/gxf/sample_models/sec.carmake.resnet18.caffemodel_b16_gpu0_int8.engine failed
0:00:11.755528450  6004 0x7f3a48002360 WARN                 nvinfer gstnvinfer.cpp:643:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 3]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1897> [UID = 3]: deserialize engine from file :/tmp/ds.deepstream-test2/gxf/sample_models/sec.carmake.resnet18.caffemodel_b16_gpu0_int8.engine failed2022-09-09 11:37:34 [1,401,477ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:37:34 [1,401,477ms] [Error] [omni.kit.app.impl] [py stderr]: 0:00:11.755613757  6004 0x7f3a48002360 WARN                 nvinfer gstnvinfer.cpp:643:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 3]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2002> [UID = 3]: deserialize backend context from engine from file :/tmp/ds.deepstream-test2/gxf/sample_models/sec.carmake.resnet18.caffemodel_b16_gpu0_int8.engine failed, try rebuild
0:00:11.755613757  6004 0x7f3a48002360 WARN                 nvinfer gstnvinfer.cpp:643:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 3]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2002> [UID = 3]: deserialize backend context from engine from file :/tmp/ds.deepstream-test2/gxf/sample_models/sec.carmake.resnet18.caffemodel_b16_gpu0_int8.engine failed, try rebuild2022-09-09 11:37:34 [1,401,477ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:37:34 [1,401,477ms] [Error] [omni.kit.app.impl] [py stderr]: 0:00:11.755621045  6004 0x7f3a48002360 INFO                 nvinfer gstnvinfer.cpp:646:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 3]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1923> [UID = 3]: Trying to create engine from model files
0:00:11.755621045  6004 0x7f3a48002360 INFO                 nvinfer gstnvinfer.cpp:646:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 3]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1923> [UID = 3]: Trying to create engine from model files2022-09-09 11:37:34 [1,401,477ms] [Error] [omni.kit.app.impl] [py stderr]: 


INFO: ../nvdsinfer/nvdsinfer_model_builder.cpp:610 [Implicit Engine Info]: layers num: 2
0   INPUT  kFLOAT input_1         3x224x224
1   OUTPUT kFLOAT predictions/Softmax 6x1x1

WARNING: ../nvdsinfer/nvdsinfer_model_builder.cpp:1482 Deserialize engine failed because file path: /tmp/ds.deepstream-test2/gxf/sample_models/sec.carmake.resnet18.caffemodel_b16_gpu0_int8.engine open error
WARNING: [TRT]: The implicit batch dimension mode has been deprecated. Please create the network with NetworkDefinitionCreationFlag::kEXPLICIT_BATCH flag whenever possible.
Warning: Flatten layer ignored. TensorRT implicitly flattens input to FullyConnected layers, but in other circumstances this will result in undefined behavior.
2022-09-09 11:37:42 [1,410,220ms] [Error] [omni.kit.app.impl] [py stderr]: 0:00:20.488999584  6004 0x7f3a48002360 INFO                 nvinfer gstnvinfer.cpp:646:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 3]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1955> [UID = 3]: serialize cuda engine to file: /tmp/ds.deepstream-test2/gxf/sample_models/sec.carmake.resnet18.caffemodel_b16_gpu0_int8.engine successfully
0:00:20.488999584  6004 0x7f3a48002360 INFO                 nvinfer gstnvinfer.cpp:646:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 3]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1955> [UID = 3]: serialize cuda engine to file: /tmp/ds.deepstream-test2/gxf/sample_models/sec.carmake.resnet18.caffemodel_b16_gpu0_int8.engine successfully2022-09-09 11:37:42 [1,410,220ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:37:42 [1,410,220ms] [Error] [omni.kit.app.impl] [py stderr]: 0:00:20.492058696  6004 0x7f3a48002360 INFO                 nvinfer gstnvinfer_impl.cpp:328:notifyLoadModelStatus:<nvinfer_bin_nvinfer> [UID 3]: Load new model:/tmp/ds.deepstream-test2/gxf/sample_models/config_infer_secondary_carmake.txt sucessfully
0:00:20.492058696  6004 0x7f3a48002360 INFO                 nvinfer gstnvinfer_impl.cpp:328:notifyLoadModelStatus:<nvinfer_bin_nvinfer> [UID 3]: Load new model:/tmp/ds.deepstream-test2/gxf/sample_models/config_infer_secondary_carmake.txt sucessfully2022-09-09 11:37:42 [1,410,220ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:37:43 [1,411,217ms] [Error] [omni.kit.app.impl] [py stderr]: 0:00:21.497792793  6004 0x7f3a48002360 WARN                 nvinfer gstnvinfer.cpp:643:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 2]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1897> [UID = 2]: deserialize engine from file :/tmp/ds.deepstream-test2/gxf/sample_models/sec.carcolor.resnet18.caffemodel_b16_gpu0_int8.engine failed
0:00:21.497792793  6004 0x7f3a48002360 WARN                 nvinfer gstnvinfer.cpp:643:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 2]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1897> [UID = 2]: deserialize engine from file :/tmp/ds.deepstream-test2/gxf/sample_models/sec.carcolor.resnet18.caffemodel_b16_gpu0_int8.engine failed2022-09-09 11:37:43 [1,411,217ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:37:43 [1,411,217ms] [Error] [omni.kit.app.impl] [py stderr]: 0:00:21.497870226  6004 0x7f3a48002360 WARN                 nvinfer gstnvinfer.cpp:643:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 2]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2002> [UID = 2]: deserialize backend context from engine from file :/tmp/ds.deepstream-test2/gxf/sample_models/sec.carcolor.resnet18.caffemodel_b16_gpu0_int8.engine failed, try rebuild
0:00:21.497870226  6004 0x7f3a48002360 WARN                 nvinfer gstnvinfer.cpp:643:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 2]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2002> [UID = 2]: deserialize backend context from engine from file :/tmp/ds.deepstream-test2/gxf/sample_models/sec.carcolor.resnet18.caffemodel_b16_gpu0_int8.engine failed, try rebuild2022-09-09 11:37:43 [1,411,217ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:37:43 [1,411,217ms] [Error] [omni.kit.app.impl] [py stderr]: 0:00:21.497877304  6004 0x7f3a48002360 INFO                 nvinfer gstnvinfer.cpp:646:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 2]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1923> [UID = 2]: Trying to create engine from model files
0:00:21.497877304  6004 0x7f3a48002360 INFO                 nvinfer gstnvinfer.cpp:646:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 2]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1923> [UID = 2]: Trying to create engine from model files2022-09-09 11:37:43 [1,411,217ms] [Error] [omni.kit.app.impl] [py stderr]: 


INFO: ../nvdsinfer/nvdsinfer_model_builder.cpp:610 [Implicit Engine Info]: layers num: 2
0   INPUT  kFLOAT input_1         3x224x224
1   OUTPUT kFLOAT predictions/Softmax 20x1x1

WARNING: ../nvdsinfer/nvdsinfer_model_builder.cpp:1482 Deserialize engine failed because file path: /tmp/ds.deepstream-test2/gxf/sample_models/sec.carcolor.resnet18.caffemodel_b16_gpu0_int8.engine open error
WARNING: [TRT]: The implicit batch dimension mode has been deprecated. Please create the network with NetworkDefinitionCreationFlag::kEXPLICIT_BATCH flag whenever possible.
Warning: Flatten layer ignored. TensorRT implicitly flattens input to FullyConnected layers, but in other circumstances this will result in undefined behavior.
2022-09-09 11:37:52 [1,419,703ms] [Error] [omni.kit.app.impl] [py stderr]: 0:00:29.977437259  6004 0x7f3a48002360 INFO                 nvinfer gstnvinfer.cpp:646:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 2]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1955> [UID = 2]: serialize cuda engine to file: /tmp/ds.deepstream-test2/gxf/sample_models/sec.carcolor.resnet18.caffemodel_b16_gpu0_int8.engine successfully
0:00:29.977437259  6004 0x7f3a48002360 INFO                 nvinfer gstnvinfer.cpp:646:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 2]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1955> [UID = 2]: serialize cuda engine to file: /tmp/ds.deepstream-test2/gxf/sample_models/sec.carcolor.resnet18.caffemodel_b16_gpu0_int8.engine successfully2022-09-09 11:37:52 [1,419,703ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:37:52 [1,419,703ms] [Error] [omni.kit.app.impl] [py stderr]: 0:00:29.980004821  6004 0x7f3a48002360 INFO                 nvinfer gstnvinfer_impl.cpp:328:notifyLoadModelStatus:<nvinfer_bin_nvinfer> [UID 2]: Load new model:/tmp/ds.deepstream-test2/gxf/sample_models/config_infer_secondary_carcolor.txt sucessfully
0:00:29.980004821  6004 0x7f3a48002360 INFO                 nvinfer gstnvinfer_impl.cpp:328:notifyLoadModelStatus:<nvinfer_bin_nvinfer> [UID 2]: Load new model:/tmp/ds.deepstream-test2/gxf/sample_models/config_infer_secondary_carcolor.txt sucessfully2022-09-09 11:37:52 [1,419,703ms] [Error] [omni.kit.app.impl] [py stderr]: 


INFO: ../nvdsinfer/nvdsinfer_model_builder.cpp:610 [Implicit Engine Info]: layers num: 2
0   INPUT  kFLOAT input_1         3x224x224
1   OUTPUT kFLOAT predictions/Softmax 12x1x1

gstnvtracker: Loading low-level lib at /opt/nvidia/deepstream/deepstream/lib/libnvds_nvmultiobjecttracker.so
gstnvtracker: Batch processing is ON
gstnvtracker: Past frame output is OFF
[NvMultiObjectTracker] Initialized
2022-09-09 11:37:53 [1,420,761ms] [Error] [omni.kit.app.impl] [py stderr]: 0:00:31.037200660  6004 0x7f3a48002360 WARN                 nvinfer gstnvinfer.cpp:643:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1897> [UID = 1]: deserialize engine from file :/tmp/ds.deepstream-test2/gxf/sample_models/primary.resnet10.caffemodel_b1_gpu0_int8.engine failed
0:00:31.037200660  6004 0x7f3a48002360 WARN                 nvinfer gstnvinfer.cpp:643:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1897> [UID = 1]: deserialize engine from file :/tmp/ds.deepstream-test2/gxf/sample_models/primary.resnet10.caffemodel_b1_gpu0_int8.engine failed2022-09-09 11:37:53 [1,420,761ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:37:53 [1,420,761ms] [Error] [omni.kit.app.impl] [py stderr]: 0:00:31.037333807  6004 0x7f3a48002360 WARN                 nvinfer gstnvinfer.cpp:643:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2002> [UID = 1]: deserialize backend context from engine from file :/tmp/ds.deepstream-test2/gxf/sample_models/primary.resnet10.caffemodel_b1_gpu0_int8.engine failed, try rebuild
0:00:31.037333807  6004 0x7f3a48002360 WARN                 nvinfer gstnvinfer.cpp:643:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2002> [UID = 1]: deserialize backend context from engine from file :/tmp/ds.deepstream-test2/gxf/sample_models/primary.resnet10.caffemodel_b1_gpu0_int8.engine failed, try rebuild2022-09-09 11:37:53 [1,420,762ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:37:53 [1,420,762ms] [Error] [omni.kit.app.impl] [py stderr]: 0:00:31.037340812  6004 0x7f3a48002360 INFO                 nvinfer gstnvinfer.cpp:646:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1923> [UID = 1]: Trying to create engine from model files
0:00:31.037340812  6004 0x7f3a48002360 INFO                 nvinfer gstnvinfer.cpp:646:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1923> [UID = 1]: Trying to create engine from model files2022-09-09 11:37:53 [1,420,762ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:38:02 [1,430,158ms] [Error] [omni.kit.app.impl] [py stderr]: 0:00:40.436947981  6004 0x7f3a48002360 INFO                 nvinfer gstnvinfer.cpp:646:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1955> [UID = 1]: serialize cuda engine to file: /tmp/ds.deepstream-test2/gxf/sample_models/primary.resnet10.caffemodel_b1_gpu0_int8.engine successfully
0:00:40.436947981  6004 0x7f3a48002360 INFO                 nvinfer gstnvinfer.cpp:646:gst_nvinfer_logger:<nvinfer_bin_nvinfer> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1955> [UID = 1]: serialize cuda engine to file: /tmp/ds.deepstream-test2/gxf/sample_models/primary.resnet10.caffemodel_b1_gpu0_int8.engine successfully2022-09-09 11:38:02 [1,430,159ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:38:02 [1,430,159ms] [Error] [omni.kit.app.impl] [py stderr]: 0:00:40.438875495  6004 0x7f3a48002360 INFO                 nvinfer gstnvinfer_impl.cpp:328:notifyLoadModelStatus:<nvinfer_bin_nvinfer> [UID 1]: Load new model:/tmp/ds.deepstream-test2/gxf/sample_models/config_infer_primary.txt sucessfully
0:00:40.438875495  6004 0x7f3a48002360 INFO                 nvinfer gstnvinfer_impl.cpp:328:notifyLoadModelStatus:<nvinfer_bin_nvinfer> [UID 1]: Load new model:/tmp/ds.deepstream-test2/gxf/sample_models/config_infer_primary.txt sucessfully2022-09-09 11:38:02 [1,430,159ms] [Error] [omni.kit.app.impl] [py stderr]: 


WARNING: ../nvdsinfer/nvdsinfer_model_builder.cpp:1482 Deserialize engine failed because file path: /tmp/ds.deepstream-test2/gxf/sample_models/primary.resnet10.caffemodel_b1_gpu0_int8.engine open error
WARNING: [TRT]: The implicit batch dimension mode has been deprecated. Please create the network with NetworkDefinitionCreationFlag::kEXPLICIT_BATCH flag whenever possible.
INFO: ../nvdsinfer/nvdsinfer_model_builder.cpp:610 [Implicit Engine Info]: layers num: 3
0   INPUT  kFLOAT input_1         3x368x640
1   OUTPUT kFLOAT conv2d_bbox     16x23x40
2   OUTPUT kFLOAT conv2d_cov/Sigmoid 4x23x40

Running...
****** NvDsScheduler Runtime Keyboard controls:
p: Pause pipeline
r: Resume pipeline
q: Quit pipeline
2022-09-09 13:38:02.794 INFO  extensions/nvdsbase/nvds_scheduler.cpp@393: NvDsScheduler Pipeline ready

2022-09-09 13:38:02.963 INFO  extensions/nvdsbase/nvds_scheduler.cpp@378: NvDsScheduler Pipeline running

cuGraphicsGLRegisterBuffer failed with error(304) gst_eglglessink_cuda_init texture = 1
Source 0: Frame Number = 0 Total objects = 0 [ ]
Source 0: Frame Number = 1 Total objects = 0 [ ]
Source 0: Frame Number = 2 Total objects = 0 [ ]
Source 0: Frame Number = 3 Total objects = 8 [ Car:3 Person:5 ]
Source 0: Frame Number = 4 Total objects = 8 [ Car:3 Person:5 ]
Source 0: Frame Number = 5 Total objects = 9 [ Car:5 Person:4 ]
Source 0: Frame Number = 6 Total objects = 8 [ Car:4 Person:4 ]
Source 0: Frame Number = 7 Total objects = 7 [ Car:4 Person:3 ]
Source 0: Frame Number = 8 Total objects = 9 [ Car:5 Person:4 ]
Returned, stopping playback
2022-09-09 11:38:03 [1,430,784ms] [Error] [omni.kit.app.impl] [py stderr]: 0:00:41.056683089  6004 0x7f3a6c003c60 WARN                 nvinfer gstnvinfer.cpp:2125:gst_nvinfer_submit_input_buffer:<nvinfer_bin_nvinfer> error: Internal data stream error.
0:00:41.056683089  6004 0x7f3a6c003c60 WARN                 nvinfer gstnvinfer.cpp:2125:gst_nvinfer_submit_input_buffer:<nvinfer_bin_nvinfer> error: Internal data stream error.2022-09-09 11:38:03 [1,430,784ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:38:03 [1,430,784ms] [Error] [omni.kit.app.impl] [py stderr]: 0:00:41.056693720  6004 0x7f3a6c003c60 WARN                 nvinfer gstnvinfer.cpp:2125:gst_nvinfer_submit_input_buffer:<nvinfer_bin_nvinfer> error: streaming stopped, reason not-negotiated (-4)
0:00:41.056693720  6004 0x7f3a6c003c60 WARN                 nvinfer gstnvinfer.cpp:2125:gst_nvinfer_submit_input_buffer:<nvinfer_bin_nvinfer> error: streaming stopped, reason not-negotiated (-4)2022-09-09 11:38:03 [1,430,784ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:38:03 [1,430,784ms] [Error] [omni.kit.app.impl] [py stderr]: 2022-09-09 13:38:03.411 ERROR extensions/nvdsbase/nvds_scheduler.cpp@307: Error from /GstPipeline:NvDsScheduler-Pipeline/GstDsNvInferBin:SEC. CLASS. - VEHICLE TYPE..af28/nv_ds_infer27..1f28/GstNvInfer:nvinfer_bin_nvinfer: Internal data stream error.
2022-09-09 13:38:03.411 ERROR extensions/nvdsbase/nvds_scheduler.cpp@307: Error from /GstPipeline:NvDsScheduler-Pipeline/GstDsNvInferBin:SEC. CLASS. - VEHICLE TYPE..af28/nv_ds_infer27..1f28/GstNvInfer:nvinfer_bin_nvinfer: Internal data stream error.2022-09-09 11:38:03 [1,430,784ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:38:03 [1,430,784ms] [Error] [omni.kit.app.impl] [py stderr]: 2022-09-09 13:38:03.411 ERROR extensions/nvdsbase/nvds_scheduler.cpp@309: Debug info:
2022-09-09 13:38:03.411 ERROR extensions/nvdsbase/nvds_scheduler.cpp@309: Debug info:2022-09-09 11:38:03 [1,430,784ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:38:03 [1,430,784ms] [Error] [omni.kit.app.impl] [py stderr]: gstnvinfer.cpp(2125): gst_nvinfer_submit_input_buffer (): /GstPipeline:NvDsScheduler-Pipeline/GstDsNvInferBin:SEC. CLASS. - VEHICLE TYPE..af28/nv_ds_infer27..1f28/GstNvInfer:nvinfer_bin_nvinfer:
gstnvinfer.cpp(2125): gst_nvinfer_submit_input_buffer (): /GstPipeline:NvDsScheduler-Pipeline/GstDsNvInferBin:SEC. CLASS. - VEHICLE TYPE..af28/nv_ds_infer27..1f28/GstNvInfer:nvinfer_bin_nvinfer:2022-09-09 11:38:03 [1,430,784ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:38:03 [1,430,784ms] [Error] [omni.kit.app.impl] [py stderr]: streaming stopped, reason not-negotiated (-4)
streaming stopped, reason not-negotiated (-4)2022-09-09 11:38:03 [1,430,784ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:38:03 [1,430,784ms] [Error] [omni.kit.app.impl] [py stderr]: 2022-09-09 13:38:03.411 ERROR extensions/nvdsbase/nvds_scheduler.cpp@344: Error from /GstPipeline:NvDsScheduler-Pipeline/GstDsNvInferBin:SEC. CLASS. - VEHICLE TYPE..af28/nv_ds_infer27..1f28/GstNvInfer:nvinfer_bin_nvinfer: Internal data stream error.
2022-09-09 13:38:03.411 ERROR extensions/nvdsbase/nvds_scheduler.cpp@344: Error from /GstPipeline:NvDsScheduler-Pipeline/GstDsNvInferBin:SEC. CLASS. - VEHICLE TYPE..af28/nv_ds_infer27..1f28/GstNvInfer:nvinfer_bin_nvinfer: Internal data stream error.2022-09-09 11:38:03 [1,430,784ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:38:03 [1,430,784ms] [Error] [omni.kit.app.impl] [py stderr]: 2022-09-09 13:38:03.411 ERROR extensions/nvdsbase/nvds_scheduler.cpp@346: Debug info:
2022-09-09 13:38:03.411 ERROR extensions/nvdsbase/nvds_scheduler.cpp@346: Debug info:2022-09-09 11:38:03 [1,430,784ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:38:03 [1,430,784ms] [Error] [omni.kit.app.impl] [py stderr]: gstnvinfer.cpp(2125): gst_nvinfer_submit_input_buffer (): /GstPipeline:NvDsScheduler-Pipeline/GstDsNvInferBin:SEC. CLASS. - VEHICLE TYPE..af28/nv_ds_infer27..1f28/GstNvInfer:nvinfer_bin_nvinfer:
gstnvinfer.cpp(2125): gst_nvinfer_submit_input_buffer (): /GstPipeline:NvDsScheduler-Pipeline/GstDsNvInferBin:SEC. CLASS. - VEHICLE TYPE..af28/nv_ds_infer27..1f28/GstNvInfer:nvinfer_bin_nvinfer:2022-09-09 11:38:03 [1,430,784ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:38:03 [1,430,785ms] [Error] [omni.kit.app.impl] [py stderr]: streaming stopped, reason not-negotiated (-4)
streaming stopped, reason not-negotiated (-4)2022-09-09 11:38:03 [1,430,785ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:38:03 [1,430,785ms] [Error] [omni.kit.app.impl] [py stderr]: 0:00:41.061845953  6004 0x556cd7dcb6a0 WARN                 nvinfer gstnvinfer.cpp:2125:gst_nvinfer_submit_input_buffer:<nvinfer_bin_nvinfer> error: Internal data stream error.
0:00:41.061845953  6004 0x556cd7dcb6a0 WARN                 nvinfer gstnvinfer.cpp:2125:gst_nvinfer_submit_input_buffer:<nvinfer_bin_nvinfer> error: Internal data stream error.2022-09-09 11:38:03 [1,430,785ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:38:03 [1,430,785ms] [Error] [omni.kit.app.impl] [py stderr]: 0:00:41.061883224  6004 0x556cd7dcb6a0 WARN                 nvinfer gstnvinfer.cpp:2125:gst_nvinfer_submit_input_buffer:<nvinfer_bin_nvinfer> error: streaming stopped, reason not-negotiated (-4)
0:00:41.061883224  6004 0x556cd7dcb6a0 WARN                 nvinfer gstnvinfer.cpp:2125:gst_nvinfer_submit_input_buffer:<nvinfer_bin_nvinfer> error: streaming stopped, reason not-negotiated (-4)2022-09-09 11:38:03 [1,430,785ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:38:03 [1,430,785ms] [Error] [omni.kit.app.impl] [py stderr]: 2022-09-09 13:38:03.416 ERROR extensions/nvdsbase/nvds_scheduler.cpp@307: Error from /GstPipeline:NvDsScheduler-Pipeline/GstDsNvInferBin:SEC. CLASS. - CAR MAKE..bcc0/nv_ds_infer23..3a20/GstNvInfer:nvinfer_bin_nvinfer: Internal data stream error.
2022-09-09 13:38:03.416 ERROR extensions/nvdsbase/nvds_scheduler.cpp@307: Error from /GstPipeline:NvDsScheduler-Pipeline/GstDsNvInferBin:SEC. CLASS. - CAR MAKE..bcc0/nv_ds_infer23..3a20/GstNvInfer:nvinfer_bin_nvinfer: Internal data stream error.2022-09-09 11:38:03 [1,430,785ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:38:03 [1,430,785ms] [Error] [omni.kit.app.impl] [py stderr]: 2022-09-09 13:38:03.416 ERROR extensions/nvdsbase/nvds_scheduler.cpp@309: Debug info:
2022-09-09 13:38:03.416 ERROR extensions/nvdsbase/nvds_scheduler.cpp@309: Debug info:2022-09-09 11:38:03 [1,430,785ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:38:03 [1,430,785ms] [Error] [omni.kit.app.impl] [py stderr]: gstnvinfer.cpp(2125): gst_nvinfer_submit_input_buffer (): /GstPipeline:NvDsScheduler-Pipeline/GstDsNvInferBin:SEC. CLASS. - CAR MAKE..bcc0/nv_ds_infer23..3a20/GstNvInfer:nvinfer_bin_nvinfer:
gstnvinfer.cpp(2125): gst_nvinfer_submit_input_buffer (): /GstPipeline:NvDsScheduler-Pipeline/GstDsNvInferBin:SEC. CLASS. - CAR MAKE..bcc0/nv_ds_infer23..3a20/GstNvInfer:nvinfer_bin_nvinfer:2022-09-09 11:38:03 [1,430,785ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:38:03 [1,430,785ms] [Error] [omni.kit.app.impl] [py stderr]: streaming stopped, reason not-negotiated (-4)
streaming stopped, reason not-negotiated (-4)2022-09-09 11:38:03 [1,430,785ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:38:03 [1,430,785ms] [Error] [omni.kit.app.impl] [py stderr]: 0:00:41.068422941  6004 0x7f3a6c004400 WARN                 nvinfer gstnvinfer.cpp:2125:gst_nvinfer_submit_input_buffer:<nvinfer_bin_nvinfer> error: Internal data stream error.
0:00:41.068422941  6004 0x7f3a6c004400 WARN                 nvinfer gstnvinfer.cpp:2125:gst_nvinfer_submit_input_buffer:<nvinfer_bin_nvinfer> error: Internal data stream error.2022-09-09 11:38:03 [1,430,785ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:38:03 [1,430,786ms] [Error] [omni.kit.app.impl] [py stderr]: 0:00:41.068438906  6004 0x7f3a6c004400 WARN                 nvinfer gstnvinfer.cpp:2125:gst_nvinfer_submit_input_buffer:<nvinfer_bin_nvinfer> error: streaming stopped, reason not-negotiated (-4)
0:00:41.068438906  6004 0x7f3a6c004400 WARN                 nvinfer gstnvinfer.cpp:2125:gst_nvinfer_submit_input_buffer:<nvinfer_bin_nvinfer> error: streaming stopped, reason not-negotiated (-4)2022-09-09 11:38:03 [1,430,786ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:38:03 [1,430,786ms] [Error] [omni.kit.app.impl] [py stderr]: 2022-09-09 13:38:03.422 ERROR extensions/nvdsbase/nvds_scheduler.cpp@307: Error from /GstPipeline:NvDsScheduler-Pipeline/GstDsNvInferBin:SEC. CLASS. - CAR COLOR..bd68/nv_ds_infer19..6ba8/GstNvInfer:nvinfer_bin_nvinfer: Internal data stream error.
2022-09-09 13:38:03.422 ERROR extensions/nvdsbase/nvds_scheduler.cpp@307: Error from /GstPipeline:NvDsScheduler-Pipeline/GstDsNvInferBin:SEC. CLASS. - CAR COLOR..bd68/nv_ds_infer19..6ba8/GstNvInfer:nvinfer_bin_nvinfer: Internal data stream error.2022-09-09 11:38:03 [1,430,786ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:38:03 [1,430,786ms] [Error] [omni.kit.app.impl] [py stderr]: 2022-09-09 13:38:03.422 ERROR extensions/nvdsbase/nvds_scheduler.cpp@309: Debug info:
2022-09-09 13:38:03.422 ERROR extensions/nvdsbase/nvds_scheduler.cpp@309: Debug info:2022-09-09 11:38:03 [1,430,786ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:38:03 [1,430,786ms] [Error] [omni.kit.app.impl] [py stderr]: gstnvinfer.cpp(2125): gst_nvinfer_submit_input_buffer (): /GstPipeline:NvDsScheduler-Pipeline/GstDsNvInferBin:SEC. CLASS. - CAR COLOR..bd68/nv_ds_infer19..6ba8/GstNvInfer:nvinfer_bin_nvinfer:
gstnvinfer.cpp(2125): gst_nvinfer_submit_input_buffer (): /GstPipeline:NvDsScheduler-Pipeline/GstDsNvInferBin:SEC. CLASS. - CAR COLOR..bd68/nv_ds_infer19..6ba8/GstNvInfer:nvinfer_bin_nvinfer:2022-09-09 11:38:03 [1,430,786ms] [Error] [omni.kit.app.impl] [py stderr]: 


2022-09-09 11:38:03 [1,430,786ms] [Error] [omni.kit.app.impl] [py stderr]: streaming stopped, reason not-negotiated (-4)
streaming stopped, reason not-negotiated (-4)2022-09-09 11:38:03 [1,430,786ms] [Error] [omni.kit.app.impl] [py stderr]: 


[NvMultiObjectTracker] De-initialized
Deleting pipeline
2022-09-09 13:38:03.499 INFO  gxf/gxe/gxe.cpp@320: Deinitializing...
2022-09-09 13:38:03.500 INFO  gxf/gxe/gxe.cpp@327: Destroying context
2022-09-09 13:38:03.501 INFO  gxf/gxe/gxe.cpp@333: Context destroyed.
*******************************************************************
End deepstream-test2.yaml
*******************************************************************
[INFO] Graph installation directory /tmp/ds.deepstream-test2 and manifest /tmp/ds.deepstream-test2/manifest.yaml retained 

@stefan.s_from_G Those “error: Internal data stream error.” from your last post occur when you try to run a graph with an output to screen from a ssh terminal… Try running it from a local terminal? (I get exactly the same error running on my NX using ssh, but it works using the local terminal with an hdmi/keyboard/mouse connected.

This is a task related to the SDKManager Flash issues that I have run into…

@Nerdx86
So far I tried to installed both ways with tar ball and deb, and at first via sdkmanager, for taking my jetson alive by flashing. After that deepstream and graph compose were next.

btw:
My first impression was deb install of deepstream on jetson was / is buggy. On Jetson I use the tar ball method. so far so goot.
@Fiona.Chen advised me to reinstall deepstream on gpu machine, so was taking the first option (deb install) of installing deepstream. Option 1 is the highest priority to take, I thought…

ssh / terminal: I am working direct in x11 with console terminal on a gpu ubuntu with composer 2.0.1. Local execution of graohs is buggy at all, only remote execution on the jetson xavier nx are successful for my first simple graphs and deepstream-test1 and 2.

install:
I removed deepstream install (deb) and reinstalled via tar ball.

So long, I won`t give up so quickly :-).

@stefan.s_from_G I am getting good results on my dGPU based system… It took a little bit to get it working, but it’s now working well… (it also worked well with DS 6.1 and GC 2.0)

I did have to do a remove and use the tarball install to get it working well on the dGPU version… I also had to restart a couple times. Message me if you want to compare notes.

@stefan.s_from_G Did you finally install the deepstream on your host?
Seems it is your another topic Deepstream-test1.yaml - Could not create GStreamer element ‘nvurisrcbin’ - what to be done? - Intelligent Video Analytics / DeepStream SDK - NVIDIA Developer Forums has the same installation issue.

@yingliu
The author of the other topic is me…

Yes, I realized it, so to check if both topics refer the same issue and if solved or not.