Pipeline is switching to paused state if more than one input stream is provided

sandeep.yadav.07780 · March 8, 2022, 11:24am

Description

I have created a pipeline for object detection and redaction of a certain class of object. I have modified deepstream-imagedata-multistream to do that. I have used filesink as sink element.

Everything works fine if I pass only one input stream. But, if more than one input stream is passed, the pipeline switches to PAUSED state after a few frames.

Environment

GPU
Deepstream 6
TensorRT 8

Relevant Files

main_0.7.py (22.4 KB)
utils.py (328 Bytes)
FPS.py (1.7 KB)
labels.txt (28 Bytes)
resnet10.prototxt (7.4 KB)
resnet10.caffemodel_b1_gpu0_int8.engine (2.4 MB)
cal_trt.bin (1.1 KB)
resnet10.caffemodel (6.0 MB)

Steps To Reproduce

python3 main_0.7.py http://commondatastorage.googleapis.com/gtv-videos-bucket/sample/BigBuckBunny.mp4
will run normally.
But whn I pass two input streams:
python3 main_0.7.py http://commondatastorage.googleapis.com/gtv-videos-bucket/sample/BigBuckBunny.mp4 http://commondatastorage.googleapis.com/gtv-videos-bucket/sample/ElephantsDream.mp4
The pipeline will pause after a few frames.

/home/sandeep/Evaluation/My_Code# python3 main_0.7.py http://commondatastorage.googleapis.com/gtv-videos-bucket/sample/BigBuckBunny.mp4 http://commondatastorage.googleapis.com/gtv-videos-bucket/sample/ElephantsDream.mp4
Unable to init server: Could not connect: Connection refused
Unable to init server: Could not connect: Connection refused
################################################
cfg_file_name : /home/sandeep/Evaluation/My_Code/dstest_imagedata_config_copy.txt
################################################
Creating pipeline
batch_size: 2
        Creating Element: nvstreammux
        Creating Element: nvinfer
        Creating Element: nvvideoconvert
        Creating Element: nvdsosd
        Creating Element: nvvideoconvert
        Creating Element: nvstreamdemux
Writing to existing directory  Output_Videos/stream_0
Creating source_bin  0  
 
Creating source bin
bin_name : source-bin-00
Creating sink bin
bin_name : sink-bin-00
        Creating Element: nvvideoconvert
        Creating Element: x264enc
        Creating Element: avimux
        Creating Element: filesink
sink_bin.pads : [<Gst.GhostPad object at 0x7f1f2b07f678 (GstGhostPad at 0x303c370)>]
Writing to existing directory  Output_Videos/stream_1
Creating source_bin  1  
 
Creating source bin
bin_name : source-bin-01
Creating sink bin
bin_name : sink-bin-01
        Creating Element: nvvideoconvert
        Creating Element: x264enc
        Creating Element: avimux
        Creating Element: filesink
sink_bin.pads : [<Gst.GhostPad object at 0x7f1f2b07f630 (GstGhostPad at 0x303c870)>]
batch_size : 2
Adding Probe to sink pad 
Changing pipeline state to playing
0:00:02.706994875   131      0x304c0f0 INFO                 nvinfer gstnvinfer.cpp:638:gst_nvinfer_logger:<nvinfer> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1900> [UID = 1]: deserialized trt engine from :/home/sandeep/Evaluation/My_Code/Primary_Detector/resnet10.caffemodel_b1_gpu0_int8.engine
INFO: ../nvdsinfer/nvdsinfer_model_builder.cpp:610 [Implicit Engine Info]: layers num: 3
0   INPUT  kFLOAT input_1         3x368x640       
1   OUTPUT kFLOAT conv2d_bbox     16x23x40        
2   OUTPUT kFLOAT conv2d_cov/Sigmoid 4x23x40         

0:00:02.707143071   131      0x304c0f0 WARN                 nvinfer gstnvinfer.cpp:635:gst_nvinfer_logger:<nvinfer> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::checkBackendParams() <nvdsinfer_context_impl.cpp:1833> [UID = 1]: Backend has maxBatchSize 1 whereas 2 has been requested
0:00:02.707163132   131      0x304c0f0 WARN                 nvinfer gstnvinfer.cpp:635:gst_nvinfer_logger:<nvinfer> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2012> [UID = 1]: deserialized backend context :/home/sandeep/Evaluation/My_Code/Primary_Detector/resnet10.caffemodel_b1_gpu0_int8.engine failed to match config params, trying rebuild
0:00:02.709758587   131      0x304c0f0 INFO                 nvinfer gstnvinfer.cpp:638:gst_nvinfer_logger:<nvinfer> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1914> [UID = 1]: Trying to create engine from model files
WARNING: [TRT]: Detected invalid timing cache, setup a local cache instead
0:00:15.000231139   131      0x304c0f0 INFO                 nvinfer gstnvinfer.cpp:638:gst_nvinfer_logger:<nvinfer> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1947> [UID = 1]: serialize cuda engine to file: /home/sandeep/Evaluation/My_Code/Primary_Detector/resnet10.caffemodel_b2_gpu0_int8.engine successfully
INFO: ../nvdsinfer/nvdsinfer_model_builder.cpp:610 [Implicit Engine Info]: layers num: 3
0   INPUT  kFLOAT input_1         3x368x640       
1   OUTPUT kFLOAT conv2d_bbox     16x23x40        
2   OUTPUT kFLOAT conv2d_cov/Sigmoid 4x23x40         

0:00:15.010561670   131      0x304c0f0 INFO                 nvinfer gstnvinfer_impl.cpp:313:notifyLoadModelStatus:<nvinfer> [UID 1]: Load new model:/home/sandeep/Evaluation/My_Code/dstest_imagedata_config_copy.txt sucessfully
Decodebin child added: source 

Decodebin child added: typefindelement0 

Decodebin child added: source 

Decodebin child added: typefindelement1 

Starting main
Pipeline state changed from NULL to READY
Pipeline state changed from NULL to READY
Pipeline state changed from NULL to READY
Pipeline state changed from NULL to READY
Pipeline state changed from NULL to READY
Pipeline state changed from NULL to READY
Pipeline state changed from NULL to READY
Pipeline state changed from NULL to READY
Pipeline state changed from NULL to READY
Pipeline state changed from NULL to READY
Pipeline state changed from NULL to READY
Pipeline state changed from NULL to READY
Pipeline state changed from NULL to READY
Pipeline state changed from NULL to READY
Pipeline state changed from NULL to READY
Pipeline state changed from NULL to READY
Pipeline state changed from NULL to READY
Pipeline state changed from NULL to READY
Pipeline state changed from NULL to READY
Pipeline state changed from NULL to READY
Pipeline state changed from NULL to READY
Pipeline state changed from READY to PAUSED
Pipeline state changed from READY to PAUSED
Pipeline state changed from READY to PAUSED
Pipeline state changed from READY to PAUSED
Pipeline state changed from READY to PAUSED
Pipeline state changed from READY to PAUSED
Pipeline state changed from READY to PAUSED
Pipeline state changed from READY to PAUSED
Pipeline state changed from READY to PAUSED
Pipeline state changed from READY to PAUSED
Pipeline state changed from READY to PAUSED
Pipeline state changed from READY to PAUSED
Pipeline state changed from NULL to READY
Pipeline state changed from READY to PAUSED
Pipeline state changed from NULL to READY
Pipeline state changed from READY to PAUSED
Pipeline state changed from NULL to READY
Pipeline state changed from READY to PAUSED
Pipeline state changed from NULL to READY
Pipeline state changed from READY to PAUSED
Decodebin child added: decodebin0 

Decodebin child added: queue2-0 

Pipeline state changed from NULL to READY
Pipeline state changed from NULL to READY
Pipeline state changed from READY to PAUSED
Pipeline state changed from NULL to READY
Pipeline state changed from READY to PAUSED
Decodebin child added: qtdemux0 

Pipeline state changed from NULL to READY
Pipeline state changed from READY to PAUSED
Decodebin child added: multiqueue0 

Decodebin child added: decodebin1 

Decodebin child added: queue2-1 

Pipeline state changed from NULL to READY
Pipeline state changed from NULL to READY
Pipeline state changed from READY to PAUSED
Pipeline state changed from NULL to READY
Decodebin child added: aacparse0 

Pipeline state changed from READY to PAUSED
Decodebin child added: qtdemux1 

Pipeline state changed from NULL to READY
Pipeline state changed from READY to PAUSED
Pipeline state changed from NULL to READY
Pipeline state changed from READY to PAUSED
Decodebin child added: multiqueue1 

Decodebin child added: aacparse1 

Decodebin child added: avdec_aac0 

Pipeline state changed from NULL to READY
Pipeline state changed from READY to PAUSED
Pipeline state changed from NULL to READY
Pipeline state changed from READY to PAUSED
Decodebin child added: avdec_aac1 

Pipeline state changed from NULL to READY
Pipeline state changed from READY to PAUSED
Decodebin child added: h264parse0 

Pipeline state changed from NULL to READY
Decodebin child added: h264parse1 

Decodebin child added: capsfilter0 

Decodebin child added: capsfilter1 

Pipeline state changed from NULL to READY
Pipeline state changed from READY to PAUSED
Pipeline state changed from READY to PAUSED
Decodebin child added: nvv4l2decoder0 

Decodebin child added: nvv4l2decoder1 

Pipeline state changed from NULL to READY
Pipeline state changed from NULL to READY
Pipeline state changed from READY to PAUSED
Pipeline state changed from READY to PAUSED
Pipeline state changed from READY to PAUSED
Pipeline state changed from READY to PAUSED
Pipeline state changed from READY to PAUSED
Pipeline state changed from READY to PAUSED
Pipeline state changed from READY to PAUSED
Pipeline state changed from READY to PAUSED
Frame Number= 0 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 0 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 1 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 1 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 2 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 2 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 3 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 3 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 4 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 4 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 5 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 5 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 6 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 6 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 7 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 7 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 8 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 8 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 9 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 9 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 10 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 10 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 11 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 11 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 12 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 12 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 13 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 13 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 14 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 14 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 15 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 15 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 16 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 16 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 17 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 17 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 18 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 18 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 19 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 19 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 20 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 20 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 21 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 21 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 22 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 22 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 23 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 23 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 24 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 24 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 25 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 25 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 26 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 26 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 27 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 27 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 28 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 28 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 29 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 29 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 30 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 30 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 31 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 31 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 32 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 32 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 33 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 33 Number of Objects= 1 Vahicle_count= 0 Person_count= 0
Frame Number= 34 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 34 Number of Objects= 1 Vahicle_count= 0 Person_count= 0
Frame Number= 35 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 35 Number of Objects= 2 Vahicle_count= 0 Person_count= 0
Frame Number= 36 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 36 Number of Objects= 2 Vahicle_count= 0 Person_count= 0
Frame Number= 37 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 37 Number of Objects= 1 Vahicle_count= 0 Person_count= 0
Frame Number= 38 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 38 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 39 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 39 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 40 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 40 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 41 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 41 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 42 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 42 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 43 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 43 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 44 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 44 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 45 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 45 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 46 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 46 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 47 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 47 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 48 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 48 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 49 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 49 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 50 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 50 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 51 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 51 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 52 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 52 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 53 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 53 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 54 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 54 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 55 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 55 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 56 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 56 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 57 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 57 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 58 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 58 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 59 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 59 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 60 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 60 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 61 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 61 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 62 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 62 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 63 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 63 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 64 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 64 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 65 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Frame Number= 65 Number of Objects= 0 Vahicle_count= 0 Person_count= 0
Pipeline state changed from READY to PAUSED
Pipeline state changed from READY to PAUSED

Please, let me know how I can get out of this.
Thanks in advance.

spolisetty · March 8, 2022, 12:13pm

Hi,

This looks like a deepstream issue. We move this post to deepstream forum to get better help.

Thank you.

kayccc · March 15, 2022, 2:19am

Sorry for the late response, is this still an issue to support? Thanks

sandeep.yadav.07780 · March 15, 2022, 2:43am

Yes, please do

fanzh · March 18, 2022, 3:16pm

1 Are you using Jetson or dGPU?
2 could you reduce some code modification and narrow down the issue?

fanzh · March 23, 2022, 3:51am

we recommend using python deepstream-test3 to test multiple sources. here is the link:deepstream_python_apps/apps/deepstream-test3 at master · NVIDIA-AI-IOT/deepstream_python_apps · GitHub.

sandeep.yadav.07780 · March 23, 2022, 5:05am

I am using dGPU.
Okay, thanks fanzh. I will check.

system · April 12, 2022, 3:04am

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.