Why my pipeline is stuck and delayed, but deepstream-app is very smooth?

I tested the code of deepstream-app to load the model of yolov5s.
At the same time I built my own pipeline based on deepstream-test3, but I found that my video detection was very stuck, where the configuration I set by referring to the configuration file of deepstream-app.
Does deepstream-app have some buffering optimizations?

Please provide complete information as applicable to your setup and your pipeline description:
• Hardware Platform (Jetson / GPU)
• DeepStream Version
• JetPack Version (valid for Jetson only)
• TensorRT Version
• NVIDIA GPU Driver Version (valid for GPU only)
• Issue Type( questions, new requirements, bugs)
• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)
• Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)
• The pipeline being used

  • deepstream-app version 6.1.0
  • DeepStreamSDK 6.1.0
  • CUDA Driver Version: 11.4
  • CUDA Runtime Version: 11.0
  • TensorRT Version: 8.2
  • cuDNN Version: 8.4
  • libNVWarp360 Version: 2.0.1d3
  • Device on A6000

Hi @autodrive2022 ,

Does deepstream-app have some buffering optimizations?
I don’t think there is special optimization.

Could you refer to this sample to measure the latency of the GST components?

I have modified the deepstream-test3 program, and after running it,
no box is displayed and printed out the results like this:

************BATCH-NUM = 41**************
Comp name = nvv4l2decoder0 in_system_timestamp = 1666856167763.085938 out_system_timestamp = 1666856167763.748047               component latency= 0.662109
Comp name = nvstreammux-stream-muxer source_id = 0 pad_index = 0 frame_num = 41               in_system_timestamp = 1666856167763.829102 out_system_timestamp = 1666856167763.986084               component_latency = 0.156982
Comp name = primary-nvinference-engine in_system_timestamp = 1666856167764.033936 out_system_timestamp = 1666856167764.889893               component latency= 0.855957
Comp name = nvtiler in_system_timestamp = 1666856167764.944092 out_system_timestamp = 1666856167765.343018               component latency= 0.398926
Comp name = nvvideo-converter in_system_timestamp = 1666856167765.561035 out_system_timestamp = 1666856167765.716064               component latency= 0.155029
Comp name = nv-onscreendisplay in_system_timestamp = 1666856167765.833008 out_system_timestamp = 1666856167765.847900               component latency= 0.014893
Source id = 0 Frame_num = 41 Frame latency = 2.807129 (ms) 

************BATCH-NUM = 42**************
Comp name = nvv4l2decoder0 in_system_timestamp = 1666856167842.747070 out_system_timestamp = 1666856167846.197998               component latency= 3.450928
Comp name = nvstreammux-stream-muxer source_id = 0 pad_index = 0 frame_num = 42               in_system_timestamp = 1666856167846.235107 out_system_timestamp = 1666856167846.388916               component_latency = 0.153809
Comp name = primary-nvinference-engine in_system_timestamp = 1666856167846.506104 out_system_timestamp = 1666856167853.613037               component latency= 7.106934
Comp name = nvtiler in_system_timestamp = 1666856167853.754883 out_system_timestamp = 1666856167857.861084               component latency= 4.106201
Comp name = nvvideo-converter in_system_timestamp = 1666856167858.092041 out_system_timestamp = 1666856167860.152100               component latency= 2.060059
Comp name = nv-onscreendisplay in_system_timestamp = 1666856167860.270996 out_system_timestamp = 1666856167860.284912               component latency= 0.013916
Source id = 0 Frame_num = 42 Frame latency = 17.585938 (ms) 

************BATCH-NUM = 43**************
Comp name = nvv4l2decoder0 in_system_timestamp = 1666856167924.729004 out_system_timestamp = 1666856167929.532959               component latency= 4.803955
Comp name = nvstreammux-stream-muxer source_id = 0 pad_index = 0 frame_num = 43               in_system_timestamp = 1666856167929.616943 out_system_timestamp = 1666856167929.775879               component_latency = 0.158936
Comp name = primary-nvinference-engine in_system_timestamp = 1666856167929.823975 out_system_timestamp = 1666856167936.742920               component latency= 6.918945
Comp name = nvtiler in_system_timestamp = 1666856167936.896973 out_system_timestamp = 1666856167941.375977               component latency= 4.479004
Comp name = nvvideo-converter in_system_timestamp = 1666856167941.607910 out_system_timestamp = 1666856167943.681885               component latency= 2.073975
Comp name = nv-onscreendisplay in_system_timestamp = 1666856167943.801025 out_system_timestamp = 1666856167943.815918               component latency= 0.014893
Source id = 0 Frame_num = 43 Frame latency = 19.133057 (ms) 

************BATCH-NUM = 44**************
Comp name = nvv4l2decoder0 in_system_timestamp = 1666856168013.827881 out_system_timestamp = 1666856168014.311035               component latency= 0.483154
Comp name = nvstreammux-stream-muxer source_id = 0 pad_index = 0 frame_num = 44               in_system_timestamp = 1666856168014.347900 out_system_timestamp = 1666856168014.500977               component_latency = 0.153076
Comp name = primary-nvinference-engine in_system_timestamp = 1666856168014.614990 out_system_timestamp = 1666856168015.392090               component latency= 0.777100
Comp name = nvtiler in_system_timestamp = 1666856168015.520020 out_system_timestamp = 1666856168015.728027               component latency= 0.208008
Comp name = nvvideo-converter in_system_timestamp = 1666856168015.934082 out_system_timestamp = 1666856168016.008057               component latency= 0.073975
Comp name = nv-onscreendisplay in_system_timestamp = 1666856168016.129883 out_system_timestamp = 1666856168016.144043               component latency= 0.014160
Source id = 0 Frame_num = 44 Frame latency = 2.363037 (ms) 

************BATCH-NUM = 45**************
Comp name = nvv4l2decoder0 in_system_timestamp = 1666856168092.749023 out_system_timestamp = 1666856168096.949951               component latency= 4.200928
Comp name = nvstreammux-stream-muxer source_id = 0 pad_index = 0 frame_num = 45               in_system_timestamp = 1666856168097.033936 out_system_timestamp = 1666856168097.187012               component_latency = 0.153076
Comp name = primary-nvinference-engine in_system_timestamp = 1666856168097.233887 out_system_timestamp = 1666856168104.199951               component latency= 6.966064
Comp name = nvtiler in_system_timestamp = 1666856168104.336914 out_system_timestamp = 1666856168108.649902               component latency= 4.312988
Comp name = nvvideo-converter in_system_timestamp = 1666856168108.876953 out_system_timestamp = 1666856168110.936035               component latency= 2.059082
Comp name = nv-onscreendisplay in_system_timestamp = 1666856168111.058105 out_system_timestamp = 1666856168111.072998               component latency= 0.014893
Source id = 0 Frame_num = 45 Frame latency = 18.369873 (ms) 

There is no update from you for a period, assuming this is not an issue anymore. Hence we are closing this topic. If need further support, please open a new one.
Thanks

From above log, the frame latency is ~19ms, do you still see stuck with 19ms frame latency ?

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.