Need help configuring Yolo pgie interval

• Hardware Platform Jetson
• DeepStream Version 6.3
• JetPack Version 5.1
• TensorRT Version 5.1

Hi, I’m trying to configure my pipeline (which consists of YoloV4 detector as pgie and custom model as sgie) to perform inference once every second and then send results to cloud. Since camera stream is 30 FPS, if I understood the docs correctly, I need to set interval value in Yolo config file to 30.

However, when I do that at inference time model waits for 30 frames to do first inference, but then proceeds to infer every consecutive frame. This does not happen with ResNet10 and deepstream-test3 example only with YoloV4.

Logs:

2023-10-31 03:33:58.979 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 0
2023-10-31 03:33:58.980 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 1
2023-10-31 03:33:58.986 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 2
2023-10-31 03:33:58.991 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 3
2023-10-31 03:33:59.006 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 4
2023-10-31 03:33:59.020 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 5
2023-10-31 03:33:59.029 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 6
2023-10-31 03:33:59.054 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 7
2023-10-31 03:33:59.056 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 8
2023-10-31 03:33:59.063 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 9
2023-10-31 03:33:59.067 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 10
2023-10-31 03:33:59.125 | WARNING | utils.bus_call:bus_call:32 - Warning: gst-core-error-quark: A lot of buffers are being dropped. (13): gstbasesink.c(3003): gst_base_sink_is_too_late (): /GstPipeline:pipeline0/GstNv3dSink:nv3d-sink:
There may be a timestamping problem, or this computer is too slow.

2023-10-31 03:33:59.205 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 11
2023-10-31 03:33:59.231 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 12
2023-10-31 03:33:59.233 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 13
2023-10-31 03:33:59.250 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 14
2023-10-31 03:33:59.255 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 15
2023-10-31 03:33:59.270 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 16
2023-10-31 03:33:59.278 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 17
2023-10-31 03:33:59.279 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 18
2023-10-31 03:33:59.318 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 19
2023-10-31 03:33:59.319 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 20
2023-10-31 03:33:59.324 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 21
2023-10-31 03:33:59.339 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 22
2023-10-31 03:33:59.350 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 23
2023-10-31 03:33:59.355 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 24
2023-10-31 03:33:59.356 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 25
2023-10-31 03:33:59.409 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 26
2023-10-31 03:33:59.419 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 27
2023-10-31 03:33:59.428 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 28
2023-10-31 03:33:59.444 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 29
2023-10-31 03:33:59.502 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 30
2023-10-31 03:33:59.558 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 31
2023-10-31 03:34:00.477 | INFO | utils.aws_util:put_object_to_s3:69 - Putting inference results to S3
2023-10-31 03:34:00.482 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 32
2023-10-31 03:34:01.407 | INFO | utils.aws_util:put_object_to_s3:69 - Putting inference results to S3
2023-10-31 03:34:01.410 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 33
2023-10-31 03:34:02.348 | INFO | utils.aws_util:put_object_to_s3:69 - Putting inference results to S3
2023-10-31 03:34:02.352 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 34
2023-10-31 03:34:03.223 | INFO | utils.FPS:perf_print_callback:77 - PERF: {‘stream0’: 7.81}
2023-10-31 03:34:03.377 | INFO | utils.aws_util:put_object_to_s3:69 - Putting inference results to S3
2023-10-31 03:34:03.381 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 35
2023-10-31 03:34:04.404 | INFO | utils.aws_util:put_object_to_s3:69 - Putting inference results to S3
2023-10-31 03:34:04.408 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 36
2023-10-31 03:34:04.419 | WARNING | utils.bus_call:bus_call:32 - Warning: gst-core-error-quark: A lot of buffers are being dropped. (13): gstbasesink.c(3003): gst_base_sink_is_too_late (): /GstPipeline:pipeline0/GstNv3dSink:nv3d-sink:
There may be a timestamping problem, or this computer is too slow.

2023-10-31 03:34:05.343 | INFO | utils.aws_util:put_object_to_s3:69 - Putting inference results to S3
2023-10-31 03:34:05.345 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 37
2023-10-31 03:34:06.278 | INFO | utils.aws_util:put_object_to_s3:69 - Putting inference results to S3
2023-10-31 03:34:06.281 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 38
2023-10-31 03:34:06.292 | WARNING | utils.bus_call:bus_call:32 - Warning: gst-core-error-quark: A lot of buffers are being dropped. (13): gstbasesink.c(3003): gst_base_sink_is_too_late (): /GstPipeline:pipeline0/GstNv3dSink:nv3d-sink:
There may be a timestamping problem, or this computer is too slow.

2023-10-31 03:34:07.304 | INFO | utils.aws_util:put_object_to_s3:69 - Putting inference results to S3
2023-10-31 03:34:07.307 | WARNING | main:sgie_src_pad_buffer_probe:273 - frame number: 39
2023-10-31 03:34:07.321 | WARNING | utils.bus_call:bus_call:32 - Warning: gst-core-error-quark: A lot of buffers are being dropped. (13): gstbasesink.c(3003): gst_base_sink_is_too_late (): /GstPipeline:pipeline0/GstNv3dSink:nv3d-sink:

There is no update from you for a period, assuming this is not an issue any more. Hence we are closing this topic. If need further support, please open a new one. Thanks.
interval means nvinfer skips doing inference, no delete the frame. nvinfer still pushes all frames downstream.
you can use Gstreamer opensource videorate plguin to control fps before inference.

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.