Latency measurement issue

Please provide complete information as applicable to your setup.

• Hardware Platform (Jetson / GPU) T4
• DeepStream Version 5.0
• JetPack Version (valid for Jetson only)
• TensorRT Version 7.0.0-1
• NVIDIA GPU Driver Version (valid for GPU only) * 440.64.00

export NVDS_ENABLE_LATENCY_MEASUREMENT=1

root@mooncake-1604:/opt/nvidia/deepstream/deepstream-5.0/sources/objectDetector_Yolo# deepstream-app -c source4_1080p_dec_infer-resnet_tracker_sgie_tiled_display_int8.txtsource4_1080p_dec_infer-resnet_tracker_sgie_tiled_display_int8.txt.log (4.9 KB)

When it is running, it shows the following. There are some strange big numbers. Also have some normal numbers.

Why is it like this? and how to make these strange numbers not show up?

BATCH-NUM = 0**
Source id = 0 Frame_num = 0 Frame latency = 1589249105000.361084 (ms)

BATCH-NUM = 1**
Source id = 0 Frame_num = 0 Frame latency = 1589249105000.391113 (ms)

BATCH-NUM = 2**
Source id = 0 Frame_num = 1 Frame latency = 409.870117 (ms)

BATCH-NUM = 3**
Source id = 0 Frame_num = 1 Frame latency = 409.885986 (ms)

BATCH-NUM = 4**
Source id = 0 Frame_num = 2 Frame latency = 354.300049 (ms)

BATCH-NUM = 5**
Source id = 0 Frame_num = 2 Frame latency = 354.329834 (ms)

BATCH-NUM = 6**
Source id = 0 Frame_num = 3 Frame latency = 356.243896 (ms)

BATCH-NUM = 7**
Source id = 0 Frame_num = 3 Frame latency = 356.273926 (ms)

BATCH-NUM = 8**
Source id = 0 Frame_num = 4 Frame latency = 357.906006 (ms)

BATCH-NUM = 9**
Source id = 0 Frame_num = 4 Frame latency = 357.937012 (ms)

BATCH-NUM = 10**
Source id = 0 Frame_num = 5 Frame latency = 441.004150 (ms)

BATCH-NUM = 11**
Source id = 0 Frame_num = 5 Frame latency = 441.031006 (ms)

BATCH-NUM = 12**
Source id = 0 Frame_num = 6 Frame latency = 413.202881 (ms)

BATCH-NUM = 13**
Source id = 0 Frame_num = 6 Frame latency = 413.217773 (ms)

BATCH-NUM = 14**
Source id = 0 Frame_num = 7 Frame latency = 299.378906 (ms)

BATCH-NUM = 15**
Source id = 0 Frame_num = 7 Frame latency = 299.389893 (ms)

BATCH-NUM = 16**
Source id = 0 Frame_num = 8 Frame latency = 387.315918 (ms)

BATCH-NUM = 17**
Source id = 0 Frame_num = 8 Frame latency = 387.332031 (ms)

BATCH-NUM = 18**
Source id = 0 Frame_num = 9 Frame latency = 1589249105295.864014 (ms)

BATCH-NUM = 19**
Source id = 0 Frame_num = 9 Frame latency = 1589249105295.873047 (ms)

BATCH-NUM = 20**
Source id = 0 Frame_num = 10 Frame latency = 1589249105299.900879 (ms)

BATCH-NUM = 21**
Source id = 0 Frame_num = 10 Frame latency = 1589249105299.910889 (ms)

BATCH-NUM = 22**
Source id = 0 Frame_num = 11 Frame latency = 1589249105385.011963 (ms)

BATCH-NUM = 23**
Source id = 0 Frame_num = 11 Frame latency = 1589249105385.025879 (ms)

BATCH-NUM = 24**
Source id = 0 Frame_num = 12 Frame latency = 300.829102 (ms)

BATCH-NUM = 25**
Source id = 0 Frame_num = 12 Frame latency = 300.848877 (ms)

BATCH-NUM = 26**
Source id = 0 Frame_num = 13 Frame latency = 300.604004 (ms)

BATCH-NUM = 27**
Source id = 0 Frame_num = 13 Frame latency = 300.616943 (ms)

BATCH-NUM = 28**
Source id = 0 Frame_num = 14 Frame latency = 385.822998 (ms)

BATCH-NUM = 29**
Source id = 0 Frame_num = 14 Frame latency = 385.866943 (ms)

BATCH-NUM = 30**
Source id = 0 Frame_num = 15 Frame latency = 1589249105489.489014 (ms)

BATCH-NUM = 31**
Source id = 0 Frame_num = 15 Frame latency = 1589249105489.565918 (ms)

BATCH-NUM = 32**
Source id = 0 Frame_num = 16 Frame latency = 300.606934 (ms)

BATCH-NUM = 33**
Source id = 0 Frame_num = 16 Frame latency = 300.620117 (ms)

BATCH-NUM = 34**
Source id = 0 Frame_num = 17 Frame latency = 1589249105576.393066 (ms)

BATCH-NUM = 35**
Source id = 0 Frame_num = 17 Frame latency = 1589249105576.437012 (ms)

BATCH-NUM = 36**
Source id = 0 Frame_num = 18 Frame latency = 295.581055 (ms)

BATCH-NUM = 37**
Source id = 0 Frame_num = 18 Frame latency = 295.611084 (ms)

BATCH-NUM = 38**
Source id = 0 Frame_num = 19 Frame latency = 1589249105585.721924 (ms)

BATCH-NUM = 39**
Source id = 0 Frame_num = 19 Frame latency = 1589249105585.736084 (ms)

BATCH-NUM = 40**
Source id = 0 Frame_num = 20 Frame latency = 1589249105676.833008 (ms)

BATCH-NUM = 41**
Source id = 0 Frame_num = 20 Frame latency = 1589249105676.861084 (ms)

BATCH-NUM = 42**
Source id = 0 Frame_num = 21 Frame latency = 291.814941 (ms)

BATCH-NUM = 43**
Source id = 0 Frame_num = 21 Frame latency = 291.829102 (ms)

BATCH-NUM = 44**
Source id = 0 Frame_num = 22 Frame latency = 1589249105685.104980 (ms)

BATCH-NUM = 45**
Source id = 0 Frame_num = 22 Frame latency = 1589249105685.124023 (ms)

BATCH-NUM = 46**
Source id = 0 Frame_num = 23 Frame latency = 377.307129 (ms)

BATCH-NUM = 47**
Source id = 0 Frame_num = 23 Frame latency = 377.345947 (ms)

BATCH-NUM = 48**
Source id = 0 Frame_num = 24 Frame latency = 287.805908 (ms)

BATCH-NUM = 49**
Source id = 0 Frame_num = 24 Frame latency = 287.821045 (ms)

BATCH-NUM = 50**
Source id = 0 Frame_num = 25 Frame latency = 285.850830 (ms)

BATCH-NUM = 51**
Source id = 0 Frame_num = 25 Frame latency = 285.881836 (ms)

BATCH-NUM = 52**
Source id = 0 Frame_num = 26 Frame latency = 1589249105868.332031 (ms)

BATCH-NUM = 53**
Source id = 0 Frame_num = 26 Frame latency = 1589249105868.345947 (ms)

BATCH-NUM = 54**
Source id = 0 Frame_num = 27 Frame latency = 295.294922 (ms)

BATCH-NUM = 55**
Source id = 0 Frame_num = 27 Frame latency = 295.312988 (ms)

BATCH-NUM = 56**
Source id = 0 Frame_num = 28 Frame latency = 1589249105877.877930 (ms)

BATCH-NUM = 57**
Source id = 0 Frame_num = 28 Frame latency = 1589249105877.897949 (ms)

BATCH-NUM = 58**
Source id = 0 Frame_num = 29 Frame latency = 1589249105963.928955 (ms)

BATCH-NUM = 59**
Source id = 0 Frame_num = 29 Frame latency = 1589249105963.947998 (ms)

BATCH-NUM = 60**
Source id = 0 Frame_num = 30 Frame latency = 1589249105969.229004 (ms)

BATCH-NUM = 61**
Source id = 0 Frame_num = 30 Frame latency = 1589249105969.246094 (ms)

BATCH-NUM = 62**
Source id = 0 Frame_num = 31 Frame latency = 293.968994 (ms)

BATCH-NUM = 63**
Source id = 0 Frame_num = 31 Frame latency = 293.989014 (ms)

BATCH-NUM = 64**
Source id = 0 Frame_num = 32 Frame latency = 376.910889 (ms)

BATCH-NUM = 65**
Source id = 0 Frame_num = 32 Frame latency = 376.925049 (ms)

You can enable NVDS_ENABLE_LATENCY_MEASUREMENT and NVDS_ENABLE_COMPONENT_LATENCY_MEASUREMENT to see components latency, if your rtsp camera or stream have network latency, it will impact decoder and streammux latency, and streammux property live set to 1, sink sync set to 0 before you do the test.

@amycao, thanks for the answer. I use MULTIURI in config file. Is it ok to use NVDS_ENABLE_LATENCY_MEASUREMENT and NVDS_ENABLE_COMPONENT_LATENCY_MEASUREMENT to measure the latency?
If no, it there any way to measure latency for MULTIURI sources?

please noted it’s for rtsp stream or rtsp camera only, not for local file.