Jetson latency

[marveltll]

Please provide complete information as applicable to your setup.

• Hardware Platform (Jetson / GPU)

jetson nano

• DeepStream Version

nvcr.io/nvidia/deepstream-l4t : 6.0.1-samples

• Question

> My pipeline is nvarguscamerasrc(capsfilter)->nvstreammux->nvinfer->nvvideoconvert->nvdsosd->nvvideoconvert->x264enc->flvmux->rtmpsink (there are queues between each element), the delay is very serious(playing through VLC, about 6s), so I replaced x264enc with nvv4l2h264enc->h264parse, but the delay did not decrease, only the CPU utilization was reduced.Could you give me some suggestions and guidance, thank you.

CODE
deepstaream-test1.txt (10.6 KB)
CONFIG
config.txt (758 Bytes)
LOG
0:00:09.173413039 18227 0x55aab70ed0 INFO baseparse gstbaseparse.c:4004:gst_base_parse_set_latency: min/max latency 0:00:00.033333333, 0:00:00.033333333
0:00:11.173665697 18227 0x55aab70ed0 INFO baseparse gstbaseparse.c:4004:gst_base_parse_set_latency: min/max latency 0:00:00.033333333, 0:00:00.033333333
0:00:13.173076354 18227 0x55aab70ed0 INFO baseparse gstbaseparse.c:4004:gst_base_parse_set_latency: min/max latency 0:00:00.033333333, 0:00:00.033333333
0:00:15.172922029 18227 0x55aab70ed0 INFO baseparse gstbaseparse.c:4004:gst_base_parse_set_latency: min/max latency 0:00:00.033333333, 0:00:00.033333333

[junshengy]

@marveltll

the delay is very serious(playing through VLC, about 6s),

rtmpsink --> server --> vlc

1.This does not mean that the delay is caused by the performance of Deepstream/Jetson nano. You can try to remove plugins such as nvstreamux/nvinfer and only use nvarguscamerasrc/nvv4l2h264enc/rtmpsink to build a pipeline to observe the latency.
You can also use nveglglessink to observe the latency
2.This FAQ can measure the element latency of each deepstream

DeepStream SDK FAQ

7. [DS 5.0GA_All_App] Enable Latency measurement for deepstream sample apps If you are using deepstream-app, to check the component latency directly, you need to set the env export NVDS_ENABLE_COMPONENT_LATENCY_MEASUREMENT=1 export NVDS_ENABLE_LATENCY_MEASUREMENT=1 If you are using other deepstream sample apps such as deepstream-test3, you need to apply the following patch and set the env export NVDS_ENABLE_COMPONENT_LATENCY_MEASUREMENT=1 export NVDS_ENABLE_LATENCY_MEASUREMENT=1 …

[marveltll]

Thank you!Have anice day!

[marveltll]

GST_DEBUG=4 NVDS_ENABLE_LATENCY_MEASUREMENT=1 NVDS_ENABLE_LATENCY_MEASUREMENT=1 ./deepstream-test1-app rtmp://10.0.0.50:1937/safevideolive/pfs/123

When I run the above latency test command, I get the following results, thanks for your guidance.

[junshengy]

I think there is something wrong with the code you ported, the latency seems to be too high.

[marveltll]

I just replaced osd_sink_pad_buffer_probe with latency_measurement_buf_prob. Also, I set num_sources to a constant 1. This also makes me very confused.

[junshengy]

This measurement approach determines the input timestamp based on the name of the nvv4l2decoder element, and you are using test1, which may cause some problems.

Try the following code snippet.

  decoder = gst_element_factory_make ("nvv4l2decoder", "nvv4l2decoder");

[marveltll]

I am using nvarguscamerasrc, no additional decoder nvv4l2decoder is needed, could you give me a code example of low latency rtmp sink? Thanks

[junshengy]

The latency of rtmpsink depends on your server, network, etc. This is not a feature provided by deepstream

[marveltll]

Thanks!