Image display delay issue

Autonomous Machines Jetson & Embedded Systems Jetson AGX Xavier
1

Hello all,

I was tested 4K(3840x2160)/60fps and 4channel camera streamming in AGX Xavier.
I confirmed that there is a video delay time. (it’s about 300miliseconds )

I was tested gstreammer command as shown below.

gst-launch-1.0 nvcompositor name=comp sink_0::xpos=0 sink_0::ypos=0 sink_0::width=1920 sink_0::height=1080 sink_1::xpos=1920 sink_1::ypos=0 sink_1::width=1920 sink_1::height=2160 sink_2::xpos=0 sink_2::ypos=1080 sink_2::width=1920 sink_2::height=1080 sink_3::xpos=1920 sink_3::ypos=1080 sink_3::width=1920 sink_3::height=1080 ! nvoverlaysink nvarguscamerasrc sensor-id=0 aelock=1 ee-mode=1 ee-strength=0 tnr-strength=0 tnr-mode=1 ispdigitalgainrange=“1 10” exposurecompensation=0 ! ‘video/x-raw(memory:NVMM), width=3840, height=2160, framerate=60/1, format=NV12’ ! nvvidconv flip-method=0 ! comp. nvarguscamerasrc sensor-id=1 aelock=1 ee-mode=1 ee-strength=0 tnr-strength=0 tnr-mode=1 ispdigitalgainrange=“1 10” exposurecompensation=0 ! ‘video/x-raw(memory:NVMM), width=3840, height=2160, framerate=60/1, format=NV12’ ! nvvidconv flip-method=0 ! comp. nvarguscamerasrc sensor-id=2 aelock=1 ee-mode=1 ee-strength=0 tnr-strength=0 tnr-mode=1 ispdigitalgainrange=“1 10” exposurecompensation=0 ! ‘video/x-raw(memory:NVMM), width=3840, height=2160, framerate=60/1, format=NV12’ ! nvvidconv flip-method=0 ! comp. nvarguscamerasrc sensor-id=3 aelock=1 ee-mode=1 ee-strength=0 tnr-strength=0 tnr-mode=1 ispdigitalgainrange=“1 10” exposurecompensation=0 ! ‘video/x-raw(memory:NVMM), width=3840, height=2160, framerate=60/1, format=NV12’ ! nvvidconv flip-method=0 ! comp.

and also maximum performance clock setting and use FAN enable setting.

$ sudo /usr/sbin/nvpmodel –m 6
$ sudo /usr/bin/jetson_clocks –fan

20220523_081557155_iOS
20220523_081557155_iOS1920×1440 269 KB

Is there a way to reduce the video latency or something to review?

3

Does single camera get the same result?

4

Yes, single camera preview was also same delay.

5

Did you check if the frame rate consistent reach 60fps for single camera?

6

How do i check frame rate in gstreamer streaming?

7

Check with below command.

gst-launch-1.0 nvarguscamerasrc sensor-id=0 ! 'video/x-raw(memory:NVMM),width=1920,height=1080,framerate=30/1,format=NV12' ! nvvidconv ! fpsdisplaysink video-sink=xvimagesink sync=false -v
8

I was checked fram rate as your help in single camera 4K / 60fps.

display latency is 300ms .
frame rate is 48.58fps

20220526_030111218_iOS
20220526_030111218_iOS1920×2560 421 KB

I think the video lancey time should be lowered to 100ms.
please, let me know check point to reduce video latency time.

9

Could you check with 1280x720@60 sensor mode.
We got about 80 ~ 100 with reference sensor ov5693

image
image1108×1478 107 KB

10

custom sensor just support 1920x1080 (FHD) mode.

video latency time is same 300ms
frame rate is 59.69fps as shown below.

20220526_040145241_iOS
20220526_040145241_iOS1920×2560 432 KB

11

Do you have reference sensor e3326(ov5693) to verify?

12

No, i didn’t verify ov5693.