Hwo to design a low-latency 4k@60 camera?

Robotics & Edge Computing Jetson & Embedded Systems Jetson AGX Orin
1

I use the jestson AGX Orin 64G dev kit。
I want to achieve extremely low latency 4k@60 video output to the monitor, how do I do this? Do you have any feasible suggestions?
Now I am using a mipi-csi camera (2 lane) and the latency (glass to glass) measured using sample arugs_camera is around (130-180ms). I expect this latency to be below 80ms.

3

Please reference to below link to syn up the result.

NVIDIA Jetson Glass to Glass Latency - RidgeRun Developer Wiki

4

Thanks for the reply, I think what I mean is: What should I pay attention to in order to achieve the minimum delay? In other words, what is the specific scheme for the minimum latency?

5

I think the sensor frame rate and display latency should be the key.

Thanks

6

Thank you for your reply.
Our sensor works at 4k@60 resolution and frame rate.
What is the reasonable video capture, processing, display flow and scheme to achieve the minimum display delay?
My idea was to use the Arugs API to capture the video, hand it to cuda for processing, and then use drm to display it. I don’t know if this is feasible, and I don’t know if this is the optimal solution.

7

You can checking the MMAPI sample code for referencing.

Thanks

8

After a trial, I used a jestson agx orin + imx219 camera with sensor working at 720P@60, and ran the cudaBayerDemosaic sample program. The measured glass-to-glass latency was 110-150ms. This is much more than my expectation, I hope this delay is 60~90ms, I wonder if it can be achieved?

9

You can implement 120fps sensor mode to check.

11

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.