LI-IMX390-GMSL2 camera latency

Hi,

I recently purchased the LI-IMX390-GMSL2 camera from Leopard imaging:
https://www.leopardimaging.com/product/autonomous-camera/maxim-gmsl2-cameras/li-imx390-gmsl2/li-imx390-gmsl2-120h/
I connected it to my Rudi-AGX module (https://connecttech.com/product/rudi-agx-embedded-system-nvidia-jetson-agx-xavier/) running Jetpack 4.6.2.

I used the following gstreamer pipeline for streaming the video to the screen:

gst-launch-1.0 nvarguscamerasrc sensor-id=0 ! ‘video/x-raw(memory:NVMM), width=(int)1920, height=(int)1080, framerate=30/1, format=(string)NV12’ ! nvegltransform ! nveglglessink sync=0

I tried to measure the latency by capturing a timer on my screen and saw about 120ms delay (3-4 frames @ 30fps).

Is it the minimum possible latency? is there anything I can do to make it better?

Thanks a lot!
Amir

It’s reasonable result. Try higher frame rate should be get improve.

ShaneCCC thanks for your reply.

Unfortunately this camera can only output 30fps.
Is there no way to get lower latency?

I saw this post:

that mentioned they can reach as low as 40ms.
Do I need to build special drivers for that?

I also saw this post:

that mentions the queue size may impact the latency.

Thanks,
Amir

The latency is about ~= 4-6 frames times, that’s why suggest using high frame rate sensor mode for it.

Thanks

Thanks ShaneCCC.

Can you tell where this latency is originated from? Is it the camera’s driver or something with the gstreamer?
Are there any cameras that are expected to have a lower latency?

Thanks,
Amir

It’s from the 3A alg and ISP pipeline.

Got it, thanks!

Are there any other GMSL cameras you may suggest that have a lower latency in this pipeline?

I would suggest consult with camera partner to check if any high frame rate sensor like 120fps sensor.

Thanks

Will do. Thanks!