LI-IMX390-GMSL2 camera latency

Autonomous Machines Jetson & Embedded Systems Jetson AGX Xavier
#1

Hi,

I recently purchased the LI-IMX390-GMSL2 camera from Leopard imaging:
https://www.leopardimaging.com/product/autonomous-camera/maxim-gmsl2-cameras/li-imx390-gmsl2/li-imx390-gmsl2-120h/
I connected it to my Rudi-AGX module (https://connecttech.com/product/rudi-agx-embedded-system-nvidia-jetson-agx-xavier/) running Jetpack 4.6.2.

I used the following gstreamer pipeline for streaming the video to the screen:

gst-launch-1.0 nvarguscamerasrc sensor-id=0 ! ‘video/x-raw(memory:NVMM), width=(int)1920, height=(int)1080, framerate=30/1, format=(string)NV12’ ! nvegltransform ! nveglglessink sync=0

I tried to measure the latency by capturing a timer on my screen and saw about 120ms delay (3-4 frames @ 30fps).

Is it the minimum possible latency? is there anything I can do to make it better?

Thanks a lot!
Amir

#3

It’s reasonable result. Try higher frame rate should be get improve.

#4

ShaneCCC thanks for your reply.

Unfortunately this camera can only output 30fps.
Is there no way to get lower latency?

I saw this post:

that mentioned they can reach as low as 40ms.
Do I need to build special drivers for that?

I also saw this post:

that mentions the queue size may impact the latency.

Thanks,
Amir

#5

The latency is about ~= 4-6 frames times, that’s why suggest using high frame rate sensor mode for it.

Thanks

#6

Thanks ShaneCCC.

Can you tell where this latency is originated from? Is it the camera’s driver or something with the gstreamer?
Are there any cameras that are expected to have a lower latency?

Thanks,
Amir

#7

It’s from the 3A alg and ISP pipeline.

#8

Got it, thanks!

Are there any other GMSL cameras you may suggest that have a lower latency in this pipeline?

#9

I would suggest consult with camera partner to check if any high frame rate sensor like 120fps sensor.

Thanks

#10

Will do. Thanks!