The feasibility of high frame rate camera input on Jetson AGX Xavier

Do you have any concern about capturing high frame rate camera input data by using v4l2src plugin of Gstreamer?
We would like to know whether Jetson AGX Xavier hardware and L4T meets our requirements.
The platform is Jetson AGX Xavier and the expected JetPack version is v4.6.
The following is the requirements of input camera data.

  • resolution: 406 x 310
  • format: RAW8 or RAW10
  • frame rate: 960fps (RAW10), 1200fps (RAW8)
  • camera will be monochrome camera and interface is MIPI-CSI2 4lane

Best Regards,
NY

v4l2src plugin may not support Bayer RAW sensor. L4T using nvarguscamerasrc for Bayer RAW sensor.
And didn’t verify this higher frame ever can’t guarantee to support it or not.

ShaneCCC-san,

Thank you for your reply.
We could find that the higher frame data input wasn’t verified.

In past, we could capture 640 x 480 monochrome Bayer RAW sensor input data by using the v4l2src plugin.

In this time, we’ll try to capture 406 x 310 monochrome Bayer RAW sensor input data by using the v4l2src plugin or nvarguscamerasrc.
But there are several restrictions to use nvarguscamerasrc for capturing this sensor data.
If you have any idea to address the following restrictions, please let us know.

  • nvarguscamerasrc cannot handle monochrome Bayer RAW sensor input data.
  • The minimum resolution of nvarguscamerasrc is 640 x 480, so nvarguscamerasrc cannot handle 406 x 310 input data.

Best Regards,
NY

Right, the resolution is not support. If you have experience used v4l2src I would suggest try this way.

Hi ShaneCCC-san,

Thank you for your reply.
How about handling monochrome Bayer RAW sensor input data by nvarguscamerasrc?
Do you have any solution to address the restrictions?

Best Regards,
NY

You can just report it as normal RGB bayer sensor and create camera_overrides.isp at /var/nvidia/nvcam/settings/
Also need change the file attribute to 644 by sudo chmod 644 camera_overrides.isp

demosaic.v5.family.use=CCCC
defaults.yuvMatrix[0] = {0.3333, 0.3333, 0.3333, 0};
defaults.yuvMatrix[1] = {0, 0, 0, 0};
defaults.yuvMatrix[2] = {0, 0, 0, 0};
defaults.yuvMatrix[3] = {0, 0, 0, 1};

Hi ShaneCCC-san,

Thank you for your reply.
We’ll refer your advice.

Best Regards,
Nomo