Assistance with 'RG10' Pixel Format in Argus API for 360 Camera Application Using IMX477 and SyncStereo

Robotics & Edge Computing Jetson & Embedded Systems Jetson Orin Nano
,
1

I am working on a 360 camera application using the NVIDIA Jetson platform, specifically leveraging the IMX477 sensor. Our application requires the use of the Argus SyncStereo feature to synchronize multiple IMX477 sensors for a seamless 360-degree capture experience.

In setting up our system, we’ve identified that the IMX477 sensor supports the ‘RG10’ format (10-bit Bayer RGRG/GBGB), as verified by the v4l2-ctl command, which shows support for:

  • 3840x2160 at 30 fps
  • 1920x1080 at 60 fps

However, I am facing a challenge in the Argus API environment. When attempting to set this pixel format in our code, we found that the PIXEL_FMT_RG10 constant is not recognized, leading to a compilation error. The problematic code section is as follows:

iEGLStreamSettings->setPixelFormat(PIXEL_FMT_RG10);

This is a crucial step in our application, as correct pixel format setting is key for the proper functioning of the SyncStereo feature and, subsequently, the entire 360 camera system.

I am reaching out for guidance on:

  1. The appropriate pixel format constant or method in the Argus API for setting the ‘RG10’ format on the IMX477 sensor.
  2. Any specific considerations or additional configurations needed for integrating the IMX477 sensor with the SyncStereo feature in a 360 camera application context.

Any insights, suggestions, or examples of similar implementations would be greatly appreciated

Thank you in advance for your time and assistance!

3

Why do you need RG10?
Current Argus only support PIXEL_FMT_YCbCr_420_888 and PIXEL_FMT_RAW16

    Format                     State
    =======================    ==========
    PIXEL_FMT_Y8               Not Supported
    PIXEL_FMT_Y16              Not Supported
    PIXEL_FMT_YCbCr_420_888    Works with all consumers.
    PIXEL_FMT_YCbCr_422_888    Not Supported
    PIXEL_FMT_YCbCr_444_888    Not Supported
    PIXEL_FMT_JPEG_BLOB        Not Supported (TODO: Remove format)
    PIXEL_FMT_RAW16            Works with all consumers
4

RG10 is the pixel format compatible with the IMX477

v4l2-ctl --list-formats-ext

image

when I use PIXEL_FMT_YCbCr_420_888 it doesn’t

when I run syncstereo I get the following message, it seems like the camera isn’t been initializing properly

image (1)
image (1)712×169 27 KB

5

RG10 is input format. The setting in argus is the ISP output format.
Doesn’t see any error message for the argus_syncstereo.

6

The cameras will not initialize or show up. I can access them using python and take videos, do you have any input about what could be happening? This is the modified code Im running
main.zip (7.0 KB)

7

Well, looks like those sample code don’t show the preview.
For the preview you may reference to others samples to implement it.
The multi-session of argus_camera would show two sensor output on screen.

Thanks

9

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.