Sony IMX477 Getting Images of HDR and DOL HDR

Robotics & Edge Computing Jetson & Embedded Systems Jetson AGX Xavier
1

Hello everyone,

In our project, we get images from camera with low mid high exposure values, then we construct HDR image manually. We first used FLIR camera from usb port and we succeed. Now, we are trying to get images with different exposures from Sony IMX477 camera. We use pipeline to get image and process it with OpenCV.

Here is the pipeline.

nvarguscamerasrc ! video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, format=(string)NV12, framerate=(fraction)60/1 ! nvvidconv flip-method=0 ! video/x-raw, width=(int)1280, height=(int)720, format=(string)BGRx ! videoconvert ! video/x-raw, format=(string)BGR ! appsink

I have two questions:

  1. It is possible to get image with specific exposure value by giving proper parameters to pipeline. However, closing pipeline, adjusting parameter and opening pipeline again is a waste of time. Is there any way to set 3 different exposure values at the same time and swapping camera exposure between values? HDR mode of FLIR camera does this. We set 4 exposure and gain values and the camera gives us proper images in order with metadata. In short, I want to get images with different exposure values and with exposure metadata without changing pipeline everytime.
  2. Does IMX477 DOL HDR enable us to get image data with different exposures, or create HDR image itself and give just HDR image? If it enables us to get, how can I get these images with knowing their exposure metadata?

Thank you.

3

hello ahmetksasmaz,

please check Sensor Software Driver Programming Guide for reference,
there’s an example of digital overlap WDR exposure frame. you may check a diagram shows an example of a two-exposure DOL (Digital Overlap) multi-frame.
please consult with Jetson Camera Partners for supported camera solutions,
thanks

4

Some details in programming guide helped me to figure out.

Thanks.

1 Like