Jetson Xavier AGX ISP

Robotics & Edge Computing Jetson & Embedded Systems Jetson AGX Xavier
1

Hi,

We have been using a Jetson Xavier board with a MIPI camera providing bayer , we use nvarguscamerasrc with to inject buffers into a GStreamer pipeline, but we have an algorithm that requires to perform dewarp on video buffers after the ISP does debayer but before the ISP does HDR and color correction, we are wondering if it is possible to:

1. Extract the video buffer from the ISP after debayer (buffer converted to YUV), but before HDR and ColorCorrection
2. Perfom an operation on the extracted buffer like: image dewarp algorithm using CUDA or similar
3. Inject the buffer after the dewarp into the ISP and let the ISP continue doing HDR and ColorCorrection
4. Continue with nvarguscamerasrc and GStreamer as usual.

Could you please indicate if it is possible to perform this extraction/injection of buffers on the ISP? And if possible indicate documentation that can be used to understand how to perform this task.

Regards and thank you for your time.

3

1/3. Not possible, current the ISP pipeline can not insert any of external plugin element.
4. You can modify the nvarguscamerasrc due to it source is public.(libgstnvarguscamerasrc.so)

4

Hi,
Thank you for your prompt reply, just double checking, this phrase:

  • 1/3. Not possible, current the ISP pipeline can insert any of external plugin element.

Should it be?

  • 1/3. Not possible, current the ISP pipeline can not insert any of external plugin element.

Regards.

5

Sorry for typo, can not insert

1 Like