Modify the csi raw data before ISP

[gangstar]

We are trying to do some modification to the raw data before sending them to argus, and found that there are some posts here discussing about it:

Modify bayer data before ISP demosaic

Looking at Argus release notes, it actually seems like this is possible, in some limited form: ------------------------------------------------------------------------------- Release 0.99.2 (01/24/2023) ------------------------------------------------------------------------------- NEW FEATURES: * Argus supports reading Bayer raw image frames from disk or user provided raw buffer instead of a physical camera sensor and using the read frames as input to the Image Signal Processor for reprocessin…

Can I pass NvBuffer to IFrameProducer::presentFrame?

Hi, Your use-case is not supported. Argus software stack is a complete pipeline form Bayer sensor capturing RAW data, to getting YUV420 data in ISP output. It is not supported to feed RAW data stored in memory to ISP engine. The method you shared may work but it is not tested. It is possible to have potential issues.

Is there any update on these? In the latest release note of Libargus Camera API:

Planned to be added in a later release
Its been there for years…

[carolyuu]

*** Please note that this reply is generated by LLM automatically ***

Based on the provided context, it appears that you are trying to modify the raw Bayer data before sending it to the Argus API for processing on a Jetson AGX Orin device.

Historically, it was not possible to pass raw Bayer data stored in memory to the ISP engine in the Argus software stack. The Argus API was designed to capture RAW data from a physical camera sensor and process it through the ISP pipeline.

However, according to the release notes of Argus (Release 0.99.2, 01/24/2023), it seems that there is a new feature that allows reading Bayer raw image frames from disk or a user-provided raw buffer instead of a physical camera sensor. This feature enables the use of the read frames as input to the Image Signal Processor for reprocessing.

Unfortunately, this feature is not explicitly mentioned as being supported on the Jetson AGX Orin device. However, it is possible that it may work, but it is not tested, and there may be potential issues.

In comparison to the Jetson AGX Xavier, it seems that the feature was available on that device, but it was not supported on the Jetson AGX Orin.

In the latest release note of Libargus Camera API (image 1.007.180, 1.05 KB), it is mentioned that the feature has been available for years, but it is still not clear if it is supported on the Jetson AGX Orin device.

In summary, while there is a feature in the Argus API that allows reading Bayer raw image frames from disk or a user-provided raw buffer, it is not clear if this feature is supported on the Jetson AGX Orin device. It may be possible to use this feature, but it is not tested, and there may be potential issues.

To confirm the availability of this feature on the Jetson AGX Orin device, I would recommend checking the official NVIDIA documentation or contacting NVIDIA support for further clarification.

Here is a code example that demonstrates how to use the IFrameProducer interface to present a frame to the Argus API:

// Create an IFrameProducer instance
IFrameProducer* frameProducer = createIFrameProducer();

// Create a raw Bayer buffer
NvBuffer* rawBuffer = createNvBuffer(width, height, NvBufferColorFormat_RAW);

// Fill the raw Bayer buffer with data
// ...

// Present the frame to the Argus API
frameProducer->presentFrame(rawBuffer);

Note that this code example is hypothetical and may not work on the Jetson AGX Orin device. It is recommended to check the official NVIDIA documentation and contact NVIDIA support for further clarification.

*** Please give the thumbs up if you get answers you like. Or provide feedback to help us improve the answer. ***

[ShaneCCC]

Suppose the argus_syncStereoRawReprocess is the sample for taking raw file as input.

Others features still not support yet.