Capture Embedded Data in Xavier NX

Robotics & Edge Computing Jetson & Embedded Systems Jetson Xavier NX
1

Hi,

I was trying to capture Embedded Data and Image data from my Camera. The data flow is like,

Image Sensor → External ISP → Jetson Xavier NX

As per the MIPI-CSI2 Specs, YUV422 needs to be of datatype 0x1E and Embedded Data needs to be of datatype 0x12. But our External ISP is able to send only 0x1E as output datatype. So I’m planning to set the ISP output in 2 channels.

Channel 0 - Image Data - 1920 x 1080
Channel 1 - Embedded Data - 1920 x 1.

In both cases, I’m planning to use datatype as 0x1E. So due to the ISP limitation, Is it possible to implement an architecture like this in order to capture image data and embedded data separately at Xavier NX end?

3

For this I would try package the embedded data in the header of pixel data like first line for it.

Thanks

4

Hi @ShaneCCC

Thanks for the response.

We packed the embedded data in the pixel data. So the final resolution will be 1920x1081(ie, 1 row of embedded data packed at the top). I had applied the same resolution to driver as well as device tree and mentioned embedded_metadata_height as 0 since we’re packing embedded data inside pixel data. In that scenario, I’m able to view 1920x1081 pixels in G-streamer(Both Image data and Embedded data).

My aim was to separate out embedded data in vi5_fops.c or some other kernel files. But in the vi5_fops.c, we’re separating the embedded data using the embedded_metadata_height parameter mentioned in the device tree. So in that scenario, how can I extract the embedded data row from pixel data?

5

Current don’t support none 0x12 embedded data.

Thanks

7

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.