How to merge two 1920x2160xP60 to 3840x2160xP60 video in AGX ORIN?

Robotics & Edge Computing Jetson Systems Jetson AGX Orin
,
1

We have Jetson AGX ORIN custom board and the FPGA design HDMI to MIPI which has 8 lane MIPI support.
The block diagram:

hdmi2mipi_fpga_block_diagram
hdmi2mipi_fpga_block_diagram2201×651 148 KB

It input HDMI signal (3840x2160xP60) to FPGA, and the FPGA output 8 lane (4 lane + 4 lane, 1920x2160xP60 YUV422 + 1920x2160xP60 YUV422) to AGX ORIN CSI.
AGX ORIN CSI merge 1920x2160xP60 YUV422 and 1920x2160xP60 YUV422 to /dev/video0 (3840x2160xP60).

Currently, we can successfully receive two video (1920x2160xP60 YUV422) in AGX ORIN.

But we need to know how to enable the gang mode for merge two video to /dev/video0 (3840x2160xP60) on Jetson AGX ORIN platform.
Could you give some documents and sample code for us?

3

Hi,
We have the function and it is demonstrated in the 13 sample in

/use/src/jetson_multimedia_api/samples

Please check and give it a try.

4

But I see below post mention Jetson CSI could support gang mode, and it could support this requirement.
Could you provide more detail in device tree setting?
Does it only set ‘bus-width = <8>’ for it in JetPack 5.1.1?

[Forums] How to enable 8-lane MIPI data (Gang mode) on Jetson Xavier nx

5

Hi,
We don’t support the mode on Orin series. The possible solution is to capture 2 1920x2160 frame data and composite to single 3840x2160 through hardware converter.

6

The FPGA could output 3840x2160xP60 YUV422, but the bottleneck is ORIN CSI 4 lane bandwidth can’t transfer 3840x2160xP60 YUV422 data.

Why AGX ORIN CSI can’t support the gang mode? or What’s JetPack schedule will support it?

7

Hi,

Please share where you see this constraint. For imx274, we can capture bayer frame data in 4Kp60 with 4 lanes. It is supposed to work for YUV422 4Kp60.