GMSL Deserializer Design for 6-8 cameras on Jetson Orin NX

Robotics & Edge Computing Jetson Systems Jetson Orin NX
1

Hi we have some questions regarding having 6-8 cameras support on Jetson Orin NX. We plan to use 2xMAX96724 to provide 6-8 GMSL ports

  1. For each MAX96724, on Jetson side it supports either 1x4-Lane MIPI or 2x2-Lane MIPI configuration, what would be recomendded connection between MAX96724<>Jetson, or it does not really matter?
  2. The MIPI lane configuration is not necessarily tied to number of cameras if my understanding is correct, since a single MAX96724 can route all 4 cameras it connected with into a 1x4-Lane MIPI?
  3. if some cameras needs more than 1 VCs and Video Pipes, say on the 1st camera connected to a MAX96724, if its serializer is configured to use 4 VCs and 4 video pipes, and the rest 3 cameras with each uses 1 VC and 1 Video Pipe, given that the bandwidth is sufficient, would the MAX96724 still be able to send all streams back to Jetson with 1x4MIPI Lane?
2

— 🤖 This is an automated AI response. I’m here to help, but please verify important details! —

Based on the provided context, I’ll try to help you with your questions regarding the GMSL deserializer design for 6-8 cameras on Jetson Orin NX.

Connection between MAX96724 and Jetson Orin NX

The context does not explicitly recommend a specific connection configuration between the MAX96724 and Jetson Orin NX. However, it does mention that each MAX96724 can be configured to support either 1x4-Lane MIPI or 2x2-Lane MIPI on the Jetson side.

MIPI Lane Configuration and Number of Cameras

Your understanding is correct. The MIPI lane configuration is not necessarily tied to the number of cameras. A single MAX96724 can route all 4 cameras it is connected to into a 1x4-Lane MIPI configuration.

Multiple VCs and Video Pipes

Regarding your question about multiple VCs and video pipes, the context does not provide a clear answer. However, it does mention that the MAX96724 can support multiple VCs and video pipes. If some cameras need more than 1 VC and video pipe, and the bandwidth is sufficient, it is likely that the MAX96724 can still send all streams back to Jetson with a 1x4 MIPI lane configuration. However, this would depend on the specific configuration and requirements of your setup.

Recommendation

Based on the provided context, I would recommend consulting the MAX96724 datasheet and the Jetson Orin NX documentation for more detailed information on the recommended connection configuration and MIPI lane setup. Additionally, you may want to consider the specific requirements of your camera setup, such as the number of VCs and video pipes needed, and the available bandwidth.

I could not find clear support for a specific recommendation on the connection configuration between MAX96724 and Jetson Orin NX in the provided context.

— We support team will also look into your issue to have further suggestions soon. please stay tuned. —

4

hello gen2,

you may refer to above automated AI response.
please also note that, on Orin NX developer kit, only single camera slot works (J21/CAM1) with 4-lane configuration.

5

yes we understand the developer kit, the context is more related to carrier board we are designing on our own.

the automated response doesn’t seem to fully answer my question regarding the Video Pipes configuration part, I am asking because it looks like MAX96724 only supports up to 4 video pipe, I am not sure if its tunneling means that even if the camera/serializer decides to use 4 video pipe, it can still tunnel into 1 video pipe on deserializer side, and any implication regarding jetson’s limiation with it.

and if the camera is tunneled through 1 video pipe, would it matter for the PP(Pixel Parser) to de-interleave it

also if there is any limitaionts regarding max number of virtual channels per 1x4 MIPI lane

6

hello gen2,

please refer to developer guide, Jetson Virtual Channel with GMSL Camera Framework.
as you can see, aggregator maps to your MAX96724, a CSI brick can support up-to 4 VC streams.
so, you can have either 2-lane or 4-lane configuration for handling 4 camera inputs. it depends-on your own customization.