Real-Time Camera Engine (RCE) Subsystem in Xavier

Robotics & Edge Computing Jetson & Embedded Systems Jetson AGX Xavier
1

I was reading through Xavier Series SOC TRM, could not find a chapter for Real-Time Camera Engine (RCE). I like to understand the function details of RCE, would appreciate if someone can point me to the right resources.

Thanks

2

hello zxu,

I’m sorry that there’s no documentation to cover RCE engine.
if you got camera functionality crash, you’ll see failure messages reported by RCE firmware.
please refer to Partition Configuration, there’s camera firmware camera-rtcpu-rce.bin to handle that.
thanks

3

Thanks Jerry, that’s very helpful. In addition, I need to control multiple flashlights with different trigger timing. From the TRM, it seems we need to program VGPIOs, Host1x, Falcon, and VI. Could you provide more insights how we should best utilize Xavier’s capabilities ? Thanks a lot !

4

hello zxu,

I need to control multiple flashlights with different trigger timing.
may I know more details about your use-case.

for example, there are torch mode and flash mode for LED flashes.
you could have implementation in your kernel driver to trigger LED as torch mode for your usage.
but, if you would like to trigger LED as flash mode at specific frame timing, it may not supported.
thanks

5

Thanks Jerry. Looks like we need flash mode. The sequence would be 1) Turn-on flashlight, 2) Open shutter, 3) Close shutter, 4) Turn-off flashlight. This completes one frame. The second frame will repeat the sequence of first frame with a different flashlight, the flash on and off time and shutter open-close time could be different as well.

We certainly can fulfill this task through your Camel CPU, here we are exploring whether the Multimedia Complex/subsystem can do this job.

Thanks

6

hello zxu,

we don’t support LED flash mode due to

  1. you need to calculate the AE settings to compensate the LED flash condition
  2. you need to know flash timing to match rolling shutter timing exactly, or you got part of frame without flash.

we suggest you have implementation with Torch mode, please also check Topic 1045634 for reference.
thanks

7

Thanks Jerry, we’ll give torch mode a try.