Orin ISP Frame Dropping: 6x 8 Megapixel Cameras @ 30FPS

Using the sample frame grabber program provided with Driveworks on the Orin 6.0.6 platform, when running with 6 IMX728 cameras with ISP enabled with, I observed significant frame dropping.

I set the cameras to run at 30fps, 3840x2160 resolution, camera:V1SIM728S2RU4120HB20, and observed that ~60% of the captured frames were dropped @ ISP time.

I would like to to understand:

  • Is the Orin platform expected to be able to run these 6 cameras at this framerate + resolution without dropping frames? Is there some inefficiency in the sample code or is this a fundamental HW limitation?
  • Is there a way to reduce the frame rate for this camera down to 10Hz as a part of the sample driver code, or the driveworks api

I know the max ISP throughput of the Orin-X is 1.85 gigapixels per second, which should handle 30fps, 3840x2160 x6 cameras by that metric. Is there some inefficiency with the sample Driveworks camera application, or some other issue?

Statistics results for 6 cameras, 30fps, 8MPx:

[18-06-2024 20:19:53] Statistics for DW_SENSOR_STATE_DELTA_HOST_AND_HOST_TIME
Events: 375
Errors: 1
Drops: 249
minDelta: 33332.0000 us
maxDelta: 200023.0000 us
meanDelta: 77297.3750us
Standard deviation: 20531.7754

Please provide the following info (tick the boxes after creating this topic):
Software Version
DRIVE OS 6.0.8.1
DRIVE OS 6.0.6
DRIVE OS 6.0.5
DRIVE OS 6.0.4 (rev. 1)
DRIVE OS 6.0.4 SDK
other

Target Operating System
Linux
QNX
other

Hardware Platform
DRIVE AGX Orin Developer Kit (940-63710-0010-300)
DRIVE AGX Orin Developer Kit (940-63710-0010-200)
DRIVE AGX Orin Developer Kit (940-63710-0010-100)
DRIVE AGX Orin Developer Kit (940-63710-0010-D00)
DRIVE AGX Orin Developer Kit (940-63710-0010-C00)
DRIVE AGX Orin Developer Kit (not sure its number)
other

SDK Manager Version
1.9.3.10904
other

Host Machine Version
native Ubuntu Linux 20.04 Host installed with SDK Manager
native Ubuntu Linux 20.04 Host installed with DRIVE OS Docker Containers
native Ubuntu Linux 18.04 Host installed with DRIVE OS Docker Containers
other

Dear @ssimpson1,

There is no update from you for a period, assuming this is not an issue any more.
Hence we are closing this topic. If need further support, please open a new one.
Thanks

Could you check with nvsipl_camera and share your observation?
Also, any reason to use DRIVE OS 6.0.6 instead of DRIVE OS 6.0.8.1?
If possible could you verify with 6.0.8.1?

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.