NvSIPL sporadic camera loss issues

Autonomous Vehicles DRIVE AGX Xavier DRIVE AGX Xavier General
1

Dear Support,

Our application uses NvSIPL with 11 Sony IMX cameras in a recording setup.
We use DriveOS 5.2.6, the camera driver is obtained from the developer portal of Sony.
We experience sporadic errors during recording and get either of the following notifications:

  • NOTIF_ERROR_ACP_PROCESSING_FAILURE
  • NOTIF_ERROR_ISC_SET_SENSOR_CTRL_FAILURE
  • NOTIF_ERROR_ICP_BAD_INPUT_STREAM
    When any of the above error occurs, the DriveAGX needs to be rebooted to recover the lost camera.
    Unfortunately we could not find any correlation to the type of the sensor, etc.

Could you please describe the potential cause of the errors above?
Are these related to the vendor specific part of the NvSIPL driver?

Thank you!

Software Version
DRIVE OS Linux 5.2.6
DRIVE OS Linux 5.2.6 and DriveWorks 4.0
DRIVE OS Linux 5.2.0
DRIVE OS Linux 5.2.0 and DriveWorks 3.5
NVIDIA DRIVE™ Software 10.0 (Linux)
NVIDIA DRIVE™ Software 9.0 (Linux)
other DRIVE OS version
other

Target Operating System
Linux
QNX
other

Hardware Platform
NVIDIA DRIVE™ AGX Xavier DevKit (E3550)
NVIDIA DRIVE™ AGX Pegasus DevKit (E3550)
other

SDK Manager Version
1.9.1.10844
other

Host Machine Version
native Ubuntu 18.04
other

2

Dear @krisztian.holman,
May I know the camera module. Is it listed in https://developer.nvidia.com/drive/ecoystem

4

Dear SivaRamaKrishnaNV,

The modules are Sony IMX490 and IMX390.

Thank you!

5

Dear @krisztian.holman,

Did you notify Sony on these issues?
Do you notice issues only when using 11 cameras and working good when using less than 11 cameras.

6

Dear @SivaRamaKrishnaNV,

I haven’t contacted Sony with these issues, as we couldn’t distinguish between the responsibilities of the vendor and Nvidia.

The issue occurs less frequently with 11 cameras, but without the description of the errors mentioned above it is hard to consistently reproduce them. Could you please elaborate the meaning of the error messages above, or point me towards the corresponding documentation?

Thank you!

7

Dear @krisztian.holman,
Could you please describe the potential cause of the errors above?

Did you check NVIDIA DRIVE OS Linux SDK API Reference: nvsipl::NvSIPLPipelineNotifier Class Reference | NVIDIA Docs already diffrent notification type. I could not find NOTIF_ERROR_ISC_SET_SENSOR_CTRL_FAILURE in this. Could you double check the notification type?

When any of the above error occurs, the DriveAGX needs to be rebooted to recover the lost camera

Once you hit this issue, Could you check running single camera at a time for all cameras to see if it occurs only when you try to run 11 cameras.

Could you share the used nvsipl_camera command to test ?

8

Dear @SivaRamaKrishnaNV,

  • Thank you, I was familiar with the documentation NVIDIA DRIVE OS Linux SDK API Reference: nvsipl::NvSIPLPipelineNotifier Class Reference | NVIDIA Docs however I was hoping for something more detailed to understand how the errors propagate in the NvSIPL pipeline.
  • My understanding is that the nvsipl_camera application cannot support different platform configs at the same time, so we have modified it. Should we peform test using as many cameras as possible with the same platform config (for example 11 IMX490 cameras)?

Thank you for your support!