RoadRunner Sensor Issues

Please provide the following info (check/uncheck the boxes after creating this topic):
Software Version
DRIVE OS Linux 5.2.6
DRIVE OS Linux 5.2.6 and DriveWorks 4.0
DRIVE OS Linux 5.2.0
DRIVE OS Linux 5.2.0 and DriveWorks 3.5
NVIDIA DRIVE™ Software 10.0 (Linux)
NVIDIA DRIVE™ Software 9.0 (Linux)
other DRIVE OS version
other

Target Operating System
Linux
QNX
other

Hardware Platform
NVIDIA DRIVE™ AGX Xavier DevKit (E3550)
NVIDIA DRIVE™ AGX Pegasus DevKit (E3550)
other

SDK Manager Version
1.9.1.10844
other

Host Machine Version
native Ubuntu 18.04
other

After working very reliably, our system is showing a “Camera disconnect” message and RoadRunner shows a blank screen which sometimes recovers itself but sometimes just stays like that and a power cycle is required.

Checking the logs, it seems the attached message correlates with this event: “RRMainpipeline: camera queue pop_front time out 500000”

Also, this message shows up as well: [15483.617776] serial-tegra 3110000.serial: RxData DMA copy to tty layer failed

Trying to understand if this could be a hardware issue, Xavier A thing or software related (DriveWorks).

Any suggestions or ideas to troubleshoot the issue are welcome

Which camera modules are you using? Do you see any issues with any camera sample applications of DRIVE OS (in NvMedia Sample Applications)?

@VickNV using the sample_camera_gsml_custom generates this error

EngineStatusError (2), Detailed Error Code: 00000200 at StreamId:2 vcId:0 CSIFrameId:0 notified-bits:400000000
[22-05-2023 16:12:40] CameraClient: Notification received from pipeline index:3 of type: NOTIF_ERROR_ICP_BAD_INPUT_STREAM
EngineStatusError (2), Detailed Error Code: 00000100 at StreamId:2 vcId:0 CSIFrameId:0 notified-bits:200020000
[22-05-2023 16:12:40] CameraClient: Notification received from pipeline index:3 of type: NOTIF_ERROR_ICP_BAD_INPUT_STREAM
EngineStatusError (2), Detailed Error Code: 00000100 at StreamId:2 vcId:0 CSIFrameId:0 notified-bits:200068000
[22-05-2023 16:12:40] CameraClient: Notification received from pipeline index:3 of type: NOTIF_ERROR_ICP_BAD_INPUT_STREAM
EngineStatusError (2), Detailed Error Code: 00000200 at StreamId:2 vcId:0 CSIFrameId:0 notified-bits:400220000
[22-05-2023 16:12:40] CameraClient: Notification received from pipeline index:3 of type: NOTIF_ERROR_ICP_BAD_INPUT_STREAM
EngineStatusError (2), Detailed Error Code: 00000100 at StreamId:2 vcId:0 CSIFrameId:0 notified-bits:200200000
[22-05-2023 16:12:40] CameraClient: Notification received from pipeline index:3 of type: NOTIF_ERROR_ICP_BAD_INPUT_STREAM
EngineStatusError (2), Detailed Error Code: 00000200 at StreamId:2 vcId:0 CSIFrameId:0 notified-bits:400220000
[22-05-2023 16:12:40] CameraClient: Notification received from pipeline index:3 of type: NOTIF_ERROR_ICP_BAD_INPUT_STREAM
EngineStatusError (2), Detailed Error Code: 00000100 at StreamId:2 vcId:0 CSIFrameId:0 notified-bits:200220000
[22-05-2023 16:12:40] CameraClient: Notification received from pipeline index:3 of type: NOTIF_ERROR_ICP_BAD_INPUT_STREAM
EngineStatusError (2), Detailed Error Code: 00000100 at StreamId:2 vcId:0 CSIFrameId:0 notified-bits:200220000

Currently, trying to identify the camera source. We are using 6 cameras for RoadRunner

@VickNV, We narrowed down the camera issue to the Forward 60 FOV camera. Will check connections and possibly swap it to another GSML port. Just to provide an update.