Entron Camera Frame are getting Dropped using sample_camera application

Autonomous Vehicles DRIVE AGX Orin DRIVE AGX Orin General
1

Please provide the following info (tick the boxes after creating this topic):
Software Version
[*] DRIVE OS 6.0.10.0
DRIVE OS 6.0.8.1
DRIVE OS 6.0.6
DRIVE OS 6.0.5
DRIVE OS 6.0.4 (rev. 1)
DRIVE OS 6.0.4 SDK
other

Target Operating System
[*] Linux
QNX
other

Hardware Platform
DRIVE AGX Orin Developer Kit (940-63710-0010-300)
DRIVE AGX Orin Developer Kit (940-63710-0010-200)
[*] DRIVE AGX Orin Developer Kit (940-63710-0010-100)
DRIVE AGX Orin Developer Kit (940-63710-0010-D00)
DRIVE AGX Orin Developer Kit (940-63710-0010-C00)
DRIVE AGX Orin Developer Kit (not sure its number)
other

SDK Manager Version
2.1.0
other

Host Machine Version
native Ubuntu Linux 20.04 Host installed with SDK Manager
[*] native Ubuntu Linux 20.04 Host installed with DRIVE OS Docker Containers
native Ubuntu Linux 18.04 Host installed with DRIVE OS Docker Containers
other

Issue Description
I am trying to capture png images using sample_camera. I am observing loss of frames in the console messages.

  1. How to find out how many frames per second are currently supported by sample_camera application?

  2. How to configure the resolution for camera currently it is 8MP i.e 3848x2168 , I want to reduce to 1080.

  3. How to run sample_camera on GPU to check any improvement with respect to frame droppage.

Error String
SIPLNotifier: Notification received from pipeline index:0 of type: NOTIF_WARN_ICP_FRAME_DROP

Logs

2

Dear @AD_GN,
Could you check using isp0-res parameter to reduce resolution. Please see DriveWorks SDK Reference: Camera for details.
Do you see frame drop messages when trying to store using sample_camera? Could you check the storage write BW using dd command?

4

Could you check using isp0-res parameter to reduce resolution.

—> Yes, with addition of this parameter in rig.json able to change the resolution of camera stream. Can you please let me know how to hardcode the resolution, FPS & Bitrate parameters into the code of sample_camera & nvsipl_camera? As from the code it seems these values are obtained from DW specific libs.
Do you see frame drop messages when trying to store using sample_camera? Could you check the storage write BW using dd command?

—> Yes, when we try to capture each frame into png by enabling the m_frameGrab variabled in samples/src/sensors/camera/camera/main.cpp (source code for sample_camera) then we see camera stream getting stuck and continuous prints like - SIPLNotifier: Notification received from pipeline index:0 of type: NOTIF_WARN_ICP_FRAME_DROP

—> Have checked BW using command : dd if=/dev/zero of=/home/sample_apps/orin_sample_apps/testfile bs=1G count=1 oflag=direct and the BW obtained is 604 MB/s.

5

@SivaRamaKrishnaNV , Kindly check response in above post.

Also let me know , how I can verify that application is running on GPU or not on Orin Board.

6

To hardcode GMSL parameters, can you check appending the the isp0-res to params variable in OnInitialize()

For serializer parameters. Please check DriveWorks SDK Reference: Sensor Serializer and check appending the needed params to serializerParams.parameters in intializeSerializer().

You can verify using tegrastats or nsys profiler

8

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.