Camera failure to work out of port A and Cor D at same time

Autonomous Vehicles DRIVE AGX Orin DRIVE AGX Orin General
1

Please provide the following info (tick the boxes after creating this topic):
Software Version
DRIVE OS 6.0.6
DRIVE OS 6.0.5
DRIVE OS 6.0.4 (rev. 1)
DRIVE OS 6.0.4 SDK
other

Target Operating System
Linux
QNX
other

Hardware Platform
DRIVE AGX Orin Developer Kit (940-63710-0010-300)
DRIVE AGX Orin Developer Kit (940-63710-0010-200)
DRIVE AGX Orin Developer Kit (940-63710-0010-100)
DRIVE AGX Orin Developer Kit (940-63710-0010-D00)
DRIVE AGX Orin Developer Kit (940-63710-0010-C00)
DRIVE AGX Orin Developer Kit (not sure its number)
other

SDK Manager Version
1.9.2.10884
other

Host Machine Version
native Ubuntu Linux 20.04 Host installed with SDK Manager
native Ubuntu Linux 20.04 Host installed with DRIVE OS Docker Containers
native Ubuntu Linux 18.04 Host installed with DRIVE OS Docker Containers
other

Hi ,
I see that on Orin AGX with camera configuration V1SIM728S2RU2030NB20_CPHY_x4 , we are able to get the camera working with nvsipl_camera out of only one port at a time. The Configuration for works for PORT A ,C D individually. But when we try to work with port A and C or A and D the nvsipl_camera fails

sudo ./nvsipl_camera --platform-config “V1SIM728S2RU2030NB20_CPHY_x4” --link-enable-masks " 0x1111 0 0 0" showfps -d 1 works

but

sudo ./nvsipl_camera --platform-config “V1SIM728S2RU2030NB20_CPHY_x4” --link-enable-masks " 0x1110 0 0 1" showfps -d 1 fails

Any specific reason behind this ?

2

Could you confirm whether the given command works? If it doesn’t, kindly share its output.
$ sudo ./nvsipl_camera --platform-config “V1SIM728S2RU2030NB20_CPHY_x4” --link-enable-masks " 0x0001 0x0000 0x0000 0x0001" showfps -v 4

3

out.txt (2.1 MB)
Hi Vick,

here is the output with -v 4 enabled. I see that only 1 camera connected to group A works the group D , is not working.

4

It seems that the output is not from the given command. Kindly double-check and provide the exact output of the following command:

$sudo ./nvsipl_camera --platform-config “V1SIM728S2RU2030NB20_CPHY_x4” --link-enable-masks “0x0001 0x0000 0x0000 0x0001” showfps -v 4

5

0x0001-out.txt (3.3 MB)
Here is the log again vick. Looking at the log in the start i can see 2 configurations being detected.

6

Please provide the output of the exact command (e.g. without -d option). Also, could you confirm if you’re running on DRIVE OS 6.0.6 Linux SDK?

$sudo ./nvsipl_camera --platform-config “V1SIM728S2RU2030NB20_CPHY_x4” --link-enable-masks “0x0001 0x0000 0x0000 0x0001” showfps -v 4

7

Hi Vick, Yes this is run on DriveOS 6.0.6.

here is the output with -d 1 removed.
0x0002-out-without-d.txt (2.2 MB)

8

What kind of failure are you seeing when running cameras on 2 groups simultaneously? From the log, I don’t see any error, and both cameras on group A and D are streaming. I can see

nvsipl_camera: Pipeline: 12, NOTIF_INFO_ICP_PROCESSING_DONE

nvsipl_camera: Pipeline: 0, NOTIF_INFO_ICP_PROCESSING_DONE

nvsipl_camera: Pipeline: 0, NOTIF_INFO_ISP_PROCESSING_DONE

nvsipl_camera: Pipeline: 12, NOTIF_INFO_ISP_PROCESSING_DONE

suggesting both pipelines are working, and auto exposure/gain is also functioning on both camera pipelines from the log

SIPL_VI_ISP_12: /dvs/git/dirty/git-master_modular/camera/fusa/sipl/src/core/pipelineMgr/spmgr/pipeline/blocks/CNvFEmbeddedDataParser.cpp: 182: sParseTopEmbData: Parsed Exposure time[0]:.010000
SIPL_VI_ISP_0: /dvs/git/dirty/git-master_modular/camera/fusa/sipl/src/core/pipelineMgr/spmgr/pipeline/blocks/CNvFEmbeddedDataParser.cpp: 185: sParseTopEmbData: Parsed Sensor Gain[0]: ]:0.010000
SIPL_VI_ISP_12: /dvs/git/dirty/git-master_modular/camera/fusa/sipl/src/core/pipelineMgr/spmgr/pipeline/blocks/CNvFEmbeddedDataParser.cpp: 185: sParseTopEmbData: Parsed Sensor Gain[0]:15.848933
SIPL_VI_ISP_12: /dvs/git/dirty/git-master_modular/camera/fusa/sipl/src/core/pipelineMgr/spmgr/pipeline/blocks/CNvFEmbeddedDataParser.cpp: 182: ParseTopEmbData: Parsed Exposure time[1]:0.010000
SIPL_VI_ISP_0: /dvs/git/dirty/git-master_modular/camera/fusa/sipl/src/core/pipelineMgr/spmgr/pipeline/blocks/CNvFEmbeddedDataParser.cpp: 185: sParseTopEmbData: Parsed Exposure time[1]:0.010000
SIPL_VI_ISP_0: /dvs/git/dirty/git-master_modular/camera/fusa/sipl/src/core/pipelineMgr/spmgr/pipeline/blocks/CNvFEmbeddedDataParser.cpp: 185: sParseTopEmbData: Parsed Sensor Gain[1]: 1.000000
SIPL_VI_ISP_0: /dvs/git/dirty/git-master_modular/camera/fusa/sipl/src/core/pipelineMgr/spmgr/pipeline/blocks/CNvFEmbeddedDataParser.cpp: 182: sParseTopEmbData: Parsed Exposure time[2: 1.000000

If you don’t use -v 4 flag, what kind of fps are you seeing?

9

Vick, we see the frame captured on to display only from one camera group A and not group D camera . Is this a limitation ? I was thinking we should be able to see on display the capture from both cameras

10

Hey Vick, Is there a way using nvsipl_camera , that we can use ISP0 for one port like PORT A and ISP1 or ISP2 for PORT B.

11

That’s by design as stated in Display Layout. You can refer to Interactive Menu Options to understand how to switch with the 'e<g><d>' option.

12

I recommend creating a new forum topic dedicated to this topic. By creating a new topic, we can provide more focused assistance and insights.

13

Sure Vick i will create a new topic for this.

14

Has your original question been addressed by this?

15

No , I created a new case for the same reason.

16

I didn’t get you. The behavior you described, where only images from a single camera group are displayed, is intentional and designed that way.

17

Hi Vick,

I agree that when we are using one port say like PORT A , all the cameras in that port are able to get the display. But there should be a way to display 2 camara capture take out of 2 different ports. Nvsipl_camera may not be the right one. But is there a way outside of nvsipl_camera if so how

18

You have the option to switch and display images from cameras connected to specific ports, but not from cameras connected to different ports simultaneously.

19

Hi Vick, thank you for the information. So at the API level can you provide any references that can help us for this purpose. want to make sure that i can be able to capture video using all the cameras.

21

Thank you for your response. To gain more insights and references for capturing video using all the cameras, I recommend exploring the source code and the document of the sample application. You can find the source code at the following location on your host system that is installed with DRIVE OS packages:

~/nvidia/nvidia_sdk/DRIVE_OS_6.0.6_SDK_Linux_DRIVE_AGX_ORIN_DEVKITS/DRIVEOS/drive-linux/samples/nvmedia/nvsipl/test/camera

By examining the source code, you can better understand the implementation details and usage of the related APIs. This will provide you with valuable references to achieve your goal.

1 Like