How to set up multiple cameras of different models

TomFord · April 28, 2023, 6:16am

Software Version
DRIVE OS 6.0.6

Target Operating System
Linux

Hardware Platform
DRIVE AGX Orin Developer Kit (not sure its number)

I have multiple cameras of different models, and when I call INvSIPLQuery:: GetPlatformCfg for different cameras, there will be different arguments’ name '. Then when I call INvSIPLCamera:: SetPlatformCfg for each camera, it will report an error. Can’t INvSIPLCamera:: SetPlatformCfg be called for different cameras in the same program? How to call INvSIPLCamera:: SetPlatformCfg for configuration of different camera models?

TomFord · April 28, 2023, 6:20am

I found that in the same program, INvSIPLCamera:: SetPlatformCfg can only be called once, which prevents me from configuring different models of cameras through this interface

SivaRamaKrishnaNV · April 28, 2023, 7:50am

Dear @TomFord,
Is it like you want to run single instance of nvsipl_camera process to with multiple cameras of different type?
May I know the camera modules and connections port details.

TomFord · April 28, 2023, 8:00am

Dear @SivaRamaKrishnaNV
Yes, I want to run single instance of nvsipl_camera process to with multiple cameras of different type.
the camera modules is V1SIM728S2RU2030NB20_CPHY_x4 and F008A120RM0A_CPHY_x2. The connections port is C, pin-2 and pin-3 .

SivaRamaKrishnaNV · April 28, 2023, 5:29pm

Dear @TomFord,
Could you try below steps.

Create mixed JSON file with two cameras.
Run ./nvsipl_camera -t ./mixed_camera.json -c MIXED_CAMERA_CPHY_x4 -m “0x0110” –showfps to create new mixed platform config in database (or just -t -c are enough?)
Run ./nvsipl_camera -c MIXED_CAMERA_CPHY_x4 -m “0x110” –showfps to test the mixed config

Mixed_camera.json is below

{
“platformConfigs”: [

    {

        "name": "MIXED_CAMERA_CPHY_x4",

        "description": "MIXED CAMERA_4 lane CPHY mode",

        "enableMasks" : ["0x0110"],

        "deviceBlocks": [

            {

                "homogenousModules": false,

                "csiPort": "csi-ef",

                "passiveMode": false,

                "phyMode": "cphy",

                "simulatorMode": false,

                "deserializer": "MAX96712_Fusa_nv",

                "groupInitProg": false,

                "cameraModules": [

                    {"name": " V1SIM728S2RU2030NB20", "linkIndex": 1, "sensors": [{"name": "IMX728", "id": 0}]},

                    {"name": " F008A120RM0A ", "linkIndex": 2, "sensors": [{"name": " AR0820 ", "id": 1}]}

                ]

            }

        ]

    }

]

}

TomFord · May 4, 2023, 6:23am

Dear @SivaRamaKrishnaNV
My JSON file is below:

{
	"platformConfigs": [

		{

			"name": "MIXED_CAMERA_CPHY_x4",

			"description": "MIXED CAMERA_4 lane CPHY mode",

			"enableMasks": ["0x0000 0x0000 0x1001 0x0000"],

			"deviceBlocks": [

				{

					"homogenousModules": false,

					"csiPort": "csi-c",

					"passiveMode": false,

					"phyMode": "cphy",

					"simulatorMode": false,

					"deserializer": "MAX96712_Fusa_nv",

					"groupInitProg": false,

					"cameraModules": [

						{
							"name": "SG0233C5200M",
							"linkIndex": 0,
							"sensors": [{
								"name": "GW5200",
								"id": 8
							}]
						},

						{
							"name": "V1SIM623S4RU5195NB3",
							"linkIndex": 3,
							"sensors": [{
								"name": "IMX623",
								"id": 11
							}]
						}

					]

				}

			]

		}

	]
}

But when I run the command ./nvsipl_camera -t ./mixed_camera.json -c “MIXED_CAMERA_CPHY_x4” --showfps -v 3, an error is reported as follows:

Platform configuration name: MIXED_CAMERA_CPHY_x4
Platform configuration file: ./mixed_camera.json
Verbosity level: 3
Raw output: disabled
ISP0 output: enabled
ISP1 output: enabled
ISP2 output: enabled
Enabled FPS logging
Disabled Metadata logging
Disabled automatic recovery
Disabled NvSci
Disabled profiling
Disabled initialization profiling
Disabled ISP Statistics settings override
Subframe : disabled
Disabled Passive mode
Disabled retrieving/displaying NITO Metadata
nvsipl_camera: Setting up signal handler

libnvsipl_query.so: CNvMQuery.cpp : 238: ParseJsonFile: CNvMQuery::ParseJsonFile reading file ./mixed_camera.json
libnvsipl_query.so: CNvMDeviceBlockInfo.cpp : 134: ParseJson: deserializer on this platform MAX96712_Fusa_nv
libnvsipl_query.so: CNvMSensorInfo.cpp : 209: ParseJson: Updated GW5200
libnvsipl_query.so: CNvMCameraModuleInfo.cpp : 226: ParseJson: Parsed SG0233C5200M
libnvsipl_query.so: CNvMSensorInfo.cpp : 209: ParseJson: Updated IMX623
libnvsipl_query.so: CNvMCameraModuleInfo.cpp : 226: ParseJson: Parsed V1SIM623S4RU5195NB3
nvsipl_camera: Getting platform configuration for MIXED_CAMERA_CPHY_x4

nvsipl_camera: Creating camera master

nvsipl_camera: Setting up master

nvsipl_camera: Creating consumers

Main: /dvs/git/dirty/git-master_modular/camera/fusa/sipl/src/core/CNvMCamera.cpp: 394: LogPlatformCfg: ---------- START PLATFORM CONFIGURATION ----------
Main: /dvs/git/dirty/git-master_modular/camera/fusa/sipl/src/core/CNvMCamera.cpp: 395: LogPlatformCfg: platform:
Main: /dvs/git/dirty/git-master_modular/camera/fusa/sipl/src/core/CNvMCamera.cpp: 396: LogPlatformCfg: platformConfig: MIXED_CAMERA_CPHY_x4
Main: /dvs/git/dirty/git-master_modular/camera/fusa/sipl/src/core/CNvMCamera.cpp: 397: LogPlatformCfg: description: MIXED CAMERA_4 lane CPHY mode
Main: /dvs/git/dirty/git-master_modular/camera/fusa/sipl/src/core/CNvMCamera.cpp: 398: LogPlatformCfg: numDeviceBlocks: 0
Main: /dvs/git/dirty/git-master_modular/camera/fusa/sipl/src/core/CNvMCamera.cpp: 500: LogPlatformCfg: ----------- END PLATFORM CONFIGURATION -----------
nvsipl_camera: ERROR: Master SetPlatformConfig failed. status: 1

SivaRamaKrishnaNV · May 4, 2023, 6:37am

Dear @TomFord,
Could you please confirm if the used camera modules are listed in DRIVE AGX Orin Sensors & Accessories | NVIDIA Developer .

Is nvsipl_camera is working with both camera modules independently?

TomFord · May 4, 2023, 7:27am

Dear @SivaRamaKrishnaNV
Yes, nvsipl_camera is working with both camera modules independently. And I have already used V1SIM728S2RU2030NB20_ CPHY_ x4 and F008A120RM0A_ CPHY_ X2, similar errors will also occur:

Platform configuration name: MIXED_CAMERA_CPHY_x4
Platform configuration file: ./mixed_camera.json
Verbosity level: 3
Raw output: disabled
ISP0 output: enabled
ISP1 output: enabled
ISP2 output: enabled
Enabled FPS logging
Disabled Metadata logging
Disabled automatic recovery
Disabled NvSci
Disabled profiling
Disabled initialization profiling
Disabled ISP Statistics settings override
Subframe : disabled
Disabled Passive mode
Disabled retrieving/displaying NITO Metadata
nvsipl_camera: Setting up signal handler

libnvsipl_query.so: CNvMQuery.cpp : 238: ParseJsonFile: CNvMQuery::ParseJsonFile reading file ./mixed_camera.json
libnvsipl_query.so: CNvMDeviceBlockInfo.cpp : 134: ParseJson: deserializer on this platform MAX96712_Fusa_nv
libnvsipl_query.so: CNvMSensorInfo.cpp : 209: ParseJson: Updated IMX728
libnvsipl_query.so: CNvMCameraModuleInfo.cpp : 226: ParseJson: Parsed V1SIM728S2RU2030NB20
libnvsipl_query.so: CNvMSensorInfo.cpp : 209: ParseJson: Updated AR0820
libnvsipl_query.so: CNvMCameraModuleInfo.cpp : 226: ParseJson: Parsed F008A120RM0A
nvsipl_camera: Getting platform configuration for MIXED_CAMERA_CPHY_x4

nvsipl_camera: Creating camera master

nvsipl_camera: Setting up master

nvsipl_camera: Creating consumers

Main: /dvs/git/dirty/git-master_modular/camera/fusa/sipl/src/core/CNvMCamera.cpp: 394: LogPlatformCfg: ---------- START PLATFORM CONFIGURATION ----------
Main: /dvs/git/dirty/git-master_modular/camera/fusa/sipl/src/core/CNvMCamera.cpp: 395: LogPlatformCfg: platform:
Main: /dvs/git/dirty/git-master_modular/camera/fusa/sipl/src/core/CNvMCamera.cpp: 396: LogPlatformCfg: platformConfig: MIXED_CAMERA_CPHY_x4
Main: /dvs/git/dirty/git-master_modular/camera/fusa/sipl/src/core/CNvMCamera.cpp: 397: LogPlatformCfg: description: MIXED CAMERA_4 lane CPHY mode
Main: /dvs/git/dirty/git-master_modular/camera/fusa/sipl/src/core/CNvMCamera.cpp: 398: LogPlatformCfg: numDeviceBlocks: 0
Main: /dvs/git/dirty/git-master_modular/camera/fusa/sipl/src/core/CNvMCamera.cpp: 500: LogPlatformCfg: ----------- END PLATFORM CONFIGURATION -----------
nvsipl_camera: ERROR: Master SetPlatformConfig failed. status: 1

system · May 18, 2023, 7:27am

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.

SivaRamaKrishnaNV · May 23, 2023, 5:38pm

Dear @TomFord,
I see above post is marked as solution. Could you confirm the status?

SivaRamaKrishnaNV · July 10, 2023, 6:22am

Dear @TomFord,
May I know if you are able to run the multiple camera configuration?

Topic		Replies	Views
Unable to get multiple cameras working on AGX ORIN DRIVE AGX Orin General driveos-nvmedia	11	869	August 11, 2023
NVSIPL Camera with Custom JSON config input DRIVE AGX Orin General driveos-nvmedia	6	699	January 17, 2024
Camera failure to work out of port A and Cor D at same time DRIVE AGX Orin General driveos-nvmedia	22	741	August 9, 2023
Nvsipl_camera: ERROR: NvSIPLCamera Init failed DRIVE AGX Orin General driveos-nvmedia	16	1485	July 27, 2023
Cannot connect to camera by nvsipl_sample DRIVE AGX Orin General driveos-nvmedia	7	836	March 15, 2023
wfdCreateDevice failed on drive agx orin DRIVE AGX Orin General driveos-nvmedia	14	2184	August 18, 2023
Nvsipl error with custom driver DRIVE AGX Orin General driveos-nvmedia	12	1549	March 17, 2023
NVSIPL Camera Display Error DRIVE AGX Orin General driveos-nvmedia	5	748	September 2, 2023
Nvsipl_camera: ERROR: GetSyncObj failed. status: 10 DRIVE AGX Orin General driveos-nvmedia	3	95	August 8, 2024
Nvsipl camera failed DRIVE AGX Xavier General driveos-nvmedia , driveworks-cameras	6	1008	August 3, 2023

How to set up multiple cameras of different models

Related topics