Is it possible to use sample_object_detector_tracker for USB cameras?

Autonomous Vehicles DRIVE AGX Orin DRIVE AGX Orin General
1

Please provide the following info (tick the boxes after creating this topic):
Software Version
[*] DRIVE OS 6.0.10.0
DRIVE OS 6.0.8.1
DRIVE OS 6.0.6
DRIVE OS 6.0.5
DRIVE OS 6.0.4 (rev. 1)
DRIVE OS 6.0.4 SDK
other

Target Operating System
[*] Linux
QNX
other

Hardware Platform
DRIVE AGX Orin Developer Kit (940-63710-0010-300)
DRIVE AGX Orin Developer Kit (940-63710-0010-200)
[*] DRIVE AGX Orin Developer Kit (940-63710-0010-100)
DRIVE AGX Orin Developer Kit (940-63710-0010-D00)
DRIVE AGX Orin Developer Kit (940-63710-0010-C00)
DRIVE AGX Orin Developer Kit (not sure its number)
other

SDK Manager Version
2.1.0
other

Host Machine Version
native Ubuntu Linux 20.04 Host installed with SDK Manager
[*] native Ubuntu Linux 20.04 Host installed with DRIVE OS Docker Containers
native Ubuntu Linux 18.04 Host installed with DRIVE OS Docker Containers
other

Issue Description

I want to integrate USB cameras with Drive AGX Orin and require below details :
a) Can I use any USB camera with Orin?
b) Can I use sample_object_detector_tracker application to access USB cameras? Any modifications are required?

3

Dear @PA_GN ,
Please check using DriveWorks SDK Reference: USB Camera Capture Sample to test USB camera.
We have not tested DNN sample with USB camera. But, I think is possible if we can get RGBA frame from camera to feed into DNN.

4

Hi @SivaRamaKrishnaNV,

Can you share more insight on how you have tested the USB camera & which USB cameras have you used?
Also, to access USB camera frame from DNN based application (sample_object_detector_tracker) any modifications have to be made ex : in rig.json or some other files?

Did anyone tried to use DNN sample with USB cameras?

5

@SivaRamaKrishnaNV Please share your inputs.

6

I have not tested any USB camera. But, I would expect any USB camera to work. Note that when using USB camera, it does not use SIPL and uses opencv library. Please see DriveWorks SDK Reference: Camera

Yes. you need to use camera.usb protocol and use correct device parameter associated to camera for dwSensorParams and create SAL sensor. You can follow the workflow and get the camera frame that needs to be fed into network.