How to register the USB camera as an input device? / I want to hand over the camera data to frame

Robotics & Edge Computing Jetson & Embedded Systems Jetson TX2
1

Could you please teach me how to register the USB camera on VisionWorks’s SfM for Jetson TX2.
I want to use USB camera (PointGrey chamelon3) and hand over its data to frame.
Can I dessinate the PointGrey as an input device? like following.

input = “device:///nvcamera”; //tx2 onbord camera device
input = “device:///v4l2?index=0”//default usb camera device
input = “device:///nvmedia?config=dvp-ov10635-yuv422-ab&number=1” //omvision camera

Instead of registering device, I’m trying a method, converting from camera raw data to VxImage via flycaptureSDK, to hand over from cvImage to frame.
But it cannot be reached success because the conversion misstake, initialization of Sfm is failed.

cv_img = cv::Mat(rgbImage.GetRows(), rgbImage.GetCols(), CV8UC3, rgbImage.GetData(),rowBytes);
vxImage frame = nvx_cv::createVXImageFromCVMat(context, cv_img);
vx_status status = sfm->init(frame, mask, imuDataFile, frameDataFile);

Ofcourse, the best way is successing the registering as an input device.
Could you please give me advice?

Best regards,

2

Hi,

Could you share the camera format with us?
Does your camera have GStreamer support?
If yes, please feed it into VisionWorks via changing the device:///v4l2?index=0 directly.

Thanks.

3

Could you share the camera format with us?

rawImage.Convert to rgb.( PIXEL_FORMAT_BGR)

Does your camera have GStreamer support?
Yes, my camera is GStreamer supported.

If yes, please feed it into VisionWorks via changing the device:///v4l2?index=0 directly.
I already tried that code. But I cannot.

4

Hi,

Please remember to correct the video index for your camera.

Not sure if your GStreamer pipeline is same as a general usb camera.
If not, please modify the frame source code at $VisionWorks_root/nvxio/src/NVX/FrameSource/GStreamer/* to your use case.

Thanks