Using webcam on Jetson Nano running on YOLO

megans0610 · April 16, 2021, 2:52am

Hi!

I am currently trying to run YOLO on my Jetson Nano and apparently it is unable to switch on the webcam. However, the predictions all came out on the terminal but the webcam viewer is not appearing even though the light on the camera is switched on. The webcam I am using is C270 Logitech Webcam.

Another problem is that my other Jetson Nano is facing similar issues. However, in this case, the webcam does not switched on at all and no predictions on the terminal but an error message that says videostream stops which runs continuously without stopping.

Is there anyone who faced the same issue and is able to help me solve this problem? Hope there is a reply soon as I need it for my project now.

Thank you very much! Have a great day :D

Edwin2087 · April 16, 2021, 4:45am

What command do you use to run YOLO?

megans0610 · April 16, 2021, 5:41am

The command I used to run YOLO is:

./darknet detector demo cfg/coco.data cfg/yolov3.cfg yolov3.weights -c 0

MtHiker · April 16, 2021, 5:51am

Can you open the USB webcams with other ways?
e.g cheese, vlc …

And jetcam for Jetson would be a good way.

megans0610 · April 16, 2021, 5:54am

Hi! Yep the webcam is working as it works when we run using MobileNetV2.

MtHiker · April 16, 2021, 5:58am

Any messages at ‘darknet command’?

megans0610 · April 16, 2021, 6:02am

This is what I got after running the command which is:

./darknet detector demo cfg/coco.data cfg/yolov3.cfg yolov3.weights

However, the webcam viewer is not appearing but it’s sensing the image by providing the results on the terminal screen as shown in the picture.

MtHiker · April 16, 2021, 6:09am

I think, OpenCV on your Jetson Nano has some problem.
Would you test your OpenCv with following simple Python code?

import cv2

img = cv2.imread('your-image.jpg', cv2.IMREAD_COLOR)

cv2.imshow('image', img)
cv2.waitKey(0)
cv2.destroyAllWindows()

megans0610 · April 16, 2021, 6:24am

Hi, looks like its an error. Is there a link to tell me how to download the working OpenCV?

MtHiker · April 16, 2021, 6:36am

This error means the image file is empty, that is, wrong file name or wrong path.
Make sure that your image file is existing where you want and replace ‘your-image.jpg’ of imread.

Even JetPack already has pre-built OpenCV, if you want to re-install OpenCV,
sudo apt install python3-opencv

megans0610 · April 16, 2021, 6:41am

Hi! OpenCV is installed inside. So what else could have caused the original problem of the webcam?

MtHiker · April 16, 2021, 6:47am

No trouble about OpenCV at jetson, but you’d better test it works pretty well.

How about the small Python code?

megans0610 · April 16, 2021, 6:49am

Ya I tried it with the small Python Code that you sent. It was an error because I didn’t change the image filename. So with that code you gave me, it works.

Edwin2087 · April 16, 2021, 7:09am

Did you compile the Darknet correctly?
In Makefile

# Set these variable to 1:
GPU=1
CUDNN=1
OPENCV=1

# Uncomment the following line
# For Jetson TX1, Tegra X1, DRIVE CX, DRIVE PX - uncomment:
ARCH= -gencode arch=compute_53,code=[sm_53,compute_53]

# Replace NVCC path
NVCC=/usr/local/cuda/bin/nvcc

Maybe you can try different input methods for Darknet.

./darknet detector demo cfg/coco.data cfg/yolov4.cfg yolov4.weights “v4l2src ! video/x-raw, framerate=30/1, width=640, height=360 ! videoconvert ! appsink” -ext_output -dont_show

megans0610 · April 16, 2021, 7:28am

Hi I have followed your instructions to edit the Makefile and I had the same error with video-stream stop as shown in the picture.

Edwin2087 · April 16, 2021, 7:59am

I had a similar problem with RPi HQ camera (it’s not USB however).

This command worked for me:

./darknet detector demo cfg/coco.data cfg/yolov4.cfg yolov4.weights “nvarguscamerasrc ! video/x-raw(memory:NVMM),width=1280, height=720, framerate=30/1, format=NV12 ! nvvidconv ! video/x-raw, format=BGRx, width=640, height=360 ! videoconvert ! video/x-raw, format=BGR ! appsink”

Edwin2087 · April 16, 2021, 8:50am

One more thing. I also installed OpenCV by this script:

It enables Cuda and Gstreamer. Before installing this, I remember having some issues in OpenCV.

megans0610 · April 16, 2021, 2:02pm

Okay I’ll try it out on Monday and get back to you by that day :D Thank you very much!

Nick_H · April 16, 2021, 2:39pm

For the demo with webcam I use.

./darknet detector demo cfg/coco.data cfg/yolov4.cfg yolov4.weights /dev/video0

Honey_Patouceul · April 16, 2021, 2:45pm

This would work if /dev/video0 is a UVC camera such as most USB webcams.

However, if you are using a RPi v2 camera, it is not, it is a bayer sensor providing RG10 format.

The command provided by @Edwin2087 will use a gstreamer pipeline reading from CSI and debayering with nvarguscamerasrc plugin, converting into BGRx format while resizing with hardware, then converting into BGR with videoconvert as expected by the app.