USB Camera not working in detectnet-camera.py on Nano

mr.jared.turner · January 24, 2020, 4:57pm

Hi I am working on the Jetson Nano developer kit. I have not worked with gstreamer and I am testing out the jetson.inference and jetson.utils. I am trying to get the detectnet-camera python example working. I have a usb camera, which works fine in cheese, with the following v4l2-ctl -d /dev/video0 --list-formats-ext output:

ioctl: VIDIOC_ENUM_FMT
	Index       : 0
	Type        : Video Capture
	Pixel Format: 'UYVY'
	Name        : UYVY 4:2:2
		Size: Discrete 640x360
			Interval: Discrete 0.019s (52.000 fps)
		Size: Discrete 1280x720
			Interval: Discrete 0.077s (13.000 fps)
		Size: Discrete 1920x1080
			Interval: Discrete 0.167s (6.000 fps)

	Index       : 1
	Type        : Video Capture
	Pixel Format: 'MJPG' (compressed)
	Name        : Motion-JPEG
		Size: Discrete 1280x720
			Interval: Discrete 0.017s (60.000 fps)
			Interval: Discrete 0.033s (30.000 fps)
		Size: Discrete 640x352
			Interval: Discrete 0.017s (60.000 fps)
			Interval: Discrete 0.033s (30.000 fps)
		Size: Discrete 1920x1072
			Interval: Discrete 0.017s (60.000 fps)
			Interval: Discrete 0.033s (30.000 fps)

	Index       : 2
	Type        : Video Capture
	Pixel Format: 'H264' (compressed)
	Name        : H.264
		Size: Discrete 640x360
			Interval: Discrete 0.017s (60.000 fps)
			Interval: Discrete 0.033s (30.000 fps)
		Size: Discrete 1280x720
			Interval: Discrete 0.017s (60.000 fps)
			Interval: Discrete 0.033s (30.000 fps)
		Size: Discrete 1920x1080
			Interval: Discrete 0.017s (60.000 fps)
			Interval: Discrete 0.033s (30.000 fps)

When I run detectnet.py, the detections run fine but I get no display window. So I ran the following modified script, to cutout the detections and just get the display working:

import jetson.utils

camera = jetson.utils.gstCamera()
display = jetson.utils.glDisplay()

while display.IsOpen():
    img, height, width = camera.CaptureRGBA()
    display.RenderOnce(img, width, height)
    display.SetTitle("Camera read and display test...")

which opens an empty display window and outputs the following:

jetson.utils.__init__.py
jetson.utils -- initializing Python 3.6 bindings...
jetson.utils -- registering module functions...
jetson.utils -- done registering module functions
jetson.utils -- registering module types...
jetson.utils -- done registering module types
jetson.utils -- done Python 3.6 binding initialization
jetson.utils -- PyCamera_New()
jetson.utils -- PyCamera_Init()
[gstreamer] initialized gstreamer, version 1.14.5.0
[gstreamer] gstCamera attempting to initialize with GST_SOURCE_NVARGUS, camera 0
[gstreamer] gstCamera pipeline string:
nvarguscamerasrc sensor-id=0 ! video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, framerate=30/1, format=(string)NV12 ! nvvidconv flip-method=2 ! video/x-raw ! appsink name=mysink
[gstreamer] gstCamera successfully initialized with GST_SOURCE_NVARGUS, camera 0
jetson.utils -- PyDisplay_New()
jetson.utils -- PyDisplay_Init()
[OpenGL] glDisplay -- X screen 0 resolution:  1920x1080
[OpenGL] glDisplay -- display device initialized
[gstreamer] opening gstCamera for streaming, transitioning pipeline to GST_STATE_PLAYING
[gstreamer] gstreamer changed state from NULL to READY ==> mysink
[gstreamer] gstreamer changed state from NULL to READY ==> capsfilter1
[gstreamer] gstreamer changed state from NULL to READY ==> nvvconv0
[gstreamer] gstreamer changed state from NULL to READY ==> capsfilter0
[gstreamer] gstreamer changed state from NULL to READY ==> nvarguscamerasrc0
[gstreamer] gstreamer changed state from NULL to READY ==> pipeline0
[gstreamer] gstreamer changed state from READY to PAUSED ==> capsfilter1
[gstreamer] gstreamer changed state from READY to PAUSED ==> nvvconv0
[gstreamer] gstreamer changed state from READY to PAUSED ==> capsfilter0
[gstreamer] gstreamer stream status CREATE ==> src
[gstreamer] gstreamer changed state from READY to PAUSED ==> nvarguscamerasrc0
[gstreamer] gstreamer changed state from READY to PAUSED ==> pipeline0
[gstreamer] gstreamer stream status ENTER ==> src
[gstreamer] gstreamer msg new-clock ==> pipeline0
[gstreamer] gstreamer changed state from PAUSED to PLAYING ==> capsfilter1
[gstreamer] gstreamer changed state from PAUSED to PLAYING ==> nvvconv0
[gstreamer] gstreamer changed state from PAUSED to PLAYING ==> capsfilter0
[gstreamer] gstreamer changed state from PAUSED to PLAYING ==> nvarguscamerasrc0
[gstreamer] gstreamer msg stream-start ==> pipeline0
Error generated. /dvs/git/dirty/git-master_linux/multimedia/nvgstreamer/gst-nvarguscamera/gstnvarguscamerasrc.cpp, execute:532 No cameras available
[gstreamer] gstCamera onEOS

Any ideas on where I can look to get this working? Am I missing any arguments? The documentation on jetson.utils is sparse. Any help is appreciated.

**Update

After specifying the dimensions and the device by changing

camera = jetson.utils.gstCamera()

to

camera = jetson.utils.gstCamera(1920, 1080, “/dev/video0”)

I get the following output

jetson.utils.__init__.py
jetson.utils -- initializing Python 3.6 bindings...
jetson.utils -- registering module functions...
jetson.utils -- done registering module functions
jetson.utils -- registering module types...
jetson.utils -- done registering module types
jetson.utils -- done Python 3.6 binding initialization
jetson.utils -- PyCamera_New()
jetson.utils -- PyCamera_Init()
[gstreamer] initialized gstreamer, version 1.14.5.0
[gstreamer] gstCamera attempting to initialize with GST_SOURCE_NVARGUS, camera /dev/video0
[gstreamer] gstCamera pipeline string:
v4l2src device=/dev/video0 ! video/x-raw, width=(int)1920, height=(int)1080, format=YUY2 ! videoconvert ! video/x-raw, format=RGB ! videoconvert !appsink name=mysink
[gstreamer] gstCamera successfully initialized with GST_SOURCE_V4L2, camera /dev/video0
jetson.utils -- PyDisplay_New()
jetson.utils -- PyDisplay_Init()
[OpenGL] glDisplay -- X screen 0 resolution:  1920x1080
[OpenGL] glDisplay -- display device initialized
[gstreamer] opening gstCamera for streaming, transitioning pipeline to GST_STATE_PLAYING
[gstreamer] gstreamer changed state from NULL to READY ==> mysink
[gstreamer] gstreamer changed state from NULL to READY ==> videoconvert1
[gstreamer] gstreamer changed state from NULL to READY ==> capsfilter1
[gstreamer] gstreamer changed state from NULL to READY ==> videoconvert0
[gstreamer] gstreamer changed state from NULL to READY ==> capsfilter0
[gstreamer] gstreamer changed state from NULL to READY ==> v4l2src0
[gstreamer] gstreamer changed state from NULL to READY ==> pipeline0
[gstreamer] gstreamer changed state from READY to PAUSED ==> videoconvert1
[gstreamer] gstreamer changed state from READY to PAUSED ==> capsfilter1
[gstreamer] gstreamer changed state from READY to PAUSED ==> videoconvert0
[gstreamer] gstreamer changed state from READY to PAUSED ==> capsfilter0
[gstreamer] gstreamer stream status CREATE ==> src
[gstreamer] gstreamer changed state from READY to PAUSED ==> v4l2src0
[gstreamer] gstreamer changed state from READY to PAUSED ==> pipeline0
[gstreamer] gstreamer stream status ENTER ==> src
[gstreamer] gstreamer msg new-clock ==> pipeline0
[gstreamer] gstreamer changed state from PAUSED to PLAYING ==> videoconvert1
[gstreamer] gstreamer changed state from PAUSED to PLAYING ==> capsfilter1
[gstreamer] gstreamer msg stream-start ==> pipeline0
[gstreamer] gstreamer changed state from PAUSED to PLAYING ==> videoconvert0
[gstreamer] gstreamer changed state from PAUSED to PLAYING ==> capsfilter0
[gstreamer] gstreamer changed state from PAUSED to PLAYING ==> v4l2src0
[gstreamer] gstCamera onEOS
[gstreamer] gstreamer v4l2src0 ERROR Internal data stream error.
[gstreamer] gstreamer Debugging info: gstbasesrc.c(3055): gst_base_src_loop (): /GstPipeline:pipeline0/GstV4l2Src:v4l2src0:
streaming stopped, reason not-negotiated (-4)
[gstreamer] gstreamer changed state from READY to PAUSED ==> mysink

dusty_nv · January 24, 2020, 5:13pm

Hi Mr. Jared, you should launch the program with the --camera=/dev/video0 argument to use VL42 USB camera. From your terminal log, it is trying to use MIPI CSI camera (which is the default if you don’t specify a --camera argument). For more info, see here - I recommend just trying the included camera-viewer.py script first to make sure your camera is working:

$ python camera-viewer.py --camera=/dev/video0
$ python detectnet-camera.py --camera=/dev/video0

If you run into other issues, it may be because your camera is UYVY format (whereas the pipeline is setup for YUY2 USB camera)

If needed, try changing this line of code from ‘format=YUY2’ to ‘format=UYVY’:
https://github.com/dusty-nv/jetson-utils/blob/798c416c175d509571859c9290257bd5cce1fd63/camera/gstCamera.cpp#L432

//ss << "format=YUY2 ! videoconvert ! video/x-raw, format=RGB ! videoconvert !";
ss << "format=YUVY ! videoconvert ! video/x-raw, format=RGB ! videoconvert !";

Then recompile and reinstall jetson-inference before trying to run camera-viewer.py again:

$ cd /path/to/your/jetson-inference/build
$ make
$ sudo make install

mr.jared.turner · January 24, 2020, 9:41pm

Awesome. Thanks Dusty for your quick reply. After recompiling with UYVY I got the camera to work with camera-viewer.py. However, detectnet-camera.py still does not show any window, it just continually outputs [TRT] steps of Feature Extraction and Tactics. Should I start a new topic for this as the camera is technically working now with jetson.utils?

mr.jared.turner · January 24, 2020, 9:47pm

Actually adding

camera.Open()

to detectnet-camera.py rendered the image in a display window as expected.

Topic		Replies	Views
How to find read the contents of usb_camera.py in the Juperlab Jetson Nano jupyterlab , ai-training , getting-started	7	2625	September 28, 2021
camera demos seem to fail due to not finding imports? Jetson Nano	14	1124	September 23, 2019
Usb camera not working on jetson nano Jetson Nano camera , jetson	13	2973	March 8, 2022
Jetson NANO and USB 5.8G UVC Camera Receiver Jetson Nano	12	1494	October 14, 2021
Imagenet-camera.cpp libraries not working on jetson nano Jetson Nano	40	4470	October 14, 2021
Webcam and Jetson nano Jetson Nano gstreamer	5	1143	March 15, 2023
Testing usb cam on deepstream test1 usb-cam app without pgie config file DeepStream SDK camera , jetson , deepstream , jetson-nano	12	43	September 11, 2024
USB Camera not recognized Jetson Nano camera , usb	7	1436	October 15, 2021
Unable to stream RTSP Camera Stream for detectnet-camera to apply Jetson Nano camera , gstreamer	9	1547	October 15, 2021
Connect Jetson Nano to a laptop camera via RTP Jetson Nano camera	11	2712	December 22, 2021

USB Camera not working in detectnet-camera.py on Nano

Related topics