jetson-inference not accessing USB camera

Robotics & Edge Computing Jetson & Embedded Systems Jetson Nano
1

I built the jetson-inference package on my Nano (mostly following https://www.pyimagesearch.com/2019/05/06/getting-started-with-the-nvidia-jetson-nano/ but with of a freshly built OpenCV 4.1.1). The various console functions work fine (ex. ./imagenet-console dog_0.jpg), but I get a seg fault when I try functions that use my USB camera. This is strange because I can verify that my camera on /dev/video0 works with “cheese” and also with python scripts that use openCV. Below is the output I get when I run: imagenet-camera --camera 0

Any insights as to what might be wrong?

Thanks!
Daniel

./imagenet-camera --camera 0
[gstreamer] initialized gstreamer, version 1.14.5.0
[gstreamer] gstCamera attempting to initialize with GST_SOURCE_NVARGUS, camera 0
[gstreamer] gstCamera pipeline string:
nvarguscamerasrc sensor-id=0 ! video/x-raw(memory:NVMM), width=(int)1280, height=(int)720, framerate=30/1, format=(string)NV12 ! nvvidconv flip-method=2 ! video/x-raw ! appsink name=mysink
[gstreamer] gstCamera successfully initialized with GST_SOURCE_NVARGUS, camera 0

imagenet-camera:  successfully initialized camera device
    width:  1280
   height:  720
    depth:  12 (bpp)

imageNet -- loading classification network model from:
         -- prototxt     networks/googlenet.prototxt
         -- model        networks/bvlc_googlenet.caffemodel
         -- class_labels networks/ilsvrc12_synset_words.txt
         -- input_blob   'data'
         -- output_blob  'prob'
         -- batch_size   1

[TRT]   TensorRT version 5.0.6
[TRT]   loading NVIDIA plugins...
[TRT]   completed loading NVIDIA plugins.
[TRT]   detected model format - caffe  (extension '.caffemodel')
[TRT]   desired precision specified for GPU: FASTEST
[TRT]   requested fasted precision for device GPU without providing valid calibrator, disabling INT8
[TRT]   native precisions detected for GPU:  FP32, FP16
[TRT]   selecting fastest native precision for GPU:  FP16
[TRT]   attempting to open engine cache file networks/bvlc_googlenet.caffemodel.1.1.GPU.FP16.engine
[TRT]   loading network profile from engine cache... networks/bvlc_googlenet.caffemodel.1.1.GPU.FP16.engine
[TRT]   device GPU, networks/bvlc_googlenet.caffemodel loaded
[TRT]   device GPU, CUDA engine context initialized with 2 bindings
[TRT]   binding -- index   0
               -- name    'data'
               -- type    FP32
               -- in/out  INPUT
               -- # dims  3
               -- dim #0  3 (CHANNEL)
               -- dim #1  224 (SPATIAL)
               -- dim #2  224 (SPATIAL)
[TRT]   binding -- index   1
               -- name    'prob'
               -- type    FP32
               -- in/out  OUTPUT
               -- # dims  3
               -- dim #0  1000 (CHANNEL)
               -- dim #1  1 (SPATIAL)
               -- dim #2  1 (SPATIAL)
[TRT]   binding to input 0 data  binding index:  0
[TRT]   binding to input 0 data  dims (b=1 c=3 h=224 w=224) size=602112
[TRT]   binding to output 0 prob  binding index:  1
[TRT]   binding to output 0 prob  dims (b=1 c=1000 h=1 w=1) size=4000
device GPU, networks/bvlc_googlenet.caffemodel initialized.
[TRT]   networks/bvlc_googlenet.caffemodel loaded
imageNet -- loaded 1000 class info entries
networks/bvlc_googlenet.caffemodel initialized.
[OpenGL] glDisplay -- X screen 0 resolution:  1920x1080
[OpenGL] glDisplay -- display device initialized
[gstreamer] opening gstCamera for streaming, transitioning pipeline to GST_STATE_PLAYING
[gstreamer] gstreamer changed state from NULL to READY ==> mysink
[gstreamer] gstreamer changed state from NULL to READY ==> capsfilter1
[gstreamer] gstreamer changed state from NULL to READY ==> nvvconv0
[gstreamer] gstreamer changed state from NULL to READY ==> capsfilter0
[gstreamer] gstreamer changed state from NULL to READY ==> nvarguscamerasrc0
[gstreamer] gstreamer changed state from NULL to READY ==> pipeline0
[gstreamer] gstreamer changed state from READY to PAUSED ==> capsfilter1
[gstreamer] gstreamer changed state from READY to PAUSED ==> nvvconv0
[gstreamer] gstreamer changed state from READY to PAUSED ==> capsfilter0
[gstreamer] gstreamer stream status CREATE ==> src
[gstreamer] gstreamer changed state from READY to PAUSED ==> nvarguscamerasrc0
[gstreamer] gstreamer changed state from READY to PAUSED ==> pipeline0
[gstreamer] gstreamer stream status ENTER ==> src
[gstreamer] gstreamer msg new-clock ==> pipeline0
[gstreamer] gstreamer changed state from PAUSED to PLAYING ==> capsfilter1
[gstreamer] gstreamer changed state from PAUSED to PLAYING ==> nvvconv0
[gstreamer] gstreamer changed state from PAUSED to PLAYING ==> capsfilter0
[gstreamer] gstreamer changed state from PAUSED to PLAYING ==> nvarguscamerasrc0
[gstreamer] gstreamer msg stream-start ==> pipeline0

imagenet-camera:  camera open for streaming
GST_ARGUS: Creating output stream
GST_ARGUS: Available Sensor modes :
Segmentation fault (core dumped)
2

Hi Daniel, to use V4L2 webcam, use the --camera=/dev/video0 argument when launching the program. The way you are running it now will try to use MIPI CSI camera.

For more info about the camera argument, use the --help flag to print out the usage or see this page:

[url]https://github.com/dusty-nv/jetson-inference/blob/master/docs/imagenet-camera-2.md[/url]

3

dusty_nv: Ah, thank you! That works.

It would be nice if the output told me that it was not able to access the camera stream, though.

4

The code does check if the GStreamer pipeline failed to create the camera, and prints out associated error messages if so, but unfortunately it appears that GStreamer is crashing when it isn’t able to open a MIPI CSI camera when one isn’t detected. Will have to play around more with this scenario.

5

I’m also experiencing problems with logitech C170 webcam.

6

Hi matesanz.cuadrado, are you launching the program with “–camera=/dev/video0” argument? Or if your USB webcam exists in the system as /dev/video1, use “–camera=/dev/video1”, ect.

Also, you may want to run these commands and check the supported formats/resolutions of your webcam:

$ sudo apt-get install v4l-utils
$ v4l2-ctl --list-formats-ext

You should use one of the supported resolutions with the --width=X and --height=Y arguments (see here for more info)