Exception: jetson.utils -- failed to create videoSource device

karishmathumu · August 17, 2022, 1:25pm

I am learning about Jetson Orin and trying to implement the AI Image classification following this tutorial with Jetson-Inference.

github.com

dusty-nv/jetson-inference/blob/master/docs/imagenet-console-2.md

<img src="https://github.com/dusty-nv/jetson-inference/raw/master/docs/images/deep-vision-header.jpg" width="100%">
<p align="right"><sup><a href="building-repo-2.md">Back</a> | <a href="imagenet-example-python-2.md">Next</a> | </sup><a href="../README.md#hello-ai-world"><sup>Contents</sup></a>
<br/>
<sup>Image Recognition</sup></p>  

# Classifying Images with ImageNet
There are multiple types of deep learning networks available, including recognition, detection/localization, and semantic segmentation.  The first deep learning capability we're highlighting in this tutorial is **image recognition**, using classifcation networks that have been trained on large datasets to identify scenes and objects.

<img src="https://github.com/dusty-nv/jetson-inference/raw/pytorch/docs/images/imagenet.jpg" width="1000">

The [`imageNet`](../c/imageNet.h) object accepts an input image and outputs the probability for each class.  Having been trained on the ImageNet ILSVRC dataset of **[1000 objects](../data/networks/ilsvrc12_synset_words.txt)**, the GoogleNet and ResNet-18 models were automatically downloaded during the build step.  See [below](#downloading-other-classification-models) for other classification models that can be downloaded and used as well.

As an example of using the [`imageNet`](../c/imageNet.h) class, we provide sample programs for C++ and Python:

- [`imagenet.cpp`](../examples/imagenet/imagenet.cpp) (C++) 
- [`imagenet.py`](../python/examples/imagenet.py) (Python) 

These samples are able to classify images, videos, and camera feeds.  For more info about the various types of input/output streams supported, see the [Camera Streaming and Multimedia](aux-streaming.md) page.

This file has been truncated. show original

The Image classification works with the pictures. But when it is applied on the Jellyfish Video, it has some problem with video streaming

The error is sighted as below. [gstreamer] gstDecoder – failed to create pipeline
[gstreamer] (no element “nvv4l2decoder”)
[gstreamer] gstDecoder – failed to create decoder for file:///home/sesotec-ai-2/tk_ws/src/jetson-inference/build/aarch64/bin/jellyfish.mkv
Traceback (most recent call last):
File “./imagenet.py”, line 58, in
input = videoSource(args.input_URI, argv=sys.argv)
Exception: jetson.utils – failed to create videoSource device

I also checked for sesotec-ai-2@Sesotec-AI-2:~/tk_ws/src/recognition$ v4l2-ctl --list-devices

NVIDIA Tegra Video Input Device (platform:tegra-camrtc-ca):
/dev/media0

HD Pro Webcam C920 (usb-3610000.xhci-4.2):
/dev/video0
/dev/video1
/dev/media1

Kind request for help.

dusty_nv · August 17, 2022, 1:37pm

Hi @karishmathumu, it appears your system doesn’t have the nvv4l2decoder GStreamer element installed, which comes as part of JetPack-L4T - which Jetson device and version of JetPack-L4T are you running? Is it Jetson AGX Orin and JetPack 5.x?

Can you run this command on your system to check which NVIDIA GStreamer elements are installed?

$ gst-inspect-1.0 | grep nvv4l2
nvv4l2camerasrc:  nvv4l2camerasrc: NvV4l2CameraSrc
nvvideo4linux2:  nvv4l2decoder: NVIDIA v4l2 video decoder
nvvideo4linux2:  nvv4l2h264enc: V4L2 H.264 Encoder
nvvideo4linux2:  nvv4l2h265enc: V4L2 H.265 Encoder
nvvideo4linux2:  nvv4l2vp8enc: V4L2 VP8 Encoder
nvvideo4linux2:  nvv4l2vp9enc: V4L2 VP9 Encoder
nvvideo4linux2:  nvv4l2av1enc: V4L2 AV1 Encoder

karishmathumu · August 17, 2022, 1:45pm

Thank you for your quick response. As far as i know, it is Jetson AGX Orin.

When I ran the command you told me to the follwing appears.

sesotec-ai-2@Sesotec-AI-2:~$ gst-inspect-1.0 | grep nvv4l2
nvv4l2camerasrc: nvv4l2camerasrc: NvV4l2CameraSrc

sesotec-ai-2@Sesotec-AI-2:~$ dpkg-query --show nvidia-l4t-core
nvidia-l4t-core 34.1.1-20220516211757

is there a way to install nvv4l2decoder please? I have tried the
sudo apt-get install v4l-utils

Regards,
Karishma

dusty_nv · August 17, 2022, 2:08pm

Can you try installing nvidia-l4t-gstreamer package from apt?

If that doesn’t work, I recommend re-flashing the device with SDK Manager, as this stuff is normally already installed on the device.

karishmathumu · August 18, 2022, 5:00am

As you suggested, I did the sudo apt-get install nvidia-l4t-gstreamer
and then went into build and ran “make” and “sudo make install”
and then when into bin and ran
wget https://nvidia.box.com/shared/static/tlswont1jnyu3ix2tbf7utaekpzcx4rc.mkv -O jellyfish.mkv
and then ran
./imagenet.py --netwerk=resnet-18 jellyfish.mkv images/test/jellyfish-resnet18.mkv

But the error remains the same.

[gstreamer] gstDecoder – pipeline string:
[gstreamer] filesrc location=jellyfish.mkv ! matroskademux ! queue ! h264parse ! nvv4l2decoder ! video/x-raw(memory:NVMM) ! nvvidconv ! video/x-raw ! appsink name=mysink
[gstreamer] gstDecoder – failed to create pipeline
[gstreamer] (no element “nvv4l2decoder”)
[gstreamer] gstDecoder – failed to create decoder for file:///home/sesotec-ai-2/tk_ws/src/jetson-inference/build/aarch64/bin/jellyfish.mkv
Traceback (most recent call last):
File “./imagenet.py”, line 58, in
input = videoSource(args.input_URI, argv=sys.argv)
Exception: jetson.utils – failed to create videoSource device

I will try to re-flash the device with SDK manager as you said and see if it works. Will inform you soon.

Thank you very much. It is really kind of you.

Regards,
Karishma

karishmathumu · August 18, 2022, 6:51am

Hai Sir,

I have went along with the next steps. I ran the image recognition program with the code you gave in the tutorial. It worked well with the black bear, polar bear and brown bear.

I wanted to then try with the images of my own. So I added two images to my github and downloaded them with wget, same as like the bear examples.

But when i ran the ./my.py sea.jpg. It has a huge error in RED and now the ‘sesotec-ai-2@Sesotec-AI-2:’ and every line is totally in RED color

Could you please tell me where I went wrong and how to rectify it please.

Regards,
Karishma

dusty_nv · August 18, 2022, 12:13pm

Hi @karishmathumu, it looks like you actually downloaded the HTML GitHub page of sea.jpg, and not the raw sea.jpg itself. If you navigate to the GitHub page of your image, right click on the Download button and copy the URL from there. It should have raw in it.

karishmathumu · August 18, 2022, 12:25pm

Hai Sir,

I tried to do as you said, but there still seems to not work. Have I committed any mistake?

I did the wget https://github.com/karishmathumu/karishmathumu/raw/main/sea.jpg

The following resulted.

Regards,
Karishma

dusty_nv · August 18, 2022, 12:33pm

If you check the output, wget saved your second download to sea.jpg.2. So do the following:

rm sea.jpg
mv sea.jpg.2 sea.jpg
./my.py sea.jpg

karishmathumu · August 18, 2022, 12:34pm

Hai Sir,

I think it worked. I forgot to add the number of the sea.

This time I ran it as, “./my.py sea.jpg.3” , as when i ran the wget (url) it displayed as
“2022-08-18 14:26:27 (2,37 MB/s) - ‘sea.jpg.3’ saved [98118/98118]”

karishmathumu · August 18, 2022, 12:46pm

About the issue with videos and camera, I found that the parts of tutorial involving, live camera or video image detection or video object detection. none of them working in my system . All of them are having the same issue of both:

Download test video

wget https://nvidia.box.com/shared/static/veuuimq6pwvd62p9fresqhrrmfqz0e2f.mp4 -O pedestrians.mp4

C++

./detectnet pedestrians.mp4 images/test/pedestrians_ssd.mp4

Python

./detectnet.py pedestrians.mp4 images/test/pedestrians_ssd.mp4
[gstreamer] gstDecoder – pipeline string:
[gstreamer] filesrc location=pedestrians.mp4 ! qtdemux ! queue ! h264parse ! nvv4l2decoder ! video/x-raw(memory:NVMM) ! nvvidconv ! video/x-raw ! appsink name=mysink
[gstreamer] gstDecoder – failed to create pipeline
[gstreamer] (no element “nvv4l2decoder”)
[gstreamer] gstDecoder – failed to create decoder for file:///home/sesotec-ai-2/tk_ws/src/jetson-inference/build/aarch64/bin/pedestrians.mp4
Traceback (most recent call last):
File “./detectnet.py”, line 51, in
input = videoSource(args.input_URI, argv=sys.argv)
Exception: jetson.utils – failed to create videoSource device

and Live Camera Recognition. “./imagenet.py /dev/video0 output.mp4”

I am sorry, for bothering you. If you would like me to, I will create a new request.

Kind regards,
Karishma

karishmathumu · August 18, 2022, 12:47pm

Thank you very much Sir. For your patience and great help.

Regards,
Karishma

dusty_nv · August 18, 2022, 1:30pm

It says that you are missing the nvv4l2decoder element again…not sure what is happening to it.

Regarding the camera, do you have a camera plugged in? Is it MIPI CSI or USB? What does ls /dev/video* show?

karishmathumu · August 18, 2022, 1:33pm

It is a logitech USB camera.

ls /dev/video*

shows these two

/dev/video0 /dev/video1

dusty_nv · August 18, 2022, 1:38pm

OK, can you try running with imagenet.py with /dev/video1 instead?

karishmathumu · August 18, 2022, 1:50pm

I ran it like this, ./imagenet.py /dev/video1

It shows this error : " failed to create videoSource device"

For ./imagenet.py /dev/video0

dusty_nv · August 18, 2022, 3:48pm

Can you copy and paste the terminal log for running the command ./video-viewer /dev/video1 ?

It seems there is some problem with using your USB camera - not sure if it’s related to jetson-inference/jetson-utils or not. You might want to try viewing your USB camera on some other app on your Jetson to make sure it’s working okay first.

karishmathumu · August 19, 2022, 8:51am

sesotec-ai-2@Sesotec-AI-2:~/tk_ws/src/jetson-inference/build/aarch64/bin$ ./video-viewer /dev/video1
[gstreamer] initialized gstreamer, version 1.16.3.0
[gstreamer] gstCamera – attempting to create device v4l2:///dev/video1
[gstreamer] gstCamera – found v4l2 device: HD Pro Webcam C920
[gstreamer] v4l2-proplist, device.path=(string)/dev/video0, udev-probed=(boolean)false, device.api=(string)v4l2, v4l2.device.driver=(string)uvcvideo, v4l2.device.card=(string)“HD\ Pro\ Webcam\ C920”, v4l2.device.bus_info=(string)usb-3610000.xhci-4.2, v4l2.device.version=(uint)330305, v4l2.device.capabilities=(uint)2225078273, v4l2.device.device_caps=(uint)69206017;
[gstreamer] gstCamera – could not find v4l2 device /dev/video1
[gstreamer] gstCamera – device discovery failed, but /dev/video1 exists
[gstreamer] support for compressed formats is disabled
[gstreamer] gstCamera pipeline string:
[gstreamer] v4l2src device=/dev/video1 do-timestamp=true ! nvvidconv flip-method=0 ! video/x-raw ! appsink name=mysink
[gstreamer] gstCamera successfully created device v4l2:///dev/video1
[video] created gstCamera from v4l2:///dev/video1

gstCamera video options:

– URI: v4l2:///dev/video1
- protocol: v4l2
- location: /dev/video1
- port: 1
– deviceType: v4l2
– ioType: input
– codec: unknown
– width: 1280
– height: 720
– frameRate: 30.000000
– bitRate: 0
– numBuffers: 4
– zeroCopy: true
– flipMethod: none
– loop: 0
– rtspLatency 2000

[OpenGL] glDisplay – X screen 0 resolution: 3840x1080
[OpenGL] glDisplay – X window resolution: 3840x1080
[OpenGL] glDisplay – display device initialized (3840x1080)
[video] created glDisplay from display://0

glDisplay video options:

– URI: display://0
- protocol: display
- location: 0
– deviceType: display
– ioType: output
– codec: raw
– width: 3840
– height: 1080
– frameRate: 0.000000
– bitRate: 0
– numBuffers: 4
– zeroCopy: true
– flipMethod: none
– loop: 0
– rtspLatency 2000

[gstreamer] opening gstCamera for streaming, transitioning pipeline to GST_STATE_PLAYING
[gstreamer] gstCamera failed to set pipeline state to PLAYING (error 0)
video-viewer: failed to capture video frame
video-viewer: shutting down…
video-viewer: shutdown complete

dusty_nv · August 19, 2022, 11:57am

I’m not sure why, but it has trouble discovering the different modes/formats of your camera.

Can you try running this:

sudo apt-get install v4l-utils
v4l2-ctl --device=/dev/video1 --list-formats-ext

Are you able to view your USB camera through other programs?

karishmathumu · August 22, 2022, 8:35am

Good morning Sir,

Here is the result of the command as you said to try:

I am not sure how to check the USB with the other programs. Could you give any hints?

I am sorry, I forgot to mention to you that I am accessing the Jetson nano with SSH connection. Might this be the issue?

Regards,
Karishma

Topic		Replies	Views
Imagenet-camera.cpp libraries not working on jetson nano Jetson Nano	40	4472	October 14, 2021
How does one encode and stream detectnet object detection video over network using the dusty-jetson-inference repo? Jetson TX2	15	3860	October 18, 2021
Jetson inference code breaks when running on my other jetson Jetson Nano jetson-inference	8	275	July 7, 2024
Issue Running detectnet.py with CSI Camera on Jetson AGX Orin Jetson AGX Orin camera , jetson-inference , gstreamer	7	30	March 13, 2025
video output does not show up because, [OpenGL] failed to create X11 Window imagenet-camera: failed to create openGL display Jetson TX2	10	6758	October 18, 2021
./video-viewer /dev/video0 from github Hello AI World failing Jetson Nano camera , jetson-inference , gstreamer	16	3129	October 15, 2021
EGL display error and execute: 751 Failed to create CaptureSession Jetson Nano camera , gstreamer	6	1701	July 27, 2022
Build new camera sensor kernel module - symbols missing Jetson Orin NX camera	29	512	June 14, 2024
Unable to open camera for CSİ Camera Jetson Orin Nano camera , ubuntu , python	23	483	November 2, 2024
Jetson NANO and USB 5.8G UVC Camera Receiver Jetson Nano	12	1500	October 14, 2021

Exception: jetson.utils -- failed to create videoSource device

Download test video

C++

Python

gstCamera video options:

– URI: v4l2:///dev/video1 - protocol: v4l2 - location: /dev/video1 - port: 1 – deviceType: v4l2 – ioType: input – codec: unknown – width: 1280 – height: 720 – frameRate: 30.000000 – bitRate: 0 – numBuffers: 4 – zeroCopy: true – flipMethod: none – loop: 0 – rtspLatency 2000

[OpenGL] glDisplay – X screen 0 resolution: 3840x1080 [OpenGL] glDisplay – X window resolution: 3840x1080 [OpenGL] glDisplay – display device initialized (3840x1080) [video] created glDisplay from display://0

glDisplay video options:

– URI: display://0 - protocol: display - location: 0 – deviceType: display – ioType: output – codec: raw – width: 3840 – height: 1080 – frameRate: 0.000000 – bitRate: 0 – numBuffers: 4 – zeroCopy: true – flipMethod: none – loop: 0 – rtspLatency 2000

Related topics

– URI: v4l2:///dev/video1
- protocol: v4l2
- location: /dev/video1
- port: 1
– deviceType: v4l2
– ioType: input
– codec: unknown
– width: 1280
– height: 720
– frameRate: 30.000000
– bitRate: 0
– numBuffers: 4
– zeroCopy: true
– flipMethod: none
– loop: 0
– rtspLatency 2000

[OpenGL] glDisplay – X screen 0 resolution: 3840x1080
[OpenGL] glDisplay – X window resolution: 3840x1080
[OpenGL] glDisplay – display device initialized (3840x1080)
[video] created glDisplay from display://0

– URI: display://0
- protocol: display
- location: 0
– deviceType: display
– ioType: output
– codec: raw
– width: 3840
– height: 1080
– frameRate: 0.000000
– bitRate: 0
– numBuffers: 4
– zeroCopy: true
– flipMethod: none
– loop: 0
– rtspLatency 2000