How Jetson Orin Nano device use command to receive uvc streaming and decode display

Robotics & Edge Computing Jetson & Embedded Systems Jetson Orin Nano
1

I want to decode usb streaming and display it，what command should I use？

3

Hi,
For UVC(USB Video Class) streaming, we support to capture frame data through v4l2. Please check if you can run v4l2-ctl commands to capture good frame data. And then you can try v4l2src plugin in gstreamer. Or try jetson_multimedia_api samples.

4

v4l2-ctl commands could capture

5

Hi,
For using gstreamer, please check
Using gst-launch-1.0 pipeline to Receiving (on target) : Network Source + video decode + video render - #14 by DaneLLL

Please make sure format, width,height,framerate are configured as the mode shown in v4l2-ctl --list-formats-ext. If either one is not coneectly set, it may fail in launching the gstreamer pipeline.

For using jetson_multimedia_api, you can try the sample:

/usr/src/jetson_multimedia_api/samples/12_v4l2_camera_cuda

6

image
image731×585 14.7 KB

7

a5dc81be4e0ad8173599965cddc5fc1
a5dc81be4e0ad8173599965cddc5fc11702×1276 205 KB

8

Hi,
Th camera source does not support general YUV422. Please try H264:

$ gst-launch-1.0 v4l2src num-buffers=150 device=/dev/video0 ! video/x-h264,width=1920,height=1080,framerate=30/1 ! fakesink sync=0

If above command works, please then try

$ gst-launch-1.0 v4l2src num-buffers=150 device=/dev/video0 ! video/x-h264,width=1920,height=1080,framerate=30/1 ! h264parse ! nvv4l2decoder ! fakesink sync=0

Then try this command and check if camera preview is shown:

$ DISPLAY=:0 gst-launch-1.0 v4l2src device=/dev/video0 ! video/x-h264,width=1920,height=1080,framerate=30/1 ! h264parse ! nvv4l2decoder ! nvvidconv ! video/x-raw ! xvimagesink sync=0
9

1c3dabdca76a25d42395915ebb86a53
1c3dabdca76a25d42395915ebb86a531702×1276 277 KB

10

Hi,
It looks like the stream cannot be decoded by hardware decoder. Please try software decoder:

$ DISPLAY=:0 gst-launch-1.0 v4l2src device=/dev/video0 ! video/x-h264,width=1920,height=1080,framerate=30/1 ! h264parse ! avdec_h264 ! videoconvert ! video/x-raw ! xvimagesink sync=0
11

721ec96ba4dcc37f285c6c5a2396327
721ec96ba4dcc37f285c6c5a23963271702×1276 171 KB

12

Hi,
Please run the command and check if you can see the plugin:

$ rm .cache/gstreamer-1.0/registry.aarch64.bin
$ export LD_PRELOAD=/usr/lib/aarch64-linux-gnu/libgomp.so.1
$ gst-inspect-1.0 avdec_h264
13

0b31130d73f4e47a92cd9511acf2e02
0b31130d73f4e47a92cd9511acf2e021702×1276 217 KB

14

Hi,
The software decoder is present. Please try to decode the h264 stream with it.

15

this can decode the h265 stream？

16

Hi,
avdec_h264 is software decoder for decoding h264 stream. Your camera source can output h264 stream. Please try the command and check if you can see camera preview.

17

it can see camera preview now.
i want to ask can decode the h265 stream？

18

Hi,
For decoding h265 stream, please try hardware decoder nvv4l2decoder or software decoder avdec_h265

19

Hi：
how to use v4l2-ctrl capture streaming?

20

Hi,
You may refer to this webpage and try the commands:
linux - Error negotiating V4L2 H264 output over UVC USB webcam - Stack Overflow

22

Hi,
I use opencv to capture the steaming，but the picture is black，why？
the opencv code as the upload test_3.py
test_3.py (785 Bytes)