color stripes contained in decoded image

Autonomous Machines Jetson & Embedded Systems Jetson Nano
1

Hi，
When i use the gstreamer to decode a video of 1080p. I found there are several color stripes in the bottom of the image(see the attachment). I used the pipeline as follows:

gst-launch-1.0 rtspsrc location=rtsp://admin:12345@172.16.10.195:554/h264/ch1/main/av_stream ! rtph264depay ! h264parse ! omxh264dec ! nvvidconv ! video/x-raw ! videoconvert ! nveglglessink -e

It seems that the image size was changed to 19201088(for 16-byte alignment) after processing by decoder. I thought nvvidconv should cropped the raw image to 19201080 according to the mata-info before processing, but in fact it just resized the image to 1920*1080 and this would cause the output image contains several color stripes .

I also made a test by using nvivafilter to instead of the nvvidconv, the output image is OK. but It seems that the nvivafilter takes high CPU performance, I don’t know why! The pipeline I used as follows:

gst-launch-1.0 rtspsrc location=rtsp://admin:12345@172.16.10.195:554/h264/ch1/main/av_stream ! rtph264depay ! h264parse ! omxh264dec ! nvivafilter ! video/x-raw(memory:NVMM),format=NV12  ! nvoverlaysink -e

capture.jpg
capture.jpg1920×1080 918 KB

capture.jpg
capture.jpg1920×1080 918 KB

2

Hi,
You can configure top, bottom, left, right in nvvidconv.

3

Hi DaneLLL,

I know that I can assign the cropped-rect in nvvidconv when processing the 1080p videos, But In fact I don't even know the video resolution that i used. In addition, considering that the video resolution may be changed, i can't set the cropped rectangle to a fixed value.
4

Hi,
We do not support runtime resolution change in nvvidconv plugin. Once the resolution is changed, you need to re-initialize nvvidconv.

5

Hi DaneLLL,

Maybe you don’t understand what i mean, i just want to remove the color stripes contained in decoded image.
I can’t use nvvidconv plugin to crop the image because i don’t know the video resolution. Any other ways to resolve this issue?

6

Hi,
UPDATE
We don’t observe the issue in running 1080p video playback with nvv4l2decoder:

$ gst-launch-1.0 filesrc location=~/jellyfish-5-mbps-hd-h264.mkv ! matroskademux ! h264parse ! <b>nvv4l2decoder</b> ! nvvidconv ! nveglglessink

But it does happen with omxh264dec:

$ gst-launch-1.0 filesrc location=~/jellyfish-5-mbps-hd-h264.mkv ! matroskademux ! h264parse ! <b>omxh264dec</b> ! nvvidconv ! nveglglessink

Sample video file is at http://jell.yfish.us/

We are deprecating omx plugins, so please utilize nvviafilter while using omxh264dec:

$ gst-launch-1.0 filesrc location=~/jellyfish-5-mbps-hd-h264.mkv ! matroskademux ! h264parse ! omxh264dec ! nvivafilter ! 'video/x-raw(memory:NVMM),format=NV12' ! nvvidconv ! nveglglessink
7

Hi DaneLLL,

Thanks for your reply. As i said above, after i added nvviafilter while using omxh264dec,the CPU usage will become higher. In fact, I used the decodebin to auto-magically construct a decoding pipeline as i don’t know the video format(maybe a H265 format).

8

Hi,
Please wait for nexr r32 release and utilize nvv4l2decoder.
There is an issue to run rtspsrc with nvv4l2decoder on r32.1. This shall be fixed in next release.

9

Hi DaneLLL,
’
I utilized the ‘appsrc’ and push back the H264/H265 video frames to the gst pipeline to instead the ‘rtspsrc’.
Then i utilized ‘parsebin | nvv4l2decoder’ to instead the ‘decodebin’, it works well, thank you!

10

This is a smart solution for r32.1. Thanks for the sharing.