Distortion issues on video of Gstreamer on Jetson Xavier NX

ask1 · November 26, 2021, 5:08pm

Hi, I’m using the production module of Jetson Xavier NX

Jetpack 4.5.1 [L4T 32.5.1]
cuDNN: 8.0.0.180

I use GitHub - balena-os/balena-jetson yocto build as base. and this docker container:

https://hub.docker.com/layers/balenalib/jetson-nano-ubuntu/bionic/images/sha256-b29927f1e1b2dcd282be960df873f9cb371a9d5b815340868d8d39d367e72493?context=explore

gst-launch-1.0 rtspsrc latency=50 location=rtsp://192.168.1.219:8554/ ! rtph264depay ! decodebin ! nvvidconv ! video/x-raw,width=1280,height=720,format=BGRx | appsink

The current command works fine on Jetson Nano, but not on the Xavier NX

The image is getting disorted by unknown reasons.

Here’s my factory output

GST_ELEMENT_FACTORY gstelementfactory.c:361:gst_element_factory_create: creating element "rtspsrc"
GST_ELEMENT_FACTORY gstelementfactory.c:361:gst_element_factory_create: creating element "rtspwms"
GST_ELEMENT_FACTORY gstelementfactory.c:361:gst_element_factory_create: creating element "rtspreal"
GST_ELEMENT_FACTORY gstelementfactory.c:361:gst_element_factory_create: creating element "rtph264depay"
GST_ELEMENT_FACTORY gstelementfactory.c:361:gst_element_factory_create: creating element "decodebin"
GST_ELEMENT_FACTORY gstelementfactory.c:359:gst_element_factory_create: creating element "typefind" named "typefind"
GST_ELEMENT_FACTORY gstelementfactory.c:361:gst_element_factory_create: creating element "nvvidconv"
GST_ELEMENT_FACTORY gstelementfactory.c:361:gst_element_factory_create: creating element "appsink"
GST_ELEMENT_FACTORY gstelementfactory.c:361:gst_element_factory_create: creating element "pipeline"
GST_ELEMENT_FACTORY gstelementfactory.c:361:gst_element_factory_create: creating element "capsfilter"
 
GST_ELEMENT_FACTORY gstelementfactory.c:361:gst_element_factory_create: creating element "udpsrc"
GST_ELEMENT_FACTORY gstelementfactory.c:361:gst_element_factory_create: creating element "udpsrc"
GST_ELEMENT_FACTORY gstelementfactory.c:361:gst_element_factory_create: creating element "udpsrc"
GST_ELEMENT_FACTORY gstelementfactory.c:359:gst_element_factory_create: creating element "rtpbin" named "manager"
GST_ELEMENT_FACTORY gstelementfactory.c:361:gst_element_factory_create: creating element "rtpsession"
GST_ELEMENT_FACTORY gstelementfactory.c:361:gst_element_factory_create: creating element "rtpssrcdemux"
GST_ELEMENT_FACTORY gstelementfactory.c:361:gst_element_factory_create: creating element "rtpstorage"
GST_ELEMENT_FACTORY gstelementfactory.c:361:gst_element_factory_create: creating element "funnel"
GST_ELEMENT_FACTORY gstelementfactory.c:361:gst_element_factory_create: creating element "funnel"
GST_ELEMENT_FACTORY gstelementfactory.c:361:gst_element_factory_create: creating element "rtpjitterbuffer"
GST_ELEMENT_FACTORY gstelementfactory.c:361:gst_element_factory_create: creating element "rtpptdemux"
GST_ELEMENT_FACTORY gstelementfactory.c:361:gst_element_factory_create: creating element "h264parse"
GST_ELEMENT_FACTORY gstelementfactory.c:361:gst_element_factory_create: creating element "capsfilter"
GST_ELEMENT_FACTORY gstelementfactory.c:361:gst_element_factory_create: creating element "nvv4l2decoder"

DaneLLL · November 29, 2021, 1:54am

Hi,
Please check if you observe the same issue in video playback:

$ gst-launch-1.0 rtspsrc latency=50 location=rtsp://192.168.1.219:8554/ ! rtph264depay ! h264parse ! nv4l2decoder ! nvoverlaysink

ask1 · November 29, 2021, 4:21pm

Exactly the same issue


 h264parse ! nvv4l2decoder ! nvoverlaysinkh-1.0 rtspsrc latency=50 location=rtsp://192.168.1.219:8554/  ! rtph264depay ! 
nvbuf_utils: Could not get EGL display connection
Setting pipeline to PAUSED ...
Opening in BLOCKING MODE
Opening in BLOCKING MODE 
Pipeline is live and does not need PREROLL ...
Progress: (open) Opening Stream
Progress: (connect) Connecting to rtsp://192.168.1.219:8554/channel1_1
Progress: (open) Retrieving server options
Progress: (open) Retrieving media info
Progress: (request) SETUP stream 0
Progress: (request) SETUP stream 0
Progress: (request) SETUP stream 0
Progress: (open) Opened Stream
Setting pipeline to PLAYING ...
New clock: GstSystemClock
Progress: (request) Sending PLAY request
Progress: (request) Sending PLAY request
Progress: (request) Sent PLAY request
NvMMLiteOpen : Block : BlockType = 261 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteBlockCreate : Block : BlockType = 261 

(gst-launch-1.0:59501): GStreamer-CRITICAL **: 16:19:56.452: gst_mini_object_unref: assertion 'mini_object != NULL' failed
NvMMLiteOpen : Block : BlockType = 261 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteBlockCreate : Block : BlockType = 261 
WARNING: from element /GstPipeline:pipeline0/GstNvOverlaySink-nvoverlaysink:nvoverlaysink-nvoverlaysink0: A lot of buffers are being dropped.
Additional debug info:
gstbasesink.c(2902): gst_base_sink_is_too_late (): /GstPipeline:pipeline0/GstNvOverlaySink-nvoverlaysink:nvoverlaysink-nvoverlaysink0:
There may be a timestamping problem, or this computer is too slow.
WARNING: from element /GstPipeline:pipeline0/GstNvOverlaySink-nvoverlaysink:nvoverlaysink-nvoverlaysink0: A lot of buffers are being dropped.
Additional debug info:
gstbasesink.c(2902): gst_base_sink_is_too_late (): /GstPipeline:pipeline0/GstNvOverlaySink-nvoverlaysink:nvoverlaysink-nvoverlaysink0:
There may be a timestamping problem, or this computer is too slow.
WARNING: from element /GstPipeline:pipeline0/GstNvOverlaySink-nvoverlaysink:nvoverlaysink-nvoverlaysink0: A lot of buffers are being dropped.
Additional debug info:
gstbasesink.c(2902): gst_base_sink_is_too_late (): /GstPipeline:pipeline0/GstNvOverlaySink-nvoverlaysink:nvoverlaysink-nvoverlaysink0:
There may be a timestamping problem, or this computer is too slow.

Did a test with outputting an png

gst-launch-1.0 rtspsrc latency=50 location=rtsp://192.168.1.219:8554/ ! rtph264depay ! decodebin ! nvjpegenc ! filesink location= ./start/web/build/test10.jpg

got this as output

thanks for the support

DaneLLL · November 30, 2021, 3:06am

Hi,
It seems like the stream is corrupted. Please try software decoder:

$ export DISPLAY=:0
$ gst-launch-1.0 rtspsrc latency=50 location=rtsp://192.168.1.219:8554/ ! rtph264depay ! h264parse ! avdec_h264 ! xvimagesink

ask1 · November 30, 2021, 5:24pm

yes already done that :) the image is fine then. The yocto build depends on GitHub - OE4T/meta-tegra: BSP layer for NVIDIA Jetson platforms, based on L4T

github.com

balena-os/balena-jetson/blob/master/layers/meta-balena-jetson/recipes-bsp/u-boot/u-boot-tegra_%.bbappend

FILESEXTRAPATHS:prepend := "${THISDIR}/${PN}:${THISDIR}/32.7.1:"

UBOOT_KCONFIG_SUPPORT = "1"

inherit resin-u-boot

LIC_FILES_CHKSUM = "\
    file://Licenses/README;md5=5a7450c57ffe5ae63fd732446b988025 \
"

# The u-boot versions 2021 / 2022 from
# meta-tegra don't work well when
# booting with custom device trees, even
# if it's the same dt that's written
# in the bootblob or in the dtb partitions.
# Let's switch to using the Nvidia u-boot.
SRCBRANCH="l4t/l4t-r32.6.1-v2020.04"
# Master HEAD as of today
SRCREV="46e4604c78d3804ccd4cf9624460a86ea5318a61"

This file has been truncated. show original

Is this issue known for L4T 32.5.1 specific cases?

DaneLLL · December 13, 2021, 8:51am

Hi,
Please save the h264 stream to local file:

gst-launch-1.0 rtspsrc latency=50 location=rtsp://192.168.1.219:8554/ ! rtph264depay ! h264parse ! video/x-h264,stream-format=byte-stream ! filesink location=test.h264

And check if software decoder works:

gst-launch-1.0 filesrc location=test.h264 ! h264parse ! avdec_h264 ! xvimagesink

Hardware decoder fails to decode the stream correctly:

gst-launch-1.0 filesrc location=test.h264 ! h264parse ! nvv4l2decoder ! nvoverlaysink

If running above commands shows the error please attach test.h264 so that we can give it a try.

system · January 5, 2022, 4:55am

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
Jetson Nano - unable to decode frames from IP camera streams with GPU (nvv412decoder) Jetson Nano	4	1792	October 15, 2021
Gstreamer stream on xavier stuck Jetson Xavier NX rtsp , camera , gstreamer	9	1535	October 18, 2021
GStreamer segmentation fault on Jetson Nano for MJPEG stream Jetson Nano camera , gstreamer , nano , video	12	2962	October 15, 2021
DS4.0/Nano: uridecodebin (rtsp) "Not supported input Rmsurface" when using ! nvegltransform ! nveglglessink sync=false -e DeepStream SDK	13	658	October 12, 2021
Possible memory leak in nvvidconv gstreamer plugin or decoder? Jetson Nano gstreamer	4	1817	October 18, 2021
revising streaming with Xavier Jetson AGX Xavier	12	1252	October 18, 2021
Jetson Xavier NX deepstream decode local mp4 video files or rtsp stream by nvv4l2decoder hardware accelerated on background Jetson Xavier NX decoder	15	1875	October 18, 2021
Question about encoding a USB camera stream to H.264 and decode it directly gstreamer Jetson Xavier NX gstreamer	5	488	May 1, 2024
Deepstream 3.0 C API Jetson AGX Xavier	10	2491	May 30, 2019
nvvideoconvert crashes on RTSP input + src-crop=x:y:w:h pipeline DeepStream SDK	45	5829	October 5, 2021

Distortion issues on video of Gstreamer on Jetson Xavier NX

Related topics