System Information OpenCV version: 4.8.0 Operating System / Platform: Ubuntu 18.04 Compiler & compiler version: GCC 7.5.0 nvidia-xavier-nx Detailed description By compiling opencv4.8 with gstreamer, At Nvidia jestson Xavier NX uses mat data as rtsp server, the client to pull the flow, the code is as follows: void* InitRtspServerModules() { std::string gstreamerOutputUrl ="appsrc ! x264enc ! rtph264pay name=pay0 pt=96"; cv::VideoWriter outWriter = cv::VideoWriter(gstreamerOutputUrl, cv::CAP_GSTREAMER,cv::VideoWriter::fourcc('H','2','6','4'), 25.0, cv::Size(320, 320)); if(!outWriter.isOpened()) { std::cout _param = std::make_shared (); _instance->_param->writer = outWriter; _instance->_param->bParamIsOk = true; return (void*)_instance; } FACE_ERROR_E WriteStreamForRtspServer( void* pOutputInstance, cv::Mat frame) { struct rtsp_server_instance* _instance = reinterpret_cast (pOutputInstance); if (!_instance || !_instance->_param->bParamIsOk) { std::cout _param->writer _param->writer.write(frame); return FACE_OK; } However, the following problems were reported: [ WARN:0@24.097] global cap_gstreamer.cpp:2676 writeFrame OpenCV | GStreamer warning: Error pushing buffer to GStreamer pipeline However, it is normal for me to refer to the rtsp-server source code to create the service： examples/test-launch.c master /* GStreamer * Copyright (C) 2008 Wim Taymans * * This library is free software; you can redistribute it and/or * modify it under the terms of the GNU Library General Public * License as published by the Free Software Foundation; either * version 2 of the License, or (at your option) any later version. * * This library is distributed in the hope that it will be useful, * but WITHOUT ANY WARRANTY; without even the implied warranty of * MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU * Library General Public License for more details. * * You should have received a copy of the GNU Library General Public * License along with this library; if not, write to the * Free Software Foundation, Inc., 51 Franklin St, Fifth Floor, * Boston, MA 02110-1301, USA. */ #include This file has been truncated. show original 1. After compiling, switch to the examples directory: cd examples 2. Build the Rtsp Server: ./test-launch "( videotestsrc ! x264enc ! rtph264pay name=pay0 pt=96 )" 3, Play rtsp stream: GST - launch - 1.0 playbin uri = RTSP: / / 127.0.0.1:8554 / test Steps to reproduce Compile gstreamer version opencv： cmake -D CMAKE_BUILD_TYPE=RELEASE -D CMAKE_INSTALL_PREFIX=install -D INSTALL_C_EXAMPLES=OFF -D WITH_FFMPEG=ON -D WITH_GSTREAMER=ON -D WITH_GTK_2_X=ON -D WITH_GTHREAD=ON -D WITH_TBB=ON -D WITH_OPENGL=ON -DBUILD_opencv_python3=ON -D OPENCV_GENERATE_PKGCONFIG=1 .. gstreamer part info is: – Video I/O: – DC1394: NO – FFMPEG: NO – avcodec: NO – avformat: NO – avutil: NO – swscale: NO – avresample: NO – GStreamer: YES (1.14.5) – v4l/v4l2: YES (linux/videodev2.h) Compile the interface code to run the program.

Hi, Please try this sample code and see if it works: Displaying to the screen with OpenCV and GStreamer - #9 by DaneLLL

@DaneLLL My current problem may be different, my input is to decode the RTSP stream and then push the stream to the default address in the way of the RTSP service, and the client pulls the stream through the address。

This is my modified gstreamer code, but the client can’t pull streams through rtsp://x.x.x.x:8554/test: appsrc ! videoconvert ! video/x-raw,format=BGRx ! nvvidconv ! nvv4l2h264enc ! rtph264pay name=pay0 pt=96 !gdppay ! tcpserversink host=0.0.0.0 port=8554

Hi, We don’t have experience in launching RTSP server in OpenCV. This would need other users to suggest next. For running UDP, please refer to Stream processed video with OpenCV on Jetson TX2 - #5 by DaneLLL OpenvCV, Gstreamer, Python camera capture/access and streaming to RTP

@DaneLLL I tried to decode RTSP with the following code： gstreamerUrl = format("rtspsrc location=%s latency=200 ! rtph264depay ! h264parse ! omxh264dec ! nvvidconv ! video/x-raw, format=(string)BGRx ! videoconvert n-threads=4 ! video/x-raw, format=(string)BGR ! appsink sync=false", strRtspUrl.c_str()); videocapcfg = cv::VideoCapture(gstreamerUrl,cv::CAP_GSTREAMER); The following code is used to transfer to the RTSP server: std::string gstreamerOutputUrl ="appsrc ! video/x-raw, format=BGR ! queue ! videoconvert ! video/x-raw,format=BGRx ! nvvidconv ! nvv4l2h264enc ! h264parse ! rtph264pay name=pay0 pt=96 config-interval=1 ! udpsink host=0.0.0.0 port=8554"; cv::VideoWriter outWriter = cv::VideoWriter(gstreamerOutputUrl, cv::CAP_GSTREAMER,cv::VideoWriter::fourcc('H','2','6','4'), 25.0, cv::Size(320, 320)); Code to run nor any error, I am a 192.168.101.79 server IP, udpsink address from 0.0.0.0 modification for 192.168.101.79 also, but I’m from the network, through the VLC from RTSP: / / 192.168.101.79:8554 / test can’t flow, What is the reason for this?

@DaneLLL After I modify the code to nvv4l2decoder, the image I get from tcp or udp addresses via vlc is black： gstreamerUrl = format("rtspsrc location=%s latency=200 ! rtph264depay ! h264parse ! nvv4l2decoder ! nvvidconv ! video/x-raw, format=(string)BGRx ! videoconvert n-threads=4 ! video/x-raw, format=(string)BGR ! appsink", strRtspUrl.c_str()); videocapcfg = cv::VideoCapture(gstreamerUrl,cv::CAP_GSTREAMER); std::string gstreamerOutputUrl ="appsrc ! video/x-raw, format=BGR ! queue ! videoconvert ! video/x-raw,format=BGRx ! nvvidconv ! nvv4l2h264enc insert-vui=1 ! h264parse ! rtph264pay config-interval=1 pt=96 ! tcpserversink host=0.0.0.0 port=8554"; cv::VideoWriter outWriter = cv::VideoWriter(gstreamerOutputUrl, cv::CAP_GSTREAMER,cv::VideoWriter::fourcc('H','2','6','4'), 25.0, cv::Size(320, 320)); [2023-10-03 08-32-43屏幕截图]

Hi, Please try the pipeline and see if video preview is correctly shown: $ DISPLAY=:0 gst-launch-1.0 rtspsrc location=RTSP_URI latency=200 ! rtph264depay ! h264parse ! nvv4l2decoder ! nvegltransform ! nveglglessink

@DaneLLL Decode normal display, push RTSP server flow how to handle？

GStreamer warning: Error pushing buffer to GStreamer pipeline

Robotics & Edge Computing Jetson Systems Jetson Xavier NX

DaneLLL October 2, 2023, 9:24am 8

Hi,
We suggest use nvv4l2decoder since omx plugins are deprecated. Please try this sample and check if video preview is good:
Doesn't work nvv4l2decoder for decoding RTSP in gstreamer + opencv - #3 by DaneLLL

And then it should work by applying the URI to this sample:
Stream processed video with OpenCV on Jetson TX2 - #5 by DaneLLL

Topic		Replies	Views
RTSP stream with openCV: Missing installation? Jetson Xavier NX rtsp	12	8403	December 7, 2021
Problem using gstreamer with opencv and cuda on TX2 with Jetpack 4.3 Jetson TX2 rtsp , opencv , cuda , gstreamer	20	3801	May 8, 2020
Jetson TX2 RTSP Streaming, FFmpeg or Gstreamer? Jetson TX2 opencv , gstreamer	7	10406	November 9, 2021
nvarguscamerasrc OpenCV (Solved) Jetson AGX Xavier opencv	51	31830	June 12, 2021
Gstreamer RTSP server setup Jetson TX2 rtsp , gstreamer	15	20737	May 28, 2020
RTSP server gstreamer pipeline Jetson TX1	15	28476	April 17, 2017
About use gstreamer stream to rtsp System Management and Monitoring (NVML) gstreamer	0	1335	May 27, 2021
Ip camera OpenCV + GStreamer Jetson Xavier NX opencv , gstreamer	20	8142	November 1, 2020
Jetson Xavier NX - RTSP camera open issue Jetson Xavier NX camera , opencv	3	1950	May 13, 2021
How can I use gstreamer in my opencv program(on TX1 board)? Jetson TX1	20	17536	April 20, 2017

GStreamer warning: Error pushing buffer to GStreamer pipeline

Related topics