I am trying to create a gstreamer plugin that retrieves a gst buffer and creates a cv::gpu::GpuMat without making any copy. My pipeline is: gst-launch-1.0 rtspsrc location=rtsp://ip:port/file.mp4 ! rtph264depay ! decodebin ! nvvidconv ! 'video/x-raw(memory:NVMM),format=(string)RGBA' ! myPlugin ! fa…

This may not fit your need, but you may check my post [url] gstreamer NVMM <-> opencv gpuMat - Jetson TX2 - NVIDIA Developer Forums .

Thank you very much Honey_Patouceul. I managed to use the Nvivafilter. I have one question though: in which color format are the data I get from the pdata pointer? Is it already an RGB pointer?

It should be RGBA (use cv type CV_8UC4).

Yes it is. Thanks. Sorry to bother you again Honey_Patouceul, do you know if it is possible to receive multiple streams using nvivafilter? In this post https://devtalk.nvidia.com/default/topic/1019224/jetson-tx1/how-to-pass-data-between-gstreamer-and-cuda-without-memory-copying-/post/5192702/#519270…

Although it might not be impossible to use several inputs, this would need some work. I had made a tentative at that time (multiple nvivafilters using the same custom lib and synchronizing threads with semaphores), but I have not finished it. I’ll let you know if I find some time for this, but I’m u…

I see. Thank you very much, I hope nvidia will do something about that.

Hi andreaaa, nvivafilter only handles single input. Please refer to tegra_multimedia_api for multiple inputs. You can install samples via Jetpack.

I have Nvidia GTX 1080Ti card and i am doing some vision stuff using gstreamer and opencv. I want access to the decoded gstbuffer (decoded using GPU using vaapi) and create a GpuMat from it without copying data from Host to Device (as described by OP in second point). how can i do it.? Is Nvivafil…

Hi andreaaa, You may found interesting the following information about the GstCUDA framework, I think that is exactly what you are looking for. Below you will find a more detailed description, but in summary, it consists of a framework that allows to easily and optimally interface GStreamer with CU…

Hi @andreaaa and @Honey_Patouceul , I want to create the same kind of plugin now. I can’t use nvivafilter with CUDA post process due to the reason that I need to pass the input data into the plugin on every frame. and draw OSD on video frame using “nvosd.h” from L4T. I have created a simple plugi…

Retrieve buffer from gstreamer flow when using video/x-raw(memory:NVMM)

Robotics & Edge Computing Jetson Systems Jetson TX2

Honey_Patouceul March 18, 2021, 12:19pm 13

You may try this example.

Topic		Replies	Views
Process multiple Gstreamer buffers directly allocated in CUDA memory Jetson TX2	4	4227	July 24, 2018
NVMM memory in custom GStreamer plugin Jetson TX1	10	6317	July 24, 2018
Send OpenCV GpuMat to GStreamer pipeline without memory copy? Jetson TX2	11	4191	January 15, 2018
Gstreamer get the buf content from (memory:NVMM) form jetson Jetson Xavier NX gstreamer , mmapi	6	1506	May 11, 2022
NVMM and Gstreamer Jetson TX2	17	9188	March 18, 2019
How can I get gpu memory buffer from gstreamer? Jetson Nano cuda , gstreamer	2	2094	August 5, 2020
NVIDIA Gstreamer nvvidconv question Jetson Xavier NX gstreamer	4	2806	January 18, 2021
How to pass data between GStreamer and CUDA without memory copying? Jetson TX1	5	4380	July 24, 2018
Opencv gpu mat into GStreamer without downloading to cpu Jetson Nano opencv , gstreamer	18	9578	October 7, 2021
GpuMat from input GstBuffer and Mat/GpuMat to output GstBuffer DeepStream SDK	2	1752	April 25, 2019

Retrieve buffer from gstreamer flow when using video/x-raw(memory:NVMM)

Related topics