plantform: jetson nx jetpack: 4.6 CUDA: 10.2 OPENCV: 3.4.1 I’m trying to get the RGB picture from the nvbuf, but I dont’t know how to deal with the dmabuf_fd. The nvbuf from the gstpad_probe of element “nvvidconv” ,format NV12,video/x-raw(memory:NVMM). static GstFlowReturn new_buffer(GstAppSink *appsink, gpointer user_data) { GstSample *sample = NULL; g_signal_emit_by_name (appsink, "pull-sample", &sample,NULL); if (sample) { GstBuffer *buffer = NULL; GstCaps *caps = NULL; GstMapInfo map = {0}; int dmabuf_fd = 0; caps = gst_sample_get_caps (sample); if (!caps) { printf("could not get snapshot format\n"); } gst_caps_get_structure (caps, 0); buffer = gst_sample_get_buffer (sample); gst_buffer_map (buffer, &map, GST_MAP_READ); ExtractFdFromNvBuffer((void *)map.data, &dmabuf_fd); gst_buffer_unmap(buffer, &map); gst_sample_unref (sample); } else { g_print ("could not make snapshot\n"); } return GST_FLOW_OK; } So,how could I get the picture in the nvbuf then save it. Moreover, I need to convert NV12 to RGB, so how to make the format change in the gpu then download it cpu ?

Hi, Please check the suggestion in Gstreamer get the buf content from (memory:NVMM) form jetson - #7 by DaneLLL

So, how to get the nvbuf to cpu, and convert nv12 to RGBA ? I need to download the nvbbuf to cpu.

Hi, In gstreamer, you can use nvvidconv plugin to convert to RGBA. And then call dump_dmabuf() to dump the data. Please refer to Dump YUV buffer with libargus - #9 by DaneLLL There are also sample code in /usr/src/jetson_multimedia_api Can also call NvBufferTransform() for NV12 to RGBA conversion.

Hi,DaneLLL I don’t konw how to convert the format by NvBufferTransform(). It’s just flip the picture.

Hi, There are sample code in /usr/src/jetson_multimedia_api Yo may grep NvBufferTransform() and check the code. For using gstreamer, you can use nvvidconv plugin gst-launch-1.0 nvarguscamerasrc ! nvvidconv ! 'video/x-raw(memory:NVMM),format=RGBA' ! nvvidconv ! 'video/x-raw(memory:NVMM),format=NV12' ! ... In the example, the camera frames are converted to RGBA and then covert back to NV12.

Hi, I have used the pipeline : nvargscamerasrc → nvvidconv → nvtee name=t → queue → nvvidconv → videoconvert → appsink t. → queue → omxh264enc → h264parse → mpegtsmux → udpsink The pipeline have two function, appsink output the rgb picture, udpsink output the video. But some something wrong in the pipeline, the pipeline was blocked.

Hi, Please use tee and nvv4l2h264enc plugins. Here is a sample for reference: Problems using gstreamer pipeline in openCV for recording video - #5 by DaneLLL You can try and check if you can run it successfully. And refer to the pipeline to modify your pipeline.

Hi，DaneLLL I met a new problem unexpected. my pipeline: nvargscamerasrc → nvvidconv → capsfilter → tee name=t → queue → nvvidconv → capsfilter caps=“video/x-raw, width=1280, height=960, format=(string)NV12, framerate=(fraction)30/1” → videoconvert → capsfilter caps="video/x-raw, width=1280, height=960, format=(string)BGR, framerate=(fraction)30/1"→ appsink t. → queue → nvv4l2h264enc → h264parse → mpegtsmux → udpsink The pipeline became unstable, cause the large things to do, I think. Sometime report: CONSUMER: ERROR OCCURRED error------------------- error from element nvsrc: TIMEOUT Debugging information: Argus Error Status GST_ARGUS: Cleaning up or report: error------------------- error from element nvsrc: DISCONNECTED Debugging information: Argus Error Status CONSUMER: ERROR OCCURRED (Argus) Error EndOfFile: Unexpected error in reading socket (in src/rpc/socket/client/ClientSocketManager.cpp, function recvThreadCore(), line 266) (Argus) Error EndOfFile: Receiving thread terminated with error (in src/rpc/socket/client/ClientSocketManager.cpp, function recvThreadWrapper(), line 368) GST_ARGUS: Cleaning up (Argus) Error InvalidState: Receive thread is not running cannot send. (in src/rpc/socket/client/ClientSocketManager.cpp, function send(), line 96) (Argus) Error InvalidState: (propagating from src/rpc/socket/client/SocketClientDispatch.cpp, function dispatch(), line 91) (Argus) Error InvalidState: Receive thread is not running cannot send. (in src/rpc/socket/client/ClientSocketManager.cpp, function send(), line 96) (Argus) Error InvalidState: (propagating from src/rpc/socket/client/SocketClientDispatch.cpp, function dispatch(), line 91) (Argus) Error InvalidState: Receive thread is not running cannot send. (in src/rpc/socket/client/ClientSocketManager.cpp, function send(), line 96) (Argus) Error InvalidState: (propagating from src/rpc/socket/client/SocketClientDispatch.cpp, function dispatch(), line 91) Segmentation fault (core dumped) I don’t know why the pipeline became such fragile.

Hi, The error shows the camera input is not stable: error from element nvsrc: TIMEOUT Debugging information: Argus Error Status Please share more information about the camera. Do you use the camera board from our camera partner?

Hi, I’m using my own driver board, not the nvidia. But it work well without fetch RGB picture in the pipeline. The pipeline will block for some reason when it runing for while, then is killed by itself.

How to get picture from nv12 (memory:NVMM) in nvbuf?

Robotics & Edge Computing Jetson Systems Jetson Xavier NX

DaneLLL May 13, 2022, 2:56am 20

Hi,
Please refer to the code:
How to run RTP Camera in deepstream on Nano - #29 by DaneLLL
For accessing NvBuffer in appsink or prob function.

Topic		Replies	Views
Gstreamer get the buf content from (memory:NVMM) form jetson Jetson Xavier NX gstreamer , mmapi	6	1527	May 11, 2022
Deepstream DeepStream SDK gstreamer , jetson , deepstream	13	849	July 9, 2024
Can nvvidconv load a frame from CPU buffer to NVMM buffer in Gstreamer pipeline? Jetson AGX Xavier	9	1376	September 20, 2019
Processing NV12 buffer from nvarguscamerasrc Jetson Orin NX gstreamer	3	336	November 19, 2024
Transform_ip buffer of custom gstreamer plugin not what I expected Jetson Nano gstreamer	10	1757	August 17, 2021
get RGB frame data from nvvidconv gstreamer 1.0 Jetson TX1	4	4256	November 21, 2016
Passing NVMM frames to Gstreamer appsink to apply custom processing Jetson AGX Xavier cuda , gstreamer	2	2816	July 30, 2020
how can I change GstBuffer to NvBuffer? Jetson TX2	4	974	April 18, 2019
Recommended Method for Interfacing jetson-inference with NvBuffer Jetson TX2 jetson-inference	2	732	March 24, 2020
NvUtils NvBufSurface to gstreamer Jetson AGX Orin camera , gstreamer , nvbugs	2	1691	July 25, 2022

How to get picture from nv12 (memory:NVMM) in nvbuf?

Related topics