OpenCV to Gstreamer

Autonomous Machines Jetson & Embedded Systems Jetson Nano
1

I am trying to put a processed photo on top of a CSI-Camera on the jetson nano. It would be very similar to a “Picture-in-Picture” scenario. Here is my current pipeline:

   gst-launch-1.0  \
        mpegtsmux  name=mux \
        ! rtpmp2tpay \
        ! queue ! tee name=t \
            t. ! queue ! udpsink host=52.45.14.72 port=5000 sync=false \
            t. ! queue ! udpsink host=54.227.164.160 port=5000 sync=false \
        nvarguscamerasrc sensor-id=0 \
	! nvvidconv ! 'video/x-raw, format=I420, width=(int)1920, height=(int)1080, framerate=(fraction)30/1' ! nvvidconv \
    	! nvcompositor name=mix \
		sink_0::xpos=0 sink_0::ypos=0 sink_0::width=1920 sink_0::height=1080 \
		sink_1::xpos=150 sink_1::ypos=150  \
    	! nvvidconv !'video/x-raw(memory:NVMM), format=(string)NV12' \
        	! omxh264enc ! 'video/x-h264, stream-format=(string)byte-stream' \
        	! h264parse ! queue ! mux. \
        audiotestsrc ! queue ! audioconvert ! audioresample ! queue \
	! voaacenc ! aacparse ! queue ! mux. \
    tcpclientsrc port=7677 host=127.0.0.1 ! queue ! tsdemux ! h264parse ! queue \
	! omxh264dec ! queue ! nvvidconv ! mix.
        #

Here is my opencv pipeline:

outUrl =
"gst-launch-1.0 -v v4l2src " +//
"! video/x-raw,format=YUY2,width=450,height=84 " +//
"! jpegenc " +//
"! rtpjpegpay " +//
“! udpsink host=127.0.0.1 port=5000”;

I can get the PIP to show up, but the picture from opencv does not show up. Any help would be greatly appreciated. Thanks

2

Hi,
Not sure but it looks like the v4l2 sources are encoded into JPEG but you use omxh264dec to decode it?

3

Hi jacobrichards,

We haven’t heard back from you in a couple weeks, so marking this issue resolved by “accepting” this comment as answer.
Please open a new forum issue when you are ready and we’ll pick it up there.