Muxing audio and video over RTP

Autonomous Machines Jetson & Embedded Systems Jetson TK1
#1

Hi all,

my application uses “appsrc” to stream a video over RTP. The following pipeline has no problem:

appsrc name=mysource ! video/x-raw, format=I420, framerate=15/1, width=720, height=480 ! \
 omxh264enc bitrate=1000000 insert-sps-pps=true control-rate=2 low-latency=true ! h264parse ! \
rtph264pay config-interval=1 pt=96 ! \
udpsink host=239.0.0.101 port=15000 multicast-iface='eth0' auto-multicast=true sync=false async=false

Now I would like to mux an audio source to the video… the audio comes from an RTP source in wave format (L16) and I would like to mux it without any changes, so I tried this pipeline:

appsrc name=mysource ! video/x-raw, format=I420, framerate=15/1, width=720, height=480  ! \ 
omxh264enc bitrate=1000000 insert-sps-pps=true control-rate=2 low-latency=true ! \
h264parse ! rtph264pay config-interval=1 pt=96 ! queue ! qtmux0. udpsrc port=5000 ! \
application/x-rtp, media=audio, clock-rate=44100, width=16, height=16, encoding-name=L16, encoding-params=1, channels=1, payload=96 ! \
queue ! qtmux ! \
udpsink host=239.0.0.101 port=15000 multicast-iface='eth0' auto-multicast=true sync=false async=false

but I get the following error:

WARNING: erroneous pipeline: could not link queue0 to qtmux0

Which is the correct way to mux the two streams?

Thank you
Walter

#2

Hi Have a shot for below command.

appsrc name=mysource ! video/x-raw, format=I420, framerate=15/1, width=720, height=480  ! \ 
omxh264enc bitrate=1000000 insert-sps-pps=true control-rate=2 low-latency=true ! \
h264parse ! rtph264pay config-interval=1 pt=96 ! queue ! qtmux name=mux udpsink host=239.0.0.101 port=15000 multicast-iface='eth0' auto-multicast=true sync=false async=false udpsrc port=5000 ! \
application/x-rtp, media=audio, clock-rate=44100, width=16, height=16, encoding-name=L16, encoding-params=1, channels=1, payload=96 ! queue ! mux.
#3