Tiff with alpha and compositor

Autonomous Machines Jetson & Embedded Systems Jetson TX2
1

Hi all,
i have a problem with my gstreamer pipeline.
When i try to read a RGBA tiff image with multifilesrc, gst goes to Internal data flow error.
But if i use a RGB tiff (without alpha channel) all works well.

This is my pipeline:

gst-launch-1.0 -e \
    v4l2src device=/dev/video1 name=cam1 ! \
    video/x-raw,width=1920,height=1080,framerate=30/1 ! \
    videoflip method=rotate-180 ! \
    videobox autocrop=true ! \
    video/x-raw,width=1920,height=720,framerate=30/1 ! \
    compositor name=mix sink_1::ypos=720 sink_1::xpos=1440 sink_2::ypos=720 ! \
    gdkpixbufoverlay location=$OVERLAY offset-x=1749 offset-y=10 ! \
    omxh265enc control-rate=3 iframeinterval=30 ! \
    matroskamux name=mux ! \
    multifilesink location=$OUTPUT next-file=5 max-file-duration=10000000000 \
    v4l2src device=/dev/video2 name=cam2 ! \
    video/x-raw,width=640,height=480,framerate=30/1 ! \
    videoflip method=rotate-180 ! \
    videoscale ! \
    video/x-raw,width=480,height=360,framerate=30/1 ! \
    mix. \
    multifilesrc location=$DASHBOARD caps="image/tiff,framerate=30/1" ! \
    avdec_tiff ! \
    videorate ! \
    mix. \
    alsasrc device=hw:2,0 ! \
    queue ! audioresample ! \
    'audio/x-raw, format=(string)S16LE,layout=(string)interleaved, rate=(int)44100, channels=(int)1' ! \
    voaacenc ! \
    mux.

Making some research i found some people saying to use videomixer instead of compositor.
I tried it but output was very laggy and audio often skip.

2

hello aldown4yc,

suggest you refer to [Accelerated GStreamer User Guide] from Jetson Download Center, [url]Jetson Download Center | NVIDIA Developer
thanks

3

I used the documentation to create the pipeline, but i found nothing about my case.

I saw there is nvcompositor, but, if i use it, i got this warning:

WARNING: erroneous pipeline: could not link gdkpixbufoverlay0 to omxh265enc-omxh265enc0

and this error that close the stream instantly:

ERROR: from element /GstPipeline:pipeline0/GstMultiFileSrc:multifilesrc0: Internal data flow error
4

Hi,
Your usecase mainly uses plugins running on CPU. One thing you can try is to run at max performance.

sudo nvpmodel -m 0
sudo ./jetson_clocks.sh

nvcompositor plugin is for video decoding case and cannot be applied to yours.