We use nvv4l2decoder to decode h.265 simulcast stream on Xavier.
When stream changes it’s caps (because layer of simulcast is changing) then decoder stuck.
In logs I can see last message from decoder:
0:05:35.555564239 24543 0x7f74003190 DEBUG videodecoder gstvideodecoder.c:690:gst_video_decoder_setcaps:<nvv4l2decoder4> Checking if caps changed old video/x-h265, stream-format=(string)byte-stream, alignment=(string)au, width=(int)1280, height=(int)720, framerate=(fraction)30/1, chroma-format=(string)4:2:0, bit-depth-luma=(uint)8, bit-depth-chroma=(uint)8, parsed=(boolean)true, profile=(string)main, tier=(string)main, level=(string)3.1 new video/x-h265, stream-format=(string)byte-stream, alignment=(string)au, width=(int)858, height=(int)480, framerate=(fraction)30/1, chroma-format=(string)4:2:0, bit-depth-luma=(uint)8, bit-depth-chroma=(uint)8, parsed=(boolean)true, profile=(string)main, tier=(string)main, level=(string)3
After that - no any frames from decoder and all pipeline stops to work.
This behavior is also possible without simulcast, when caps cumming too fast, even if they are not changing.