Hi,
If you think it is something wrong in nvv4l2decoder, please dump the stream:
gst-launch-1.0 rtspsrc ! h264parse ! video/x-h264,stream-format=byte-stream ! filesink location=dump.264
And try both software decoder and hardware decoder:
gst-launch-1.0 filesrc location=dump.h264 ! h264parse ! nvv4l2decoder ! nvvidconv ! video/x-raw ! xvimagesink sync=0
gst-launch-1.0 filesrc location=dump.h264 ! h264parse ! avdec_h264 ! videoconvert ! video/x-raw ! xvimagesink sync=0
If software decoder can decode the stream without issue and hardware decoder malfunctions, please attach the dumped stream so that we can try and debug further.