Hi,
Please try the pipeline without h264parse:
rtspsrc location=<my_rtsp_source> latency=5000 protocols=tcp ! rtph264depay ! nvv4l2decoder cudadec-memtype=0 ! nvvideoconvert ! video/x-raw(memory:NVMM),format=NV12 ! appsink drop=true max-buffers=5
This could be same as the topic: