NVENC latency

The pipeline is optimal and may not have further room for improvement. You may try with different TVs. We have seen some case that TV has latency in rendering frame buffers.

And not sure if it helps but you can try to run VIC engine at max clock:
Nvvideoconvert issue, nvvideoconvert in DS4 is better than Ds5? - #3 by DaneLLL