Just a wild guess: I wonder if it may be related to DP-HDMI conversion: do you have a possibility to use native HDMI-HDMI and try newer drivers + newer kernels then?
Also, if you want any attention from NV engs, you need to provide a bug report file (probably v580 on the latest backports kernel will be most useful to them).