3090 on Ubuntu 18.04 doesn't wake HDMI X11 display from sleep

After upgrading to an RTX 3090 and the nvidia 455.38 driver, my display no longer wakes from sleep when running Xorg.

My display waked correctly with a GTX 1080 and the nvidia 450 driver.

To reproduce:
Allow the display to go to sleep and turn off. Turn on TV and move mouse/press keyboard keys to wake. The GPU never wakes and the display remains idle.

I have to switch to a text console with Ctrl+Alt+F1 to wake the display and then go back to Xorg with Ctrl+Alt+F7.

Display: Samsung UN40JU6700
GPU: Zotac RTX 3090
Motherboard: ASRock B450m Pro4
CPU: Ryzen 3900X

Nvidia: 455.38 (bug happens with both the Ubuntu packages and the NVidia installer)
Kernel: 5.4.0-54-generic
OS: Ubuntu 18.04.5 LTS

nvidia-bug-report.log.gz (300.7 KB)