nVidia kernel modules and Xorg DPMS

I use my GeForce GTX 1660 only for CUDA. Therefore I load only nvidia and nvidia_uvm modules. Somehow these modules have adverse effect on Xorg DPMS. I do not run any extra screensavers, only the Xorg built-in features. When two above mentioned modules are loaded my screens wake up randomly and then go back to sleep. When I unload the two modules Xorg puts displays to sleep and that’s it. I do not load nvidia Xorg driver, there is no sign of it in Xorg log.
Is there some option I can pass to kernel modules to stop this undesired power management?
Gentoo Linux, driver 470.57.02.