Debian: Xwayland/NVIDIA driver 550.54.15 cannot find eDP-1 display (no EDID modelines from screen?)

Hi

I cannot get NVIDIA drivers 550.54.15 work with Xwayland on Debian 12 testing. I used one day tweaking various things in my laptop but cannot get it working. I installed driver+cuda packages from:
https://developer.download.nvidia.com/compute/cuda/repos/debian12/x86_64/

I have a secure boot so I installed mok dkms key used to sign compiled kernel drivers so drivers are loaded with the secure boot, disabled nouveau-driver and set nvidia_drm.modeset=1 and nvidia_drm.fbdev=1 and tried to create custom EDID files loaded using kernel parameters.

Now the drivers are loaded so CUDA should work but Xwayland only uses i915 driver and if I disable i915 module I get blank screen when gdm3/gnome 44 tries to start.

cslr@whiteice:~$ uname -a
Linux whiteice 6.6.15-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.6.15-2 (2024-02-04) x86_64 GNU/Linux

cslr@whiteice:~$ inxi -G
Graphics:
Device-1: Intel CoffeeLake-H GT2 [UHD Graphics 630] driver: i915 v: kernel
Device-2: NVIDIA GP107M [GeForce GTX 1050 Mobile] driver: nvidia
v: 550.54.15
Device-3: Chicony USB 2.0 Camera driver: uvcvideo type: USB
Display: wayland server: X.Org v: 1.23.2.4 with: Xwayland v: 23.2.4
compositor: gnome-shell v: 44.9 driver: X: loaded: vesa
unloaded: fbdev,modesetting gpu: i915 resolution: 1920x1080~60Hz
API: EGL v: 1.5 drivers: iris,nvidia,swrast
platforms: gbm,wayland,x11,surfaceless,device
API: OpenGL v: 4.6.0 compat-v: 4.5 vendor: nvidia mesa v: 550.54.15
renderer: NVIDIA GeForce GTX 1050/PCIe/SSE2
API: Vulkan v: 1.3.275 drivers: N/A surfaces: xcb,xlib,wayland

Please use render offload to invoke the nvidia gpu in xwayland.