Display Output freezing when connecting RTX 3060 eGPU to XPS 13 Laptop

When connecting my RTX 3060 eGPU, X.Org freezes. After restarting GDM3 via SSH the system becomes responsive again and I was able to check dmesg and found this error:

kernel: [drm:__nv_drm_gem_nvkms_memory_prime_get_sg_table [nvidia_drm]] *ERROR* [nvidia-drm] [GPU ID 0x00000800] Failed to get memory pages for NvKmsKapiMemory 0x000000004d89f1a4

I was unable to upload the nvidia-bug-report.log on the forums, so I have linked in below:
https://pushbox.es/s/D7CnF3XPwqHMyHa/download/nvidia-bug-report.log.gz

I managed to fix this issue by disabling Wayland for the login screen in /etc/gdm3/custom