510.60.02-1 Page fault when enabling nvidia-drm.modeset=1 and having multiple monitors connected

Whenever I enable nvidia-drm.modeset=1 in GRUB, and boot with more than one external monitors connected, I get this error.
Full journalctl-log: journalctl-log.txt - Google Drive

Apr 13 10:13:15 archlegion kernel: BUG: unable to handle page fault for address: 0000000000001668

Apr 13 10:13:15 archlegion kernel: #PF: supervisor read access in kernel mode

Apr 13 10:13:15 archlegion kernel: #PF: error_code(0x0000) - not-present page

Apr 13 10:13:15 archlegion kernel: PGD 0 P4D 0

Apr 13 10:13:15 archlegion kernel: Oops: 0000 [#1] PREEMPT SMP NOPTI

Apr 13 10:13:15 archlegion kernel: CPU: 2 PID: 260 Comm: nvidia-modeset/ Tainted: P OE 5.17.1-arch1-1 #1 0ea933cb6bfe82a8dc16ab834a4bccdd297f98b7

Apr 13 10:13:15 archlegion kernel: Hardware name: LENOVO 82B1/LNVNB161216, BIOS FSCN18WW 01/01/2021

Apr 13 10:13:15 archlegion kernel: RIP: 0010:_nv015945rm+0x191/0x2d0 [nvidia]

Apr 13 10:13:15 archlegion kernel: Code: 00 41 8b b5 2c 06 00 00 e8 9c 1f fc ff 48 89 c7 48 c7 c6 c0 c8 3a c2 e8 cd 57 51 00 41 83 bf 6c 16 00 00 02 0f 84 16 01 00 00 <44> 8b 88 68 16 00 00 41 ba 01 00 00 00 44 8d 5b 01 89 5d 18 0f b6

Apr 13 10:13:15 archlegion kernel: RSP: 0018:ffffb13ac0d5bbd8 EFLAGS: 00010293

Apr 13 10:13:15 archlegion kernel: RAX: 0000000000000000 RBX: 0000000000000001 RCX: 0000000000000005

Apr 13 10:13:15 archlegion kernel: RDX: 0000000000000006 RSI: 0000000000272cdd RDI: 0000000000000000

Apr 13 10:13:15 archlegion kernel: RBP: ffff937960ae5ba0 R08: ffffffffc2310da0 R09: ffff9379522a9660

Apr 13 10:13:15 archlegion kernel: R10: 0000000000001e70 R11: ffff937960ae5bbc R12: ffff937952240008

Apr 13 10:13:15 archlegion kernel: R13: ffff937943ef1008 R14: ffff9379522a8010 R15: ffff9379522a8008

Apr 13 10:13:15 archlegion kernel: FS: 0000000000000000(0000) GS:ffff93804ee80000(0000) knlGS:0000000000000000

Apr 13 10:13:15 archlegion kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033

Apr 13 10:13:15 archlegion kernel: CR2: 0000000000001668 CR3: 00000005d3e10000 CR4: 0000000000350ee0

Apr 13 10:13:15 archlegion kernel: Call Trace:

Apr 13 10:13:15 archlegion kernel: <TASK>

Apr 13 10:13:15 archlegion kernel: ? _nv015848rm+0x4b/0xf0 [nvidia ac55155d17b813f26e751eeade4e3b2d9e0d157b]

Apr 13 10:13:15 archlegion kernel: ? _nv017799rm+0xea3/0x1930 [nvidia ac55155d17b813f26e751eeade4e3b2d9e0d157b]

Apr 13 10:13:15 archlegion kernel: ? _nv034289rm+0x174/0x180 [nvidia ac55155d17b813f26e751eeade4e3b2d9e0d157b]

Apr 13 10:13:15 archlegion kernel: ? _nv017658rm+0xd9/0x170 [nvidia ac55155d17b813f26e751eeade4e3b2d9e0d157b]

Apr 13 10:13:15 archlegion kernel: ? _nv035933rm+0x265/0x2c0 [nvidia ac55155d17b813f26e751eeade4e3b2d9e0d157b]

Apr 13 10:13:15 archlegion kernel: ? _nv011414rm+0x4fe/0x620 [nvidia ac55155d17b813f26e751eeade4e3b2d9e0d157b]

Apr 13 10:13:15 archlegion kernel: ? _nv034423rm+0x53/0xb0 [nvidia ac55155d17b813f26e751eeade4e3b2d9e0d157b]

Apr 13 10:13:15 archlegion kernel: ? _nv010343rm+0x52/0xa0 [nvidia ac55155d17b813f26e751eeade4e3b2d9e0d157b]

Apr 13 10:13:15 archlegion kernel: ? _nv010342rm+0x46/0x50 [nvidia ac55155d17b813f26e751eeade4e3b2d9e0d157b]

Apr 13 10:13:15 archlegion kernel: ? _nv010342rm+0x2f/0x50 [nvidia ac55155d17b813f26e751eeade4e3b2d9e0d157b]

Apr 13 10:13:15 archlegion kernel: ? rm_kernel_rmapi_op+0x141/0x190 [nvidia ac55155d17b813f26e751eeade4e3b2d9e0d157b]

Apr 13 10:13:15 archlegion kernel: ? nvkms_call_rm+0x4b/0x80 [nvidia_modeset b4a5a343bfd8e28d2caa2e4e58f16a83b4671228]

Apr 13 10:13:15 archlegion kernel: ? _nv002519kms+0x51/0x60 [nvidia_modeset b4a5a343bfd8e28d2caa2e4e58f16a83b4671228]

Apr 13 10:13:15 archlegion kernel: ? _nv001550kms+0x30/0x30 [nvidia_modeset b4a5a343bfd8e28d2caa2e4e58f16a83b4671228]

Apr 13 10:13:15 archlegion kernel: ? _nv001212kms+0x127/0x3a0 [nvidia_modeset b4a5a343bfd8e28d2caa2e4e58f16a83b4671228]

Apr 13 10:13:15 archlegion kernel: ? _nv001487kms+0xb7/0xc0 [nvidia_modeset b4a5a343bfd8e28d2caa2e4e58f16a83b4671228]

Apr 13 10:13:15 archlegion kernel: ? _nv001582kms+0x22/0x40 [nvidia_modeset b4a5a343bfd8e28d2caa2e4e58f16a83b4671228]

Apr 13 10:13:15 archlegion kernel: ? nvkms_kthread_q_callback+0x9c/0x100 [nvidia_modeset b4a5a343bfd8e28d2caa2e4e58f16a83b4671228]

Apr 13 10:13:15 archlegion kernel: ? _main_loop+0x9e/0x150 [nvidia_modeset b4a5a343bfd8e28d2caa2e4e58f16a83b4671228]

Apr 13 10:13:15 archlegion kernel: ? nvkms_sema_up+0x10/0x10 [nvidia_modeset b4a5a343bfd8e28d2caa2e4e58f16a83b4671228]

Apr 13 10:13:15 archlegion kernel: ? kthread+0xd8/0x100

Apr 13 10:13:15 archlegion kernel: ? kthread_complete_and_exit+0x20/0x20

Apr 13 10:13:15 archlegion kernel: ? ret_from_fork+0x22/0x30

Apr 13 10:13:15 archlegion kernel: </TASK>

Apr 13 10:13:15 archlegion kernel: Modules linked in: ccm hid_logitech_hidpp hid_logitech_dj cmac algif_hash algif_skcipher af_alg bnep snd_usb_audio snd_usbmidi_lib snd_rawmidi snd_seq_device btusb btrtl btbcm btintel uvcvideo uas btmtk usb_storage videobuf2_vmalloc bluetooth videobuf2_memops vfat joydev videobuf2_v4l2 fat mousedev ecdh_generic usbhid crc16 iwlmvm videobuf2_common snd_sof_amd_renoir snd_acp_config videodev snd_sof_amd_acp mac80211 intel_rapl_msr hid_multitouch libarc4 mc ucsi_ccg snd_sof_pci snd_hda_codec_realtek wmi_bmof snd_sof snd_hda_codec_generic snd_hda_codec_hdmi snd_soc_acpi ledtrig_audio snd_soc_core snd_hda_intel snd_intel_dspcfg intel_rapl_common snd_intel_sdw_acpi snd_compress iwlwifi ac97_bus snd_hda_codec snd_pcm_dmaengine snd_hda_core iwlmei snd_pci_acp6x edac_mce_amd snd_hwdep tpm_crb crct10dif_pclmul snd_pcm snd_pci_acp5x crc32_pclmul ideapad_laptop ucsi_acpi ghash_clmulni_intel snd_rn_pci_acp3x sparse_keymap cfg80211 sp5100_tco snd_timer aesni_intel tpm_tis typec_ucsi

Apr 13 10:13:15 archlegion kernel: platform_profile crypto_simd cryptd rapl psmouse pcspkr typec tpm_tis_core rfkill k10temp snd i2c_piix4 mei r8168(OE) snd_pci_acp3x soundcore i2c_nvidia_gpu roles wmi video tpm cm32181 pinctrl_amd industrialio i2c_hid_acpi i2c_hid mac_hid acpi_cpufreq squashfs loop kvm_amd ccp rng_core kvm irqbypass pkcs8_key_parser i2c_dev sg crypto_user fuse bpf_preload ip_tables x_tables btrfs blake2b_generic libcrc32c crc32c_generic xor raid6_pq serio_raw atkbd libps2 crc32c_intel xhci_pci i8042 xhci_pci_renesas serio nvidia_drm(POE) nvidia_modeset(POE) nvidia_uvm(POE) nvidia(POE)

Apr 13 10:13:15 archlegion kernel: CR2: 0000000000001668

Apr 13 10:13:15 archlegion kernel: ---[ end trace 0000000000000000 ]---

Apr 13 10:13:15 archlegion kernel: RIP: 0010:_nv015945rm+0x191/0x2d0 [nvidia]

Apr 13 10:13:15 archlegion kernel: Code: 00 41 8b b5 2c 06 00 00 e8 9c 1f fc ff 48 89 c7 48 c7 c6 c0 c8 3a c2 e8 cd 57 51 00 41 83 bf 6c 16 00 00 02 0f 84 16 01 00 00 <44> 8b 88 68 16 00 00 41 ba 01 00 00 00 44 8d 5b 01 89 5d 18 0f b6

Apr 13 10:13:15 archlegion kernel: RSP: 0018:ffffb13ac0d5bbd8 EFLAGS: 00010293

Apr 13 10:13:15 archlegion kernel: RAX: 0000000000000000 RBX: 0000000000000001 RCX: 0000000000000005

Apr 13 10:13:15 archlegion kernel: RDX: 0000000000000006 RSI: 0000000000272cdd RDI: 0000000000000000

Apr 13 10:13:15 archlegion kernel: RBP: ffff937960ae5ba0 R08: ffffffffc2310da0 R09: ffff9379522a9660

Apr 13 10:13:15 archlegion kernel: R10: 0000000000001e70 R11: ffff937960ae5bbc R12: ffff937952240008

Apr 13 10:13:15 archlegion kernel: R13: ffff937943ef1008 R14: ffff9379522a8010 R15: ffff9379522a8008

Apr 13 10:13:15 archlegion kernel: FS: 0000000000000000(0000) GS:ffff93804ee80000(0000) knlGS:0000000000000000

Apr 13 10:13:15 archlegion kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033

Apr 13 10:13:15 archlegion kernel: CR2: 0000000000001668 CR3: 00000005d3e10000 CR4: 0000000000350ee0