NULL pointer dereference under wayland shortly after nvidia-powerd start

I tried to test nvidia-powerd again with wayland session but shortly after I started it I got kernel panic:

BUG: kernel NULL pointer dereference, address: 0000000000000008
#PF: supervisor read access in kernel mode
#PF: error_code(0x0000) - not-present page
PGD 0 P4D 0 
Oops: 0000 [#1] PREEMPT SMP NOPTI
CPU: 13 PID: 4567 Comm: QSGRenderThread Tainted: P           O      5.17.5-200.fc35.x86_64 #1
Hardware name: Dell Inc. Dell G15 5510/0H0F1D, BIOS 1.10.1 03/24/2022
RIP: 0010:__rb_insert_augmented+0x28/0x1d0
Code: 00 90 4c 8b 07 48 89 f8 4d 85 c0 0f 84 b7 01 00 00 41 55 49 89 f5 41 54 49 89 d4 55 53 49 8b 28 40 f6 c5 01 0f 85 ee 00 00 00 <48> 8b 55 08 4c 39 c2 74 69 48 85 d2 74 09 f6 02 01 0f 84 a7 00 00
RSP: 0018:ffffb6790666fd60 EFLAGS: 00010246
RAX: ffffa0526a143088 RBX: ffffa051812dea40 RCX: 00007fac59cc7000
RDX: ffffffff862e3610 RSI: ffffa051812dea48 RDI: ffffa0526a143088
RBP: 0000000000000000 R08: ffffa05203a00020 R09: 0000000000000000
R10: 00007fac59cc7000 R11: 0000000000001000 R12: ffffffff862e3610
R13: ffffa051812dea48 R14: ffffa0526a143068 R15: ffffa05203a00000
FS:  00007fabea6f3640(0000) GS:ffffa054ff740000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000000008 CR3: 00000001594f4005 CR4: 00000000007706e0
PKRU: 55555554
Call Trace:
 <TASK>
 vma_link+0x195/0x1c0
 mmap_region+0x4a1/0x650
 do_mmap+0x360/0x550
 ? security_mmap_file+0x7f/0xe0
 vm_mmap_pgoff+0xb6/0x150
 ? lapic_next_deadline+0x28/0x30
 ksys_mmap_pgoff+0x184/0x1f0
 do_syscall_64+0x38/0x90
 entry_SYSCALL_64_after_hwframe+0x44/0xae
RIP: 0033:0x7facc934cfe7
Code: 00 00 00 89 ef e8 f9 b5 ff ff eb e4 e8 52 52 01 00 66 90 f3 0f 1e fa 41 89 ca 41 f7 c1 ff 0f 00 00 75 10 b8 09 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 21 c3 48 8b 05 09 fe 0a 00 64 c7 00 16 00 00
RSP: 002b:00007fabea6f2668 EFLAGS: 00000246 ORIG_RAX: 0000000000000009
RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 00007facc934cfe7
RDX: 0000000000000003 RSI: 0000000000001000 RDI: 0000000000000000
RBP: 00007fabea6f2770 R08: 0000000000000014 R09: 0000000102b35000
R10: 0000000000000001 R11: 0000000000000246 R12: 00007fabe04e48c0
R13: 0000000000000000 R14: 00007faca5f8edc0 R15: 0000000000000014
 </TASK>
Modules linked in: snd_seq_dummy snd_hrtimer rfcomm nf_tables ebtable_nat ebtable_broute vboxnetadp(O) ip6table_nat ip6table_mangle vboxnetflt(O) ip6table_raw ip6table_security iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 iptable_mangle vboxdrv(O) iptable_raw iptable_security ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter qrtr bnep binfmt_misc vfat fat nvidia_drm(PO) snd_ctl_led nvidia_modeset(PO) snd_soc_skl_hda_dsp snd_soc_intel_hda_dsp_common intel_tcc_cooling x86_pkg_temp_thermal snd_soc_hdac_hdmi intel_powerclamp coretemp nvidia_uvm(PO) snd_soc_dmic iTCO_wdt intel_pmc_bxt ee1004 mei_hdcp mei_pxp iTCO_vendor_support intel_rapl_msr kvm_intel dell_laptop kvm irqbypass rapl nvidia(PO) intel_cstate iwlmvm snd_hda_codec_realtek snd_hda_codec_generic mac80211 snd_sof_pci_intel_cnl snd_sof_intel_hda_common soundwire_intel soundwire_generic_allocation soundwire_cadence snd_sof_intel_hda snd_sof_pci snd_sof_xtensa_dsp snd_sof
 soundwire_bus libarc4 snd_soc_skl snd_soc_hdac_hda snd_hda_ext_core snd_soc_sst_ipc snd_soc_sst_dsp snd_soc_acpi_intel_match snd_soc_acpi iwlwifi snd_soc_core btusb btrtl btbcm btintel iwlmei btmtk snd_hda_codec_hdmi intel_uncore bluetooth snd_compress cfg80211 ac97_bus snd_pcm_dmaengine snd_hda_intel snd_intel_dspcfg snd_intel_sdw_acpi snd_hda_codec uvcvideo snd_hda_core videobuf2_vmalloc videobuf2_memops videobuf2_v4l2 snd_hwdep snd_seq videobuf2_common snd_seq_device dell_wmi videodev ledtrig_audio snd_pcm dell_smbios processor_thermal_device_pci_legacy pcspkr dcdbas processor_thermal_device processor_thermal_rfim mei_me dell_wmi_sysman snd_timer i2c_i801 processor_thermal_mbox ecdh_generic mc alienware_wmi rfkill firmware_attributes_class dell_wmi_descriptor intel_wmi_thunderbolt wmi_bmof i2c_smbus thunderbolt processor_thermal_rapl snd joydev mei intel_rapl_common soundcore idma64 intel_soc_dts_iosf intel_pch_thermal int3403_thermal int340x_thermal_zone intel_hid
 int3400_thermal acpi_pad sparse_keymap acpi_thermal_rel acpi_tad ip_tables i915 i2c_algo_bit drm_kms_helper cec nvme ttm ucsi_acpi hid_multitouch crct10dif_pclmul crc32_pclmul typec_ucsi crc32c_intel drm nvme_core ghash_clmulni_intel r8169 serio_raw typec wmi i2c_hid_acpi i2c_hid video pinctrl_cannonlake ipmi_devintf ipmi_msghandler fuse
CR2: 0000000000000008
---[ end trace 0000000000000000 ]---
RIP: 0010:__rb_insert_augmented+0x28/0x1d0
Code: 00 90 4c 8b 07 48 89 f8 4d 85 c0 0f 84 b7 01 00 00 41 55 49 89 f5 41 54 49 89 d4 55 53 49 8b 28 40 f6 c5 01 0f 85 ee 00 00 00 <48> 8b 55 08 4c 39 c2 74 69 48 85 d2 74 09 f6 02 01 0f 84 a7 00 00
RSP: 0018:ffffb6790666fd60 EFLAGS: 00010246
RAX: ffffa0526a143088 RBX: ffffa051812dea40 RCX: 00007fac59cc7000
RDX: ffffffff862e3610 RSI: ffffa051812dea48 RDI: ffffa0526a143088
RBP: 0000000000000000 R08: ffffa05203a00020 R09: 0000000000000000
R10: 00007fac59cc7000 R11: 0000000000001000 R12: ffffffff862e3610
R13: ffffa051812dea48 R14: ffffa0526a143068 R15: ffffa05203a00000
FS:  00007fabea6f3640(0000) GS:ffffa054ff740000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000000008 CR3: 00000001594f4005 CR4: 00000000007706e0
PKRU: 55555554

nvidia-bug-report.log.gz (1.3 MB)

And another one while entering suspend under X11:

PM: suspend entry (s2idle)
Filesystems sync: 0.019 seconds
BUG: kernel NULL pointer dereference, address: 0000000000000008
fbcon: Taking over console
#PF: supervisor read access in kernel mode
#PF: error_code(0x0000) - not-present page
PGD 0 P4D 0 
Oops: 0000 [#1] PREEMPT SMP NOPTI
CPU: 13 PID: 19006 Comm: systemd-sleep Tainted: P           O      5.17.5-200.fc35.x86_64 #1
Hardware name: Dell Inc. Dell G15 5510/0H0F1D, BIOS 1.10.1 03/24/2022
RIP: 0010:devres_for_each_res+0x64/0xf0
Code: 89 44 24 18 4d 89 ce 4d 8d a5 a8 02 00 00 e8 c3 ac 46 00 49 8b b5 b0 02 00 00 48 89 44 24 20 4c 8b 7e 08 4c 39 e6 75 11 eb 53 <49> 8b 47 08 4c 89 fe 4d 39 e7 74 47 49 89 c7 48 3b 5e 10 75 eb 48
RSP: 0018:ffffb00383b3fca8 EFLAGS: 00010086
RAX: 0000000000000000 RBX: ffffffffb08817a0 RCX: ffffffffb2c548a0
RDX: 0000000000000001 RSI: ffff9349d2731300 RDI: 0000000000000000
RBP: ffffffffb0881720 R08: ffffffffb0881a80 R09: ffffb00383b3fd08
R10: 000000000000013f R11: 0000000000000000 R12: ffff9349ca962eb8
R13: ffff9349ca962c10 R14: ffffb00383b3fd08 R15: 0000000000000000
FS:  00007f7502eb6b40(0000) GS:ffff934d3f740000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000000008 CR3: 000000016f860002 CR4: 00000000007706e0
PKRU: 55555554
Call Trace:
 <TASK>
 ? alloc_fw_cache_entry+0x60/0x60
 ? dev_create_fw_entry+0x50/0x50
 dev_cache_fw_image+0x40/0x180
 ? dev_create_fw_entry+0x50/0x50
 dpm_for_each_dev+0x3e/0x70
 fw_pm_notify+0x61/0xf0
 blocking_notifier_call_chain_robust+0x61/0xd0
 pm_notifier_call_chain_robust+0x19/0x40
 pm_suspend.cold+0x12d/0x342
 state_store+0x71/0xd0
 kernfs_fop_write_iter+0x11e/0x1b0
 new_sync_write+0x108/0x180
 vfs_write+0x20a/0x2a0
 ksys_write+0x4f/0xc0
 do_syscall_64+0x38/0x90
 entry_SYSCALL_64_after_hwframe+0x44/0xae
RIP: 0033:0x7f7503acfbc7
Code: 0b 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b7 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 48 89 54 24 18 48 89 74 24
RSP: 002b:00007ffff9ea7e98 EFLAGS: 00000246 ORIG_RAX: 0000000000000001
RAX: ffffffffffffffda RBX: 0000000000000004 RCX: 00007f7503acfbc7
RDX: 0000000000000004 RSI: 00007ffff9ea7f80 RDI: 0000000000000004
RBP: 00007ffff9ea7f80 R08: 000055c032173650 R09: 00007f7503b414e0
R10: 00007f7503b413e0 R11: 0000000000000246 R12: 0000000000000004
R13: 000055c03216f650 R14: 0000000000000004 R15: 00007f7503b859e0
 </TASK>
Modules linked in: snd_seq_dummy snd_hrtimer rfcomm vboxnetadp(O) vboxnetflt(O) nf_tables ebtable_nat ebtable_broute ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat vboxdrv(O) nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 iptable_mangle iptable_raw iptable_security ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter qrtr bnep binfmt_misc vfat fat nvidia_drm(PO) nvidia_modeset(PO) intel_tcc_cooling nvidia_uvm(PO) x86_pkg_temp_thermal intel_powerclamp coretemp snd_ctl_led snd_soc_skl_hda_dsp kvm_intel snd_soc_intel_hda_dsp_common snd_soc_hdac_hdmi kvm irqbypass nvidia(PO) rapl snd_hda_codec_realtek snd_hda_codec_generic snd_soc_dmic snd_sof_pci_intel_cnl snd_sof_intel_hda_common soundwire_intel soundwire_generic_allocation soundwire_cadence snd_sof_intel_hda snd_sof_pci snd_sof_xtensa_dsp snd_sof soundwire_bus snd_soc_skl snd_soc_hdac_hda snd_hda_ext_core intel_cstate snd_soc_sst_ipc iwlmvm snd_soc_sst_dsp
 snd_soc_acpi_intel_match snd_soc_acpi mac80211 ee1004 mei_hdcp mei_pxp snd_soc_core iTCO_wdt intel_pmc_bxt iTCO_vendor_support intel_rapl_msr snd_hda_codec_hdmi snd_compress dell_laptop ac97_bus snd_pcm_dmaengine libarc4 btusb snd_hda_intel snd_intel_dspcfg snd_intel_sdw_acpi btrtl uvcvideo snd_hda_codec btbcm videobuf2_vmalloc iwlwifi btintel snd_hda_core videobuf2_memops btmtk videobuf2_v4l2 snd_hwdep dell_wmi snd_seq videobuf2_common ledtrig_audio bluetooth dell_smbios intel_uncore videodev iwlmei snd_seq_device dcdbas snd_pcm dell_wmi_sysman cfg80211 pcspkr mc ecdh_generic alienware_wmi firmware_attributes_class intel_wmi_thunderbolt wmi_bmof dell_wmi_descriptor processor_thermal_device_pci_legacy snd_timer processor_thermal_device processor_thermal_rfim snd i2c_i801 processor_thermal_mbox mei_me rfkill processor_thermal_rapl i2c_smbus intel_rapl_common joydev thunderbolt mei idma64 soundcore intel_soc_dts_iosf intel_pch_thermal int3403_thermal int340x_thermal_zone
 intel_hid int3400_thermal acpi_tad sparse_keymap acpi_thermal_rel acpi_pad ip_tables i915 i2c_algo_bit drm_kms_helper cec ttm nvme ucsi_acpi hid_multitouch crct10dif_pclmul typec_ucsi crc32_pclmul crc32c_intel drm nvme_core ghash_clmulni_intel r8169 serio_raw typec wmi i2c_hid_acpi i2c_hid video pinctrl_cannonlake ipmi_devintf ipmi_msghandler fuse
CR2: 0000000000000008
---[ end trace 0000000000000000 ]---
RIP: 0010:devres_for_each_res+0x64/0xf0
Code: 89 44 24 18 4d 89 ce 4d 8d a5 a8 02 00 00 e8 c3 ac 46 00 49 8b b5 b0 02 00 00 48 89 44 24 20 4c 8b 7e 08 4c 39 e6 75 11 eb 53 <49> 8b 47 08 4c 89 fe 4d 39 e7 74 47 49 89 c7 48 3b 5e 10 75 eb 48
RSP: 0018:ffffb00383b3fca8 EFLAGS: 00010086
RAX: 0000000000000000 RBX: ffffffffb08817a0 RCX: ffffffffb2c548a0
RDX: 0000000000000001 RSI: ffff9349d2731300 RDI: 0000000000000000
RBP: ffffffffb0881720 R08: ffffffffb0881a80 R09: ffffb00383b3fd08
R10: 000000000000013f R11: 0000000000000000 R12: ffff9349ca962eb8
R13: ffff9349ca962c10 R14: ffffb00383b3fd08 R15: 0000000000000000
FS:  00007f7502eb6b40(0000) GS:ffff934d3f740000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000000008 CR3: 000000016f860002 CR4: 00000000007706e0
PKRU: 55555554
note: systemd-sleep[19006] exited with preempt_count 1

@thesourcehim
I am not seeing any logs pointing issue towards driver, can you please capture bug report immediately once you hit with issue and share again.