575 release feedback & discussion

Fedora 42, laptop not recovering from suspend:

Jun 14 12:44:10 fedora systemd[1]: Reached target sleep.target - Sleep.
Jun 14 12:44:10 fedora systemd[1]: Starting nvidia-suspend.service - NVIDIA system suspend actions...
Jun 14 12:44:10 fedora suspend[22439]: nvidia-suspend.service
Jun 14 12:44:10 fedora logger[22439]: <13>Jun 14 12:44:10 suspend: nvidia-suspend.service
Jun 14 12:44:10 fedora kernel: rfkill: input handler enabled
Jun 14 12:44:10 fedora kernel: nvidia-modeset: ERROR: GPU:0: Failed to query display engine channel state: 0x0000c67e:0:0:0x00000011
Jun 14 12:44:10 fedora kernel: nvidia-modeset: ERROR: GPU:0: Failed to query display engine channel state: 0x0000c67e:2:0:0x00000011
Jun 14 12:44:10 fedora kernel: nvidia-modeset: ERROR: GPU:0: Failed to query display engine channel state: 0x0000c67e:4:0:0x00000011
Jun 14 12:44:10 fedora kernel: nvidia-modeset: ERROR: GPU:0: Failed to query display engine channel state: 0x0000c67e:6:0:0x00000011
Jun 14 12:44:10 fedora kernel: nvidia-modeset: ERROR: GPU:0: Failed to query display engine channel state: 0x0000c67d:0:0:0x00000011
Jun 14 12:44:10 fedora kernel: nvidia-modeset: ERROR: GPU:0: Failed to query display engine channel state: 0x0000c67d:0:0:0x00000011
Jun 14 12:44:10 fedora kernel: nvidia-modeset: ERROR: GPU:0: Failed to query display engine channel state: 0x0000c67d:0:0:0x00000011
Jun 14 12:44:14 fedora kernel: nvidia-modeset: ERROR: GPU:0: Failed to tear down display engine channel
Jun 14 12:44:14 fedora kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x00000011 for fn 10!
Jun 14 12:44:14 fedora kernel: NVRM: rpcRmApiFree_GSP: GspRmFree failed: hClient=0xc1d00002; hObject=0x00010011; paramsStatus=0x00000000; status=0x00000011
Jun 14 12:44:14 fedora kernel: NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
Jun 14 12:44:14 fedora kernel: NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
Jun 14 12:44:14 fedora kernel: nvidia-modeset: ERROR: GPU:0: Failed to tear down Disp
Jun 14 12:44:14 fedora kernel: ------------[ cut here ]------------
Jun 14 12:44:14 fedora kernel: WARNING: CPU: 6 PID: 22440 at nvidia/nv.c:4430 nv_suspend_devices+0x19c/0x300 [nvidia]
Jun 14 12:44:14 fedora kernel: Modules linked in: uinput rfcomm snd_seq_dummy snd_hrtimer nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nf_tables ip_set qrtr uhid bnep sunrpc binfmt_misc vfat fat snd_ctl_led snd_soc_skl_hda_dsp snd_soc_intel_sof_board_helpers snd_sof_probes snd_soc_intel_hda_dsp_common snd_hda_codec_realtek snd_hda_codec_generic snd_hda_scodec_component snd_soc_dmic snd_sof_pci_intel_tgl snd_sof_pci_intel_cnl snd_sof_intel_hda_generic soundwire_intel soundwire_cadence snd_sof_intel_hda_common snd_soc_hdac_hda snd_sof_intel_hda_mlink snd_sof_intel_hda snd_sof_pci snd_sof_xtensa_dsp snd_sof snd_sof_utils snd_soc_acpi_intel_match snd_soc_acpi_intel_sdca_quirks soundwire_generic_allocation snd_soc_acpi soundwire_bus snd_soc_sdca snd_soc_avs snd_soc_hda_codec snd_hda_ext_core snd_soc_core snd_hda_codec_hdmi snd_compress ac97_bus snd_pcm_dmaengine
Jun 14 12:44:14 fedora kernel:  squashfs intel_uncore_frequency intel_uncore_frequency_common iwlmvm x86_pkg_temp_thermal intel_powerclamp coretemp mac80211 kvm_intel nvidia_drm(OE) nvidia_modeset(OE) libarc4 kvm nvidia_uvm(OE) snd_hda_intel iwlwifi snd_intel_dspcfg snd_intel_sdw_acpi snd_hda_codec uvcvideo btusb btrtl snd_hda_core uvc btintel videobuf2_vmalloc spi_nor iTCO_wdt videobuf2_memops videobuf2_v4l2 btbcm irqbypass intel_pmc_bxt snd_hwdep videobuf2_common btmtk rapl mtd mei_hdcp mei_pxp spd5118 iTCO_vendor_support intel_rapl_msr cfg80211 snd_seq intel_cstate bluetooth videodev thunderbolt snd_seq_device nvidia(OE) processor_thermal_device_pci intel_uncore snd_pcm processor_thermal_device mc processor_thermal_wt_hint mei_me pcspkr processor_thermal_rfim snd_timer processor_thermal_rapl wmi_bmof snd mei intel_rapl_common spi_intel_pci i2c_i801 idma64 rfkill spi_intel processor_thermal_wt_req soundcore i2c_smbus igen6_edac processor_thermal_power_floor processor_thermal_mbox int3403_thermal intel_pmc_core joydev
Jun 14 12:44:14 fedora kernel:  int340x_thermal_zone pmt_telemetry int3400_thermal pmt_class intel_hid acpi_thermal_rel acpi_tad sparse_keymap acpi_pad loop nfnetlink zram lz4hc_compress lz4_compress dm_crypt xe drm_ttm_helper gpu_sched drm_suballoc_helper drm_gpuvm drm_exec i915 i2c_algo_bit drm_buddy ttm nvme sdhci_pci drm_display_helper nvme_core sdhci_uhs2 polyval_clmulni sdhci polyval_generic ghash_clmulni_intel sha512_ssse3 cqhci sha256_ssse3 hid_multitouch nvidia_wmi_ec_backlight mmc_core sha1_ssse3 cec nvme_auth intel_vsec i2c_hid_acpi i2c_hid video wmi pinctrl_tigerlake i2c_dev fuse
Jun 14 12:44:14 fedora kernel: CPU: 6 UID: 0 PID: 22440 Comm: nvidia-sleep.sh Tainted: G           OE      6.14.9-300.fc42.x86_64 #1
Jun 14 12:44:14 fedora kernel: Tainted: [O]=OOT_MODULE, [E]=UNSIGNED_MODULE
Jun 14 12:44:14 fedora kernel: Hardware name: Razer Blade 15 (2022) - RZ09-0421/CH580, BIOS 2.06 11/01/2023
Jun 14 12:44:14 fedora kernel: RIP: 0010:nv_suspend_devices+0x19c/0x300 [nvidia]
Jun 14 12:44:14 fedora kernel: Code: 3c d9 e9 f4 fe ff ff 48 c7 c7 f0 29 75 c1 e8 9b ae 16 da 31 ed 48 83 c4 08 89 e8 5b 5d 41 5c 41 5d 41 5e 41 5f c3 cc cc cc cc <0f> 0b 4c 89 e7 e8 7a ae 16 da 4d 85 ed 74 0d e8 20 d0 12 00 84 c0
Jun 14 12:44:14 fedora kernel: RSP: 0018:ffffd391a8f5bda8 EFLAGS: 00010206
Jun 14 12:44:14 fedora kernel: RAX: 0000000000000011 RBX: ffff8d10c3600000 RCX: ffffd391a8f5bd38
Jun 14 12:44:14 fedora kernel: RDX: 0000000000000000 RSI: 0000000000000292 RDI: ffffd391a8f5bcf8
Jun 14 12:44:14 fedora kernel: RBP: 0000000000000011 R08: 0000000000000000 R09: ffffffffc1712b86
Jun 14 12:44:14 fedora kernel: R10: ffff8d10fbbc4de0 R11: fffff57704eef100 R12: ffff8d10c36006a8
Jun 14 12:44:14 fedora kernel: R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000000
Jun 14 12:44:14 fedora kernel: FS:  00007f23b947f740(0000) GS:ffff8d145d500000(0000) knlGS:0000000000000000
Jun 14 12:44:14 fedora kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jun 14 12:44:14 fedora kernel: CR2: 000055ad5638b888 CR3: 0000000104b7b001 CR4: 0000000000f72ef0
Jun 14 12:44:14 fedora kernel: PKRU: 55555554
Jun 14 12:44:14 fedora kernel: Call Trace:
Jun 14 12:44:14 fedora kernel:  <TASK>
Jun 14 12:44:14 fedora kernel:  nv_set_system_power_state+0x8a/0x1a0 [nvidia]
Jun 14 12:44:14 fedora kernel:  nv_procfs_write_suspend+0x102/0x1c0 [nvidia]
Jun 14 12:44:14 fedora kernel:  ? security_file_permission+0x50/0xf0
Jun 14 12:44:14 fedora kernel:  proc_reg_write+0x57/0xb0
Jun 14 12:44:14 fedora kernel:  vfs_write+0xf1/0x470
Jun 14 12:44:14 fedora kernel:  ? count_memcg_events.constprop.0+0x1a/0x30
Jun 14 12:44:14 fedora kernel:  ? handle_mm_fault+0x227/0x340
Jun 14 12:44:14 fedora kernel:  ksys_write+0x74/0xf0
Jun 14 12:44:14 fedora kernel:  do_syscall_64+0x7b/0x160
Jun 14 12:44:14 fedora kernel:  ? exc_page_fault+0x7e/0x1a0
Jun 14 12:44:14 fedora kernel:  entry_SYSCALL_64_after_hwframe+0x76/0x7e
Jun 14 12:44:14 fedora kernel: RIP: 0033:0x7f23b94efa06
Jun 14 12:44:14 fedora kernel: Code: 5d e8 41 8b 93 08 03 00 00 59 5e 48 83 f8 fc 75 19 83 e2 39 83 fa 08 75 11 e8 26 ff ff ff 66 0f 1f 44 00 00 48 8b 45 10 0f 05 <48> 8b 5d f8 c9 c3 0f 1f 40 00 f3 0f 1e fa 55 48 89 e5 48 83 ec 08
Jun 14 12:44:14 fedora kernel: RSP: 002b:00007ffd08fa8470 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
Jun 14 12:44:14 fedora kernel: RAX: ffffffffffffffda RBX: 0000000000000008 RCX: 00007f23b94efa06
Jun 14 12:44:14 fedora kernel: RDX: 0000000000000008 RSI: 00005621bebb9e10 RDI: 0000000000000001
Jun 14 12:44:14 fedora kernel: RBP: 00007ffd08fa8490 R08: 0000000000000000 R09: 0000000000000000
Jun 14 12:44:14 fedora kernel: R10: 0000000000000000 R11: 0000000000000202 R12: 0000000000000008
Jun 14 12:44:14 fedora kernel: R13: 00005621bebb9e10 R14: 00007f23b966b5c0 R15: 0000000000000000
Jun 14 12:44:14 fedora kernel:  </TASK>
Jun 14 12:44:14 fedora kernel: ---[ end trace 0000000000000000 ]---
Jun 14 12:44:14 fedora kernel: ------------[ cut here ]------------

Thanks Alex,

I ran the .run driver with these properties, but I omitted the --kernel-module-type=open parameter. Without this, I noticed that the question about installing the proprietary module or the open module serves as a good indicator of whether the installer detects the NV-GPU.

Today, I saw in the Mint forums that they’ve just added the 570.153.02 driver via the graphics-drivers/ppa repository. Previously, the nvidia-driver-570-open used version 570.133.07, which was supposed to work in compatibility mode—but apparently not for our case.
I’ll try the 570.153.02 driver from the graphics repo again later.

1 Like

This seems to be related with aggressive overclocking. I tuned it down a bit and it’s been stable. Will report back if the issue re-appears.

I have seen a couple of crashes with nvidia 575.57.08, usually when playing youtube videos in google chrome.

Logs:

Jun 16 10:33:15 james-office-desktop kernel: NVRM: dmaAllocMapping_GM107: can't alloc VA space for mapping.
Jun 16 10:33:15 james-office-desktop kernel: NVRM: dmaAllocMapping_GM107: can't alloc VA space for mapping.
Jun 16 10:33:15 james-office-desktop kernel: NVRM: dmaAllocMapping_GM107: can't alloc VA space for mapping.
Jun 16 10:33:15 james-office-desktop kernel: NVRM: dmaAllocMapping_GM107: can't alloc VA space for mapping.
Jun 16 10:33:15 james-office-desktop kernel: NVRM: dmaAllocMapping_GM107: can't alloc VA space for mapping.
Jun 16 10:33:15 james-office-desktop kernel: NVRM: dmaAllocMapping_GM107: can't alloc VA space for mapping.
Jun 16 10:33:15 james-office-desktop kernel: NVRM: dmaAllocMapping_GM107: can't alloc VA space for mapping.
Jun 16 10:33:15 james-office-desktop kernel: NVRM: dmaAllocMapping_GM107: can't alloc VA space for mapping.
Jun 16 10:33:15 james-office-desktop kernel: x86/PAT: ThreadPoolForeg:401705 conflicting memory types df960000-e0550000 uncached-minus<->write-combining
Jun 16 10:33:15 james-office-desktop kernel: x86/PAT: memtype_reserve failed [mem 0xdf960000-0xe054ffff], track write-combining, req write-combining
Jun 16 10:33:15 james-office-desktop kernel: ioremap memtype_reserve failed -16
Jun 16 10:33:15 james-office-desktop kernel: [drm] [nvidia-drm] [GPU ID 0x00000e00] Failed to ioremap_wc NvKmsKapiMemory 0x00000000ce9e42b8
Jun 16 10:33:15 james-office-desktop kernel: [drm:nv_drm_atomic_apply_modeset_config [nvidia_drm]] *ERROR* [nvidia-drm] [GPU ID 0x00000e00] Failed to initialize semaphore for plane fence
Jun 16 10:33:15 james-office-desktop kernel: [drm:nv_drm_atomic_commit [nvidia_drm]] *ERROR* [nvidia-drm] [GPU ID 0x00000e00] Failed to apply atomic modeset.  Error code: -11
Jun 16 10:33:16 james-office-desktop kernel: [drm:nv_drm_atomic_apply_modeset_config [nvidia_drm]] *ERROR* [nvidia-drm] [GPU ID 0x00000e00] Failed to initialize semaphore for plane fence
Jun 16 10:33:16 james-office-desktop kernel: [drm:nv_drm_atomic_commit [nvidia_drm]] *ERROR* [nvidia-drm] [GPU ID 0x00000e00] Failed to apply atomic modeset.  Error code: -11
Jun 16 10:33:16 james-office-desktop kernel: NVRM: dmaAllocMapping_GM107: can't alloc VA space for mapping.
Jun 16 10:33:16 james-office-desktop kernel: NVRM: dmaAllocMapping_GM107: can't alloc VA space for mapping.
Jun 16 10:33:16 james-office-desktop kernel: NVRM: dmaAllocMapping_GM107: can't alloc VA space for mapping.
Jun 16 10:33:16 james-office-desktop kernel: NVRM: dmaAllocMapping_GM107: can't alloc VA space for mapping.
Jun 16 10:33:16 james-office-desktop kernel: NVRM: dmaAllocMapping_GM107: can't alloc VA space for mapping.
Jun 16 10:33:16 james-office-desktop kernel: NVRM: dmaAllocMapping_GM107: can't alloc VA space for mapping.
Jun 16 10:33:16 james-office-desktop kernel: NVRM: dmaAllocMapping_GM107: can't alloc VA space for mapping.
Jun 16 10:33:16 james-office-desktop kernel: NVRM: dmaAllocMapping_GM107: can't alloc VA space for mapping.
Jun 16 10:33:16 james-office-desktop kernel: NVRM: dmaAllocMapping_GM107: can't alloc VA space for mapping.
Jun 16 10:33:16 james-office-desktop kernel: NVRM: dmaAllocMapping_GM107: can't alloc VA space for mapping.
Jun 16 10:33:16 james-office-desktop kernel: NVRM: dmaAllocMapping_GM107: can't alloc VA space for mapping.
Jun 16 10:33:16 james-office-desktop kernel: NVRM: dmaAllocMapping_GM107: can't alloc VA space for mapping.
Jun 16 10:33:16 james-office-desktop kernel: NVRM: dmaAllocMapping_GM107: can't alloc VA space for mapping.
Jun 16 10:33:16 james-office-desktop kernel: [drm:__nv_drm_gem_nvkms_map [nvidia_drm]] *ERROR* [nvidia-drm] [GPU ID 0x00000e00] Failed to map NvKmsKapiMemory 0x000000005f4bd482
Jun 16 10:33:16 james-office-desktop kernel: traps: ThreadPoolForeg[401705] trap invalid opcode ip:55f492163e06 sp:7fb3f3ffb4b0 error:0 in chrome[a99be06,55f48a4c6000+c1a5000]
Jun 16 10:33:16 james-office-desktop systemd-coredump[401881]: Process 401703 (chrome) of user 1000 terminated abnormally with signal 4/ILL, processing...
Jun 16 10:33:16 james-office-desktop systemd[1]: Started Process Core Dump (PID 401881/UID 0).
Jun 16 10:33:17 james-office-desktop kernel: NVRM: nvAssertFailedNoLog: Assertion failed: GPPut < WATCHDOG_GPFIFO_ENTRIES @ kernel_rc_watchdog.c:1430
Jun 16 10:33:19 james-office-desktop systemd-coredump[401882]: Process 401703 (chrome) of user 1000 dumped core.
                                                               
                                                               Stack trace of thread 3:
                                                               #0  0x000055f492163e06 n/a (/opt/google/chrome/chrome + 0xa99ce06)
                                                               #1  0x000055f492163e19 n/a (/opt/google/chrome/chrome + 0xa99ce19)
                                                               #2  0x000055f48f0c1126 n/a (/opt/google/chrome/chrome + 0x78fa126)
                                                               #3  0x000055f48f56a51b n/a (/opt/google/chrome/chrome + 0x7da351b)
                                                               #4  0x000055f48c3e1a7f n/a (/opt/google/chrome/chrome + 0x4c1aa7f)
                                                               #5  0x000055f48c3e194b n/a (/opt/google/chrome/chrome + 0x4c1a94b)
                                                               #6  0x000055f48c8b0b9b n/a (/opt/google/chrome/chrome + 0x50e9b9b)
                                                               #7  0x000055f48a52797b n/a (/opt/google/chrome/chrome + 0x2d6097b)
                                                               #8  0x000055f48a52c891 n/a (/opt/google/chrome/chrome + 0x2d65891)
                                                               #9  0x000055f48a52a538 n/a (/opt/google/chrome/chrome + 0x2d63538)
                                                               #10 0x000055f48a529d9d n/a (/opt/google/chrome/chrome + 0x2d62d9d)
                                                               #11 0x000055f48dc9c1f5 n/a (/opt/google/chrome/chrome + 0x64d51f5)
                                                               #12 0x000055f48c72c839 n/a (/opt/google/chrome/chrome + 0x4f65839)
                                                               #13 0x00007fb3fbfdd7eb n/a (libc.so.6 + 0x957eb)
                                                               #14 0x00007fb3fc060fb4 __clone (libc.so.6 + 0x118fb4)
                                                               
                                                               Stack trace of thread 4:
                                                               #0  0x00007fb3fbfe5e22 n/a (libc.so.6 + 0x9de22)
                                                               #1  0x00007fb3fbfd9fda n/a (libc.so.6 + 0x91fda)
                                                               #2  0x00007fb3fbfda64c n/a (libc.so.6 + 0x9264c)
                                                               #3  0x00007fb3fbfdcf28 pthread_cond_timedwait (libc.so.6 + 0x94f28)
                                                               #4  0x000055f48b018df4 n/a (/opt/google/chrome/chrome + 0x3851df4)
                                                               #5  0x000055f48a52a307 n/a (/opt/google/chrome/chrome + 0x2d63307)
                                                               #6  0x000055f48a529d9d n/a (/opt/google/chrome/chrome + 0x2d62d9d)
                                                               #7  0x000055f48dc9c1f5 n/a (/opt/google/chrome/chrome + 0x64d51f5)
                                                               #8  0x000055f48c72c839 n/a (/opt/google/chrome/chrome + 0x4f65839)
                                                               #9  0x00007fb3fbfdd7eb n/a (libc.so.6 + 0x957eb)
                                                               #10 0x00007fb3fc060fb4 __clone (libc.so.6 + 0x118fb4)
                                                               
                                                               Stack trace of thread 2:
                                                               #0  0x00007fb3fbfe5e22 n/a (libc.so.6 + 0x9de22)
                                                               #1  0x00007fb3fbfd9fda n/a (libc.so.6 + 0x91fda)
                                                               #2  0x00007fb3fbfda024 n/a (libc.so.6 + 0x92024)
                                                               #3  0x00007fb3fc061475 epoll_wait (libc.so.6 + 0x119475)
                                                               #4  0x000055f48a5173e3 n/a (/opt/google/chrome/chrome + 0x2d503e3)
                                                               #5  0x000055f48b26cfeb n/a (/opt/google/chrome/chrome + 0x3aa5feb)
                                                               #6  0x000055f48b26c588 n/a (/opt/google/chrome/chrome + 0x3aa5588)
                                                               #7  0x000055f48b26c358 n/a (/opt/google/chrome/chrome + 0x3aa5358)
                                                               #8  0x000055f48c72c27b n/a (/opt/google/chrome/chrome + 0x4f6527b)
                                                               #9  0x000055f48c72c839 n/a (/opt/google/chrome/chrome + 0x4f65839)
                                                               #10 0x00007fb3fbfdd7eb n/a (libc.so.6 + 0x957eb)
                                                               #11 0x00007fb3fc060fb4 __clone (libc.so.6 + 0x118fb4)
                                                               
                                                               Stack trace of thread 5:
                                                               #0  0x00007fb3fbfe5e22 n/a (libc.so.6 + 0x9de22)
                                                               #1  0x00007fb3fbfd9fda n/a (libc.so.6 + 0x91fda)
                                                               #2  0x00007fb3fbfda024 n/a (libc.so.6 + 0x92024)
                                                               #3  0x00007fb3fc061475 epoll_wait (libc.so.6 + 0x119475)
                                                               #4  0x000055f48a5173e3 n/a (/opt/google/chrome/chrome + 0x2d503e3)
                                                               #5  0x000055f48b26cfeb n/a (/opt/google/chrome/chrome + 0x3aa5feb)
                                                               #6  0x000055f48b26c588 n/a (/opt/google/chrome/chrome + 0x3aa5588)
                                                               #7  0x000055f48c729d71 n/a (/opt/google/chrome/chrome + 0x4f62d71)
                                                               #8  0x000055f48c72c27b n/a (/opt/google/chrome/chrome + 0x4f6527b)
                                                               #9  0x000055f48c72c839 n/a (/opt/google/chrome/chrome + 0x4f65839)
                                                               #10 0x00007fb3fbfdd7eb n/a (libc.so.6 + 0x957eb)
                                                               #11 0x00007fb3fc060fb4 __clone (libc.so.6 + 0x118fb4)
                                                               
                                                               Stack trace of thread 6:
                                                               #0  0x00007fb3fbfe5e22 n/a (libc.so.6 + 0x9de22)
                                                               #1  0x00007fb3fbfd9fda n/a (libc.so.6 + 0x91fda)
                                                               #2  0x00007fb3fbfda64c n/a (libc.so.6 + 0x9264c)
                                                               #3  0x00007fb3fbfdcf28 pthread_cond_timedwait (libc.so.6 + 0x94f28)
                                                               #4  0x000055f48b018df4 n/a (/opt/google/chrome/chrome + 0x3851df4)
                                                               #5  0x000055f48b01890f n/a (/opt/google/chrome/chrome + 0x385190f)
                                                               #6  0x000055f48b013267 n/a (/opt/google/chrome/chrome + 0x384c267)
                                                               #7  0x000055f48b26cfeb n/a (/opt/google/chrome/chrome + 0x3aa5feb)
                                                               #8  0x000055f48b26c588 n/a (/opt/google/chrome/chrome + 0x3aa5588)
                                                               #9  0x000055f48b26bf56 n/a (/opt/google/chrome/chrome + 0x3aa4f56)
                                                               #10 0x000055f48c72c839 n/a (/opt/google/chrome/chrome + 0x4f65839)
                                                               #11 0x00007fb3fbfdd7eb n/a (libc.so.6 + 0x957eb)
                                                               #12 0x00007fb3fc060fb4 __clone (libc.so.6 + 0x118fb4)
                                                               
                                                               Stack trace of thread 10:
                                                               #0  0x00007fb3fbfe5e22 n/a (libc.so.6 + 0x9de22)
                                                               #1  0x00007fb3fbfd9fda n/a (libc.so.6 + 0x91fda)
                                                               #2  0x00007fb3fbfda64c n/a (libc.so.6 + 0x9264c)
                                                               #3  0x00007fb3fbfdcf28 pthread_cond_timedwait (libc.so.6 + 0x94f28)
                                                               #4  0x000055f48b018df4 n/a (/opt/google/chrome/chrome + 0x3851df4)
                                                               #5  0x000055f48a52a307 n/a (/opt/google/chrome/chrome + 0x2d63307)
                                                               #6  0x000055f48a529d9d n/a (/opt/google/chrome/chrome + 0x2d62d9d)
                                                               #7  0x000055f48dc9c1f5 n/a (/opt/google/chrome/chrome + 0x64d51f5)
                                                               #8  0x000055f48c72c839 n/a (/opt/google/chrome/chrome + 0x4f65839)
                                                               #9  0x00007fb3fbfdd7eb n/a (libc.so.6 + 0x957eb)
                                                               #10 0x00007fb3fc060fb4 __clone (libc.so.6 + 0x118fb4)
                                                               
                                                               Stack trace of thread 12:
                                                               #0  0x00007fb3fbfe5e22 n/a (libc.so.6 + 0x9de22)
                                                               #1  0x00007fb3fbfd9fda n/a (libc.so.6 + 0x91fda)
                                                               #2  0x00007fb3fbfda64c n/a (libc.so.6 + 0x9264c)
                                                               #3  0x00007fb3fbfdcf28 pthread_cond_timedwait (libc.so.6 + 0x94f28)
                                                               #4  0x000055f48b018df4 n/a (/opt/google/chrome/chrome + 0x3851df4)
                                                               #5  0x000055f48a52a307 n/a (/opt/google/chrome/chrome + 0x2d63307)
                                                               #6  0x000055f48a529d9d n/a (/opt/google/chrome/chrome + 0x2d62d9d)
                                                               #7  0x000055f48dc9c1f5 n/a (/opt/google/chrome/chrome + 0x64d51f5)
                                                               #8  0x000055f48c72c839 n/a (/opt/google/chrome/chrome + 0x4f65839)
                                                               #9  0x00007fb3fbfdd7eb n/a (libc.so.6 + 0x957eb)
                                                               #10 0x00007fb3fc060fb4 __clone (libc.so.6 + 0x118fb4)
                                                               
                                                               Stack trace of thread 23:
                                                               #0  0x00007fb3fbfe5e22 n/a (libc.so.6 + 0x9de22)
                                                               #1  0x00007fb3fbfd9fda n/a (libc.so.6 + 0x91fda)
                                                               #2  0x00007fb3fbfda64c n/a (libc.so.6 + 0x9264c)
                                                               #3  0x00007fb3fbfdcf28 pthread_cond_timedwait (libc.so.6 + 0x94f28)
                                                               #4  0x000055f48b018df4 n/a (/opt/google/chrome/chrome + 0x3851df4)
                                                               #5  0x000055f48a52a307 n/a (/opt/google/chrome/chrome + 0x2d63307)
                                                               #6  0x000055f48a529d9d n/a (/opt/google/chrome/chrome + 0x2d62d9d)
                                                               #7  0x000055f48dc9c1f5 n/a (/opt/google/chrome/chrome + 0x64d51f5)
                                                               #8  0x000055f48c72c839 n/a (/opt/google/chrome/chrome + 0x4f65839)
                                                               #9  0x00007fb3fbfdd7eb n/a (libc.so.6 + 0x957eb)
                                                               #10 0x00007fb3fc060fb4 __clone (libc.so.6 + 0x118fb4)
                                                               
                                                               Stack trace of thread 1:
                                                               #0  0x00007fb3fbfe5e22 n/a (libc.so.6 + 0x9de22)
                                                               #1  0x00007fb3fbfd9fda n/a (libc.so.6 + 0x91fda)
                                                               #2  0x00007fb3fbfda64c n/a (libc.so.6 + 0x9264c)
                                                               #3  0x00007fb3fbfdcd1e pthread_cond_wait (libc.so.6 + 0x94d1e)
                                                               #4  0x000055f48b0182e0 n/a (/opt/google/chrome/chrome + 0x38512e0)
                                                               #5  0x000055f48b018f16 n/a (/opt/google/chrome/chrome + 0x3851f16)
                                                               #6  0x000055f48b018797 n/a (/opt/google/chrome/chrome + 0x3851797)
                                                               #7  0x000055f48b32ef04 n/a (/opt/google/chrome/chrome + 0x3b67f04)
                                                               #8  0x000055f492109965 n/a (/opt/google/chrome/chrome + 0xa942965)
                                                               #9  0x000055f48b330960 n/a (/opt/google/chrome/chrome + 0x3b69960)
                                                               #10 0x000055f48ce2201d n/a (/opt/google/chrome/chrome + 0x565b01d)
                                                               #11 0x000055f48cb6934d n/a (/opt/google/chrome/chrome + 0x53a234d)
                                                               #12 0x000055f48cb64f6a n/a (/opt/google/chrome/chrome + 0x539df6a)
                                                               #13 0x000055f49626fa5f n/a (/opt/google/chrome/chrome + 0xeaa8a5f)
                                                               #14 0x000055f48e5bacd5 n/a (/opt/google/chrome/chrome + 0x6df3cd5)
                                                               #15 0x000055f48e5bc784 n/a (/opt/google/chrome/chrome + 0x6df5784)
                                                               #16 0x000055f48c8a3077 n/a (/opt/google/chrome/chrome + 0x50dc077)
                                                               #17 0x000055f48c8a284b n/a (/opt/google/chrome/chrome + 0x50db84b)
                                                               #18 0x000055f48c8a207b n/a (/opt/google/chrome/chrome + 0x50db07b)
                                                               #19 0x000055f48e9afdf4 n/a (/opt/google/chrome/chrome + 0x71e8df4)
                                                               #20 0x000055f4e023fe25 n/a (n/a + 0x0)
                                                               #21 0x000055f4e039cc35 n/a (n/a + 0x0)
                                                               #22 0x000055f48e9aea75 n/a (/opt/google/chrome/chrome + 0x71e7a75)
                                                               #23 0x000055f4e0302ff2 n/a (n/a + 0x0)
                                                               #24 0x000055f48e9aea75 n/a (/opt/google/chrome/chrome + 0x71e7a75)
                                                               #25 0x000055f4e02d3822 n/a (n/a + 0x0)
                                                               #26 0x000055f4e02d2ba8 n/a (n/a + 0x0)
                                                               #27 0x000055f48e9aea75 n/a (/opt/google/chrome/chrome + 0x71e7a75)
                                                               #28 0x000055f48e9aea75 n/a (/opt/google/chrome/chrome + 0x71e7a75)
                                                               #29 0x000055f48e9ae75c n/a (/opt/google/chrome/chrome + 0x71e775c)
                                                               #30 0x000055f48e9ae4ab n/a (/opt/google/chrome/chrome + 0x71e74ab)
                                                               #31 0x000055f48a814d91 n/a (/opt/google/chrome/chrome + 0x304dd91)
                                                               #32 0x000055f48ae9cd49 n/a (/opt/google/chrome/chrome + 0x36d5d49)
                                                               #33 0x000055f48ae9bc9b n/a (/opt/google/chrome/chrome + 0x36d4c9b)
                                                               #34 0x000055f48ae911c0 n/a (/opt/google/chrome/chrome + 0x36ca1c0)
                                                               #35 0x000055f48ae90fab n/a (/opt/google/chrome/chrome + 0x36c9fab)
                                                               #36 0x000055f48bc210f1 n/a (/opt/google/chrome/chrome + 0x445a0f1)
                                                               #37 0x000055f48c3ccd4c n/a (/opt/google/chrome/chrome + 0x4c05d4c)
                                                               #38 0x000055f48a522d96 n/a (/opt/google/chrome/chrome + 0x2d5bd96)
                                                               #39 0x000055f48b0131c9 n/a (/opt/google/chrome/chrome + 0x384c1c9)
                                                               #40 0x000055f48b26cfeb n/a (/opt/google/chrome/chrome + 0x3aa5feb)
                                                               #41 0x000055f48b26c588 n/a (/opt/google/chrome/chrome + 0x3aa5588)
                                                               #42 0x000055f48c72a70a n/a (/opt/google/chrome/chrome + 0x4f6370a)
                                                               #43 0x000055f48c7273d6 n/a (/opt/google/chrome/chrome + 0x4f603d6)
                                                               #44 0x000055f48c984817 n/a (/opt/google/chrome/chrome + 0x51bd817)
                                                               #45 0x000055f48c983e87 ChromeMain (/opt/google/chrome/chrome + 0x51bce87)
                                                               #46 0x00007fb3fbf6f6b5 n/a (libc.so.6 + 0x276b5)
                                                               #47 0x00007fb3fbf6f769 __libc_start_main (libc.so.6 + 0x27769)
                                                               #48 0x000055f48e7b27aa _start (/opt/google/chrome/chrome + 0x6feb7aa)
                                                               
                                                               Stack trace of thread 8:
                                                               #0  0x00007fb3fbfe5e22 n/a (libc.so.6 + 0x9de22)
                                                               #1  0x00007fb3fbfd9fda n/a (libc.so.6 + 0x91fda)
                                                               #2  0x00007fb3fbfda64c n/a (libc.so.6 + 0x9264c)
                                                               #3  0x00007fb3fbfdcf28 pthread_cond_timedwait (libc.so.6 + 0x94f28)
                                                               #4  0x000055f48b018df4 n/a (/opt/google/chrome/chrome + 0x3851df4)
                                                               #5  0x000055f48b01890f n/a (/opt/google/chrome/chrome + 0x385190f)
                                                               #6  0x000055f48b00f55a n/a (/opt/google/chrome/chrome + 0x384855a)
                                                               #7  0x000055f492140784 n/a (/opt/google/chrome/chrome + 0xa979784)
                                                               #8  0x000055f48c72c839 n/a (/opt/google/chrome/chrome + 0x4f65839)
                                                               #9  0x00007fb3fbfdd7eb n/a (libc.so.6 + 0x957eb)
                                                               #10 0x00007fb3fc060fb4 __clone (libc.so.6 + 0x118fb4)
                                                               
                                                               Stack trace of thread 9:
                                                               #0  0x00007fb3fbfe5e22 n/a (libc.so.6 + 0x9de22)
                                                               #1  0x00007fb3fbfd9fda n/a (libc.so.6 + 0x91fda)
                                                               #2  0x00007fb3fbfda64c n/a (libc.so.6 + 0x9264c)
                                                               #3  0x00007fb3fbfdcf28 pthread_cond_timedwait (libc.so.6 + 0x94f28)
                                                               #4  0x000055f48b018df4 n/a (/opt/google/chrome/chrome + 0x3851df4)
                                                               #5  0x000055f48a52a307 n/a (/opt/google/chrome/chrome + 0x2d63307)
                                                               #6  0x000055f48a529d9d n/a (/opt/google/chrome/chrome + 0x2d62d9d)
                                                               #7  0x000055f48dc9c1f5 n/a (/opt/google/chrome/chrome + 0x64d51f5)
                                                               #8  0x000055f48c72c839 n/a (/opt/google/chrome/chrome + 0x4f65839)
                                                               #9  0x00007fb3fbfdd7eb n/a (libc.so.6 + 0x957eb)
                                                               #10 0x00007fb3fc060fb4 __clone (libc.so.6 + 0x118fb4)
                                                               
                                                               Stack trace of thread 15:
                                                               #0  0x00007fb3fbfe5e22 n/a (libc.so.6 + 0x9de22)
                                                               #1  0x00007fb3fbfd9fda n/a (libc.so.6 + 0x91fda)
                                                               #2  0x00007fb3fbfda64c n/a (libc.so.6 + 0x9264c)
                                                               #3  0x00007fb3fbfdcf28 pthread_cond_timedwait (libc.so.6 + 0x94f28)
                                                               #4  0x000055f48b018df4 n/a (/opt/google/chrome/chrome + 0x3851df4)
                                                               #5  0x000055f48a52a307 n/a (/opt/google/chrome/chrome + 0x2d63307)
                                                               #6  0x000055f48a529d9d n/a (/opt/google/chrome/chrome + 0x2d62d9d)
                                                               #7  0x000055f48dc9c1f5 n/a (/opt/google/chrome/chrome + 0x64d51f5)
                                                               #8  0x000055f48c72c839 n/a (/opt/google/chrome/chrome + 0x4f65839)
                                                               #9  0x00007fb3fbfdd7eb n/a (libc.so.6 + 0x957eb)
                                                               #10 0x00007fb3fc060fb4 __clone (libc.so.6 + 0x118fb4)
                                                               
                                                               Stack trace of thread 31:
                                                               #0  0x00007fb3fbfe5e22 n/a (libc.so.6 + 0x9de22)
                                                               #1  0x00007fb3fbfd9fda n/a (libc.so.6 + 0x91fda)
                                                               #2  0x00007fb3fbfda64c n/a (libc.so.6 + 0x9264c)
                                                               #3  0x00007fb3fbfdcd1e pthread_cond_wait (libc.so.6 + 0x94d1e)
                                                               #4  0x000055f48b0182e0 n/a (/opt/google/chrome/chrome + 0x38512e0)
                                                               #5  0x000055f48b018f16 n/a (/opt/google/chrome/chrome + 0x3851f16)
                                                               #6  0x000055f48b018797 n/a (/opt/google/chrome/chrome + 0x3851797)
                                                               #7  0x000055f48b0132a2 n/a (/opt/google/chrome/chrome + 0x384c2a2)
                                                               #8  0x000055f48b26cfeb n/a (/opt/google/chrome/chrome + 0x3aa5feb)
                                                               #9  0x000055f48b26c588 n/a (/opt/google/chrome/chrome + 0x3aa5588)
                                                               #10 0x000055f48b26c3b8 n/a (/opt/google/chrome/chrome + 0x3aa53b8)
                                                               #11 0x000055f48c72c27b n/a (/opt/google/chrome/chrome + 0x4f6527b)
                                                               #12 0x000055f48c72c839 n/a (/opt/google/chrome/chrome + 0x4f65839)
                                                               #13 0x00007fb3fbfdd7eb n/a (libc.so.6 + 0x957eb)
                                                               #14 0x00007fb3fc060fb4 __clone (libc.so.6 + 0x118fb4)
                                                               
                                                               Stack trace of thread 7:
                                                               #0  0x00007fb3fbfe5e22 n/a (libc.so.6 + 0x9de22)
                                                               #1  0x00007fb3fbfd9fda n/a (libc.so.6 + 0x91fda)
                                                               #2  0x00007fb3fbfda64c n/a (libc.so.6 + 0x9264c)
                                                               #3  0x00007fb3fbfdcf28 pthread_cond_timedwait (libc.so.6 + 0x94f28)
                                                               #4  0x000055f48b018df4 n/a (/opt/google/chrome/chrome + 0x3851df4)
                                                               #5  0x000055f48a52a307 n/a (/opt/google/chrome/chrome + 0x2d63307)
                                                               #6  0x000055f48dc9c2bd n/a (/opt/google/chrome/chrome + 0x64d52bd)
                                                               #7  0x000055f48dc9c231 n/a (/opt/google/chrome/chrome + 0x64d5231)
                                                               #8  0x000055f48c72c839 n/a (/opt/google/chrome/chrome + 0x4f65839)
                                                               #9  0x00007fb3fbfdd7eb n/a (libc.so.6 + 0x957eb)
                                                               #10 0x00007fb3fc060fb4 __clone (libc.so.6 + 0x118fb4)
                                                               
                                                               Stack trace of thread 13:
                                                               #0  0x00007fb3fbfe5e22 n/a (libc.so.6 + 0x9de22)
                                                               #1  0x00007fb3fbfd9fda n/a (libc.so.6 + 0x91fda)
                                                               #2  0x00007fb3fbfda64c n/a (libc.so.6 + 0x9264c)
                                                               #3  0x00007fb3fbfdcf28 pthread_cond_timedwait (libc.so.6 + 0x94f28)
                                                               #4  0x000055f48b018df4 n/a (/opt/google/chrome/chrome + 0x3851df4)
                                                               #5  0x000055f48a52a307 n/a (/opt/google/chrome/chrome + 0x2d63307)
                                                               #6  0x000055f48a529d9d n/a (/opt/google/chrome/chrome + 0x2d62d9d)
                                                               #7  0x000055f48dc9c1f5 n/a (/opt/google/chrome/chrome + 0x64d51f5)
                                                               #8  0x000055f48c72c839 n/a (/opt/google/chrome/chrome + 0x4f65839)
                                                               #9  0x00007fb3fbfdd7eb n/a (libc.so.6 + 0x957eb)
                                                               #10 0x00007fb3fc060fb4 __clone (libc.so.6 + 0x118fb4)
                                                               
                                                               Stack trace of thread 32:
                                                               #0  0x00007fb3fbfe5e22 n/a (libc.so.6 + 0x9de22)
                                                               #1  0x00007fb3fbfd9fda n/a (libc.so.6 + 0x91fda)
                                                               #2  0x00007fb3fbfda64c n/a (libc.so.6 + 0x9264c)
                                                               #3  0x00007fb3fbfdcd1e pthread_cond_wait (libc.so.6 + 0x94d1e)
                                                               #4  0x000055f48b0182e0 n/a (/opt/google/chrome/chrome + 0x38512e0)
                                                               #5  0x000055f48b018f16 n/a (/opt/google/chrome/chrome + 0x3851f16)
                                                               #6  0x000055f48b018797 n/a (/opt/google/chrome/chrome + 0x3851797)
                                                               #7  0x000055f48b0132a2 n/a (/opt/google/chrome/chrome + 0x384c2a2)
                                                               #8  0x000055f48b26cfeb n/a (/opt/google/chrome/chrome + 0x3aa5feb)
                                                               #9  0x000055f48b26c588 n/a (/opt/google/chrome/chrome + 0x3aa5588)
                                                               #10 0x000055f48b26c3b8 n/a (/opt/google/chrome/chrome + 0x3aa53b8)
                                                               #11 0x000055f48c72c27b n/a (/opt/google/chrome/chrome + 0x4f6527b)
                                                               #12 0x000055f48c72c839 n/a (/opt/google/chrome/chrome + 0x4f65839)
                                                               #13 0x00007fb3fbfdd7eb n/a (libc.so.6 + 0x957eb)
                                                               #14 0x00007fb3fc060fb4 __clone (libc.so.6 + 0x118fb4)
                                                               
                                                               Stack trace of thread 11:
                                                               #0  0x00007fb3fbfe5e22 n/a (libc.so.6 + 0x9de22)
                                                               #1  0x00007fb3fbfd9fda n/a (libc.so.6 + 0x91fda)
                                                               #2  0x00007fb3fbfda64c n/a (libc.so.6 + 0x9264c)
                                                               #3  0x00007fb3fbfdcf28 pthread_cond_timedwait (libc.so.6 + 0x94f28)
                                                               #4  0x000055f48b018df4 n/a (/opt/google/chrome/chrome + 0x3851df4)
                                                               #5  0x000055f48a52a307 n/a (/opt/google/chrome/chrome + 0x2d63307)
                                                               #6  0x000055f48a529d9d n/a (/opt/google/chrome/chrome + 0x2d62d9d)
                                                               #7  0x000055f48dc9c1f5 n/a (/opt/google/chrome/chrome + 0x64d51f5)
                                                               #8  0x000055f48c72c839 n/a (/opt/google/chrome/chrome + 0x4f65839)
                                                               #9  0x00007fb3fbfdd7eb n/a (libc.so.6 + 0x957eb)
                                                               #10 0x00007fb3fc060fb4 __clone (libc.so.6 + 0x118fb4)
                                                               
                                                               Stack trace of thread 18:
                                                               #0  0x00007fb3fbfe5e22 n/a (libc.so.6 + 0x9de22)
                                                               #1  0x00007fb3fbfd9fda n/a (libc.so.6 + 0x91fda)
                                                               #2  0x00007fb3fbfda64c n/a (libc.so.6 + 0x9264c)
                                                               #3  0x00007fb3fbfdcf28 pthread_cond_timedwait (libc.so.6 + 0x94f28)
                                                               #4  0x000055f48b018df4 n/a (/opt/google/chrome/chrome + 0x3851df4)
                                                               #5  0x000055f48b01890f n/a (/opt/google/chrome/chrome + 0x385190f)
                                                               #6  0x000055f48b013267 n/a (/opt/google/chrome/chrome + 0x384c267)
                                                               #7  0x000055f48b26cfeb n/a (/opt/google/chrome/chrome + 0x3aa5feb)
                                                               #8  0x000055f48b26c588 n/a (/opt/google/chrome/chrome + 0x3aa5588)
                                                               #9  0x000055f48b26c3b8 n/a (/opt/google/chrome/chrome + 0x3aa53b8)
                                                               #10 0x000055f48c72c27b n/a (/opt/google/chrome/chrome + 0x4f6527b)
                                                               #11 0x000055f48c72c839 n/a (/opt/google/chrome/chrome + 0x4f65839)
                                                               #12 0x00007fb3fbfdd7eb n/a (libc.so.6 + 0x957eb)
                                                               #13 0x00007fb3fc060fb4 __clone (libc.so.6 + 0x118fb4)
                                                               
                                                               Stack trace of thread 16:
                                                               #0  0x00007fb3fbfe5e22 n/a (libc.so.6 + 0x9de22)
                                                               #1  0x00007fb3fbfd9fda n/a (libc.so.6 + 0x91fda)
                                                               #2  0x00007fb3fbfda64c n/a (libc.so.6 + 0x9264c)
                                                               #3  0x00007fb3fbfdcf28 pthread_cond_timedwait (libc.so.6 + 0x94f28)
                                                               #4  0x000055f48b018df4 n/a (/opt/google/chrome/chrome + 0x3851df4)
                                                               #5  0x000055f48a52a307 n/a (/opt/google/chrome/chrome + 0x2d63307)
                                                               #6  0x000055f48a529d9d n/a (/opt/google/chrome/chrome + 0x2d62d9d)
                                                               #7  0x000055f48dc9c1f5 n/a (/opt/google/chrome/chrome + 0x64d51f5)
                                                               #8  0x000055f48c72c839 n/a (/opt/google/chrome/chrome + 0x4f65839)
                                                               #9  0x00007fb3fbfdd7eb n/a (libc.so.6 + 0x957eb)
                                                               #10 0x00007fb3fc060fb4 __clone (libc.so.6 + 0x118fb4)
                                                               
                                                               Stack trace of thread 17:
                                                               #0  0x000055f48ca1bf63 n/a (/opt/google/chrome/chrome + 0x5254f63)
                                                               #1  0x000055f48ca1bb5b n/a (/opt/google/chrome/chrome + 0x5254b5b)
                                                               #2  0x000055f48ca1b599 n/a (/opt/google/chrome/chrome + 0x5254599)
                                                               #3  0x000055f48ca1d894 n/a (/opt/google/chrome/chrome + 0x5256894)
                                                               #4  0x000055f48ca1a053 n/a (/opt/google/chrome/chrome + 0x5253053)
                                                               #5  0x000055f48ca193ed n/a (/opt/google/chrome/chrome + 0x52523ed)
                                                               #6  0x000055f48ca18c57 n/a (/opt/google/chrome/chrome + 0x5251c57)
                                                               #7  0x000055f48ca188ee n/a (/opt/google/chrome/chrome + 0x52518ee)
                                                               ELF object binary architecture: AMD x86-64
Jun 16 10:33:19 james-office-desktop systemd[1]: systemd-coredump@3-401881-0.service: Deactivated successfully.
Jun 16 10:33:19 james-office-desktop systemd[1]: systemd-coredump@3-401881-0.service: Consumed 3.098s CPU time, 1.3G memory peak.
Jun 16 10:33:24 james-office-desktop kernel: NVRM: krcWatchdog_IMPL: RC watchdog: GPU is probably locked!  Notify Timeout Seconds: 7
Jun 16 10:33:24 james-office-desktop kernel: NVRM: GPU at PCI:0000:0e:00: GPU-e1516a20-6980-ac1d-608c-1a4892bc4b60
Jun 16 10:33:24 james-office-desktop kernel: NVRM: Xid (PCI:0000:0e:00): 8, pid=3921, name=chrome, Channel 00000012
Jun 16 10:33:24 james-office-desktop kernel: NVRM: Xid (PCI:0000:0e:00): 31, pid=3921, name=chrome, Ch 00000012, intr 00000000. MMU Fault: ENGINE GRAPHICS GPC1 GPCCLIENT_RAST faulted @ 0x0_04268000. Fault is of type FAULT_INFO_TYPE_UNSUPPORTED_KIND ACCESS_TYPE_VIRT_WRITE
Jun 16 10:33:26 james-office-desktop kernel: NVRM: nvAssertFailedNoLog: Assertion failed: GPPut < WATCHDOG_GPFIFO_ENTRIES @ kernel_rc_watchdog.c:1430
Jun 16 10:33:33 james-office-desktop kernel: NVRM: krcWatchdog_IMPL: RC watchdog: GPU is probably locked!  Notify Timeout Seconds: 7
Jun 16 10:33:34 james-office-desktop kernel: NVRM: nvAssertFailedNoLog: Assertion failed: GPPut < WATCHDOG_GPFIFO_ENTRIES @ kernel_rc_watchdog.c:1430


Seems like the same issue as this: 570 release feedback & discussion - #555 by zerkshop

EndeavourOS, Kernel 6.15.2-arch1-1.

Any ideas on how to profile the suspend process? On my laptop, it usually takes from 5 to 30 seconds to suspend (more often on the slow side), so I would like to understand in greater detail why it takes so long…

I am using the following parameters (Fedora 42, Nvidia GTX 1650 dGPU):

options nvidia_drm modeset=1
options nvidia_drm fbdev=1
options nvidia NVreg_DynamicPowerManagement=0x02
options nvidia NVreg_PreserveVideoMemoryAllocations=1
options nvidia NVreg_TemporaryFilePath=/var/tmp
options nvidia NVreg_UsePageAttributeTable=1
options nvidia NVreg_EnableGpuFirmware=1
options nvidia NVreg_EnableS0ixPowerManagement=0

my GPU is always fallen off the bus ,and linkStatus is downgraded to 2.5GT/s when i install the driver , when i uninstall it ,it become to 16GT/s.

LnkCap: Port #0, Speed 32GT/s, Width x16, ASPM L1, Exit Latency L1 unlimited
                        ClockPM+ Surprise- LLActRep- BwNot- ASPMOptComp+
                LnkCtl: ASPM Disabled; RCB 64 bytes, Disabled- CommClk+
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 2.5GT/s (downgraded), Width x16 (ok)
                        TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-

[   16.540612] NVRM: loading NVIDIA UNIX Open Kernel Module for aarch64  575.57.08  Release Build  (root@ubuntu22)  
[   20.295422] NVRM: kbifInitLtr_GB202: LTR is disabled in the hierarchy
[  147.082344] NVRM: GPU at PCI:0000:01:00: GPU-ed522521-b51c-4f5f-22c9-93158071d594
[  147.082352] NVRM: GPU Board Serial Number: xxxxxxxx
[  147.082353] NVRM: Xid (PCI:0000:01:00): 79, pid=1977, name=matrixMul, GPU has fallen off the bus.
[  147.082359] NVRM: GPU 0000:01:00.0: GPU has fallen off the bus.
[  147.082360] NVRM: GPU 0000:01:00.0: GPU serial number is xxxxxxxx.
[  147.082369] NVRM: kgspRcAndNotifyAllChannels_IMPL: RC all channels for critical error 79.
[  147.082381] NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
[  147.082392] NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
[  147.082397] NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
[  147.082401] NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
[  147.082405] NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
[  147.082408] NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
[  147.082412] NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
[  147.082416] NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
[  147.082419] NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
[  147.082423] NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
[  147.082430] NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
[  147.082436] NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
[  147.082442] NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
[  147.082452] NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
[  147.082457] NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
[  147.082484] NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
[  147.091663] NVRM: nvAssertFailedNoLog: Assertion failed: !pKernelGsp->bPollingForRpcResponse @ kernel_gsp.c:2219
[  147.091701] NVRM: _issueRpcAndWait: rpcRecvPoll failed with status 0x00000040 for fn 78!
[  147.091716] NVRM: nvCheckOkFailedNoLog: Check failed: Generic Error: Invalid state [NV_ERR_INVALID_STATE] (0x00000040) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngineCallback) @ nv_debug_dump.c:274
[  147.091956] NVRM: nvAssertFailedNoLog: Assertion failed: !pKernelGsp->bPollingForRpcResponse @ kernel_gsp.c:2219
[  147.091978] NVRM: _issueRpcAndWait: rpcRecvPoll failed with status 0x00000040 for fn 78!
[  147.091990] NVRM: nvCheckOkFailedNoLog: Check failed: Generic Error: Invalid state [NV_ERR_INVALID_STATE] (0x00000040) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngineCallback) @ nv_debug_dump.c:274
[  147.092012] NVRM: nvAssertFailedNoLog: Assertion failed: !pKernelGsp->bPollingForRpcResponse @ kernel_gsp.c:2219
[  147.092034] NVRM: _issueRpcAndWait: rpcRecvPoll failed with status 0x00000040 for fn 78!
[  147.092044] NVRM: nvCheckOkFailedNoLog: Check failed: Generic Error: Invalid state [NV_ERR_INVALID_STATE] (0x00000040) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngineCallback) @ nv_debug_dump.c:274
[  147.092068] NVRM: nvAssertFailedNoLog: Assertion failed: !pKernelGsp->bPollingForRpcResponse @ kernel_gsp.c:2219
[  147.092089] NVRM: _issueRpcAndWait: rpcRecvPoll failed with status 0x00000040 for fn 78!
[  147.092099] NVRM: nvCheckOkFailedNoLog: Check failed: Generic Error: Invalid state [NV_ERR_INVALID_STATE] (0x00000040) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngineCallback) @ nv_debug_dump.c:274
[  147.092121] NVRM: nvAssertFailedNoLog: Assertion failed: !pKernelGsp->bPollingForRpcResponse @ kernel_gsp.c:2219
[  147.092142] NVRM: _issueRpcAndWait: rpcRecvPoll failed with status 0x00000040 for fn 78!
[  147.092152] NVRM: nvCheckOkFailedNoLog: Check failed: Generic Error: Invalid state [NV_ERR_INVALID_STATE] (0x00000040) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngineCallback) @ nv_debug_dump.c:274
[  147.092174] NVRM: nvAssertFailedNoLog: Assertion failed: !pKernelGsp->bPollingForRpcResponse @ kernel_gsp.c:2219
[  147.092195] NVRM: _issueRpcAndWait: rpcRecvPoll failed with status 0x00000040 for fn 78!
[  147.092204] NVRM: nvCheckOkFailedNoLog: Check failed: Generic Error: Invalid state [NV_ERR_INVALID_STATE] (0x00000040) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngineCallback) @ nv_debug_dump.c:274
[  147.092226] NVRM: nvAssertFailedNoLog: Assertion failed: !pKernelGsp->bPollingForRpcResponse @ kernel_gsp.c:2219
[  147.092247] NVRM: _issueRpcAndWait: rpcRecvPoll failed with status 0x00000040 for fn 78!
[  147.092257] NVRM: nvCheckOkFailedNoLog: Check failed: Generic Error: Invalid state [NV_ERR_INVALID_STATE] (0x00000040) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngineCallback) @ nv_debug_dump.c:274
[  147.092278] NVRM: nvAssertFailedNoLog: Assertion failed: !pKernelGsp->bPollingForRpcResponse @ kernel_gsp.c:2219
[  147.092299] NVRM: _issueRpcAndWait: rpcRecvPoll failed with status 0x00000040 for fn 78!
[  147.092308] NVRM: nvCheckOkFailedNoLog: Check failed: Generic Error: Invalid state [NV_ERR_INVALID_STATE] (0x00000040) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngineCallback) @ nv_debug_dump.c:274
[  147.092330] NVRM: nvAssertFailedNoLog: Assertion failed: !pKernelGsp->bPollingForRpcResponse @ kernel_gsp.c:2219
[  147.092351] NVRM: _issueRpcAndWait: rpcRecvPoll failed with status 0x00000040 for fn 78!
[  147.092361] NVRM: nvCheckOkFailedNoLog: Check failed: Generic Error: Invalid state [NV_ERR_INVALID_STATE] (0x00000040) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngineCallback) @ nv_debug_dump.c:274
[  147.092382] NVRM: nvAssertFailedNoLog: Assertion failed: !pKernelGsp->bPollingForRpcResponse @ kernel_gsp.c:2219
[  147.092403] NVRM: _issueRpcAndWait: rpcRecvPoll failed with status 0x00000040 for fn 78!
[  147.092413] NVRM: nvCheckOkFailedNoLog: Check failed: Generic Error: Invalid state [NV_ERR_INVALID_STATE] (0x00000040) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngineCallback) @ nv_debug_dump.c:274
[  147.092433] NVRM: nvAssertFailedNoLog: Assertion failed: !pKernelGsp->bPollingForRpcResponse @ kernel_gsp.c:2219
[  147.092454] NVRM: _issueRpcAndWait: rpcRecvPoll failed with status 0x00000040 for fn 78!
[  147.092464] NVRM: nvCheckOkFailedNoLog: Check failed: Generic Error: Invalid state [NV_ERR_INVALID_STATE] (0x00000040) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngineCallback) @ nv_debug_dump.c:274
[  147.092521] NVRM: nvAssertFailedNoLog: Assertion failed: !pKernelGsp->bPollingForRpcResponse @ kernel_gsp.c:2219
[  147.092543] NVRM: _issueRpcAndWait: rpcRecvPoll failed with status 0x00000040 for fn 78!
[  147.092554] NVRM: nvCheckOkFailedNoLog: Check failed: Generic Error: Invalid state [NV_ERR_INVALID_STATE] (0x00000040) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngineCallback) @ nv_debug_dump.c:274
[  147.092576] NVRM: nvAssertFailedNoLog: Assertion failed: !pKernelGsp->bPollingForRpcResponse @ kernel_gsp.c:2219
[  147.092597] NVRM: _issueRpcAndWait: rpcRecvPoll failed with status 0x00000040 for fn 78!
[  147.092607] NVRM: nvCheckOkFailedNoLog: Check failed: Generic Error: Invalid state [NV_ERR_INVALID_STATE] (0x00000040) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngineCallback) @ nv_debug_dump.c:274
[  147.092629] NVRM: nvAssertFailedNoLog: Assertion failed: !pKernelGsp->bPollingForRpcResponse @ kernel_gsp.c:2219
[  147.092650] NVRM: _issueRpcAndWait: rpcRecvPoll failed with status 0x00000040 for fn 78!
[  147.092660] NVRM: nvCheckOkFailedNoLog: Check failed: Generic Error: Invalid state [NV_ERR_INVALID_STATE] (0x00000040) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngineCallback) @ nv_debug_dump.c:274
[  147.092683] NVRM: nvAssertFailedNoLog: Assertion failed: !pKernelGsp->bPollingForRpcResponse @ kernel_gsp.c:2219
[  147.092704] NVRM: _issueRpcAndWait: rpcRecvPoll failed with status 0x00000040 for fn 78!
[  147.092714] NVRM: nvCheckOkFailedNoLog: Check failed: Generic Error: Invalid state [NV_ERR_INVALID_STATE] (0x00000040) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngineCallback) @ nv_debug_dump.c:274
[  147.092736] NVRM: nvAssertFailedNoLog: Assertion failed: !pKernelGsp->bPollingForRpcResponse @ kernel_gsp.c:2219
[  147.092757] NVRM: _issueRpcAndWait: rpcRecvPoll failed with status 0x00000040 for fn 78!
[  147.092767] NVRM: nvCheckOkFailedNoLog: Check failed: Generic Error: Invalid state [NV_ERR_INVALID_STATE] (0x00000040) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngineCallback) @ nv_debug_dump.c:274
[  147.092791] NVRM: nvAssertFailedNoLog: Assertion failed: !pKernelGsp->bPollingForRpcResponse @ kernel_gsp.c:2219
[  147.092812] NVRM: _issueRpcAndWait: rpcRecvPoll failed with status 0x00000040 for fn 78!
[  147.092822] NVRM: nvCheckOkFailedNoLog: Check failed: Generic Error: Invalid state [NV_ERR_INVALID_STATE] (0x00000040) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngineCallback) @ nv_debug_dump.c:274
[  147.092846] NVRM: nvAssertFailedNoLog: Assertion failed: !pKernelGsp->bPollingForRpcResponse @ kernel_gsp.c:2219
[  147.092867] NVRM: _issueRpcAndWait: rpcRecvPoll failed with status 0x00000040 for fn 78!
[  147.092877] NVRM: nvCheckOkFailedNoLog: Check failed: Generic Error: Invalid state [NV_ERR_INVALID_STATE] (0x00000040) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngineCallback) @ nv_debug_dump.c:274
[  147.092899] NVRM: nvAssertFailedNoLog: Assertion failed: !pKernelGsp->bPollingForRpcResponse @ kernel_gsp.c:2219
[  147.092920] NVRM: _issueRpcAndWait: rpcRecvPoll failed with status 0x00000040 for fn 78!
[  147.092930] NVRM: nvCheckOkFailedNoLog: Check failed: Generic Error: Invalid state [NV_ERR_INVALID_STATE] (0x00000040) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngineCallback) @ nv_debug_dump.c:274
[  147.092952] NVRM: nvAssertFailedNoLog: Assertion failed: !pKernelGsp->bPollingForRpcResponse @ kernel_gsp.c:2219
[  147.092973] NVRM: _issueRpcAndWait: rpcRecvPoll failed with status 0x00000040 for fn 78!
[  147.092983] NVRM: nvCheckOkFailedNoLog: Check failed: Generic Error: Invalid state [NV_ERR_INVALID_STATE] (0x00000040) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngineCallback) @ nv_debug_dump.c:274
[  147.093005] NVRM: nvAssertFailedNoLog: Assertion failed: !pKernelGsp->bPollingForRpcResponse @ kernel_gsp.c:2219
[  147.093026] NVRM: _issueRpcAndWait: rpcRecvPoll failed with status 0x00000040 for fn 78!
[  147.093036] NVRM: nvCheckOkFailedNoLog: Check failed: Generic Error: Invalid state [NV_ERR_INVALID_STATE] (0x00000040) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngineCallback) @ nv_debug_dump.c:274
[  147.093057] NVRM: nvAssertFailedNoLog: Assertion failed: !pKernelGsp->bPollingForRpcResponse @ kernel_gsp.c:2219
[  147.093078] NVRM: _issueRpcAndWait: rpcRecvPoll failed with status 0x00000040 for fn 78!
[  147.093088] NVRM: nvCheckOkFailedNoLog: Check failed: Generic Error: Invalid state [NV_ERR_INVALID_STATE] (0x00000040) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngineCallback) @ nv_debug_dump.c:274
[  147.093110] NVRM: nvAssertFailedNoLog: Assertion failed: !pKernelGsp->bPollingForRpcResponse @ kernel_gsp.c:2219
[  147.093130] NVRM: _issueRpcAndWait: rpcRecvPoll failed with status 0x00000040 for fn 78!
[  147.093140] NVRM: nvCheckOkFailedNoLog: Check failed: Generic Error: Invalid state [NV_ERR_INVALID_STATE] (0x00000040) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngineCallback) @ nv_debug_dump.c:274
[  147.093162] NVRM: nvAssertFailedNoLog: Assertion failed: !pKernelGsp->bPollingForRpcResponse @ kernel_gsp.c:2219
[  147.093182] NVRM: _issueRpcAndWait: rpcRecvPoll failed with status 0x00000040 for fn 78!
[  147.093192] NVRM: nvCheckOkFailedNoLog: Check failed: Generic Error: Invalid state [NV_ERR_INVALID_STATE] (0x00000040) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngineCallback) @ nv_debug_dump.c:274
[  147.093214] NVRM: nvAssertFailedNoLog: Assertion failed: !pKernelGsp->bPollingForRpcResponse @ kernel_gsp.c:2219
[  147.093235] NVRM: _issueRpcAndWait: rpcRecvPoll failed with status 0x00000040 for fn 78!
[  147.093245] NVRM: nvCheckOkFailedNoLog: Check failed: Generic Error: Invalid state [NV_ERR_INVALID_STATE] (0x00000040) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngineCallback) @ nv_debug_dump.c:274
[  147.093737] NVRM: RmLogGpuCrash: RmLogGpuCrash: failed to save GPU crash data
[  147.093751] NVRM: nvAssertFailedNoLog: Assertion failed: expectedFunc == pHistoryEntry->function @ kernel_gsp.c:2126
[  147.093775] NVRM: _kgspLogRpcSanityCheckFailure: GPU0 sanity check failed 0xf waiting for RPC response from GSP. Expected function 21 (DUP_OBJECT) (0x0 0x0).
[  147.093783] NVRM: GPU0 GSP RPC buffer contains function 78 (DUMP_PROTOBUF_COMPONENT) and data 0x0000000000000000 0x0000000000000000.
[  147.093800] NVRM: GPU0 RPC history (CPU -> GSP):
[  147.093806] NVRM:     entry function                   data0              data1              ts_start           ts_end             duration actively_polling
[  147.093813] NVRM:      0    78   DUMP_PROTOBUF_COMPONE 0x0000000000000000 0x0000000000000000 0x00060aafe0e7d403 0x0000000000000000          y
[  147.093831] NVRM:     -1    78   DUMP_PROTOBUF_COMPONE 0x0000000000000000 0x0000000000000000 0x00060aafe0e7d3d0 0x0000000000000000
[  147.093847] NVRM:     -2    78   DUMP_PROTOBUF_COMPONE 0x0000000000000000 0x0000000000000000 0x00060aafe0e7d39c 0x0000000000000000
[  147.093860] NVRM:     -3    78   DUMP_PROTOBUF_COMPONE 0x0000000000000000 0x0000000000000000 0x00060aafe0e7d367 0x0000000000000000
[  147.093872] NVRM:     -4    78   DUMP_PROTOBUF_COMPONE 0x0000000000000000 0x0000000000000000 0x00060aafe0e7d332 0x0000000000000000
[  147.093883] NVRM:     -5    78   DUMP_PROTOBUF_COMPONE 0x0000000000000000 0x0000000000000000 0x00060aafe0e7d2fe 0x0000000000000000
[  147.093894] NVRM:     -6    78   DUMP_PROTOBUF_COMPONE 0x0000000000000000 0x0000000000000000 0x00060aafe0e7d2c9 0x0000000000000000
[  147.093905] NVRM:     -7    78   DUMP_PROTOBUF_COMPONE 0x0000000000000000 0x0000000000000000 0x00060aafe0e7d294 0x0000000000000000
[  147.093916] NVRM: GPU0 RPC event history (CPU <- GSP):
[  147.093922] NVRM:     entry function                   data0              data1              ts_start           ts_end             duration during_incomplete_rpc
[  147.093929] NVRM:      0    4124 GSP_LOCKDOWN_NOTICE   0x0000000000000000 0x0000000000000000 0x00060aafd94e2d6c 0x00060aafd94e2d6d      1us
[  147.093948] NVRM:     -1    4124 GSP_LOCKDOWN_NOTICE   0x0000000000000001 0x0000000000000000 0x00060aafd94e18d5 0x00060aafd94e18d5
[  147.093961] NVRM:     -2    4124 GSP_LOCKDOWN_NOTICE   0x0000000000000000 0x0000000000000000 0x00060aafd94e17d7 0x00060aafd94e17d7
[  147.093974] NVRM:     -3    4124 GSP_LOCKDOWN_NOTICE   0x0000000000000001 0x0000000000000000 0x00060aafd94e1401 0x00060aafd94e1402      1us
[  147.093989] NVRM:     -4    4124 GSP_LOCKDOWN_NOTICE   0x0000000000000000 0x0000000000000000 0x00060aafd94ca747 0x00060aafd94ca748      1us
[  147.094003] NVRM:     -5    4124 GSP_LOCKDOWN_NOTICE   0x0000000000000001 0x0000000000000000 0x00060aafd94ca6c3 0x00060aafd94ca6c3
[  147.094015] NVRM:     -6    4128 GSP_POST_NOCAT_RECORD 0x0000000000000002 0x0000000000000027 0x00060aafd94ca241 0x00060aafd94ca246      5us
[  147.094030] NVRM:     -7    4124 GSP_LOCKDOWN_NOTICE   0x0000000000000000 0x0000000000000000 0x00060aafd94c9770 0x00060aafd94c9771      1us
[  147.113252] NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ nv_gpu_ops.c:9558
[  147.113297] NVRM: nvGpuOpsRetainChannel: nvGpuOpsRetainChannel:9740: GPU lost from the bus [NV_ERR_GPU_IS_LOST]
[  147.113314] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.113324] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.113329] NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ nv_gpu_ops.c:9824
[  147.113346] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.113356] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.113360] NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ nv_gpu_ops.c:9839
[  147.113365] NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ nv_gpu_ops.c:9845
[  147.113417] NVRM: Xid (PCI:0000:01:00): 154, GPU recovery action changed from 0x0 (None) to 0x2 (Node Reboot Required)
[  147.113452] NVRM: nvAssertOkFailedNoLog: Assertion failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from pRmApi->Control(pRmApi, RES_GET_CLIENT_HANDLE(pKernelChannel), RES_GET_HANDLE(pKernelChannel), NVA06F_CTRL_CMD_STOP_CHANNEL, &stopChannelParams, sizeof(stopChannelParams)) @ nv_gpu_ops.c:10453
[  147.113484] NVRM: nvAssertOkFailedNoLog: Assertion failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from pRmApi->Control(pRmApi, retainedChannel->session->handle, retainedChannel->rmSubDevice->subDeviceHandle, NV2080_CTRL_CMD_GPU_EVICT_CTX, &params, sizeof(params)) @ nv_gpu_ops.c:10473
[  147.113524] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.113534] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.113539] NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ nv_gpu_ops.c:9824
[  147.113551] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.113558] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.113563] NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ nv_gpu_ops.c:9833
[  147.113578] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.113586] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.113591] NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ nv_gpu_ops.c:9839
[  147.113595] NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ nv_gpu_ops.c:9845
[  147.113621] NVRM: nvAssertOkFailedNoLog: Assertion failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from pRmApi->Control(pRmApi, RES_GET_CLIENT_HANDLE(pKernelChannel), RES_GET_HANDLE(pKernelChannel), NVA06F_CTRL_CMD_STOP_CHANNEL, &stopChannelParams, sizeof(stopChannelParams)) @ nv_gpu_ops.c:10453
[  147.113632] NVRM: nvAssertOkFailedNoLog: Assertion failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from pRmApi->Control(pRmApi, retainedChannel->session->handle, retainedChannel->rmSubDevice->subDeviceHandle, NV2080_CTRL_CMD_GPU_EVICT_CTX, &params, sizeof(params)) @ nv_gpu_ops.c:10473
[  147.113658] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.113666] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.113671] NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ nv_gpu_ops.c:9824
[  147.113682] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.113689] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.113694] NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ nv_gpu_ops.c:9833
[  147.113707] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.113714] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.113719] NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ nv_gpu_ops.c:9839
[  147.113723] NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ nv_gpu_ops.c:9845
[  147.113743] NVRM: nvAssertOkFailedNoLog: Assertion failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from pRmApi->Control(pRmApi, RES_GET_CLIENT_HANDLE(pKernelChannel), RES_GET_HANDLE(pKernelChannel), NVA06F_CTRL_CMD_STOP_CHANNEL, &stopChannelParams, sizeof(stopChannelParams)) @ nv_gpu_ops.c:10453
[  147.113753] NVRM: nvAssertOkFailedNoLog: Assertion failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from pRmApi->Control(pRmApi, retainedChannel->session->handle, retainedChannel->rmSubDevice->subDeviceHandle, NV2080_CTRL_CMD_GPU_EVICT_CTX, &params, sizeof(params)) @ nv_gpu_ops.c:10473
[  147.113775] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.113783] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.113787] NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ nv_gpu_ops.c:9824
[  147.113798] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.113805] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.113810] NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ nv_gpu_ops.c:9833
[  147.113823] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.113830] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.113835] NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ nv_gpu_ops.c:9839
[  147.113839] NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ nv_gpu_ops.c:9845
[  147.113857] NVRM: nvAssertOkFailedNoLog: Assertion failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from pRmApi->Control(pRmApi, RES_GET_CLIENT_HANDLE(pKernelChannel), RES_GET_HANDLE(pKernelChannel), NVA06F_CTRL_CMD_STOP_CHANNEL, &stopChannelParams, sizeof(stopChannelParams)) @ nv_gpu_ops.c:10453
[  147.113866] NVRM: nvAssertOkFailedNoLog: Assertion failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from pRmApi->Control(pRmApi, retainedChannel->session->handle, retainedChannel->rmSubDevice->subDeviceHandle, NV2080_CTRL_CMD_GPU_EVICT_CTX, &params, sizeof(params)) @ nv_gpu_ops.c:10473
[  147.113887] NVRM: nvGpuOpsReportFatalError: uvm encountered global fatal error 0x60, requiring os reboot to recover.
[  147.113946] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.113954] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.113959] NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ nv_gpu_ops.c:9824
[  147.113970] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.113977] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.113982] NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ nv_gpu_ops.c:9833
[  147.113995] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.114002] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.114007] NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ nv_gpu_ops.c:9839
[  147.114011] NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ nv_gpu_ops.c:9845
[  147.114044] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.114057] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.114083] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.114091] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.115054] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.115067] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.115821] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.115832] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.115849] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.115855] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.116591] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.116603] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.117319] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.117330] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.117348] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.117353] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.118071] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.118083] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.118811] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.118822] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.118841] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.118846] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.119585] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.119598] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.120509] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.120522] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.120557] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.120611] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.130981] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ vaspace_api.c:538
[  147.131558] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.131568] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.131583] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.131589] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.131866] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.131873] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.131886] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.131893] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.132112] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.132154] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.132197] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.132202] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.132215] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.132220] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.132441] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.132448] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.132479] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.132485] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.132709] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  147.132749] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  147.133276] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ vaspace_api.c:538
[  147.134069] NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ nv_gpu_ops.c:9061
[  147.134098] NVRM: kgmmuFaultBufferReplayableDestroy_IMPL: Unregistering Replayable Fault buffer failed (status=0x0000000f), proceeding...
[  147.134177] NVRM: uvmTerminateAccessCntrBuffer_IMPL: Unloading UVM Access counters failed (status=0x0000000f), proceeding...
[  148.137598] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ vaspace_api.c:538
[  148.137618] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ vaspace_api.c:538
[  148.137628] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_client.c:844
[  148.137634] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:259
[  148.137638] NVRM: nvAssertFailedNoLog: Assertion failed: (status == NV_OK) || (status == NV_ERR_GPU_IN_FULLCHIP_RESET) @ rs_server.c:1375

I’m able to launch Clair Obscur: Expedition 33 again on 575.64, unfortunately the periodic freezing issue I experience in RTX 5090 often freezes presentation for 3-5 seconds in certain games · Issue #880 · NVIDIA/open-gpu-kernel-modules · GitHub still persist

can also confirm that Oblivion: Remastered has its lighting fixed in 575.64