CPU soft lockup(s) on 510.68.02, GTX 1070TI

Probably a kernel issue, since reverting the driver to 470 doesn’t change the behaviour.

Situation:
Two soft lockups on boot, consistent between reboots:

Jun 01 10:41:45 noah-pc kernel: watchdog: BUG: soft lockup - CPU#0 stuck for 26s! [systemd-logind:897]
Jun 01 10:41:45 noah-pc kernel: Modules linked in: snd_seq_dummy snd_hrtimer nft_objref nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_rej>
Jun 01 10:41:45 noah-pc kernel:  i2c_smbus videodev snd_seq snd_seq_device mei_me joydev mc snd_pcm lpc_ich mei snd_timer parport_pc snd parport soundcore acpi_pad zram i915 crct10dif_pclmu>
Jun 01 10:41:45 noah-pc kernel: CPU: 0 PID: 897 Comm: systemd-logind Tainted: P           OE     5.17.11-300.fc36.x86_64 #1
Jun 01 10:41:45 noah-pc kernel: Hardware name: Gigabyte Technology Co., Ltd. Z97-HD3/Z97-HD3, BIOS F9 07/31/2015
Jun 01 10:41:45 noah-pc kernel: RIP: 0010:_nv039154rm+0x1c0/0x1e0 [nvidia]
Jun 01 10:41:45 noah-pc kernel: Code: ff ff 89 c7 e8 41 d9 ff ff 66 89 03 81 25 00 3b a9 01 80 f9 ff ff 5b 48 83 c5 10 c3 66 0f 1f 44 00 00 e8 23 dc ff ff 8b 7d 08 <48> 89 c3 e8 18 dc ff ff>
Jun 01 10:41:45 noah-pc kernel: RSP: 0018:ffffabd88168fa28 EFLAGS: 00000297
Jun 01 10:41:45 noah-pc kernel: RAX: ffffffffc3231f18 RBX: 00000000000017b6 RCX: 0000000000000000
Jun 01 10:41:45 noah-pc kernel: RDX: 0000000000000003 RSI: 00000000000c4358 RDI: 0000000000000006
Jun 01 10:41:45 noah-pc kernel: RBP: ffff892f8463abf0 R08: ffffffffc31c8340 R09: 0000000000000282
Jun 01 10:41:45 noah-pc kernel: R10: 0000000000000202 R11: 0000000000000001 R12: ffff892f8463ac68
Jun 01 10:41:45 noah-pc kernel: R13: ffff892f8463ac64 R14: 000000000000c000 R15: 000000000000c000
Jun 01 10:41:45 noah-pc kernel: FS:  00007fe9b5541bc0(0000) GS:ffff89329fa00000(0000) knlGS:0000000000000000
Jun 01 10:41:45 noah-pc kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jun 01 10:41:45 noah-pc kernel: CR2: 00007f6fa7ffeb48 CR3: 0000000106fd4003 CR4: 00000000001706f0
Jun 01 10:41:45 noah-pc kernel: Call Trace:
Jun 01 10:41:45 noah-pc kernel:  <TASK>
Jun 01 10:41:45 noah-pc kernel:  ? _nv000753rm+0x4f/0x130 [nvidia]
Jun 01 10:41:45 noah-pc kernel:  ? _nv030048rm+0x14c/0x200 [nvidia]
Jun 01 10:41:45 noah-pc kernel:  ? _nv038086rm+0x2a/0x80 [nvidia]
Jun 01 10:41:45 noah-pc kernel:  ? _nv015812rm+0x9cc/0xad0 [nvidia]
Jun 01 10:41:45 noah-pc kernel:  ? _nv034293rm+0x174/0x180 [nvidia]
Jun 01 10:41:45 noah-pc kernel:  ? _nv035937rm+0x265/0x2c0 [nvidia]
Jun 01 10:41:45 noah-pc kernel:  ? _nv011415rm+0x4fe/0x620 [nvidia]
Jun 01 10:41:45 noah-pc kernel:  ? _nv034427rm+0x53/0xb0 [nvidia]
Jun 01 10:41:45 noah-pc kernel:  ? _nv000642kms+0x90/0x90 [nvidia_modeset]
Jun 01 10:41:45 noah-pc kernel:  ? _nv010344rm+0x52/0xa0 [nvidia]
Jun 01 10:41:45 noah-pc kernel:  ? _nv010343rm+0x46/0x50 [nvidia]
Jun 01 10:41:45 noah-pc kernel:  ? _nv010343rm+0x2f/0x50 [nvidia]
Jun 01 10:41:45 noah-pc kernel:  ? rm_kernel_rmapi_op+0x141/0x190 [nvidia]
Jun 01 10:41:45 noah-pc kernel:  ? _nv000642kms+0x90/0x90 [nvidia_modeset]
Jun 01 10:41:45 noah-pc kernel:  ? nvkms_call_rm+0x3b/0x60 [nvidia_modeset]
Jun 01 10:41:45 noah-pc kernel:  ? _nv002519kms+0x51/0x60 [nvidia_modeset]
Jun 01 10:41:45 noah-pc kernel:  ? _nv002562kms+0x3e/0x90 [nvidia_modeset]
Jun 01 10:41:45 noah-pc kernel:  ? _nv002338kms+0x1a2/0x1c0 [nvidia_modeset]
Jun 01 10:41:45 noah-pc kernel:  ? _nv000647kms+0x30/0x60 [nvidia_modeset]
Jun 01 10:41:45 noah-pc kernel:  ? _nv000642kms+0x66/0x90 [nvidia_modeset]
Jun 01 10:41:45 noah-pc kernel:  ? nvKmsIoctl+0x96/0x1d0 [nvidia_modeset]
Jun 01 10:41:45 noah-pc kernel:  ? nvkms_ioctl_from_kapi+0x47/0x80 [nvidia_modeset]
Jun 01 10:41:45 noah-pc kernel:  ? _nv000643kms+0x3c/0x50 [nvidia_modeset]
Jun 01 10:41:45 noah-pc kernel:  ? nv_drm_master_drop+0x2e/0x60 [nvidia_drm]
Jun 01 10:41:45 noah-pc kernel:  ? _nv000091kms+0x50/0x50 [nvidia_modeset]
Jun 01 10:41:45 noah-pc kernel:  ? drm_dropmaster_ioctl+0xaa/0x120
Jun 01 10:41:45 noah-pc kernel:  ? drm_setmaster_ioctl+0x160/0x160
Jun 01 10:41:45 noah-pc kernel:  ? drm_ioctl_kernel+0x9e/0x140
Jun 01 10:41:45 noah-pc kernel:  ? drm_ioctl+0x21c/0x410
Jun 01 10:41:45 noah-pc kernel:  ? drm_setmaster_ioctl+0x160/0x160
Jun 01 10:41:45 noah-pc kernel:  ? __seccomp_filter+0x28b/0x4c0
Jun 01 10:41:45 noah-pc kernel:  ? __x64_sys_ioctl+0x8d/0xc0
Jun 01 10:41:45 noah-pc kernel:  ? do_syscall_64+0x3a/0x80
Jun 01 10:41:45 noah-pc kernel:  ? entry_SYSCALL_64_after_hwframe+0x44/0xae
Jun 01 10:41:45 noah-pc kernel:  </TASK>

Soft lockup also happens when switching TTY. I was thinking about a HW defect, but using the nouveau driver works. The issue happens early on during boot, right after POST (screen gets stuck in POST screen before showing the login screen after ~1minute).

Other than the lockups, I don’t notice odd behaviour (but maybe there is, see nvidia report attached).

Edit: I should probably note that I’ve tried re-installing the driver multiple times (including re-downloading it). Install method is the package from RPMFusion, running system is Fedora 36. I didn’t have the issue on Fedora 35, but I also didn’t notice the issue until one week of using 36, so could still be unrelated.

nvidia-bug-report.log.gz (294.8 KB)

On Ubuntu, I experience the exact same problem on the exact same model of main-board. Hence I expect faulty firmware to be the culprit. I am using the latest non-beta firmware available. Using nvidia driver 470, 510 or 515 does not make a difference. With kernel version 5.4, the lockups also happened, albeit sporadically. With kernel 5.15.0 it happens consistently every time I try to start Xorg.

[   68.140880] watchdog: BUG: soft lockup - CPU#2 stuck for 26s! [Xorg.wrap:850]
[   68.140882] Modules linked in: tls rpcsec_gss_krb5 auth_rpcgss nfsv4 nfs lockd grace fscache netfs sunrpc nvidia_uvm(POE) nvidia_drm(POE) nvidia_modeset(POE) intel_rapl_msr intel_rapl_common snd_hda_codec_realtek x86_pkg_temp_thermal intel_powerclamp nvidia(POE) coretemp i915 snd_hda_codec_generic kvm_intel snd_soc_rt5640 kvm ledtrig_audio snd_soc_rl6231 snd_hda_codec_hdmi crct10dif_pclmul ghash_clmulni_intel snd_soc_core aesni_intel snd_hda_intel snd_compress snd_intel_dspcfg ac97_bus snd_intel_sdw_acpi crypto_simd snd_hda_codec cryptd ttm snd_hda_core snd_pcm_dmaengine snd_hwdep mei_hdcp rapl intel_cstate drm_kms_helper mei_me mei snd_pcm cec rc_core i2c_algo_bit snd_timer fb_sys_fops syscopyarea sysfillrect acpi_pad ppdev sysimgblt snd at24 soundcore parport_pc mac_hid sch_fq_codel lp parport drm efi_pstore ramoops pstore_blk pstore_zone reed_solomon ip_tables x_tables autofs4 crc32_pclmul ahci i2c_i801 libahci r8169 i2c_smbus lpc_ich xhci_pci realtek xhci_pci_renesas video
[   68.140949] CPU: 2 PID: 850 Comm: Xorg.wrap Tainted: P           OE     5.15.0-50-generic #56-Ubuntu
[   68.140950] Hardware name: Gigabyte Technology Co., Ltd. H97-HD3/H97-HD3, BIOS F8 09/18/2015
[   68.140951] RIP: 0010:os_io_write_dword+0xe/0x20 [nvidia]
[   68.141124] Code: 00 55 89 f0 89 fa 48 89 e5 66 ef 5d c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 89 f0 89 fa 48 89 e5 ef <5d> c3 cc cc cc cc 66 66 2e 0f 1f 84 00 00 00 00 00 90 0f 1f 44 00
[   68.141125] RSP: 0018:ffffb128c275b940 EFLAGS: 00000202
[   68.141126] RAX: 0000000000009400 RBX: 00000000000017d5 RCX: 00000000000c0000
[   68.141127] RDX: 000000000000e008 RSI: 0000000000009400 RDI: 000000000000e008
[   68.141128] RBP: ffffb128c275b940 R08: ffffffffc32906e0 R09: 0000000000000282
[   68.141129] R10: 0000000000000000 R11: 0000000000000001 R12: ffff9e5b8a05ac68
[   68.141129] R13: ffff9e5b8a05ac64 R14: 000000000000c000 R15: 000000000000c000
[   68.141130] FS:  00007f412f5f8740(0000) GS:ffff9e5e9eb00000(0000) knlGS:0000000000000000
[   68.141131] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   68.141132] CR2: 00007f412f655280 CR3: 000000010a07e004 CR4: 00000000001706e0
[   68.141133] Call Trace:
[   68.141134]  <TASK>
[   68.141135]  _nv039200rm+0x52/0x70 [nvidia]
[   68.141310] WARNING: kernel stack frame pointer at 000000004a1e8e4e in Xorg.wrap:850 has bad value 00000000670c587a
[   68.141311] unwind stack type:0 next_sp:0000000000000000 mask:0x2 graph_idx:0
[   68.141312] 000000004a1e8e4e: ffff9e5b8a05ac00 (0xffff9e5b8a05ac00)
[   68.141314] 000000005b7a6d93: ffffffffc186de42 (_nv039200rm+0x52/0x70 [nvidia])
[   68.141487] 0000000068a78b07: ffffffffc186ddf0 (_nv039198rm+0x30/0x30 [nvidia])
[   68.141665] 00000000bb3ee9f6: ffffffffc186c87f (_nv000751rm+0x4f/0x130 [nvidia])
[   68.141848] 0000000028d36021: 00000000000017d5 (0x17d5)
[   68.141849] 000000001b116e04: ffffffffc186c6ac (_nv030062rm+0x14c/0x200 [nvidia])
[   68.142033] 000000004b19d443: ffff9e5b8a05ac64 (0xffff9e5b8a05ac64)
[   68.142034] 00000000cd37de61: 0000000000004f02 (0x4f02)
[   68.142035] 000000006a8f6ad1: 0000000000000118 (0x118)
[   68.142036] 0000000001040689: ffff9e5b8a05ac68 (0xffff9e5b8a05ac68)
[   68.142037] 00000000a74e4b27: 0000000000000000 ...
[   68.142037] 0000000047c06055: ffffffffc187ecca (_nv038103rm+0x2a/0x80 [nvidia])
[   68.142218] 00000000cd9b206e: ffffb128c0994008 (0xffffb128c0994008)
[   68.142219] 00000000b30e7c71: ffffb128c0994008 (0xffffb128c0994008)
[   68.142220] 0000000038786025: ffff9e5b8ff89e08 (0xffff9e5b8ff89e08)
[   68.142221] 00000000e86420e9: ffff9e5b8f26c008 (0xffff9e5b8f26c008)
[   68.142221] 00000000b6fa7a8c: ffffb128c0994008 (0xffffb128c0994008)
[   68.142222] 0000000075513b53: ffffffffc18801ec (_nv015817rm+0x9cc/0xad0 [nvidia])
[   68.142408] 00000000a7f4a8e8: ffff9e5b8a05ad80 (0xffff9e5b8a05ad80)
[   68.142409] 000000003835e109: ffff9e5b8e7f1820 (0xffff9e5b8e7f1820)
[   68.142410] 00000000db5f3a6b: ffff9e5b8a05acb8 (0xffff9e5b8a05acb8)
[   68.142411] 0000000068b892f3: ffffffffc3296fa0 (_nv000413rm+0xa74/0xfffffffffe689ad4 [nvidia])
[   68.142541] 00000000cec8115a: 0000000000000000 ...
[   68.142541] 00000000cd194b95: ffffffffc1683764 (_nv034307rm+0x174/0x180 [nvidia])
[   68.142770] 00000000cde700fd: ffffffffc3296fa0 (_nv000413rm+0xa74/0xfffffffffe689ad4 [nvidia])
[   68.142901] 000000002e3d4ae3: ffff9e5b8a05ad48 (0xffff9e5b8a05ad48)
[   68.142902] 00000000b2e47742: ffff9e5b8a05ad80 (0xffff9e5b8a05ad80)
[   68.142902] 00000000a03f7a4e: ffff9e5b8a05ac98 (0xffff9e5b8a05ac98)
[   68.142903] 0000000051d71209: 0000000000000000 ...
[   68.142904] 00000000921ba2f6: ffffffffc1680d15 (_nv035951rm+0x265/0x2c0 [nvidia])
[   68.143135] 000000004084eca6: 0000000000801e01 (0x801e01)
[   68.143136] 00000000c5f0d113: ffff9e5b8a05ad48 (0xffff9e5b8a05ad48)
[   68.143136] 00000000da29d3e1: ffff9e5b8a05adf8 (0xffff9e5b8a05adf8)
[   68.143137] 00000000a36d846f: ffffb128c275bbc8 (0xffffb128c275bbc8)
[   68.143138] 000000008fd509dc: 00000000c1d00000 (0xc1d00000)
[   68.143139] 000000004fcba934: ffffffffc0faea4e (_nv011421rm+0x4fe/0x620 [nvidia])
[   68.143315] 00000000fd94e719: 0000000000801e01 (0x801e01)
[   68.143316] 0000000061eb16d6: ffffb128c275bbc8 (0xffffb128c275bbc8)
[   68.143316] 00000000e5f93eb1: 0000000000000010 (0x10)
[   68.143317] 00000000a4ed5a0c: ffffffffc3296a80 (_nv000413rm+0x554/0xfffffffffe689ad4 [nvidia])
[   68.143447] 0000000089daae3c: 0000000000010001 (0x10001)
[   68.143448] 00000000796d657e: ffffffffc0faf3a3 (_nv034441rm+0x53/0xb0 [nvidia])
[   68.143625] 000000003af3e90b: ffffffffc3296a80 (_nv000413rm+0x554/0xfffffffffe689ad4 [nvidia])
[   68.143755] 000000006e5c5a99: ffffb128c275bb00 (0xffffb128c275bb00)
[   68.143756] 00000000657ffae1: ffffb128c275bb80 (0xffffb128c275bb80)
[   68.143757] 00000000f0cba2ba: 0000000000000000 ...
[   68.143757] 00000000830fc40f: ffffffffc3532c60 (_nv001958kms+0x78/0xfffffffffffe7418 [nvidia_modeset])
[   68.143779] 00000000143be75a: ffffffffc34767a0 (_nv000640kms+0x90/0x90 [nvidia_modeset])
[   68.143792] 00000000fd1c0ab5: ffffffffc0fb2742 (_nv010351rm+0x52/0xa0 [nvidia])
[   68.143968] 00000000221a054e: 0000000000000000 ...
[   68.143969] 00000000ad8ac688: ffffb128c275bb00 (0xffffb128c275bb00)
[   68.143969] 00000000f6e08ee4: ffffb128c275bb80 (0xffffb128c275bb80)
[   68.143970] 0000000026503f7b: ffff9e5b8a058000 (0xffff9e5b8a058000)
[   68.143971] 000000007fb3d253: 0000000000000004 (0x4)
[   68.143972] 00000000d1cba19e: ffffffffc0fb2b86 (_nv010350rm+0x46/0x50 [nvidia])
[   68.144148] 000000008a2b896e: 0000000100000002 (0x100000002)
[   68.144149] 00000000708f0574: 0000000000000000 ...
[   68.144149] 00000000664479ac: ffffffffc0fb2b6f (_nv010350rm+0x2f/0x50 [nvidia])
[   68.144326] 00000000218b6558: ffffb128c275bb68 (0xffffb128c275bb68)
[   68.144327] 000000009292ac1f: ffffffffc185e8d1 (rm_kernel_rmapi_op+0x141/0x190 [nvidia])
[   68.144515] 0000000032a807a4: ffffffffc0f31a5e (nvidia_modeset_rm_ops_alloc_stack+0x1e/0x50 [nvidia])
[   68.144669] 0000000021667316: 0000000000000002 (0x2)
[   68.144669] 00000000cf833a13: ffffb128c275bb78 (0xffffb128c275bb78)
[   68.144670] 000000003b2c2166: ffffffffc3472e50 (nvkms_call_rm+0x50/0x80 [nvidia_modeset])
[   68.144683] 00000000076e84d8: ffff9e5b8a058000 (0xffff9e5b8a058000)
[   68.144684] 00000000fa230770: 5fc6f8e0c2d0d000 (0x5fc6f8e0c2d0d000)
[   68.144685] 00000000e0f4eac6: ffff9e5b8e7dd008 (0xffff9e5b8e7dd008)
[   68.144686] 00000000de80869a: ffff9e5b8e7dd008 (0xffff9e5b8e7dd008)
[   68.144687] 000000005c997100: ffffffffc34b6771 (_nv002519kms+0x51/0x60 [nvidia_modeset])
[   68.144703] 00000000e46ca5f0: 0000000000000036 (0x36)
[   68.144704] 000000002804b6d6: 00010001c1d00000 (0x10001c1d00000)
[   68.144705] 00000000887bed90: 0000000000801e01 (0x801e01)
[   68.144706] 000000006b083d28: ffffb128c275bbc8 (0xffffb128c275bbc8)
[   68.144707] 000000001bb6f789: 0000000000000010 (0x10)
[   68.144707] 00000000496f7a00: 0000000000000000 ...
[   68.144708] 0000000002554c32: 0000000000010008 (0x10008)
[   68.144709] 000000003c37b70b: ffffffffc34b3c1e (_nv002562kms+0x3e/0x90 [nvidia_modeset])
[   68.144725] 0000000081169eb1: 0000000000000002 (0x2)
[   68.144726] 000000009f9bde5b: 0000000000000000 ...
[   68.144726] 000000007cc61db7: 0000000000000003 (0x3)
[   68.144727] 000000007e00f03d: ffff9e5b8e7dd128 (0xffff9e5b8e7dd128)
[   68.144728] 00000000f6dcf3d5: ffffffffc3496612 (_nv002338kms+0x1a2/0x1c0 [nvidia_modeset])
[   68.144742] 00000000a4fe9035: ffff9e5b8a0d9008 (0xffff9e5b8a0d9008)
[   68.144743] 00000000f0e5b831: ffff9e5b8e7dd008 (0xffff9e5b8e7dd008)
[   68.144744] 00000000e3c1ff19: ffff9e5b8a0d9008 (0xffff9e5b8a0d9008)
[   68.144744] 000000006a886d92: ffff9e5b893c0d08 (0xffff9e5b893c0d08)
[   68.144745] 00000000d4991bed: ffffb128c275bce8 (0xffffb128c275bce8)
[   68.144746] 00000000eda01b6d: ffffffffc34766e0 (_nv000645kms+0x30/0x60 [nvidia_modeset])
[   68.144759] 00000000ea8528e4: ffff9e5b8e7dd008 (0xffff9e5b8e7dd008)
[   68.144760] 00000000d85e95df: ffffffffc3476776 (_nv000640kms+0x66/0x90 [nvidia_modeset])
[   68.144773] 000000006592a8b6: 5fc6f8e0c2d0d000 (0x5fc6f8e0c2d0d000)
[   68.144773] 00000000991c02fd: ffffffffc3533710 (_nv002022kms+0xab0/0xfffffffffffe73a0 [nvidia_modeset])
[   68.144791] 00000000e9c6ce49: 0000000000000026 (0x26)
[   68.144792] 00000000f5dcc020: ffffffffc3477bb6 (nvKmsIoctl+0x96/0x1d0 [nvidia_modeset])
[   68.144805] 00000000d3ff99ec: ffffb128c275bce8 (0xffffb128c275bce8)
[   68.144805] 00000000a35a6bac: 0000000000000008 (0x8)
[   68.144806] 00000000b6ea0d05: ffffffffc356df90 (nvkms_pm_lock+0x30/0xfffffffffffac0a0 [nvidia_modeset])
[   68.144817] 000000004c2f8976: ffff9e5b893c3a20 (0xffff9e5b893c3a20)
[   68.144818] 00000000380628ff: ffffb128c275bcd0 (0xffffb128c275bcd0)
[   68.144819] 000000000069c1c8: 0000000000000026 (0x26)
[   68.144820] 00000000fdcaabed: ffffb128c275bce8 (0xffffb128c275bce8)
[   68.144821] 0000000022d16a5b: 0000000000000008 (0x8)
[   68.144822] 00000000a3a2241d: 0000000000000000 ...
[   68.144822] 0000000024529111: ffffffffc3473773 (nvkms_ioctl_from_kapi+0x53/0xa0 [nvidia_modeset])
[   68.144835] 0000000060f7c981: ffff9e5b82755400 (0xffff9e5b82755400)
[   68.144836] 00000000006bbf62: ffff9e5b87f0f800 (0xffff9e5b87f0f800)
[   68.144836] 00000000ae5a94da: ffff9e5b87f0f898 (0xffff9e5b87f0f898)
[   68.144837] 00000000b200041d: 0000000000000001 (0x1)
[   68.144838] 00000000a24ec2a6: ffff9e5b88346600 (0xffff9e5b88346600)
[   68.144839] 00000000a06a8c6c: ffffb128c275bd10 (0xffffb128c275bd10)
[   68.144840] 000000009e81704c: ffffffffc34fefec (_nv000641kms+0x3c/0x50 [nvidia_modeset])
[   68.144859] 000000001896d908: ffff9e5b87f0f800 (0xffff9e5b87f0f800)
[   68.144860] 0000000004b59167: 0000000000000001 (0x1)
[   68.144861] 0000000077565a41: ffffffffc34fefb0 (_nv000091kms+0x50/0x50 [nvidia_modeset])
[   68.144881] 00000000cd990cbd: ffffffffc0b11108 (nv_drm_master_drop+0x48/0x70 [nvidia_drm])
[   68.144884] 00000000bfa0d2af: ffff9e5b8ff8f800 (0xffff9e5b8ff8f800)
[   68.144896] 000000006182f32c: ffff9e5b87f0f800 (0xffff9e5b87f0f800)
[   68.144897] 000000004e6e8892: ffffb128c275bd48 (0xffffb128c275bd48)
[   68.144897] 00000000edc186f2: ffffffffc055af29 (drm_master_release+0x109/0x170 [drm])
[   68.144926] 000000007e689456: ffff9e5b8ff8f8f8 (0xffff9e5b8ff8f8f8)
[   68.144927] 00000000419e32dd: ffff9e5b8ff8f800 (0xffff9e5b8ff8f800)
[   68.144928] 00000000d23af976: ffff9e5b8ff8f8d0 (0xffff9e5b8ff8f8d0)
[   68.144928] 000000004757bf9d: dead000000000100 (0xdead000000000100)
[   68.144929] 0000000032914038: ffff9e5b87f0f800 (0xffff9e5b87f0f800)
[   68.144930] 000000006c00e80b: ffffb128c275bd90 (0xffffb128c275bd90)
[   68.144930] 000000003c61429b: ffffffffc055b8a1 (drm_file_free.part.0+0x221/0x230 [drm])
[   68.144942] 000000006e494411: 0000000000000286 (0x286)
[   68.144943] 00000000761e8bd7: ffff9e5b87f0f960 (0xffff9e5b87f0f960)
[   68.144944] 000000006993c503: ffff9e5b87f0f800 (0xffff9e5b87f0f800)
[   68.144945] 0000000068df6fde: ffff9e5b8ff8f800 (0xffff9e5b8ff8f800)
[   68.144945] 000000003d7a998b: ffff9e5b87f0f8c0 (0xffff9e5b87f0f8c0)
[   68.144946] 00000000723efd16: ffff9e5b801e8de0 (0xffff9e5b801e8de0)
[   68.144947] 00000000af451c24: ffff9e5b909ca780 (0xffff9e5b909ca780)
[   68.144947] 00000000959fbc10: ffffb128c275bdb0 (0xffffb128c275bdb0)
[   68.144948] 00000000162c1e1a: ffffffffc055baf5 (drm_close_helper.isra.0+0x65/0x70 [drm])
[   68.144960] 000000008475f6b5: ffff9e5b89506400 (0xffff9e5b89506400)
[   68.144961] 00000000c265595b: ffff9e5b83225aa8 (0xffff9e5b83225aa8)
[   68.144961] 000000001c6f8768: ffffb128c275bdd8 (0xffffb128c275bdd8)
[   68.144962] 00000000f6199f82: ffffffffc055c27a (drm_release+0x6a/0x120 [drm])
[   68.144974] 00000000766c2ce1: 00000000000a201f (0xa201f)
[   68.144975] 00000000cbce64e2: ffff9e5b89506400 (0xffff9e5b89506400)
[   68.144975] 00000000ddc7c6a5: ffff9e5b902aa710 (0xffff9e5b902aa710)
[   68.144976] 00000000a97d8000: ffffb128c275be10 (0xffffb128c275be10)
[   68.144977] 00000000b4a8e135: ffffffff8bd8f2df (__fput+0x9f/0x260)
[   68.144979] 00000000c6861fec: 0000000000000000 ...
[   68.144980] 000000003e7418f1: ffff9e5b90088000 (0xffff9e5b90088000)
[   68.144981] 000000001389833e: ffff9e5b90088c3c (0xffff9e5b90088c3c)
[   68.144981] 000000004a00177b: 0000000000000000 ...
[   68.144982] 00000000092f7b0a: ffffb128c275be20 (0xffffb128c275be20)
[   68.144982] 000000000305f696: ffffffff8bd8f4ee (____fput+0xe/0x20)
[   68.144984] 00000000c67b2203: ffffb128c275be48 (0xffffb128c275be48)
[   68.144985] 00000000070fbea6: ffffffff8bae66ad (task_work_run+0x6d/0xb0)
[   68.144987] 0000000032b67023: ffff9e5b90088000 (0xffff9e5b90088000)
[   68.144987] 0000000062f62555: 0000000000000002 (0x2)
[   68.144988] 000000003a7678c0: ffffb128c275bf58 (0xffffb128c275bf58)
[   68.144989] 0000000032e4c98f: ffffb128c275be70 (0xffffb128c275be70)
[   68.144990] 00000000e6c3a224: ffffffff8bb6c037 (exit_to_user_mode_loop+0x157/0x160)
[   68.144992] 00000000063d609b: 0000000000000000 ...
[   68.144992] 00000000da321340: 0000000000000002 (0x2)
[   68.144993] 000000003ed313d6: 0000000000000000 ...
[   68.144993] 00000000a379a097: ffffb128c275be88 (0xffffb128c275be88)
[   68.144994] 0000000009d81708: ffffffff8bb6c0e0 (exit_to_user_mode_prepare+0xa0/0xb0)
[   68.144996] 00000000c47436d5: ffffb128c275bf58 (0xffffb128c275bf58)
[   68.144996] 00000000245075c2: ffffb128c275bea0 (0xffffb128c275bea0)
[   68.144997] 00000000c08d2247: ffffffff8c79ecd7 (syscall_exit_to_user_mode+0x27/0x50)
[   68.145000] 000000005cc893ec: ffffffff8bd878f1 (__x64_sys_close+0x11/0x50)
[   68.145002] 00000000fcea48ad: ffffb128c275bf48 (0xffffb128c275bf48)
[   68.145003] 000000002dd6f8ca: ffffffff8c79a949 (do_syscall_64+0x69/0xc0)
[   68.145004] 000000008d6ceae0: ffff9e5b89506400 (0xffff9e5b89506400)
[   68.145005] 000000003f65f4a1: ffffb128c275bef0 (0xffffb128c275bef0)
[   68.145005] 000000007a742320: ffffb128c275bed8 (0xffffb128c275bed8)
[   68.145006] 000000002b6a00e0: ffffffff8bb6c077 (exit_to_user_mode_prepare+0x37/0xb0)
[   68.145008] 00000000e1fd9e8a: ffffb128c275bf58 (0xffffb128c275bf58)
[   68.145009] 00000000cf3ed45d: ffffb128c275bef0 (0xffffb128c275bef0)
[   68.145009] 00000000d3e703e5: ffffffff8c79ecd7 (syscall_exit_to_user_mode+0x27/0x50)
[   68.145011] 0000000000c19c40: 0000000000000000 ...
[   68.145011] 00000000b8ba65c7: ffffb128c275bf48 (0xffffb128c275bf48)
[   68.145012] 00000000a07f5a45: ffffffff8c79a949 (do_syscall_64+0x69/0xc0)
[   68.145013] 00000000a2d036e5: ffffffff8c79ed69 (irqentry_exit_to_user_mode+0x9/0x20)
[   68.145015] 0000000041c08c9c: ffffb128c275bf18 (0xffffb128c275bf18)
[   68.145016] 00000000fe6aea6e: ffffffff8c79ed9d (irqentry_exit+0x1d/0x30)
[   68.145017] 000000000ffa4bd4: ffffb128c275bf48 (0xffffb128c275bf48)
[   68.145018] 00000000815053af: ffffffff8c79e809 (exc_page_fault+0x89/0x170)
[   68.145020] 0000000057fcdeb4: 0000000000000000 ...
[   68.145020] 00000000c6ff463f: ffffffff8c800099 (entry_SYSCALL_64_after_hwframe+0x61/0xcb)
[   68.145022] 00000000df6a0b4e: 0000000000000001 (0x1)
[   68.145023] 00000000a12070bf: 00000000c04064a0 (0xc04064a0)
[   68.145024] 00000000c22a368e: 0000000000000002 (0x2)
[   68.145024] 000000000f10ca1f: 0000000000000003 (0x3)
[   68.145025] 0000000074935162: 00007ffea82eb880 (0x7ffea82eb880)
[   68.145026] 00000000bded81b4: 0000000000000002 (0x2)
[   68.145026] 00000000f1d6153c: 0000000000000246 (0x246)
[   68.145027] 00000000ab7ea18e: 0000000000000000 ...
[   68.145027] 00000000d68a1a8b: 00007ffea82eb610 (0x7ffea82eb610)
[   68.145028] 0000000059e94afa: 0000000000000000 ...
[   68.145028] 00000000c95659ab: 00007f412f710117 (0x7f412f710117)
[   68.145029] 00000000f2e2337b: 00007ffea82eb7a0 (0x7ffea82eb7a0)
[   68.145030] 000000007cad811e: 00000000c04064a0 (0xc04064a0)
[   68.145030] 0000000081c82fa8: 0000000000000003 (0x3)
[   68.145031] 00000000d273465b: 0000000000000003 (0x3)
[   68.145031] 000000009b46c16f: 00007f412f710117 (0x7f412f710117)
[   68.145032] 00000000cb9c2015: 0000000000000033 (0x33)
[   68.145033] 00000000cb6e3467: 0000000000000246 (0x246)
[   68.145033] 000000005c75edfd: 00007ffea82eb788 (0x7ffea82eb788)
[   68.145034] 0000000084c13b30: 000000000000002b (0x2b)
[   68.145035]  ? _nv039198rm+0x30/0x30 [nvidia]
[   68.145214]  ? _nv000751rm+0x4f/0x130 [nvidia]
[   68.145414]  ? _nv030062rm+0x14c/0x200 [nvidia]
[   68.145611]  ? _nv038103rm+0x2a/0x80 [nvidia]
[   68.145795]  ? _nv015817rm+0x9cc/0xad0 [nvidia]
[   68.145982]  ? _nv034307rm+0x174/0x180 [nvidia]
[   68.146219]  ? _nv035951rm+0x265/0x2c0 [nvidia]
[   68.146458]  ? _nv011421rm+0x4fe/0x620 [nvidia]
[   68.146635]  ? _nv034441rm+0x53/0xb0 [nvidia]
[   68.146811]  ? _nv000640kms+0x90/0x90 [nvidia_modeset]
[   68.146824]  ? _nv010351rm+0x52/0xa0 [nvidia]
[   68.147000]  ? _nv010350rm+0x46/0x50 [nvidia]
[   68.147177]  ? _nv010350rm+0x2f/0x50 [nvidia]
[   68.147354]  ? rm_kernel_rmapi_op+0x141/0x190 [nvidia]
[   68.147549]  ? nvidia_modeset_rm_ops_alloc_stack+0x1e/0x50 [nvidia]
[   68.147703]  ? nvkms_call_rm+0x50/0x80 [nvidia_modeset]
[   68.147715]  ? _nv002519kms+0x51/0x60 [nvidia_modeset]
[   68.147732]  ? _nv002562kms+0x3e/0x90 [nvidia_modeset]
[   68.147748]  ? _nv002338kms+0x1a2/0x1c0 [nvidia_modeset]
[   68.147762]  ? _nv000645kms+0x30/0x60 [nvidia_modeset]
[   68.147775]  ? _nv000640kms+0x66/0x90 [nvidia_modeset]
[   68.147788]  ? nvKmsIoctl+0x96/0x1d0 [nvidia_modeset]
[   68.147801]  ? nvkms_ioctl_from_kapi+0x53/0xa0 [nvidia_modeset]
[   68.147814]  ? _nv000641kms+0x3c/0x50 [nvidia_modeset]
[   68.147834]  ? _nv000091kms+0x50/0x50 [nvidia_modeset]
[   68.147854]  ? nv_drm_master_drop+0x48/0x70 [nvidia_drm]
[   68.147857]  ? drm_master_release+0x109/0x170 [drm]
[   68.147870]  ? drm_file_free.part.0+0x221/0x230 [drm]
[   68.147884]  ? drm_close_helper.isra.0+0x65/0x70 [drm]
[   68.147897]  ? drm_release+0x6a/0x120 [drm]
[   68.147910]  ? __fput+0x9f/0x260
[   68.147912]  ? ____fput+0xe/0x20
[   68.147913]  ? task_work_run+0x6d/0xb0
[   68.147915]  ? exit_to_user_mode_loop+0x157/0x160
[   68.147917]  ? exit_to_user_mode_prepare+0xa0/0xb0
[   68.147918]  ? syscall_exit_to_user_mode+0x27/0x50
[   68.147920]  ? __x64_sys_close+0x11/0x50
[   68.147922]  ? do_syscall_64+0x69/0xc0
[   68.147923]  ? exit_to_user_mode_prepare+0x37/0xb0
[   68.147925]  ? syscall_exit_to_user_mode+0x27/0x50
[   68.147926]  ? do_syscall_64+0x69/0xc0
[   68.147927]  ? irqentry_exit_to_user_mode+0x9/0x20
[   68.147929]  ? irqentry_exit+0x1d/0x30
[   68.147931]  ? exc_page_fault+0x89/0x170
[   68.147932]  ? entry_SYSCALL_64_after_hwframe+0x61/0xcb
[   68.147935]  </TASK>
[  100.144987] watchdog: BUG: soft lockup - CPU#3 stuck for 26s! [Xorg:850]
[  100.144990] Modules linked in: tls rpcsec_gss_krb5 auth_rpcgss nfsv4 nfs lockd grace fscache netfs sunrpc nvidia_uvm(POE) nvidia_drm(POE) nvidia_modeset(POE) intel_rapl_msr intel_rapl_common snd_hda_codec_realtek x86_pkg_temp_thermal intel_powerclamp nvidia(POE) coretemp i915 snd_hda_codec_generic kvm_intel snd_soc_rt5640 kvm ledtrig_audio snd_soc_rl6231 snd_hda_codec_hdmi crct10dif_pclmul ghash_clmulni_intel snd_soc_core aesni_intel snd_hda_intel snd_compress snd_intel_dspcfg ac97_bus snd_intel_sdw_acpi crypto_simd snd_hda_codec cryptd ttm snd_hda_core snd_pcm_dmaengine snd_hwdep mei_hdcp rapl intel_cstate drm_kms_helper mei_me mei snd_pcm cec rc_core i2c_algo_bit snd_timer fb_sys_fops syscopyarea sysfillrect acpi_pad ppdev sysimgblt snd at24 soundcore parport_pc mac_hid sch_fq_codel lp parport drm efi_pstore ramoops pstore_blk pstore_zone reed_solomon ip_tables x_tables autofs4 crc32_pclmul ahci i2c_i801 libahci r8169 i2c_smbus lpc_ich xhci_pci realtek xhci_pci_renesas video
[  100.145056] CPU: 3 PID: 850 Comm: Xorg Tainted: P           OEL    5.15.0-50-generic #56-Ubuntu
[  100.145057] Hardware name: Gigabyte Technology Co., Ltd. H97-HD3/H97-HD3, BIOS F8 09/18/2015
[  100.145058] RIP: 0010:_nv015322rm+0x4b/0xa0 [nvidia]
[  100.145264] Code: c0 41 f7 d0 44 89 c2 09 f2 44 21 c6 21 fa 89 cf 83 e7 fe 09 d6 79 05 89 cf 83 cf 01 89 f1 89 f2 c1 ea 1f c1 e9 1e 31 d1 89 fa <80> e6 f7 83 e1 01 74 08 81 cf 00 08 00 00 89 fa 89 d1 83 ca 10 83
[  100.145265] RSP: 0018:ffffb128c275b8d8 EFLAGS: 00000202
[  100.145267] RAX: 0000000000154ea0 RBX: ffffffffc32fa178 RCX: 0000000000000002
[  100.145267] RDX: 0000000000000283 RSI: 00000000fffe8000 RDI: 0000000000000283
[  100.145268] RBP: ffff9e5b87c52bf0 R08: 00000000ffeab15f R09: 0000000000000282
[  100.145269] R10: 0000000000000202 R11: 0000000000000001 R12: ffff9e5b87c52c68
[  100.145269] R13: ffff9e5b87c52c64 R14: 000000000000c000 R15: 000000000000c000
[  100.145270] FS:  00007fb1c269ea80(0000) GS:ffff9e5e9eb80000(0000) knlGS:0000000000000000
[  100.145271] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  100.145272] CR2: 000055f5c75f5130 CR3: 0000000108cde001 CR4: 00000000001706e0
[  100.145273] Call Trace:
[  100.145274]  <TASK>
[  100.145275]  ? _nv039071rm+0x181/0x190 [nvidia]
[  100.145454]  ? _nv000751rm+0x4f/0x130 [nvidia]
[  100.145633]  ? _nv030062rm+0x14c/0x200 [nvidia]
[  100.145813]  ? _nv038103rm+0x2a/0x80 [nvidia]
[  100.145989]  ? _nv015817rm+0x9cc/0xad0 [nvidia]
[  100.146166]  ? _nv034307rm+0x174/0x180 [nvidia]
[  100.146395]  ? _nv035951rm+0x265/0x2c0 [nvidia]
[  100.146627]  ? _nv011421rm+0x4fe/0x620 [nvidia]
[  100.146803]  ? _nv034441rm+0x53/0xb0 [nvidia]
[  100.146980]  ? _nv000640kms+0x90/0x90 [nvidia_modeset]
[  100.146996]  ? _nv010351rm+0x52/0xa0 [nvidia]
[  100.147152]  ? _nv010350rm+0x46/0x50 [nvidia]
[  100.147308]  ? _nv010350rm+0x2f/0x50 [nvidia]
[  100.147463]  ? rm_kernel_rmapi_op+0x141/0x190 [nvidia]
[  100.147650]  ? nvidia_modeset_rm_ops_alloc_stack+0x1e/0x50 [nvidia]
[  100.147803]  ? nvkms_call_rm+0x50/0x80 [nvidia_modeset]
[  100.147816]  ? _nv002519kms+0x51/0x60 [nvidia_modeset]
[  100.147833]  ? _nv002562kms+0x3e/0x90 [nvidia_modeset]
[  100.147849]  ? _nv002338kms+0x1a2/0x1c0 [nvidia_modeset]
[  100.147863]  ? _nv000645kms+0x30/0x60 [nvidia_modeset]
[  100.147875]  ? _nv000640kms+0x66/0x90 [nvidia_modeset]
[  100.147888]  ? nvKmsIoctl+0x96/0x1d0 [nvidia_modeset]
[  100.147901]  ? nvkms_ioctl_from_kapi+0x53/0xa0 [nvidia_modeset]
[  100.147914]  ? _nv000641kms+0x3c/0x50 [nvidia_modeset]
[  100.147935]  ? _nv000091kms+0x50/0x50 [nvidia_modeset]
[  100.147955]  ? nv_drm_master_drop+0x48/0x70 [nvidia_drm]
[  100.147958]  ? drm_master_release+0x109/0x170 [drm]
[  100.147976]  ? drm_file_free.part.0+0x221/0x230 [drm]
[  100.147989]  ? drm_close_helper.isra.0+0x65/0x70 [drm]
[  100.148003]  ? drm_release+0x6a/0x120 [drm]
[  100.148016]  ? __fput+0x9f/0x260
[  100.148019]  ? ____fput+0xe/0x20
[  100.148020]  ? task_work_run+0x6d/0xb0
[  100.148022]  ? exit_to_user_mode_loop+0x157/0x160
[  100.148024]  ? exit_to_user_mode_prepare+0xa0/0xb0
[  100.148026]  ? syscall_exit_to_user_mode+0x27/0x50
[  100.148029]  ? __x64_sys_close+0x11/0x50
[  100.148031]  ? do_syscall_64+0x69/0xc0
[  100.148033]  ? syscall_exit_to_user_mode+0x27/0x50
[  100.148034]  ? exit_to_user_mode_prepare+0x37/0xb0
[  100.148036]  ? syscall_exit_to_user_mode+0x27/0x50
[  100.148038]  ? do_syscall_64+0x69/0xc0
[  100.148039]  ? syscall_exit_to_user_mode+0x27/0x50
[  100.148040]  ? __x64_sys_write+0x19/0x20
[  100.148042]  ? do_syscall_64+0x69/0xc0
[  100.148043]  ? syscall_exit_to_user_mode+0x27/0x50
[  100.148044]  ? __x64_sys_write+0x19/0x20
[  100.148046]  ? do_syscall_64+0x69/0xc0
[  100.148047]  ? entry_SYSCALL_64_after_hwframe+0x61/0xcb
[  100.148050]  </TASK>