"Pageflip timed out!" "GPU has fallen off the bus" in multiple steam games

[soafi]

nvidia-bug-report.log.gz (415.3 KB)

Multiple games crash to black screen after a few minutes and requires reboot. Happens in Lies of P, Hollow Knight. This does not happen in Windows.

I have tried a different GPU(GTX 1060) with different drivers, different power mode kernel parameters, different PCIE lanes, cleaning ports and connections, updating BIOS version, different DE, steam game launch parameters, LTS kernel, monitoring temperature.

OS: CachyOS x86_64
Host: MS-7D09 (1.0)
Kernel: Linux 6.17.4-4-cachyos
DE: KDE Plasma 6.5.0
WM: KWin (Wayland)
CPU: Intel(R) Core™ i7-10700F (16) @ 4.80 GHz
GPU: NVIDIA GeForce RTX 3060 Lite Hash Rate
Driver Version: 580.95.05

❯ journalctl -b -1
Oct 25 13:05:34 angelstation kernel: NVRM: GPU at PCI:0000:01:00: GPU-f3e74182-e092-84fa-57cf-b3c277f634a7
Oct 25 13:05:34 angelstation kernel: NVRM: Xid (PCI:0000:01:00): 79, GPU has fallen off the bus.
Oct 25 13:05:34 angelstation kernel: NVRM: GPU 0000:01:00.0: GPU has fallen off the bus.
Oct 25 13:05:34 angelstation kernel: NVRM: kgspRcAndNotifyAllChannels_IMPL: RC all channels for critical error 79.
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39482!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39483!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39484!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39485!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39486!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39487!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39488!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39489!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39490!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39491!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39492!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39493!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39494!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39495!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39496!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39497!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39498!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39499!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39500!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39501!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39502!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39503!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39504!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39505!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39506!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: RmLogGpuCrash: RmLogGpuCrash: failed to save GPU crash data
Oct 25 13:05:34 angelstation kernel: NVRM: _kgspLogRpcSanityCheckFailure: GPU0 sanity check failed 0xf waiting for RPC response from GSP. Expected function 76 (GSP_RM_CONTROL) sequence 39481 (0x2080a0d1 0x7e8).
Oct 25 13:05:34 angelstation kernel: NVRM: GPU0 GSP RPC buffer contains function 78 (DUMP_PROTOBUF_COMPONENT) sequence 39506 and data 0x0000000000000000 0x0000000000000000.
Oct 25 13:05:34 angelstation kernel: NVRM: GPU0 RPC history (CPU -> GSP):
Oct 25 13:05:34 angelstation kernel: NVRM:     entry function                     sequence data0              data1              ts_start           ts_end             duration actively_polling
Oct 25 13:05:34 angelstation kernel: NVRM:      0    76   GSP_RM_CONTROL             39481 0x000000002080a0d1 0x00000000000007e8 0x000641ff833cc760 0x0000000000000000          y
Oct 25 13:05:34 angelstation kernel: NVRM:     -1    76   GSP_RM_CONTROL             39480 0x000000002080a0d1 0x00000000000007e8 0x000641ff832c9c0c 0x000641ff832c9d0b    255us
Oct 25 13:05:34 angelstation kernel: NVRM:     -2    76   GSP_RM_CONTROL             39479 0x000000002080a0d1 0x00000000000007e8 0x000641ff832c54f4 0x000641ff832c5610    284us
Oct 25 13:05:34 angelstation kernel: NVRM:     -3    76   GSP_RM_CONTROL             39478 0x000000002080a0d1 0x00000000000007e8 0x000641ff831d514c 0x000641ff831d5264    280us
Oct 25 13:05:34 angelstation kernel: NVRM:     -4    76   GSP_RM_CONTROL             39477 0x000000002080a0d1 0x00000000000007e8 0x000641ff83193fb3 0x000641ff831940f6    323us
Oct 25 13:05:34 angelstation kernel: NVRM:     -5    76   GSP_RM_CONTROL             39476 0x000000002080a0d1 0x00000000000007e8 0x000641ff830e0602 0x000641ff830e074e    332us
Oct 25 13:05:34 angelstation kernel: NVRM:     -6    76   GSP_RM_CONTROL             39475 0x000000002080a0d1 0x00000000000007e8 0x000641ff83062aab 0x000641ff83062bc5    282us
Oct 25 13:05:34 angelstation kernel: NVRM:     -7    76   GSP_RM_CONTROL             39474 0x000000002080a0d1 0x00000000000007e8 0x000641ff82febb15 0x000641ff82febc48    307us
Oct 25 13:05:34 angelstation kernel: NVRM: GPU0 RPC event history (CPU <- GSP):
Oct 25 13:05:34 angelstation kernel: NVRM:     entry function                     sequence data0              data1              ts_start           ts_end             duration during_incomplete_rpc
Oct 25 13:05:34 angelstation kernel: NVRM:      0    4099 POST_EVENT                     0 0x0000000000000001 0x0000000000000000 0x000641ff6a4e3b76 0x000641ff6a4e3b7e      8us
Oct 25 13:05:34 angelstation kernel: NVRM:     -1    4108 UCODE_LIBOS_PRINT              0 0x0000000000000000 0x0000000000000000 0x000641ff6a262cdb 0x000641ff6a262cdb
Oct 25 13:05:34 angelstation kernel: NVRM:     -2    4108 UCODE_LIBOS_PRINT              0 0x0000000000000000 0x0000000000000000 0x000641ff6a262baa 0x000641ff6a262bac      2us
Oct 25 13:05:34 angelstation kernel: NVRM:     -3    4098 GSP_RUN_CPU_SEQUENCER          0 0x000000000000061c 0x0000000000003fe2 0x000641ff6a256ad8 0x000641ff6a257df8   4896us
Oct 25 13:05:34 angelstation kernel: NVRM:     -4    4108 UCODE_LIBOS_PRINT              0 0x0000000000000000 0x0000000000000000 0x000641f3960fb11b 0x000641f3960fb11c      1us
Oct 25 13:05:34 angelstation kernel: NVRM:     -5    4111 PERF_BRIDGELESS_INFO_          0 0x0000000000000000 0x0000000000000000 0x000641f39608ab1e 0x000641f39608ab1e
Oct 25 13:05:34 angelstation kernel: NVRM:     -6    4108 UCODE_LIBOS_PRINT              0 0x0000000000000000 0x0000000000000000 0x000641f1d4a3d760 0x000641f1d4a3d760
Oct 25 13:05:34 angelstation kernel: NVRM:     -7    4108 UCODE_LIBOS_PRINT              0 0x0000000000000000 0x0000000000000000 0x000641f1d4a3d63e 0x000641f1d4a3d63f      1us
Oct 25 13:05:34 angelstation kernel: CPU: 14 UID: 1000 PID: 5389 Comm: [vkps] Update Tainted: G           O        6.17.4-4-cachyos #1 PREEMPT(full)  aacbcbc2762614d40a34760507e6db194636c35b
Oct 25 13:05:34 angelstation kernel: Tainted: [O]=OOT_MODULE
Oct 25 13:05:34 angelstation kernel: Hardware name: Micro-Star International Co., Ltd. MS-7D09/Z590-A PRO (MS-7D09), BIOS 1.A0 07/11/2024
Oct 25 13:05:34 angelstation kernel: Call Trace:
Oct 25 13:05:34 angelstation kernel:  <TASK>
Oct 25 13:05:34 angelstation kernel:  dump_stack_lvl+0x61/0x80
Oct 25 13:05:34 angelstation kernel:  _kgspRpcRecvPoll+0x404/0x880 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  _issueRpcAndWait+0x5a1/0x800 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? osGetCurrentThread+0x23/0x40 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? rmDeviceGpuLockIsOwner+0x1e/0x70 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? rpcWriteCommonHeader+0x99/0x230 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  rpcRmApiControl_GSP+0x41d/0x6c0 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  RmGssLegacyRpcCmd+0x19f/0x2b0 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? _nvos32FunctionAllocOsDesc+0x80/0x80 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  Nv04ControlWithSecInfo+0x6c/0xb0 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? rmapiInitDeprecatedContext+0xe0/0xe0 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? _rmAllocForDeprecatedApi+0x30/0x30 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? _rmControlForDeprecatedApi+0x20/0x20 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? _rmFreeForDeprecatedApi+0x20/0x20 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? _rmMapMemoryForDeprecatedApi+0x30/0x30 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? _rmCopyUserForDeprecatedApi+0x30/0x30 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? _rmAllocMemForDeprecatedApi+0x10/0x10 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  RmIoctl+0x6ae/0xa60 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? os_acquire_spinlock+0x12/0x30 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  rm_ioctl+0x23a/0x480 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  nvidia_unlocked_ioctl+0x5f8/0x7b0 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  __x64_sys_ioctl+0x73/0xc0
Oct 25 13:05:34 angelstation kernel:  do_syscall_64+0x85/0x200
Oct 25 13:05:34 angelstation kernel:  ? do_futex+0x196/0x1d0
Oct 25 13:05:34 angelstation kernel:  ? __se_sys_futex+0x13d/0x1d0
Oct 25 13:05:34 angelstation kernel:  ? do_syscall_64+0xb6/0x200
Oct 25 13:05:34 angelstation kernel:  ? hrtimer_cancel+0x15/0x30
Oct 25 13:05:34 angelstation kernel:  ? futex_wait+0xd1/0x150
Oct 25 13:05:34 angelstation kernel:  ? __pfx_hrtimer_wakeup+0x10/0x10
Oct 25 13:05:34 angelstation kernel:  ? do_futex+0x16b/0x1d0
Oct 25 13:05:34 angelstation kernel:  ? __rseq_handle_notify_resume+0xf6/0x580
Oct 25 13:05:34 angelstation kernel:  ? arch_exit_to_user_mode_prepare+0x85/0x90
Oct 25 13:05:34 angelstation kernel:  ? do_syscall_64+0xb6/0x200
Oct 25 13:05:34 angelstation kernel:  ? do_syscall_64+0xb6/0x200
Oct 25 13:05:34 angelstation kernel:  ? arch_exit_to_user_mode_prepare+0x85/0x90
Oct 25 13:05:34 angelstation kernel:  ? clear_bhb_loop+0x50/0xa0
Oct 25 13:05:34 angelstation kernel:  ? clear_bhb_loop+0x50/0xa0
Oct 25 13:05:34 angelstation kernel:  entry_SYSCALL_64_after_hwframe+0x76/0x7e
Oct 25 13:05:34 angelstation kernel: RIP: 0033:0x7fdb1af3610f
Oct 25 13:05:34 angelstation kernel: Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <89> c2 3d 00 f0 ff ff 77 18 48 8b 44 24 18>
Oct 25 13:05:34 angelstation kernel: RSP: 002b:00007fdaf57dab70 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
Oct 25 13:05:34 angelstation kernel: RAX: ffffffffffffffda RBX: 00007fdaf57dad80 RCX: 00007fdb1af3610f
Oct 25 13:05:34 angelstation kernel: RDX: 00007fdaf57dad80 RSI: 00000000c020462a RDI: 0000000000000156
Oct 25 13:05:34 angelstation kernel: RBP: 00000000c020462a R08: 00007fdaf57dad80 R09: 00007fdaf57dad9c
Oct 25 13:05:34 angelstation kernel: R10: 00007fdaf57dbdd0 R11: 0000000000000246 R12: 0000000000000156
Oct 25 13:05:34 angelstation kernel: R13: 00007fdaf57dad9c R14: 0000000068fd116e R15: 00007fdaf57dabd0
Oct 25 13:05:34 angelstation kernel:  </TASK>
Oct 25 13:05:34 angelstation kernel: NVRM: Xid (PCI:0000:01:00): 154, GPU recovery action changed from 0x0 (None) to 0x2 (Node Reboot Required)
Oct 25 13:05:40 angelstation kwin_wayland[1Oct 25 13:05:34 angelstation kernel: NVRM: GPU at PCI:0000:01:00: GPU-f3e74182-e092-84fa-57cf-b3c277f634a7
Oct 25 13:05:34 angelstation kernel: NVRM: Xid (PCI:0000:01:00): 79, GPU has fallen off the bus.
Oct 25 13:05:34 angelstation kernel: NVRM: GPU 0000:01:00.0: GPU has fallen off the bus.
Oct 25 13:05:34 angelstation kernel: NVRM: kgspRcAndNotifyAllChannels_IMPL: RC all channels for critical error 79.
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39482!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39483!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39484!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39485!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39486!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39487!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39488!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39489!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39490!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pOct 25 13:05:34 angelstation kernel: NVRM: GPU at PCI:0000:01:00: GPU-f3e74182-e092-84fa-57cf-b3c277f634a7
Oct 25 13:05:34 angelstation kernel: NVRM: Xid (PCI:0000:01:00): 79, GPU has fallen off the bus.
Oct 25 13:05:34 angelstation kernel: NVRM: GPU 0000:01:00.0: GPU has fallen off the bus.
Oct 25 13:05:34 angelstation kernel: NVRM: kgspRcAndNotifyAllChannels_IMPL: RC all channels for critical error 79.
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _threadNodeCheckTimeout: API_GPU_ATTACHED_SANITY_CHECK failed!
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39482!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39483!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39484!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39485!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39486!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39487!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39488!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39489!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39490!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39491!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39492!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39493!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39494!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39495!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39496!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39497!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39498!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39499!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39500!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39501!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39502!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39503!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39504!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39505!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39506!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: RmLogGpuCrash: RmLogGpuCrash: failed to save GPU crash data
Oct 25 13:05:34 angelstation kernel: NVRM: _kgspLogRpcSanityCheckFailure: GPU0 sanity check failed 0xf waiting for RPC response from GSP. Expected function 76 (GSP_RM_CONTROL) sequence 39481 (0x2080a0d1 0x7e8).
Oct 25 13:05:34 angelstation kernel: NVRM: GPU0 GSP RPC buffer contains function 78 (DUMP_PROTOBUF_COMPONENT) sequence 39506 and data 0x0000000000000000 0x0000000000000000.
Oct 25 13:05:34 angelstation kernel: NVRM: GPU0 RPC history (CPU -> GSP):
Oct 25 13:05:34 angelstation kernel: NVRM:     entry function                     sequence data0              data1              ts_start           ts_end             duration actively_polling
Oct 25 13:05:34 angelstation kernel: NVRM:      0    76   GSP_RM_CONTROL             39481 0x000000002080a0d1 0x00000000000007e8 0x000641ff833cc760 0x0000000000000000          y
Oct 25 13:05:34 angelstation kernel: NVRM:     -1    76   GSP_RM_CONTROL             39480 0x000000002080a0d1 0x00000000000007e8 0x000641ff832c9c0c 0x000641ff832c9d0b    255us
Oct 25 13:05:34 angelstation kernel: NVRM:     -2    76   GSP_RM_CONTROL             39479 0x000000002080a0d1 0x00000000000007e8 0x000641ff832c54f4 0x000641ff832c5610    284us
Oct 25 13:05:34 angelstation kernel: NVRM:     -3    76   GSP_RM_CONTROL             39478 0x000000002080a0d1 0x00000000000007e8 0x000641ff831d514c 0x000641ff831d5264    280us
Oct 25 13:05:34 angelstation kernel: NVRM:     -4    76   GSP_RM_CONTROL             39477 0x000000002080a0d1 0x00000000000007e8 0x000641ff83193fb3 0x000641ff831940f6    323us
Oct 25 13:05:34 angelstation kernel: NVRM:     -5    76   GSP_RM_CONTROL             39476 0x000000002080a0d1 0x00000000000007e8 0x000641ff830e0602 0x000641ff830e074e    332us
Oct 25 13:05:34 angelstation kernel: NVRM:     -6    76   GSP_RM_CONTROL             39475 0x000000002080a0d1 0x00000000000007e8 0x000641ff83062aab 0x000641ff83062bc5    282us
Oct 25 13:05:34 angelstation kernel: NVRM:     -7    76   GSP_RM_CONTROL             39474 0x000000002080a0d1 0x00000000000007e8 0x000641ff82febb15 0x000641ff82febc48    307us
Oct 25 13:05:34 angelstation kernel: NVRM: GPU0 RPC event history (CPU <- GSP):
Oct 25 13:05:34 angelstation kernel: NVRM:     entry function                     sequence data0              data1              ts_start           ts_end             duration during_incomplete_rpc
Oct 25 13:05:34 angelstation kernel: NVRM:      0    4099 POST_EVENT                     0 0x0000000000000001 0x0000000000000000 0x000641ff6a4e3b76 0x000641ff6a4e3b7e      8us
Oct 25 13:05:34 angelstation kernel: NVRM:     -1    4108 UCODE_LIBOS_PRINT              0 0x0000000000000000 0x0000000000000000 0x000641ff6a262cdb 0x000641ff6a262cdb
Oct 25 13:05:34 angelstation kernel: NVRM:     -2    4108 UCODE_LIBOS_PRINT              0 0x0000000000000000 0x0000000000000000 0x000641ff6a262baa 0x000641ff6a262bac      2us
Oct 25 13:05:34 angelstation kernel: NVRM:     -3    4098 GSP_RUN_CPU_SEQUENCER          0 0x000000000000061c 0x0000000000003fe2 0x000641ff6a256ad8 0x000641ff6a257df8   4896us
Oct 25 13:05:34 angelstation kernel: NVRM:     -4    4108 UCODE_LIBOS_PRINT              0 0x0000000000000000 0x0000000000000000 0x000641f3960fb11b 0x000641f3960fb11c      1us
Oct 25 13:05:34 angelstation kernel: NVRM:     -5    4111 PERF_BRIDGELESS_INFO_          0 0x0000000000000000 0x0000000000000000 0x000641f39608ab1e 0x000641f39608ab1e
Oct 25 13:05:34 angelstation kernel: NVRM:     -6    4108 UCODE_LIBOS_PRINT              0 0x0000000000000000 0x0000000000000000 0x000641f1d4a3d760 0x000641f1d4a3d760
Oct 25 13:05:34 angelstation kernel: NVRM:     -7    4108 UCODE_LIBOS_PRINT              0 0x0000000000000000 0x0000000000000000 0x000641f1d4a3d63e 0x000641f1d4a3d63f      1us
Oct 25 13:05:34 angelstation kernel: CPU: 14 UID: 1000 PID: 5389 Comm: [vkps] Update Tainted: G           O        6.17.4-4-cachyos #1 PREEMPT(full)  aacbcbc2762614d40a34760507e6db194636c35b
Oct 25 13:05:34 angelstation kernel: Tainted: [O]=OOT_MODULE
Oct 25 13:05:34 angelstation kernel: Hardware name: Micro-Star International Co., Ltd. MS-7D09/Z590-A PRO (MS-7D09), BIOS 1.A0 07/11/2024
Oct 25 13:05:34 angelstation kernel: Call Trace:
Oct 25 13:05:34 angelstation kernel:  <TASK>
Oct 25 13:05:34 angelstation kernel:  dump_stack_lvl+0x61/0x80
Oct 25 13:05:34 angelstation kernel:  _kgspRpcRecvPoll+0x404/0x880 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  _issueRpcAndWait+0x5a1/0x800 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? osGetCurrentThread+0x23/0x40 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? rmDeviceGpuLockIsOwner+0x1e/0x70 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? rpcWriteCommonHeader+0x99/0x230 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  rpcRmApiControl_GSP+0x41d/0x6c0 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  RmGssLegacyRpcCmd+0x19f/0x2b0 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? _nvos32FunctionAllocOsDesc+0x80/0x80 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  Nv04ControlWithSecInfo+0x6c/0xb0 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? rmapiInitDeprecatedContext+0xe0/0xe0 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? _rmAllocForDeprecatedApi+0x30/0x30 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? _rmControlForDeprecatedApi+0x20/0x20 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? _rmFreeForDeprecatedApi+0x20/0x20 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? _rmMapMemoryForDeprecatedApi+0x30/0x30 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? _rmCopyUserForDeprecatedApi+0x30/0x30 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? _rmAllocMemForDeprecatedApi+0x10/0x10 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  RmIoctl+0x6ae/0xa60 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? os_acquire_spinlock+0x12/0x30 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  rm_ioctl+0x23a/0x480 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  nvidia_unlocked_ioctl+0x5f8/0x7b0 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  __x64_sys_ioctl+0x73/0xc0
Oct 25 13:05:34 angelstation kernel:  do_syscall_64+0x85/0x200
Oct 25 13:05:34 angelstation kernel:  ? do_futex+0x196/0x1d0
Oct 25 13:05:34 angelstation kernel:  ? __se_sys_futex+0x13d/0x1d0
Oct 25 13:05:34 angelstation kernel:  ? do_syscall_64+0xb6/0x200
Oct 25 13:05:34 angelstation kernel:  ? hrtimer_cancel+0x15/0x30
Oct 25 13:05:34 angelstation kernel:  ? futex_wait+0xd1/0x150
Oct 25 13:05:34 angelstation kernel:  ? __pfx_hrtimer_wakeup+0x10/0x10
Oct 25 13:05:34 angelstation kernel:  ? do_futex+0x16b/0x1d0
Oct 25 13:05:34 angelstation kernel:  ? __rseq_handle_notify_resume+0xf6/0x580
Oct 25 13:05:34 angelstation kernel:  ? arch_exit_to_user_mode_prepare+0x85/0x90
Oct 25 13:05:34 angelstation kernel:  ? do_syscall_64+0xb6/0x200
Oct 25 13:05:34 angelstation kernel:  ? do_syscall_64+0xb6/0x200
Oct 25 13:05:34 angelstation kernel:  ? arch_exit_to_user_mode_prepare+0x85/0x90
Oct 25 13:05:34 angelstation kernel:  ? clear_bhb_loop+0x50/0xa0
Oct 25 13:05:34 angelstation kernel:  ? clear_bhb_loop+0x50/0xa0
Oct 25 13:05:34 angelstation kernel:  entry_SYSCALL_64_after_hwframe+0x76/0x7e
Oct 25 13:05:34 angelstation kernel: RIP: 0033:0x7fdb1af3610f
Oct 25 13:05:34 angelstation kernel: Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <89> c2 3d 00 f0 ff ff 77 18 48 8b 44 24 18>
Oct 25 13:05:34 angelstation kernel: RSP: 002b:00007fdaf57dab70 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
Oct 25 13:05:34 angelstation kernel: RAX: ffffffffffffffda RBX: 00007fdaf57dad80 RCX: 00007fdb1af3610f
Oct 25 13:05:34 angelstation kernel: RDX: 00007fdaf57dad80 RSI: 00000000c020462a RDI: 0000000000000156
Oct 25 13:05:34 angelstation kernel: RBP: 00000000c020462a R08: 00007fdaf57dad80 R09: 00007fdaf57dad9c
Oct 25 13:05:34 angelstation kernel: R10: 00007fdaf57dbdd0 R11: 0000000000000246 R12: 0000000000000156
Oct 25 13:05:34 angelstation kernel: R13: 00007fdaf57dad9c R14: 0000000068fd116e R15: 00007fdaf57dabd0
Oct 25 13:05:34 angelstation kernel:  </TASK>
Oct 25 13:05:34 angelstation kernel: NVRM: Xid (PCI:0000:01:00): 154, GPU recovery action changed from 0x0 (None) to 0x2 (Node Reboot Required)
Oct 25 13:05:40 angelstation kwin_wayland[1348]: Pageflip timed out! This is a bug in the nvidia-drm kernel driver
Oct 25 13:05:40 angelstation kwin_wayland[1348]: Please report this at https://forums.developer.nvidia.com/c/gpu-graphics/linux
Oct 25 13:05:40 angelstation kwin_wayland[1348]: With the output of 'sudo dmesg' and 'journalctl --user-unit plasma-kwin_wayland --boot 0'NvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39491!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39492!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39493!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39494!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39495!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39496!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39497!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39498!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39499!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39500!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39501!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39502!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39503!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39504!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39505!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: _issueRpcAndWait: rpcSendMessage failed with status 0x0000000f for fn 78 sequence 39506!
Oct 25 13:05:34 angelstation kernel: NVRM: nvCheckOkFailedNoLog: Check failed: GPU lost from the bus [NV_ERR_GPU_IS_LOST] (0x0000000F) returned from nvdEngineDumpCallbackHelper(pGpu, pPrbEnc, pNvDumpState, pEngin>
Oct 25 13:05:34 angelstation kernel: NVRM: RmLogGpuCrash: RmLogGpuCrash: failed to save GPU crash data
Oct 25 13:05:34 angelstation kernel: NVRM: _kgspLogRpcSanityCheckFailure: GPU0 sanity check failed 0xf waiting for RPC response from GSP. Expected function 76 (GSP_RM_CONTROL) sequence 39481 (0x2080a0d1 0x7e8).
Oct 25 13:05:34 angelstation kernel: NVRM: GPU0 GSP RPC buffer contains function 78 (DUMP_PROTOBUF_COMPONENT) sequence 39506 and data 0x0000000000000000 0x0000000000000000.
Oct 25 13:05:34 angelstation kernel: NVRM: GPU0 RPC history (CPU -> GSP):
Oct 25 13:05:34 angelstation kernel: NVRM:     entry function                     sequence data0              data1              ts_start           ts_end             duration actively_polling
Oct 25 13:05:34 angelstation kernel: NVRM:      0    76   GSP_RM_CONTROL             39481 0x000000002080a0d1 0x00000000000007e8 0x000641ff833cc760 0x0000000000000000          y
Oct 25 13:05:34 angelstation kernel: NVRM:     -1    76   GSP_RM_CONTROL             39480 0x000000002080a0d1 0x00000000000007e8 0x000641ff832c9c0c 0x000641ff832c9d0b    255us
Oct 25 13:05:34 angelstation kernel: NVRM:     -2    76   GSP_RM_CONTROL             39479 0x000000002080a0d1 0x00000000000007e8 0x000641ff832c54f4 0x000641ff832c5610    284us
Oct 25 13:05:34 angelstation kernel: NVRM:     -3    76   GSP_RM_CONTROL             39478 0x000000002080a0d1 0x00000000000007e8 0x000641ff831d514c 0x000641ff831d5264    280us
Oct 25 13:05:34 angelstation kernel: NVRM:     -4    76   GSP_RM_CONTROL             39477 0x000000002080a0d1 0x00000000000007e8 0x000641ff83193fb3 0x000641ff831940f6    323us
Oct 25 13:05:34 angelstation kernel: NVRM:     -5    76   GSP_RM_CONTROL             39476 0x000000002080a0d1 0x00000000000007e8 0x000641ff830e0602 0x000641ff830e074e    332us
Oct 25 13:05:34 angelstation kernel: NVRM:     -6    76   GSP_RM_CONTROL             39475 0x000000002080a0d1 0x00000000000007e8 0x000641ff83062aab 0x000641ff83062bc5    282us
Oct 25 13:05:34 angelstation kernel: NVRM:     -7    76   GSP_RM_CONTROL             39474 0x000000002080a0d1 0x00000000000007e8 0x000641ff82febb15 0x000641ff82febc48    307us
Oct 25 13:05:34 angelstation kernel: NVRM: GPU0 RPC event history (CPU <- GSP):
Oct 25 13:05:34 angelstation kernel: NVRM:     entry function                     sequence data0              data1              ts_start           ts_end             duration during_incomplete_rpc
Oct 25 13:05:34 angelstation kernel: NVRM:      0    4099 POST_EVENT                     0 0x0000000000000001 0x0000000000000000 0x000641ff6a4e3b76 0x000641ff6a4e3b7e      8us
Oct 25 13:05:34 angelstation kernel: NVRM:     -1    4108 UCODE_LIBOS_PRINT              0 0x0000000000000000 0x0000000000000000 0x000641ff6a262cdb 0x000641ff6a262cdb
Oct 25 13:05:34 angelstation kernel: NVRM:     -2    4108 UCODE_LIBOS_PRINT              0 0x0000000000000000 0x0000000000000000 0x000641ff6a262baa 0x000641ff6a262bac      2us
Oct 25 13:05:34 angelstation kernel: NVRM:     -3    4098 GSP_RUN_CPU_SEQUENCER          0 0x000000000000061c 0x0000000000003fe2 0x000641ff6a256ad8 0x000641ff6a257df8   4896us
Oct 25 13:05:34 angelstation kernel: NVRM:     -4    4108 UCODE_LIBOS_PRINT              0 0x0000000000000000 0x0000000000000000 0x000641f3960fb11b 0x000641f3960fb11c      1us
Oct 25 13:05:34 angelstation kernel: NVRM:     -5    4111 PERF_BRIDGELESS_INFO_          0 0x0000000000000000 0x0000000000000000 0x000641f39608ab1e 0x000641f39608ab1e
Oct 25 13:05:34 angelstation kernel: NVRM:     -6    4108 UCODE_LIBOS_PRINT              0 0x0000000000000000 0x0000000000000000 0x000641f1d4a3d760 0x000641f1d4a3d760
Oct 25 13:05:34 angelstation kernel: NVRM:     -7    4108 UCODE_LIBOS_PRINT              0 0x0000000000000000 0x0000000000000000 0x000641f1d4a3d63e 0x000641f1d4a3d63f      1us
Oct 25 13:05:34 angelstation kernel: CPU: 14 UID: 1000 PID: 5389 Comm: [vkps] Update Tainted: G           O        6.17.4-4-cachyos #1 PREEMPT(full)  aacbcbc2762614d40a34760507e6db194636c35b
Oct 25 13:05:34 angelstation kernel: Tainted: [O]=OOT_MODULE
Oct 25 13:05:34 angelstation kernel: Hardware name: Micro-Star International Co., Ltd. MS-7D09/Z590-A PRO (MS-7D09), BIOS 1.A0 07/11/2024
Oct 25 13:05:34 angelstation kernel: Call Trace:
Oct 25 13:05:34 angelstation kernel:  <TASK>
Oct 25 13:05:34 angelstation kernel:  dump_stack_lvl+0x61/0x80
Oct 25 13:05:34 angelstation kernel:  _kgspRpcRecvPoll+0x404/0x880 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  _issueRpcAndWait+0x5a1/0x800 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? osGetCurrentThread+0x23/0x40 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? rmDeviceGpuLockIsOwner+0x1e/0x70 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? rpcWriteCommonHeader+0x99/0x230 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  rpcRmApiControl_GSP+0x41d/0x6c0 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  RmGssLegacyRpcCmd+0x19f/0x2b0 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? _nvos32FunctionAllocOsDesc+0x80/0x80 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  Nv04ControlWithSecInfo+0x6c/0xb0 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? rmapiInitDeprecatedContext+0xe0/0xe0 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? _rmAllocForDeprecatedApi+0x30/0x30 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? _rmControlForDeprecatedApi+0x20/0x20 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? _rmFreeForDeprecatedApi+0x20/0x20 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? _rmMapMemoryForDeprecatedApi+0x30/0x30 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? _rmCopyUserForDeprecatedApi+0x30/0x30 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? _rmAllocMemForDeprecatedApi+0x10/0x10 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  RmIoctl+0x6ae/0xa60 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  ? os_acquire_spinlock+0x12/0x30 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  rm_ioctl+0x23a/0x480 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  nvidia_unlocked_ioctl+0x5f8/0x7b0 [nvidia c5f1e5b14f5872c3c9e0cac0303376cc790cd99b]
Oct 25 13:05:34 angelstation kernel:  __x64_sys_ioctl+0x73/0xc0
Oct 25 13:05:34 angelstation kernel:  do_syscall_64+0x85/0x200
Oct 25 13:05:34 angelstation kernel:  ? do_futex+0x196/0x1d0
Oct 25 13:05:34 angelstation kernel:  ? __se_sys_futex+0x13d/0x1d0
Oct 25 13:05:34 angelstation kernel:  ? do_syscall_64+0xb6/0x200
Oct 25 13:05:34 angelstation kernel:  ? hrtimer_cancel+0x15/0x30
Oct 25 13:05:34 angelstation kernel:  ? futex_wait+0xd1/0x150
Oct 25 13:05:34 angelstation kernel:  ? __pfx_hrtimer_wakeup+0x10/0x10
Oct 25 13:05:34 angelstation kernel:  ? do_futex+0x16b/0x1d0
Oct 25 13:05:34 angelstation kernel:  ? __rseq_handle_notify_resume+0xf6/0x580
Oct 25 13:05:34 angelstation kernel:  ? arch_exit_to_user_mode_prepare+0x85/0x90
Oct 25 13:05:34 angelstation kernel:  ? do_syscall_64+0xb6/0x200
Oct 25 13:05:34 angelstation kernel:  ? do_syscall_64+0xb6/0x200
Oct 25 13:05:34 angelstation kernel:  ? arch_exit_to_user_mode_prepare+0x85/0x90
Oct 25 13:05:34 angelstation kernel:  ? clear_bhb_loop+0x50/0xa0
Oct 25 13:05:34 angelstation kernel:  ? clear_bhb_loop+0x50/0xa0
Oct 25 13:05:34 angelstation kernel:  entry_SYSCALL_64_after_hwframe+0x76/0x7e
Oct 25 13:05:34 angelstation kernel: RIP: 0033:0x7fdb1af3610f
Oct 25 13:05:34 angelstation kernel: Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <89> c2 3d 00 f0 ff ff 77 18 48 8b 44 24 18>
Oct 25 13:05:34 angelstation kernel: RSP: 002b:00007fdaf57dab70 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
Oct 25 13:05:34 angelstation kernel: RAX: ffffffffffffffda RBX: 00007fdaf57dad80 RCX: 00007fdb1af3610f
Oct 25 13:05:34 angelstation kernel: RDX: 00007fdaf57dad80 RSI: 00000000c020462a RDI: 0000000000000156
Oct 25 13:05:34 angelstation kernel: RBP: 00000000c020462a R08: 00007fdaf57dad80 R09: 00007fdaf57dad9c
Oct 25 13:05:34 angelstation kernel: R10: 00007fdaf57dbdd0 R11: 0000000000000246 R12: 0000000000000156
Oct 25 13:05:34 angelstation kernel: R13: 00007fdaf57dad9c R14: 0000000068fd116e R15: 00007fdaf57dabd0
Oct 25 13:05:34 angelstation kernel:  </TASK>
Oct 25 13:05:34 angelstation kernel: NVRM: Xid (PCI:0000:01:00): 154, GPU recovery action changed from 0x0 (None) to 0x2 (Node Reboot Required)
Oct 25 13:05:40 angelstation kwin_wayland[1348]: Pageflip timed out! This is a bug in the nvidia-drm kernel driver
Oct 25 13:05:40 angelstation kwin_wayland[1348]: Please report this at https://forums.developer.nvidia.com/c/gpu-graphics/linux
Oct 25 13:05:40 angelstation kwin_wayland[1348]: With the output of 'sudo dmesg' and 'journalctl --user-unit plasma-kwin_wayland --boot 0'348]: Pageflip timed out! This is a bug in the nvidia-drm kernel driver
Oct 25 13:05:40 angelstation kwin_wayland[1348]: Please report this at https://forums.developer.nvidia.com/c/gpu-graphics/linux
Oct 25 13:05:40 angelstation kwin_wayland[1348]: With the output of 'sudo dmesg' and 'journalctl --user-unit plasma-kwin_wayland --boot 0'

❯ journalctl --user-unit plasma-kwin_wayland --boot -1
Oct 24 20:46:28 angelstation systemd[1265]: Starting KDE Window Manager...
Oct 24 20:46:28 angelstation systemd[1265]: Started KDE Window Manager.
Oct 24 20:46:29 angelstation kwin_wayland[1348]: No backend specified, automatically choosing drm
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1429]: The XKEYBOARD keymap compiler (xkbcomp) reports:
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1429]: > Warning:          Could not resolve keysym XF86OK
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1429]: > Warning:          Could not resolve keysym XF86GoTo
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1429]: > Warning:          Could not resolve keysym XF86VendorLogo
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1429]: > Warning:          Could not resolve keysym XF86MediaSelectProgramGuide
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1429]: > Warning:          Could not resolve keysym XF86MediaSelectProgramGuide
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1429]: > Warning:          Could not resolve keysym XF86MediaSelectHome
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1429]: > Warning:          Could not resolve keysym XF86MediaLanguageMenu
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1429]: > Warning:          Could not resolve keysym XF86MediaTitleMenu
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1429]: > Warning:          Could not resolve keysym XF86AudioChannelMode
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1429]: > Warning:          Could not resolve keysym XF86MediaSelectPC
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1429]: > Warning:          Could not resolve keysym XF86MediaSelectTV
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1429]: > Warning:          Could not resolve keysym XF86MediaSelectCable
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1429]: > Warning:          Could not resolve keysym XF86MediaSelectVCR
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1429]: > Warning:          Could not resolve keysym XF86MediaSelectVCRPlus
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1429]: > Warning:          Could not resolve keysym XF86MediaSelectSatellite
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1429]: > Warning:          Could not resolve keysym XF86MediaSelectCD
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1429]: > Warning:          Could not resolve keysym XF86MediaSelectTape
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1429]: > Warning:          Could not resolve keysym XF86MediaSelectRadio
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1429]: > Warning:          Could not resolve keysym XF86MediaSelectTuner
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1429]: > Warning:          Could not resolve keysym XF86MediaPlayer
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1429]: > Warning:          Could not resolve keysym XF86MediaSelectTeletext
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1429]: > Warning:          Could not resolve keysym XF86MediaSelectAuxiliary
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1429]: > Warning:          Could not resolve keysym XF86MediaPlaySlow
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1429]: > Warning:          Could not resolve keysym XF86NumberEntryMode
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1429]: > Warning:          Could not resolve keysym XF86RefreshRateToggle
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1429]: > Warning:          Could not resolve keysym XF86Accessibility
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1429]: > Warning:          Could not resolve keysym XF86DoNotDisturb
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1429]: Errors from xkbcomp are not fatal to the X server
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1435]: The XKEYBOARD keymap compiler (xkbcomp) reports:
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1435]: > Warning:          Unsupported maximum keycode 708, clipping.
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1435]: >                   X11 cannot support keycodes above 255.
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1435]: > Warning:          Virtual modifier Hyper multiply defined
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1435]: >                   Using 0, ignoring 0
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1435]: > Warning:          Virtual modifier ScrollLock multiply defined
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1435]: >                   Using 0, ignoring 0
Oct 24 20:46:29 angelstation kwin_wayland_wrapper[1435]: Errors from xkbcomp are not fatal to the X server
Oct 24 20:46:29 angelstation kcminit[1437]: Initializing  "/usr/lib/qt6/plugins/plasma/kcms/systemsettings/kcm_fonts.so"
Oct 24 20:46:29 angelstation kcminit[1437]: Initializing  "/usr/lib/qt6/plugins/plasma/kcms/systemsettings/kcm_style.so"
Oct 24 20:47:29 angelstation kwin_wayland[1348]: Failed to open /dev/dri/renderD128 device (No such device)
Oct 24 20:47:29 angelstation kwin_wayland[1348]: failed to open drm device at "/dev/dri/renderD128"
Oct 24 20:47:29 angelstation kwin_wayland[1348]: failed to open drm device at ""
Oct 24 20:47:29 angelstation kwin_wayland[1348]: failed to open drm device at ""
Oct 24 20:47:29 angelstation kwin_wayland[1348]: failed to open drm device at ""
Oct 24 20:47:29 angelstation kwin_wayland[1348]: failed to open drm device at ""
Oct 24 21:01:50 angelstation kwin_wayland[1348]: Failed to delay sleep: Sender is not authorized to send message
Oct 25 12:58:34 angelstation kwin_wayland[1348]: Atomic modeset test failed! Permission denied
Oct 25 12:58:34 angelstation kwin_wayland[1348]: Setting dpms mode failed!
Oct 25 13:05:40 angelstation kwin_wayland[1348]: Pageflip timed out! This is a bug in the nvidia-drm kernel driver
Oct 25 13:05:40 angelstation kwin_wayland[1348]: Please report this at https://forums.developer.nvidia.com/c/gpu-graphics/linux
Oct 25 13:05:40 angelstation kwin_wayland[1348]: With the output of 'sudo dmesg' and 'journalctl --user-unit plasma-kwin_wayland --boot 0'