570 release feedback & discussion

More and more kernel symbols become GPL-only and additionally open-source kernel modules can be signed with MOK for secure boot. Therefore maintaining the closed-source branch becomes more and more difficult and is a waste of the engineering team time, which is criminally understaffed anyway (yes, this should be extremely embarrassing for Nvidia, but they just don’t care).

2 Likes

570 crash report. Crashed weirdly right after exiting a game (expedition 33.). See attached nvidia-bug-report.log.gz
nvidia-bug-report.log.gz (934.4 KB)

Hello, I encountered a GSP wait RPC timeout issue. the log is as follows:

[   11.687184] NVRM: loading NVIDIA UNIX Open Kernel Module for aarch64  570.169  Release Build  (root@ubuntu22)  2025 06 27  16:24:12 CST
[2025-07-25 10:23:19]  [   13.195299] NVRM: kbifInitLtr_GB202: LTR is disabled in the hierarchy
[2025-07-25 10:23:19]  [ 1329.753371] NVRM: _kgspLogXid119: ********************************* GSP Timeout **********************************
[2025-07-25 10:23:19]  [ 1329.753377] NVRM: _kgspLogXid119: Note: Please also check logs above.
[2025-07-25 10:23:19]  [ 1329.753387] NVRM: GPU at PCI:0000:01:00: GPU-7a5cb836-7e15-e433-8092-d38627c2dc9a
[2025-07-25 10:23:19]  [ 1329.753390] NVRM: GPU Board Serial Number: 0
[2025-07-25 10:23:19]  [ 1329.753392] NVRM: Xid (PCI:0000:01:00): 119, pid=11349, name=python, Timeout after 45s of waiting for RPC response from GPU0 GSP! Expected function 76 (GSP_RM_CONTROL) (0x20801702 0x4).
[2025-07-25 10:23:19]  [ 1329.753399] NVRM: GPU0 GSP RPC buffer contains function 76 (GSP_RM_CONTROL) and data 0x0000000020801702 0x0000000000000004.
[2025-07-25 10:23:19]  [ 1329.753402] NVRM: GPU0 RPC history (CPU -> GSP):
[2025-07-25 10:23:19]  [ 1329.753403] NVRM:     entry function                   data0              data1              ts_start           ts_end             duration actively_polling
[2025-07-25 10:23:19]  [ 1329.753404] NVRM:      0    76   GSP_RM_CONTROL        0x0000000020801702 0x0000000000000004 0x00063ab730f3bf0c 0x0000000000000000          y
[2025-07-25 10:23:19]  [ 1329.753408] NVRM:     -1    76   GSP_RM_CONTROL        0x0000000000802009 0x0000000000000001 0x00063ab730dffe2f 0x00063ab730e1f84a 129563us  
[2025-07-25 10:23:19]  [ 1329.753411] NVRM:     -2    76   GSP_RM_CONTROL        0x00000000a06c0103 0x0000000000000008 0x00063ab730dff93f 0x00063ab730dffa1e    223us  
[2025-07-25 10:23:19]  [ 1329.753414] NVRM:     -3    76   GSP_RM_CONTROL        0x0000000020801210 0x0000000000000020 0x00063ab730dff7c0 0x00063ab730dff92d    365us  
[2025-07-25 10:23:19]  [ 1329.753417] NVRM:     -4    76   GSP_RM_CONTROL        0x0000000083de0309 0x0000000000000004 0x00063ab730dff6ed 0x00063ab730dff7ac    191us  
[2025-07-25 10:23:19]  [ 1329.753420] NVRM:     -5    103  GSP_RM_ALLOC          0x0000000000000079 0x0000000000000018 0x00063ab730dff5f7 0x00063ab730dff6ac    181us  
[2025-07-25 10:23:19]  [ 1329.753422] NVRM:     -6    103  GSP_RM_ALLOC          0x0000000000000079 0x0000000000000018 0x00063ab730dff51a 0x00063ab730dff5c5    171us  
[2025-07-25 10:23:19]  [ 1329.753425] NVRM:     -7    103  GSP_RM_ALLOC          0x0000000000000079 0x0000000000000018 0x00063ab730dff436 0x00063ab730dff4e6    176us  
[2025-07-25 10:23:19]  [ 1329.753427] NVRM: GPU0 RPC event history (CPU <- GSP):
[2025-07-25 10:23:19]  [ 1329.753428] NVRM:     entry function                   data0              data1              ts_start           ts_end             duration during_incomplete_rpc
[2025-07-25 10:23:19]  [ 1329.753431] NVRM:      0    4124 GSP_LOCKDOWN_NOTICE   0x0000000000000000 0x0000000000000000 0x00063ab6e5392088 0x00063ab6e5392089      1us  
[2025-07-25 10:23:19]  [ 1329.753434] NVRM:     -1    4124 GSP_LOCKDOWN_NOTICE   0x0000000000000001 0x0000000000000000 0x00063ab6e5390db5 0x00063ab6e5390db5           
[2025-07-25 10:23:19]  [ 1329.753436] NVRM:     -2    4124 GSP_LOCKDOWN_NOTICE   0x0000000000000000 0x0000000000000000 0x00063ab6e5390ce9 0x00063ab6e5390ce9           
[2025-07-25 10:23:19]  [ 1329.753438] NVRM:     -3    4124 GSP_LOCKDOWN_NOTICE   0x0000000000000001 0x0000000000000000 0x00063ab6e539097c 0x00063ab6e539097c           
[2025-07-25 10:23:19]  [ 1329.753441] NVRM:     -4    4124 GSP_LOCKDOWN_NOTICE   0x0000000000000000 0x0000000000000000 0x00063ab6e537ae66 0x00063ab6e537ae67      1us  
[2025-07-25 10:23:19]  [ 1329.753443] NVRM:     -5    4124 GSP_LOCKDOWN_NOTICE   0x0000000000000001 0x0000000000000000 0x00063ab6e537add4 0x00063ab6e537add4           
[2025-07-25 10:23:19]  [ 1329.753445] NVRM:     -6    4124 GSP_LOCKDOWN_NOTICE   0x0000000000000000 0x0000000000000000 0x00063ab6e5379fe8 0x00063ab6e5379fe9      1us  
[2025-07-25 10:23:19]  [ 1329.753448] NVRM:     -7    4124 GSP_LOCKDOWN_NOTICE   0x0000000000000001 0x0000000000000000 0x00063ab6e53788de 0x00063ab6e53788de           
[2025-07-25 10:23:19]  [ 1329.758203] NVRM: _kgspLogXid119: ********************************************************************************
[2025-07-25 10:23:19]  [ 1329.758207] NVRM: _issueRpcAndWait: rpcRecvPoll timedout for fn 76!
[2025-07-25 10:23:19]  [ 1329.758210] NVRM: subdeviceCtrlCmdMcServiceInterrupts_IMPL: NVRM_RPC: NV2080_CTRL_CMD_MC_SERVICE_INTERRUPTS failed with error 0x65
[2025-07-25 10:23:19]  [ 1375.760855] NVRM: Xid (PCI:0000:01:00): 119, pid=11349, name=python, Timeout after 45s of waiting for RPC response from GPU0 GSP! Expected function 76 (GSP_RM_CONTROL) (0x20801702 0x4).
[2025-07-25 10:23:19]  [ 1375.760868] NVRM: _issueRpcAndWait: rpcRecvPoll timedout for fn 76!
[2025-07-25 10:23:19]  [ 1375.760872] NVRM: subdeviceCtrlCmdMcServiceInterrupts_IMPL: NVRM_RPC: NV2080_CTRL_CMD_MC_SERVICE_INTERRUPTS failed with error 0x65
[2025-07-25 10:23:19]  [ 1421.767418] NVRM: Xid (PCI:0000:01:00): 119, pid=11349, name=python, Timeout after 45s of waiting for RPC response from GPU0 GSP! Expected function 76 (GSP_RM_CONTROL) (0x20801702 0x4).
[2025-07-25 10:23:19]  [ 1421.767430] NVRM: _issueRpcAndWait: rpcRecvPoll timedout for fn 76!
[2025-07-25 10:23:19]  [ 1421.767433] NVRM: subdeviceCtrlCmdMcServiceInterrupts_IMPL: NVRM_RPC: NV2080_CTRL_CMD_MC_SERVICE_INTERRUPTS failed with error 0x65
[2025-07-25 10:23:19]  [ 1467.768044] NVRM: Rate limiting GSP RPC error prints for GPU at PCI:0000:01:00 (printing 1 of every 30).  The GPU likely needs to be reset.
[2025-07-25 10:23:19]  [ 1467.768054] NVRM: subdeviceCtrlCmdMcServiceInterrupts_IMPL: NVRM_RPC: NV2080_CTRL_CMD_MC_SERVICE_INTERRUPTS failed with error 0x65
[2025-07-25 10:23:19]  [ 1513.770740] NVRM: subdeviceCtrlCmdMcServiceInterrupts_IMPL: NVRM_RPC: NV2080_CTRL_CMD_MC_SERVICE_INTERRUPTS failed with error 0x65
[2025-07-25 10:23:19]  [ 1559.771482] NVRM: subdeviceCtrlCmdMcServiceInterrupts_IMPL: NVRM_RPC: NV2080_CTRL_CMD_MC_SERVICE_INTERRUPTS failed with error 0x65
[2025-07-25 10:23:19]  [ 1605.776261] NVRM: subdeviceCtrlCmdMcServiceInterrupts_IMPL: NVRM_RPC: NV2080_CTRL_CMD_MC_SERVICE_INTERRUPTS failed with error 0x65
[2025-07-25 10:23:19]  [ 1651.777081] NVRM: subdeviceCtrlCmdMcServiceInterrupts_IMPL: NVRM_RPC: NV2080_CTRL_CMD_MC_SERVICE_INTERRUPTS failed with error 0x65
[2025-07-25 10:23:19]  [ 1697.777925] NVRM: subdeviceCtrlCmdMcServiceInterrupts_IMPL: NVRM_RPC: NV2080_CTRL_CMD_MC_SERVICE_INTERRUPTS failed with error 0x65
[2025-07-25 10:23:19]  [ 1743.781796] NVRM: subdeviceCtrlCmdMcServiceInterrupts_IMPL: NVRM_RPC: NV2080_CTRL_CMD_MC_SERVICE_INTERRUPTS failed with error 0x65
[2025-07-25 10:23:19]  [ 1788.784711] NVRM: nvAssertOkFailedNoLog: Assertion failed: Call timed out [NV_ERR_TIMEOUT] (0x00000065) returned from pRmApi->Control(pRmApi, RES_GET_CLIENT_HANDLE(pKernelChannel), RES_GET_HANDLE(pKernelChannel), NVA06F_CTRL_CMD_STOP_CHANNEL, &stopChannelParams, sizeof(stopChannelParams)) @ nv_gpu_ops.c:10448
[2025-07-25 10:23:19]  [ 1833.785614] NVRM: nvAssertOkFailedNoLog: Assertion failed: Call timed out [NV_ERR_TIMEOUT] (0x00000065) returned from pRmApi->Control(pRmApi, RES_GET_CLIENT_HANDLE(pKernelChannel), RES_GET_HANDLE(pKernelChannel), NVA06F_CTRL_CMD_STOP_CHANNEL, &stopChannelParams, sizeof(stopChannelParams)) @ nv_gpu_ops.c:10448
[2025-07-25 10:23:19]  [ 1878.786526] NVRM: nvAssertOkFailedNoLog: Assertion failed: Call timed out [NV_ERR_TIMEOUT] (0x00000065) returned from pRmApi->Control(pRmApi, RES_GET_CLIENT_HANDLE(pKernelChannel), RES_GET_HANDLE(pKernelChannel), NVA06F_CTRL_CMD_STOP_CHANNEL, &stopChannelParams, sizeof(stopChannelParams)) @ nv_gpu_ops.c:10448
[2025-07-25 10:23:19]  [ 1923.787556] NVRM: nvAssertOkFailedNoLog: Assertion failed: Call timed out [NV_ERR_TIMEOUT] (0x00000065) returned from pRmApi->Control(pRmApi, RES_GET_CLIENT_HANDLE(pKernelChannel), RES_GET_HANDLE(pKernelChannel), NVA06F_CTRL_CMD_STOP_CHANNEL, &stopChannelParams, sizeof(stopChannelParams)) @ nv_gpu_ops.c:10448
[2025-07-25 10:23:19]  [ 1968.788401] NVRM: nvAssertOkFailedNoLog: Assertion failed: Call timed out [NV_ERR_TIMEOUT] (0x00000065) returned from pRmApi->Control(pRmApi, RES_GET_CLIENT_HANDLE(pKernelChannel), RES_GET_HANDLE(pKernelChannel), NVA06F_CTRL_CMD_STOP_CHANNEL, &stopChannelParams, sizeof(stopChannelParams)) @ nv_gpu_ops.c:10448
[2025-07-25 10:23:19]  [ 2013.789358] NVRM: nvAssertOkFailedNoLog: Assertion failed: Call timed out [NV_ERR_TIMEOUT] (0x00000065) returned from pRmApi->Control(pRmApi, RES_GET_CLIENT_HANDLE(pKernelChannel), RES_GET_HANDLE(pKernelChannel), NVA06F_CTRL_CMD_STOP_CHANNEL, &stopChannelParams, sizeof(stopChannelParams)) @ nv_gpu_ops.c:10448
[2025-07-25 10:23:19]  [ 2058.790308] NVRM: nvAssertOkFailedNoLog: Assertion failed: Call timed out [NV_ERR_TIMEOUT] (0x00000065) returned from pRmApi->Control(pRmApi, RES_GET_CLIENT_HANDLE(pKernelChannel), RES_GET_HANDLE(pKernelChannel), NVA06F_CTRL_CMD_STOP_CHANNEL, &stopChannelParams, sizeof(stopChannelParams)) @ nv_gpu_ops.c:10448
[2025-07-25 10:23:19]  [ 2103.791396] NVRM: nvAssertOkFailedNoLog: Assertion failed: Call timed out [NV_ERR_TIMEOUT] (0x00000065) returned from pRmApi->Control(pRmApi, RES_GET_CLIENT_HANDLE(pKernelChannel), RES_GET_HANDLE(pKernelChannel), NVA06F_CTRL_CMD_STOP_CHANNEL, &stopChannelParams, sizeof(stopChannelParams)) @ nv_gpu_ops.c:10448
[2025-07-25 10:23:19]  [ 2148.792490] NVRM: nvAssertOkFailedNoLog: Assertion failed: Call timed out [NV_ERR_TIMEOUT] (0x00000065) returned from pRmApi->Control(pRmApi, RES_GET_CLIENT_HANDLE(pKernelChannel), RES_GET_HANDLE(pKernelChannel), NVA06F_CTRL_CMD_STOP_CHANNEL, &stopChannelParams, sizeof(stopChannelParams)) @ nv_gpu_ops.c:10448
[2025-07-25 10:23:19]  [ 2193.793740] NVRM: nvAssertOkFailedNoLog: Assertion failed: Call timed out [NV_ERR_TIMEOUT] (0x00000065) returned from pRmApi->Control(pRmApi, retainedChannel->session->handle, retainedChannel->rmSubDevice->subDeviceHandle, NV2080_CTRL_CMD_GPU_EVICT_CTX, &params, sizeof(params)) @ nv_gpu_ops.c:10468
[2025-07-25 10:23:19]  [ 2238.794678] NVRM: nvAssertOkFailedNoLog: Assertion failed: Call timed out [NV_ERR_TIMEOUT] (0x00000065) returned from pRmApi->Control(pRmApi, RES_GET_CLIENT_HANDLE(pKernelChannel), RES_GET_HANDLE(pKernelChannel), NVA06F_CTRL_CMD_STOP_CHANNEL, &stopChannelParams, sizeof(stopChannelParams)) @ nv_gpu_ops.c:10448
[2025-07-25 10:23:19]  [ 2283.795745] NVRM: nvAssertOkFailedNoLog: Assertion failed: Call timed out [NV_ERR_TIMEOUT] (0x00000065) returned from pRmApi->Control(pRmApi, retainedChannel->session->handle, retainedChannel->rmSubDevice->subDeviceHandle, NV2080_CTRL_CMD_GPU_EVICT_CTX, &params, sizeof(params)) @ nv_gpu_ops.c:10468
[2025-07-25 10:23:19]  [ 2328.796816] NVRM: nvAssertOkFailedNoLog: Assertion failed: Call timed out [NV_ERR_TIMEOUT] (0x00000065) returned from pRmApi->Control(pRmApi, RES_GET_CLIENT_HANDLE(pKernelChannel), RES_GET_HANDLE(pKernelChannel), NVA06F_CTRL_CMD_STOP_CHANNEL, &stopChannelParams, sizeof(stopChannelParams)) @ nv_gpu_ops.c:10448
[2025-07-25 10:23:19]  [ 2373.797963] NVRM: nvAssertOkFailedNoLog: Assertion failed: Call timed out [NV_ERR_TIMEOUT] (0x00000065) returned from pRmApi->Control(pRmApi, retainedChannel->session->handle, retainedChannel->rmSubDevice->subDeviceHandle, NV2080_CTRL_CMD_GPU_EVICT_CTX, &params, sizeof(params)) @ nv_gpu_ops.c:10468
[2025-07-25 10:23:19]  [ 2418.798955] NVRM: nvAssertOkFailedNoLog: Assertion failed: Call timed out [NV_ERR_TIMEOUT] (0x00000065) returned from pRmApi->Control(pRmApi, RES_GET_CLIENT_HANDLE(pKernelChannel), RES_GET_HANDLE(pKernelChannel), NVA06F_CTRL_CMD_STOP_CHANNEL, &stopChannelParams, sizeof(stopChannelParams)) @ nv_gpu_ops.c:10448
[2025-07-25 10:23:19]  [ 2463.800019] NVRM: nvAssertOkFailedNoLog: Assertion failed: Call timed out [NV_ERR_TIMEOUT] (0x00000065) returned from pRmApi->Control(pRmApi, retainedChannel->session->handle, retainedChannel->rmSubDevice->subDeviceHandle, NV2080_CTRL_CMD_GPU_EVICT_CTX, &params, sizeof(params)) @ nv_gpu_ops.c:10468
[2025-07-25 10:23:19]  [ 2508.801056] NVRM: nvAssertOkFailedNoLog: Assertion failed: Call timed out [NV_ERR_TIMEOUT] (0x00000065) returned from pRmApi->Control(pRmApi, RES_GET_CLIENT_HANDLE(pKernelChannel), RES_GET_HANDLE(pKernelChannel), NVA06F_CTRL_CMD_STOP_CHANNEL, &stopChannelParams, sizeof(stopChannelParams)) @ nv_gpu_ops.c:10448
[2025-07-25 10:23:19]  [ 2553.802102] NVRM: nvAssertOkFailedNoLog: Assertion failed: Call timed out [NV_ERR_TIMEOUT] (0x00000065) returned from pRmApi->Control(pRmApi, retainedChannel->session->handle, retainedChannel->rmSubDevice->subDeviceHandle, NV2080_CTRL_CMD_GPU_EVICT_CTX, &params, sizeof(params)) @ nv_gpu_ops.c:10468
[2025-07-25 10:23:19]  [ 2598.803143] NVRM: nvAssertOkFailedNoLog: Assertion failed: Call timed out [NV_ERR_TIMEOUT] (0x00000065) returned from pRmApi->Control(pRmApi, RES_GET_CLIENT_HANDLE(pKernelChannel), RES_GET_HANDLE(pKernelChannel), NVA06F_CTRL_CMD_STOP_CHANNEL, &stopChannelParams, sizeof(stopChannelParams)) @ nv_gpu_ops.c:10448
[2025-07-25 10:23:19]  [ 2643.804181] NVRM: Xid (PCI:0000:01:00): 119, pid=11349, name=python, Timeout after 45s of waiting for RPC response from GPU0 GSP! Expected function 76 (GSP_RM_CONTROL) (0x2080012c 0x14).
[2025-07-25 10:23:19]  [ 2643.804195] NVRM: _issueRpcAndWait: rpcRecvPoll timedout for fn 76!
[2025-07-25 10:23:19]  [ 2643.804207] NVRM: nvAssertOkFailedNoLog: Assertion failed: Call timed out [NV_ERR_TIMEOUT] (0x00000065) returned from pRmApi->Control(pRmApi, retainedChannel->session->handle, retainedChannel->rmSubDevice->subDeviceHandle, NV2080_CTRL_CMD_GPU_EVICT_CTX, &params, sizeof(params)) @ nv_gpu_ops.c:10468
[2025-07-25 10:23:19]  [ 2688.805232] NVRM: nvAssertOkFailedNoLog: Assertion failed: Call timed out [NV_ERR_TIMEOUT] (0x00000065) returned from pRmApi->Control(pRmApi, RES_GET_CLIENT_HANDLE(pKernelChannel), RES_GET_HANDLE(pKernelChannel), NVA06F_CTRL_CMD_STOP_CHANNEL, &stopChannelParams, sizeof(stopChannelParams)) @ nv_gpu_ops.c:10448
[2025-07-25 10:23:19]  [ 2733.806358] NVRM: nvAssertOkFailedNoLog: Assertion failed: Call timed out [NV_ERR_TIMEOUT] (0x00000065) returned from pRmApi->Control(pRmApi, retainedChannel->session->handle, retainedChannel->rmSubDevice->subDeviceHandle, NV2080_CTRL_CMD_GPU_EVICT_CTX, &params, sizeof(params)) @ nv_gpu_ops.c:10468
[2025-07-25 10:23:19]  [ 2778.807297] NVRM: nvAssertOkFailedNoLog: Assertion failed: Call timed out [NV_ERR_TIMEOUT] (0x00000065) returned from pRmApi->Control(pRmApi, RES_GET_CLIENT_HANDLE(pKernelChannel), RES_GET_HANDLE(pKernelChannel), NVA06F_CTRL_CMD_STOP_CHANNEL, &stopChannelParams, sizeof(stopChannelParams)) @ nv_gpu_ops.c:10448
[2025-07-25 10:23:19]  [ 2823.808412] NVRM: nvAssertOkFailedNoLog: Assertion failed: Call timed out [NV_ERR_TIMEOUT] (0x00000065) returned from pRmApi->Control(pRmApi, retainedChannel->session->handle, retainedChannel->rmSubDevice->subDeviceHandle, NV2080_CTRL_CMD_GPU_EVICT_CTX, &params, sizeof(params)) @ nv_gpu_ops.c:10468
[2025-07-25 10:23:19]  [ 3138.816468] NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ rs_client.c:843
[2025-07-25 10:23:19]  [ 3138.816494] NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ rs_server.c:259
[2025-07-25 10:23:19]  [ 3138.816511] NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ rs_server.c:1375

Hello Andre, Did you get chance to test it on AMD?

Yes, but it is still ongoing. They’ve already sent me a couple of patches which seemed to improve the situation (the error moved further down the execution path), but still did not completely fix it. The discussion is happening on their gitlab.

1 Like

I tried with 570 drivers again as it came with Tuxedo OS in a newer KDE Plasma version (fresh installed on 2025-07-05 and not often in use since then).

And I got a black screen again and only possibility was to switch pc off via pressing power button for 5 seconds.

Operating System: TUXEDO OS
KDE Plasma Version: 6.3.5
KDE Frameworks Version: 6.15.0
Qt Version: 6.8.2
Kernel Version: 6.11.0-120029-tuxedo (64-bit)
Graphics Platform: X11
Processors: 16 × AMD Ryzen 7 7800X3D 8-Core Processor
Memory: 62.4 GiB of RAM
Graphics Processor: NVIDIA GeForce RTX 4090
Manufacturer: ASUS
~$ inxi -GxxxZ
Graphics:
  Device-1: NVIDIA AD102 [GeForce RTX 4090] vendor: ASUSTeK driver: nvidia
    v: 570.153.02 arch: Lovelace pcie: speed: 2.5 GT/s lanes: 16 ports:
    active: none off: DP-1 empty: DP-2, DP-3, HDMI-A-1, HDMI-A-2
    bus-ID: 01:00.0 chip-ID: 10de:2684 class-ID: 0300
  Display: x11 server: X.Org v: 21.1.11 with: Xwayland v: 24.1.7
    compositor: kwin_x11 driver: X: loaded: nvidia
    unloaded: fbdev,modesetting,nouveau,vesa gpu: nvidia,nvidia-nvswitch
    display-ID: :0 screens: 1
  Screen-1: 0 s-res: 2560x1440 s-dpi: 108 s-size: 602x333mm (23.70x13.11")
    s-diag: 688mm (27.09")
  Monitor-1: DP-1 mapped: DP-0 note: disabled model: MSI MAG 274QRFW
    serial: CC2HE74300349 res: mode: 2560x1440 hz: 180 scale: 100% (1) dpi: 108
    size: 600x330mm (23.62x12.99") diag: 685mm (27") modes: max: 2560x1440
    min: 640x480
  API: EGL v: 1.5 hw: drv: nvidia platforms: device: 0 drv: nvidia device: 2
    drv: swrast gbm: drv: nvidia surfaceless: drv: nvidia x11: drv: nvidia
    inactive: wayland,device-1
  API: OpenGL v: 4.6.0 compat-v: 4.5 vendor: nvidia mesa v: 570.153.02
    glx-v: 1.4 direct-render: yes renderer: NVIDIA GeForce RTX 4090/PCIe/SSE2
  API: Vulkan v: 1.4.315 layers: 7 surfaces: xcb,xlib device: 0
    type: discrete-gpu driver: nvidia device-ID: 10de:2684 device: 1 type: cpu
    driver: mesa llvmpipe device-ID: 10005:0000
  Info: Tools: api: clinfo, eglinfo, glxinfo, vulkaninfo
    de: kscreen-console,kscreen-doctor gpu: nvidia-settings,nvidia-smi
    wl: wayland-info x11: xdriinfo, xdpyinfo, xprop, xrandr
Aug 05 16:41:40 ANDROMEDA kernel: NVRM: nvAssertFailedNoLog: Assertion failed: GPPut < WATCHDOG_GPFIFO_ENTRIES @ kernel_rc_watchdog.c:1431
Aug 05 16:41:50 ANDROMEDA kernel: NVRM: krcWatchdog_IMPL: RC watchdog: GPU is probably locked!  Notify Timeout Seconds: 7
Aug 05 16:41:55 ANDROMEDA kernel: Bluetooth: hci0: ACL packet for unknown connection handle 3837
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: kgspHealthCheck_TU102: ****************************** GSP-CrashCat Report *******************************
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: GPU at PCI:0000:01:00: GPU-607aa084-1cf9-f43c-65b1-4be9d9db92f3
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: Xid (PCI:0000:01:00): 120, GSP task panic: unknown error (0) @ pc:0x1001b30, aux:0x0, partition:2#0, task:1
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:     Reported by libos partition:2#4 kernel v3.1 [0] @ ts:1754404914
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:     RISC-V CSR State:
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:         sstatus:0x0000000200000020  sscratch:0xffffffffa3012030     sie:0x0000000000000220  sip:0x0000000000000000
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:         sepc:0x0000000001001b30     stval:0x0000000000000000  scause:0x0000000000000002
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:     RISC-V GPR State:
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:         ra:0x0000000001004304   sp:0x0000000000307b30   gp:0x0000000000000000   tp:0x0000000000000000
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:         a0:0x1858e5f9782634e0   a1:0x0000000000307ac8   a2:0x0000000000002000   a3:0x0000000004000008
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:         a4:0x0000000000600000   a5:0x000000000000191d   a6:0x0000000000000004   a7:0x0000000004003190
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:         s0:0x0000000000307b40   s1:0x00000000040028e8   s2:0x0000000004001000   s3:0x0000000000000000
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:         s4:0x0000000004002000   s5:0x0000000004003180   s6:0x000000000000002a   s7:0x000000000000002f
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:         s8:0x0000000004003150   s9:0x0000000004002000  s10:0x0000000000000000  s11:0x0000000004001000
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:         t0:0x0000000000000024   t1:0x0000000000000004   t2:0x0000000000000000   t3:0x0000000004003198
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:         t4:0x0000000000000001   t5:0x0000000001007468   t6:0xfffffffffffffff6
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:     Stack Trace:
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:         0x0000000001001b30
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:         0x0000000001004304
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:         0x000000000100687a
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:         0x00000000010067ec
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:     PC Trace:
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:         0x0000000001001b30  0x0000000001004300  0xffffffff93009c54  0x00000000010042fc  0x0000000001002870
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:         0x00000000010014c2  0x000000000100117e  0xffffffff93002c3e  0x0000000001001180  0x00000000010014b8
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:         0x0000000001002852  0x0000000001002734  0x000000000100245a  0xffffffff93009c54
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:     Local I/O Register State:
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:         0x01281500:0x00000000   0x01281504:0xbadf5041   0x01281508:0x0010ec10   0x01281510:0x00000000
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:         0x01281528:0x01049042   0x0128152c:0x01000040   0x01281530:0x00000000   0x01280008:0x00000040
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:     ------------[ end crash report ]------------
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: GPU0 GSP RPC buffer contains function 4128 (GSP_POST_NOCAT_RECORD) and data 0x0000000000000005 0x000000c7017a4d24.
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: GPU0 RPC history (CPU -> GSP):
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:     entry function                   data0              data1              ts_start           ts_end             duration actively_polling
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:      0    76   GSP_RM_CONTROL        0x000000002080a097 0x0000000000000490 0x00063b9f39780890 0x0000000000000000          y
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:     -1    76   GSP_RM_CONTROL        0x0000000020800a6a 0x0000000000000000 0x00063b9f3977f092 0x00063b9f3978086c   6106us  
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:     -2    76   GSP_RM_CONTROL        0x0000000020800a4c 0x0000000000000004 0x00063b9f38fd21b5 0x00063b9f38fd229c    231us  
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:     -3    76   GSP_RM_CONTROL        0x0000000020800a4c 0x0000000000000004 0x00063b9f38fd20fd 0x00063b9f38fd2188    139us  
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:     -4    76   GSP_RM_CONTROL        0x0000000020808513 0x0000000000000598 0x00063b9f38e51d01 0x00063b9f38fd209d   1573ms  
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:     -5    76   GSP_RM_CONTROL        0x0000000020800a4c 0x0000000000000004 0x00063b9f38a10096 0x00063b9f38a10120    138us  
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:     -6    76   GSP_RM_CONTROL        0x0000000020800a4c 0x0000000000000004 0x00063b9f38a0fd08 0x00063b9f38a10082    890us  
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:     -7    76   GSP_RM_CONTROL        0x000000002080852f 0x0000000000000308 0x00063b9f38956a0a 0x00063b9f38956bf2    488us  
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: GPU0 RPC event history (CPU <- GSP):
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:     entry function                   data0              data1              ts_start           ts_end             duration during_incomplete_rpc
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:      0    4128 GSP_POST_NOCAT_RECORD 0x0000000000000005 0x000000c7017a4d24 0x00063b9f39b5138a 0x00063b9f39b5138a          y
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:     -1    4128 GSP_POST_NOCAT_RECORD 0x0000000000000005 0x0000000001a97c66 0x00063b9f39b51315 0x00063b9f39b51315          y
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:     -2    4128 GSP_POST_NOCAT_RECORD 0x0000000000000005 0x000002a4010a30b2 0x00063b9f39b51302 0x00063b9f39b51304      2us y
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:     -3    4128 GSP_POST_NOCAT_RECORD 0x0000000000000005 0x0000000001a97c66 0x00063b9f397805de 0x00063b9f397805de           
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:     -4    4128 GSP_POST_NOCAT_RECORD 0x0000000000000005 0x000002a4010a30b2 0x00063b9f397805c0 0x00063b9f397805c1      1us  
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:     -5    4128 GSP_POST_NOCAT_RECORD 0x0000000000000005 0x000000000109e7d0 0x00063b9f3977f561 0x00063b9f3977f562      1us  
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:     -6    4128 GSP_POST_NOCAT_RECORD 0x0000000000000005 0x000000000109e7d0 0x00063b9f3977f561 0x00063b9f3977f561           
Aug 05 16:41:55 ANDROMEDA kernel: NVRM:     -7    4128 GSP_POST_NOCAT_RECORD 0x0000000000000005 0x000000000109e7d0 0x00063b9f3977f560 0x00063b9f3977f561      1us  
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: kgspRcAndNotifyAllChannels_IMPL: RC all user channels for critical error 120.
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8647eb9c0 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: currentTime: f88d8648dfc00 >= f88d828d4ad80
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _threadNodeCheckTimeout: _threadNodeCheckTimeout: Timeout was set to: 4000 msecs!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: kgspHealthCheck_TU102: **********************************************************************************
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: _issueRpcAndWait: rpcRecvPoll failed with status 0x00000062 for fn 4128!
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: nvAssertFailedNoLog: Assertion failed: GPPut < WATCHDOG_GPFIFO_ENTRIES @ kernel_rc_watchdog.c:1431
Aug 05 16:41:55 ANDROMEDA kernel: NVRM: Xid (PCI:0000:01:00): 154, GPU recovery action changed from 0x0 (None) to 0x1 (GPU Reset Required)
Aug 05 16:41:55 ANDROMEDA wireplumber[1960]: spa.audioconvert: 0x608219d83850: (0 suppressed) out of buffers on port 0 3
Aug 05 16:41:55 ANDROMEDA psensor[2357]: [2025-08-05T14:41:55] [ERR] nvctrl: Failed to retrieve measure of type 50204 for NVIDIA GPU 0
Aug 05 16:41:56 ANDROMEDA kernel: usb 1-6: USB disconnect, device number 4
Aug 05 16:42:03 ANDROMEDA kernel: NVRM: krcWatchdog_IMPL: RC watchdog: GPU is probably locked!  Notify Timeout Seconds: 7
Aug 05 16:42:03 ANDROMEDA kernel: NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ rs_client.c:843
Aug 05 16:42:03 ANDROMEDA kernel: NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ rs_server.c:259
Aug 05 16:42:03 ANDROMEDA kernel: NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ rs_server.c:1375
Aug 05 16:42:03 ANDROMEDA kernel: NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ rs_client.c:843
Aug 05 16:42:03 ANDROMEDA kernel: NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ rs_server.c:259
Aug 05 16:42:03 ANDROMEDA kernel: NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ rs_server.c:1375
Aug 05 16:42:03 ANDROMEDA kernel: NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ rs_client.c:843
Aug 05 16:42:03 ANDROMEDA kernel: NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ rs_server.c:259
Aug 05 16:42:03 ANDROMEDA kernel: NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ rs_server.c:1375
Aug 05 16:42:03 ANDROMEDA kernel: NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ rs_client.c:843
Aug 05 16:42:03 ANDROMEDA kernel: NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ rs_server.c:259
Aug 05 16:42:03 ANDROMEDA kernel: NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ rs_server.c:1375
Aug 05 16:42:03 ANDROMEDA kernel: NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ rs_client.c:843
Aug 05 16:42:03 ANDROMEDA kernel: NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ rs_server.c:259
Aug 05 16:42:03 ANDROMEDA kernel: NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ rs_server.c:1375
Aug 05 16:42:03 ANDROMEDA kernel: NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ rs_client.c:843
Aug 05 16:42:03 ANDROMEDA kernel: NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ rs_server.c:259
Aug 05 16:42:03 ANDROMEDA kernel: NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ rs_server.c:1375
Aug 05 16:42:03 ANDROMEDA kernel: NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ rs_client.c:843
Aug 05 16:42:03 ANDROMEDA kernel: NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ rs_server.c:259
Aug 05 16:42:03 ANDROMEDA kernel: NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ rs_server.c:1375
Aug 05 16:42:03 ANDROMEDA kernel: NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ rs_client.c:843
Aug 05 16:42:03 ANDROMEDA kernel: NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ rs_server.c:259
Aug 05 16:42:03 ANDROMEDA kernel: NVRM: nvAssertFailedNoLog: Assertion failed: status == NV_OK @ rs_server.c:1375

nvidia-bug-report.log_NVME0N1P2_2025-08-05_01.gz (808.5 KB)

Glad to hear that, if you still looking for support from Nvidia engineering team then we will keep requested bug open or else we would like to archive it.

Moved from: 575 release feedback & discussion

Logs for 2 x black screen (see attached files).

nvidia v570 bug report_NVME0N1P2_2025-08-07_01.txt (93.3 KB)
nvidia-bug-report.log_NVME0N1P2_2025-08-07_01.gz (758.6 KB)

nvidia v570 bug report_NVME0N1P2_2025-08-07_02.txt (56.1 KB)
nvidia-bug-report.log_NVME0N1P2_2025-08-07_02.gz (806.4 KB)

1 Like

Sure, I agree it doesn’t make sense to keep it open here considering that the problem manifests even without Nvidia drivers installed, let’s see how things evolve on AMD side first. If things advance there and I still need some help from you guys as well, I’ll give you a ping ;-) Deal?

Sounds good, Thanks!

Thank you @MelanieB for sharing multiple reports.

Would you mind trying latest R570 released driver.

https://us.download.nvidia.com/XFree86/Linux-x86_64/570.181/NVIDIA-Linux-x86_64-570.181.run

Ryzen 3700x based machine with an Asus TUF B550M mobo won’t even boot to desktop with 570.181-open, just a blank screen and fans running at full speed. Kernel 6.14 and the card is Asus RTX 5060 Dual OC. Tried different kernels and 575 driver series, dropping the PCIe bus to gen 2, disabling CMS and other common hocus pocus tricks, but always the same result.

For what it’s worth, connecting the screen using HDMI helped on one of my machines.

Hi @nodeadbatteries

Could you please try upgrading the SBIOS and share test results.

A similar “success story” with Ryzen 3600 and RTX 5050. Not even desktop. The same with an old 4770k machine. The Blackwell and Linux combo seems like a disgrace by now.

HI @nodeadbatteries

Please confirm if you get a chance to upgraded SBIOS as per my earlier comment.

Another black screen with Ryzen 5500 and RTX 5050. On the positive side, turning Resizable BAR made the machine finally boot again. Not exactly evident, but seems necessary.

Cannot play Elite Dangerous:

[  842.154497] NVRM: Xid (PCI:0000:01:00): 109, pid=31143, name=RunLoop, Ch 0000005d, errorString CTX SWITCH TIMEOUT, Info 0x8c073

The game successfully starts, does shader compilation and planet optimization, it goes through the login box into the main menu. But seconds later, the game freezes, and then the rendered screen may actually jump back a few seconds, like showing a frame from the intro video or somewhere else near initialization of the game window.

Note: Driver 575 worked almost flawlessly for me (except there seems to be some vram leak ultimately causing the driver to complain about memory allocations after long uptime). 580 driver is a complete mess: desktop works but no game using Vulkan via DXVK/vkd3d can be launched. This driver, 570, is a different complete mess of strange and random behavior. Unfortunately, 575 has been dropped from my distribution, and obviously NVIDIA isn’t able to properly fix 580 whatever is causing my issues, they are not even responding. I’ve reported in that thread multiple times. Multiple updates went by. Issues remain.

I’m not sure how long I want to continue this “journey”. Time passes, my GPU gets older, and I will eventually come to a point where I want to buy a new GPU. Will that be NVIDIA again? I’m not so sure right now. Even CUDA is broken since at least one year now, and I’ve gone to encoding with QSV (which works better, btw: less drain on the GPU performance, less stutters). So there’s not much left keeping me here for any longer. :-(

NVIDIA, please get your stuff together. I’m seeing the progress you’re making. And DLSS may be superior to other solutions. But it is also not that of an important feature I’m using, and I’m running out of driver versions that work…

nvidia-bug-report.log.gz (1,4 MB)

1 Like

As developers, we have noticed a regression in Vulkan support between 560 and 570 (likely between 561 and 565). The problem seems to be present until the current drivers. Were there any official Vulkan-related changes introduced during this period?

I have posted more details here: FORMAT_B8G8R8G8_422_UNORM is not available in newer drivers . Does anyone have more insights?

PS: This problem seems to be present in Windows as well.