Nvidia-powerd stops working after a while

Hi There

I can’t utilize the dynamic boost on my laptop on the latest stable version.

$ neofetch
                                               crashdummy@crashtux 
    ⠀⠀⢀⣤⣴⣶⣶⣶⣦⣤⡀⠀⣀⣠⣤⣴⣶⣶⣶⣶⣶⣶⣶⣶⣤⣤⣀⡀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀   ------------------- 
    ⠀⣰⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣶⣤⡀⠀⠀⠀⠀⠀⠀⠀⠀   OS: Nobara Linux 40 (KDE Plasma) x86_64 
    ⠀⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣷⣄⠀⠀⠀⠀⠀⠀   Host: TUXEDO Stellaris Intel Gen5 Standard 
    ⠀⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣷⣄⠀⠀⠀⠀   Kernel: 6.8.12-201.fsync.fc40.x86_64 
    ⠀⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣧⠀⠀⠀   Uptime: 5 hours, 46 mins 
    ⠀⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⠟⠋⠉⠁⠀⠀⠉⠉⠛⠿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣧⠀⠀   Packages: 4094 (rpm), 9 (flatpak) 
    ⠀⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⠟⠁⠀⠀⠀⢀⣀⣀⡀⠀⠀⠀⠈⢻⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⡇⠀   Shell: fish 3.7.0 
    ⠀⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⡏⠀⠀⠀⢠⣾⣿⣿⣿⣿⣷⡄⠀⠀⠀⠻⠿⢿⣿⣿⣿⣿⣿⣿⣿⣿⣿⠀   Resolution: 3840x2160 
    ⠀⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⠁⠀⠀⠀⣿⣿⣿⣿⣿⣿⣿⡇⠀⠀⠀⠀⠀⣀⣀⣬⣽⣿⣿⣿⣿⣿⣿⠀   DE: Hyprland 
    ⠀⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⠀⠀⠀⠀⠈⠻⢿⣿⣿⡿⠟⠁⠀⠀⠀⢸⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⠀   WM: sway 
    ⠀⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣇⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⢸⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⠀   Theme: Tokyonight-Dark-BL-LB [GTK2/3] 
    ⠀⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣷⣤⣤⣄⣀⡀⠀⠀⠀⠀⠀⠀⠀⠀⢸⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⠀   Icons: Flat-Remix-Blue-Dark [GTK2/3] 
    ⠀⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣷⣄⠀⠀⠀⠀⠀⠀⢸⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⠀   Terminal: kitty 
    ⠀⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣇⠀⠀⠀⠀⠀⢸⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⠀   CPU: 13th Gen Intel i9-13900HX (32) @ 5.200GHz 
    ⠀⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⡿⠟⠛⠉⠉⠛⠛⢿⣿⣿⠀⠀⠀⠀⠀⠸⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⡿⠀   GPU: NVIDIA GeForce RTX 4080 Max-Q / Mobile 
    ⠀⠘⢿⣿⣿⣿⣿⣿⣿⣿⡿⠋⠀⠀⠀⠀⠀⠀⠀⠀⠈⢿⠀⠀⠀⠀⠀⠀⠙⢿⣿⣿⣿⣿⣿⣿⣿⠟⠁⠀   GPU: Intel Raptor Lake-S UHD Graphics 
    ⠀⠀⠀⠈⠙⠛⠛⠛⠋⠁⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠉⠛⠛⠛⠛⠉⠁⠀⠀⠀   Memory: 8914MiB / 64021MiB 

My 4080 is supposed to be on 150W with 25W boost.
The problem is that nvidia-powerd.service eventually gets stuck being unable to set the new power limit and thus flodding my logs.

nvidia-smi
Wed Jul 17 14:59:59 2024       
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 555.58.02              Driver Version: 555.58.02      CUDA Version: 12.5     |
|-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA GeForce RTX 4080 ...    Off |   00000000:01:00.0  On |                  N/A |
| N/A   54C    P0             40W /  161W |    4349MiB /  12282MiB |      0%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+
systemctl status nvidia-powerd
● nvidia-powerd.service - nvidia-powerd service
     Loaded: loaded (/etc/systemd/system/nvidia-powerd.service; enabled; preset: enabled)
    Drop-In: /usr/lib/systemd/system/service.d
             └─10-timeout-abort.conf
     Active: active (running) since Wed 2024-07-17 14:46:12 CEST; 24min ago
   Main PID: 96506 (nvidia-powerd)
      Tasks: 3 (limit: 76636)
     Memory: 756.0K (peak: 1.2M)
        CPU: 2.132s
     CGroup: /system.slice/nvidia-powerd.service
             └─96506 /usr/bin/nvidia-powerd

Jul 17 15:10:28 crashtux /usr/bin/nvidia-powerd[96506]: error setting power limit
Jul 17 15:10:28 crashtux /usr/bin/nvidia-powerd[96506]: Error setting GPU limit: 175000.
Jul 17 15:10:28 crashtux /usr/bin/nvidia-powerd[96506]: error setting power limit
Jul 17 15:10:28 crashtux /usr/bin/nvidia-powerd[96506]: Error setting GPU limit: 175000.
Jul 17 15:10:28 crashtux /usr/bin/nvidia-powerd[96506]: error setting power limit
Jul 17 15:10:28 crashtux /usr/bin/nvidia-powerd[96506]: Error setting GPU limit: 175000.
Jul 17 15:10:28 crashtux /usr/bin/nvidia-powerd[96506]: error setting power limit
Jul 17 15:10:28 crashtux /usr/bin/nvidia-powerd[96506]: Error setting GPU limit: 175000.
Jul 17 15:10:28 crashtux /usr/bin/nvidia-powerd[96506]: error setting power limit
Jul 17 15:10:28 crashtux /usr/bin/nvidia-powerd[96506]: Error setting GPU limit: 175000.

Theres sometimes the error Failed to get topoloty status 55 mixed in as well.

Jul 17 15:11:23 crashtux /usr/bin/nvidia-powerd[96506]: Error setting GPU limit: 163445.
Jul 17 15:11:23 crashtux /usr/bin/nvidia-powerd[96506]: Failed to get topology status 55
Jul 17 15:11:23 crashtux /usr/bin/nvidia-powerd[96506]: error setting power limit
Jul 17 15:11:23 crashtux /usr/bin/nvidia-powerd[96506]: Error setting GPU limit: 163149.
Jul 17 15:11:23 crashtux /usr/bin/nvidia-powerd[96506]: error setting power limit
Jul 17 15:11:23 crashtux /usr/bin/nvidia-powerd[96506]: Error setting GPU limit: 163095.

Restarting nvidia-powerd doesnt help either