Unable to suspend with eGPU, 3060, Wayland and Ubuntu 22.04

Graphics / Linux Linux
1

Hello,

I’m using wayland on Ubuntu 22.04;
Inside an eGPU encluse (razer core x) I have an RTX 3060.
Driver 535

After I boot (eGPU OFF)
If I run nvidia-smi I get this output (why not, since the eGPU is OFF)

nicolas@laptop ~  » nvidia-smi                                                                                                                                                             
NVIDIA-SMI has failed because it couldn't communicate with the NVIDIA driver. Make sure that the latest NVIDIA driver is installed and running.

If I start the eGPU the GPU is detected :

nicolas@laptop ~  » nvidia-smi                                                                                                                                                                  
Wed Feb 14 14:42:51 2024       
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.154.05             Driver Version: 535.154.05   CUDA Version: 12.2     |
|-----------------------------------------+----------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |         Memory-Usage | GPU-Util  Compute M. |
|                                         |                      |               MIG M. |
|=========================================+======================+======================|
|   0  NVIDIA GeForce RTX 3060        Off | 00000000:2E:00.0 Off |                  N/A |
|  0%   27C    P0              35W / 170W |      1MiB / 12288MiB |      0%      Default |
|                                         |                      |                  N/A |
+-----------------------------------------+----------------------+----------------------+
                                                                                         
+---------------------------------------------------------------------------------------+
| Processes:                                                                            |
|  GPU   GI   CI        PID   Type   Process name                            GPU Memory |
|        ID   ID                                                             Usage      |
|=======================================================================================|
|  No running processes found                                                           |
+---------------------------------------------------------------------------------------+

If I power off the eGPU again :

nicolas@laptop ~  » nvidia-smi                                                                                                                                                                  
Failed to initialize NVML: Unknown Error

After what if I decide to suspend the computer I get stuck with this black screen :

2048×1536 480 KB

And I have to force a reboot.

in journalctl output from the time I pressed the button to suspend :
I find this error :

1794×1022 540 KB

You can download the complete journalctl output of the suspend sequence here :
journalctl.log (51.1 KB)

If I never start the eGPU i have no problem with suspend.
I only need the eGPU to accomplish deep learning tasks, no gaming, no external monitor.

I will add the nvidia bug report in my next post since it won’t upload here.

Thanks for your help

2

…hum i’m unable to upload the report (its only 130ko)

Here it is :
https://gist.githubusercontent.com/nicolas-t/c5cf4780a03222a8f500e2ee18278e47/raw/832c2268552e930dff469a5ae9f2de53ad854ced/nvidia.log

3

The nvidia driver doesn’t support hot(un)plug so before you turn off the enclosure, you will have to unload the driver, e.g. sudo modprobe -r nvidia

4

Thanks !! :)

I’m unable to use modprobe when the eGPU is ON:

nicolas@laptop ~  » sudo modprobe -r nvidia                                                                                                                                                     
modprobe: FATAL: Module nvidia is in use.
nicolas@laptop ~  » lsof /dev/nvidia*                                                                                                                                                           
nicolas@laptop ~  »

Also lsof /dev/nvidia* returns nothing

5

Depending on your modprobe config regarding nvidia,

  • try modprobe -r --ignore-remove nvidia-drm nvidia-modeset nvidia-uvm nvidia
  • make sure
sudo cat /sys/module/nvidia_drm/parameters/modeset

returns “N”, otherwise check your modprobe confing for the nvidia-drm modeset=1 option and set it to 0.

6

Thanks

nicolas@laptop ~  » sudo cat /sys/module/nvidia_drm/parameters/modeset                                            
Y

I don’t have a /etc/modprobe.d/nvidia.conf file, but I have
/etc/modprobe.d/nvidia-graphics-drivers-kms.conf

I modified it like this :

# This file was generated by nvidia-driver-535
# Set value to 0 to disable modesetting
options nvidia-drm modeset=0

I rebooted but I still get Y

nicolas@laptop ~  » sudo cat /sys/module/nvidia_drm/parameters/modeset
Y

modprob with --ignore-remove isn’t working either :

nicolas@laptop ~  » sudo modprobe -r --ignore-remove nvidia-drm nvidia-modeset nvidia-uvm nvidia
modprobe: FATAL: Module nvidia_drm is in use.
7

Some more output (lsmod and lsof) in case it helps you :)

nicolas@laptop ~  » lsmod | grep nvidia
nvidia_uvm           1777664  0
nvidia_drm             90112  2
nvidia_modeset       1314816  1 nvidia_drm
nvidia              56786944  2 nvidia_uvm,nvidia_modeset
drm_kms_helper        270336  3 drm_display_helper,nvidia_drm,i915
drm                   761856  19 drm_kms_helper,drm_display_helper,nvidia,drm_buddy,nvidia_drm,i915,ttm
video                  73728  2 i915,nvidia_modeset



nicolas@laptop ~  » lsof | grep nvidia     
gnome-she  3350                             nicolas  mem       REG              252,1    160552   29757416 /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.535.154.05
gnome-she  3350                             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
gnome-she  3350                             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
gnome-she  3350                             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
gnome-she  3350                             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
gnome-she  3350                             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
gnome-she  3350  3354 gmain                 nicolas  mem       REG              252,1    160552   29757416 /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.535.154.05
gnome-she  3350  3354 gmain                 nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
gnome-she  3350  3354 gmain                 nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
gnome-she  3350  3354 gmain                 nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
gnome-she  3350  3354 gmain                 nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
gnome-she  3350  3354 gmain                 nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
gnome-she  3350  3356 gdbus                 nicolas  mem       REG              252,1    160552   29757416 /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.535.154.05
gnome-she  3350  3356 gdbus                 nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
gnome-she  3350  3356 gdbus                 nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
gnome-she  3350  3356 gdbus                 nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
gnome-she  3350  3356 gdbus                 nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
gnome-she  3350  3356 gdbus                 nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
gnome-she  3350  3357 dconf\x20             nicolas  mem       REG              252,1    160552   29757416 /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.535.154.05
gnome-she  3350  3357 dconf\x20             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
gnome-she  3350  3357 dconf\x20             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
gnome-she  3350  3357 dconf\x20             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
gnome-she  3350  3357 dconf\x20             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
gnome-she  3350  3357 dconf\x20             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
gnome-she  3350  3359 gnome-s:d             nicolas  mem       REG              252,1    160552   29757416 /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.535.154.05
gnome-she  3350  3359 gnome-s:d             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
gnome-she  3350  3359 gnome-s:d             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
gnome-she  3350  3359 gnome-s:d             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
gnome-she  3350  3359 gnome-s:d             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
gnome-she  3350  3359 gnome-s:d             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
gnome-she  3350  3360 gnome-she             nicolas  mem       REG              252,1    160552   29757416 /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.535.154.05
gnome-she  3350  3360 gnome-she             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
gnome-she  3350  3360 gnome-she             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
gnome-she  3350  3360 gnome-she             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
gnome-she  3350  3360 gnome-she             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
gnome-she  3350  3360 gnome-she             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
gnome-she  3350  3361 gnome-she             nicolas  mem       REG              252,1    160552   29757416 /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.535.154.05
gnome-she  3350  3361 gnome-she             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
gnome-she  3350  3361 gnome-she             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
gnome-she  3350  3361 gnome-she             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
gnome-she  3350  3361 gnome-she             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
gnome-she  3350  3361 gnome-she             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
gnome-she  3350  3362 gnome-she             nicolas  mem       REG              252,1    160552   29757416 /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.535.154.05
gnome-she  3350  3362 gnome-she             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
gnome-she  3350  3362 gnome-she             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
gnome-she  3350  3362 gnome-she             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
gnome-she  3350  3362 gnome-she             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
gnome-she  3350  3362 gnome-she             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
gnome-she  3350  3363 gnome-she             nicolas  mem       REG              252,1    160552   29757416 /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.535.154.05
gnome-she  3350  3363 gnome-she             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
gnome-she  3350  3363 gnome-she             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
gnome-she  3350  3363 gnome-she             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
gnome-she  3350  3363 gnome-she             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
gnome-she  3350  3363 gnome-she             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
gnome-she  3350  3364 gnome-she             nicolas  mem       REG              252,1    160552   29757416 /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.535.154.05
gnome-she  3350  3364 gnome-she             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
gnome-she  3350  3364 gnome-she             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
gnome-she  3350  3364 gnome-she             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
gnome-she  3350  3364 gnome-she             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
gnome-she  3350  3364 gnome-she             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
gnome-she  3350  3365 gnome-she             nicolas  mem       REG              252,1    160552   29757416 /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.535.154.05
gnome-she  3350  3365 gnome-she             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
gnome-she  3350  3365 gnome-she             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
gnome-she  3350  3365 gnome-she             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
gnome-she  3350  3365 gnome-she             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
gnome-she  3350  3365 gnome-she             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
gnome-she  3350  3393 gnome-:tr             nicolas  mem       REG              252,1    160552   29757416 /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.535.154.05
gnome-she  3350  3393 gnome-:tr             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
gnome-she  3350  3393 gnome-:tr             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
gnome-she  3350  3393 gnome-:tr             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
gnome-she  3350  3393 gnome-:tr             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
gnome-she  3350  3393 gnome-:tr             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
gnome-she  3350  3394 gnome-sh:             nicolas  mem       REG              252,1    160552   29757416 /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.535.154.05
gnome-she  3350  3394 gnome-sh:             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
gnome-she  3350  3394 gnome-sh:             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
gnome-she  3350  3394 gnome-sh:             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
gnome-she  3350  3394 gnome-sh:             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
gnome-she  3350  3394 gnome-sh:             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
gnome-she  3350  3397 gnome-:tr             nicolas  mem       REG              252,1    160552   29757416 /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.535.154.05
gnome-she  3350  3397 gnome-:tr             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
gnome-she  3350  3397 gnome-:tr             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
gnome-she  3350  3397 gnome-:tr             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
gnome-she  3350  3397 gnome-:tr             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
gnome-she  3350  3397 gnome-:tr             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
gnome-she  3350  3398 gnome-sh:             nicolas  mem       REG              252,1    160552   29757416 /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.535.154.05
gnome-she  3350  3398 gnome-sh:             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
gnome-she  3350  3398 gnome-sh:             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
gnome-she  3350  3398 gnome-sh:             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
gnome-she  3350  3398 gnome-sh:             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
gnome-she  3350  3398 gnome-sh:             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
gnome-she  3350  3399 gnome-she             nicolas  mem       REG              252,1    160552   29757416 /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.535.154.05
gnome-she  3350  3399 gnome-she             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
gnome-she  3350  3399 gnome-she             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
gnome-she  3350  3399 gnome-she             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
gnome-she  3350  3399 gnome-she             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
gnome-she  3350  3399 gnome-she             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
gnome-she  3350  3403 JS\x20Hel             nicolas  mem       REG              252,1    160552   29757416 /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.535.154.05
gnome-she  3350  3403 JS\x20Hel             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
gnome-she  3350  3403 JS\x20Hel             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
gnome-she  3350  3403 JS\x20Hel             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
gnome-she  3350  3403 JS\x20Hel             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
gnome-she  3350  3403 JS\x20Hel             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
gnome-she  3350  3404 JS\x20Hel             nicolas  mem       REG              252,1    160552   29757416 /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.535.154.05
gnome-she  3350  3404 JS\x20Hel             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
gnome-she  3350  3404 JS\x20Hel             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
gnome-she  3350  3404 JS\x20Hel             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
gnome-she  3350  3404 JS\x20Hel             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
gnome-she  3350  3404 JS\x20Hel             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
gnome-she  3350  3405 JS\x20Hel             nicolas  mem       REG              252,1    160552   29757416 /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.535.154.05
gnome-she  3350  3405 JS\x20Hel             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
gnome-she  3350  3405 JS\x20Hel             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
gnome-she  3350  3405 JS\x20Hel             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
gnome-she  3350  3405 JS\x20Hel             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
gnome-she  3350  3405 JS\x20Hel             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
gnome-she  3350  3406 JS\x20Hel             nicolas  mem       REG              252,1    160552   29757416 /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.535.154.05
gnome-she  3350  3406 JS\x20Hel             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
gnome-she  3350  3406 JS\x20Hel             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
gnome-she  3350  3406 JS\x20Hel             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
gnome-she  3350  3406 JS\x20Hel             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
gnome-she  3350  3406 JS\x20Hel             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
gnome-she  3350  3407 JS\x20Hel             nicolas  mem       REG              252,1    160552   29757416 /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.535.154.05
gnome-she  3350  3407 JS\x20Hel             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
gnome-she  3350  3407 JS\x20Hel             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
gnome-she  3350  3407 JS\x20Hel             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
gnome-she  3350  3407 JS\x20Hel             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
gnome-she  3350  3407 JS\x20Hel             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
gnome-she  3350  3408 JS\x20Hel             nicolas  mem       REG              252,1    160552   29757416 /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.535.154.05
gnome-she  3350  3408 JS\x20Hel             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
gnome-she  3350  3408 JS\x20Hel             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
gnome-she  3350  3408 JS\x20Hel             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
gnome-she  3350  3408 JS\x20Hel             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
gnome-she  3350  3408 JS\x20Hel             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
gnome-she  3350  3409 JS\x20Hel             nicolas  mem       REG              252,1    160552   29757416 /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.535.154.05
gnome-she  3350  3409 JS\x20Hel             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
gnome-she  3350  3409 JS\x20Hel             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
gnome-she  3350  3409 JS\x20Hel             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
gnome-she  3350  3409 JS\x20Hel             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
gnome-she  3350  3409 JS\x20Hel             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
gnome-she  3350  3410 JS\x20Hel             nicolas  mem       REG              252,1    160552   29757416 /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.535.154.05
gnome-she  3350  3410 JS\x20Hel             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
gnome-she  3350  3410 JS\x20Hel             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
gnome-she  3350  3410 JS\x20Hel             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
gnome-she  3350  3410 JS\x20Hel             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
gnome-she  3350  3410 JS\x20Hel             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
gnome-she  3350  4240 threaded-             nicolas  mem       REG              252,1    160552   29757416 /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.535.154.05
gnome-she  3350  4240 threaded-             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
gnome-she  3350  4240 threaded-             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
gnome-she  3350  4240 threaded-             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
gnome-she  3350  4240 threaded-             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
gnome-she  3350  4240 threaded-             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
gnome-she  3350  9521 threaded-             nicolas  mem       REG              252,1    160552   29757416 /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.535.154.05
gnome-she  3350  9521 threaded-             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
gnome-she  3350  9521 threaded-             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
gnome-she  3350  9521 threaded-             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
gnome-she  3350  9521 threaded-             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
gnome-she  3350  9521 threaded-             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
gnome-she  3350 11412 pool-gnom             nicolas  mem       REG              252,1    160552   29757416 /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.535.154.05
gnome-she  3350 11412 pool-gnom             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
gnome-she  3350 11412 pool-gnom             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
gnome-she  3350 11412 pool-gnom             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
gnome-she  3350 11412 pool-gnom             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
gnome-she  3350 11412 pool-gnom             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
Xwayland   3703                             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
Xwayland   3703                             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
Xwayland   3703                             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
Xwayland   3703                             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
Xwayland   3703                             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
Xwayland   3703  3962 Xwaylan:d             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
Xwayland   3703  3962 Xwaylan:d             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
Xwayland   3703  3962 Xwaylan:d             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
Xwayland   3703  3962 Xwaylan:d             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
Xwayland   3703  3962 Xwaylan:d             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
Xwayland   3703  3963 Xwayland:             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
Xwayland   3703  3963 Xwayland:             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
Xwayland   3703  3963 Xwayland:             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
Xwayland   3703  3963 Xwayland:             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
Xwayland   3703  3963 Xwayland:             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
Xwayland   3703  3964 Xwayland:             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
Xwayland   3703  3964 Xwayland:             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
Xwayland   3703  3964 Xwayland:             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
Xwayland   3703  3964 Xwayland:             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
Xwayland   3703  3964 Xwayland:             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
Xwayland   3703  3965 Xwayland:             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
Xwayland   3703  3965 Xwayland:             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
Xwayland   3703  3965 Xwayland:             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
Xwayland   3703  3965 Xwayland:             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
Xwayland   3703  3965 Xwayland:             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
Xwayland   3703  3966 Xwayland:             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
Xwayland   3703  3966 Xwayland:             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
Xwayland   3703  3966 Xwayland:             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
Xwayland   3703  3966 Xwayland:             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
Xwayland   3703  3966 Xwayland:             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
Xwayland   3703  3967 Xwayland:             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
Xwayland   3703  3967 Xwayland:             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
Xwayland   3703  3967 Xwayland:             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
Xwayland   3703  3967 Xwayland:             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
Xwayland   3703  3967 Xwayland:             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
Xwayland   3703  3968 Xwayland:             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
Xwayland   3703  3968 Xwayland:             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
Xwayland   3703  3968 Xwayland:             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
Xwayland   3703  3968 Xwayland:             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
Xwayland   3703  3968 Xwayland:             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
Xwayland   3703  3969 Xwayla:tr             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
Xwayland   3703  3969 Xwayla:tr             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
Xwayland   3703  3969 Xwayla:tr             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
Xwayland   3703  3969 Xwayla:tr             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
Xwayland   3703  3969 Xwayla:tr             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
Xwayland   3703  3970 Xwayland:             nicolas  mem       REG              252,1  40774960   29757442 /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.535.154.05
Xwayland   3703  3970 Xwayland:             nicolas  mem       REG              252,1  43907464   29757438 /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.535.154.05
Xwayland   3703  3970 Xwayland:             nicolas  mem       REG              252,1     22768   29757436 /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0
Xwayland   3703  3970 Xwayland:             nicolas  mem       REG              252,1    656472   29757440 /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.535.154.05
Xwayland   3703  3970 Xwayland:             nicolas  mem       REG              252,1   1337472   29757427 /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.535.154.05
nvidia-mo  9098                                root  cwd   unknown                                         /proc/9098/cwd (readlink: Permission denied)
nvidia-mo  9098                                root  rtd   unknown                                         /proc/9098/root (readlink: Permission denied)
nvidia-mo  9098                                root  txt   unknown                                         /proc/9098/exe (readlink: Permission denied)
nvidia-mo  9098                                root NOFD                                                   /proc/9098/fd (opendir: Permission denied)
nvidia-mo  9099                                root  cwd   unknown                                         /proc/9099/cwd (readlink: Permission denied)
nvidia-mo  9099                                root  rtd   unknown                                         /proc/9099/root (readlink: Permission denied)
nvidia-mo  9099                                root  txt   unknown                                         /proc/9099/exe (readlink: Permission denied)
nvidia-mo  9099                                root NOFD                                                   /proc/9099/fd (opendir: Permission denied)
nvidia     9102                                root  cwd   unknown                                         /proc/9102/cwd (readlink: Permission denied)
nvidia     9102                                root  rtd   unknown                                         /proc/9102/root (readlink: Permission denied)
nvidia     9102                                root  txt   unknown                                         /proc/9102/exe (readlink: Permission denied)
nvidia     9102                                root NOFD                                                   /proc/9102/fd (opendir: Permission denied)
nvidia-pe  9236                 nvidia-persistenced  cwd   unknown                                         /proc/9236/cwd (readlink: Permission denied)
nvidia-pe  9236                 nvidia-persistenced  rtd   unknown                                         /proc/9236/root (readlink: Permission denied)
nvidia-pe  9236                 nvidia-persistenced  txt   unknown                                         /proc/9236/exe (readlink: Permission denied)
nvidia-pe  9236                 nvidia-persistenced NOFD                                                   /proc/9236/fd (opendir: Permission denied)
8

after changing modprobe config files you need to rebuild the initrd.
sudo update-initramfs -u

9

Also, if gnome-shell is running, you’re not running headless so this won’t work.

10

Thank you, so it’s not possible to hotplug a nvidia egpu on linux ?

Do you think I can try the “nouveau” drivers ?
or simply buy an AMD gpu instead ?

regardless, thank you for taking the time :)

11

There are two different mechanisms involved:

  1. AFAIK, Wayland /Xorg both don’t support gpu hot-unplug regardless of gpu vendor.
    So if you first turn on your egpu and then your computer, the display server will grab it and not let hold of it. Unless you configure Xorg/Wayland to ignore it. Xorg by creating a fitting xorg.conf, Wayland, I don’t know.
    If you first turn on your computer and only later the egpu, Xorg/Wayland will ignore it anyway, so there shouldn’t be an issue.
  2. before turning off the egpu, like said, the driver needs to be unloaded. For that, the option nvidia-drm.modeset needs to be 0 and nvidia-persistenced needs to be stopped.
    AMD was working on hot unplug support for the amdgpu driver but I don’t think this is actually implemeted in the mainline kernel.
12

Hello

Do you think this would be possible to achieve ? Even if I’m not running headless ?

13

Should be possible, for preliminary tests, make sure

sudo cat /sys/module/nvidia_drm/parameters/modeset

returns N when the egpu is active. Then shutdown the computer, turn off egpu, turn on computer and only once you’re on the desktop, turn on egpu. Then check if you can unload the driver.