I see the following error:
$ nvidia-smi
Failed to initialize NVML: Driver/library version mismatch
NVML library version: 550.163
It worked some time ago, I think I did some apt update & apt upgrade in between and now it does not startup.
I rebooted already, does not help.
**$ nvidia-container-cli --version**
cli-version: 1.17.6
lib-version: 1.17.6
build date: 2025-04-22T08:29+00:00
build revision: a198166e1c1166f4847598438115ea97dacc7a92
build compiler: x86_64-linux-gnu-gcc-7 7.5.0
build platform: x86_64
build flags: -D_GNU_SOURCE -D_FORTIFY_SOURCE=2 -DNDEBUG -std=gnu11 -O2 -g -fdata-sections -ffunction-sections -fplan9-extensions -fstack-protector -fno-strict-aliasing -fvisibility=hidden -Wall -Wextra -Wcast-align -Wpointer-arith -Wmissing-prototypes -Wnonnull -Wwrite-strings -Wlogical-op -Wformat=2 -Wmissing-format-attribute -Winit-self -Wshadow -Wstrict-prototypes -Wunreachable-code -Wconversion -Wsign-conversion -Wno-unknown-warning-option -Wno-format-extra-args -Wno-gnu-alignof-expression -Wl,-zrelro -Wl,-znow -Wl,-zdefs -Wl,--gc-sections
:~$ **nvidia-container-cli -k -d /dev/tty info**
-- WARNING, the following logs are for debugging purposes only --
I0506 06:42:17.339555 38697 nvc.c:396] initializing library context (version=1.17.6, build=a198166e1c1166f4847598438115ea97dacc7a92)
I0506 06:42:17.339757 38697 nvc.c:367] using root /
I0506 06:42:17.339768 38697 nvc.c:368] using ldcache /etc/ld.so.cache
I0506 06:42:17.339777 38697 nvc.c:369] using unprivileged user 1000:1000
I0506 06:42:17.339830 38697 nvc.c:413] attempting to load dxcore to see if we are running under Windows Subsystem for Linux (WSL)
I0506 06:42:17.340247 38697 nvc.c:415] dxcore initialization failed, continuing assuming a non-WSL environment
W0506 06:42:17.341565 38698 nvc.c:273] failed to set inheritable capabilities
W0506 06:42:17.341664 38698 nvc.c:274] skipping kernel modules load due to failure
I0506 06:42:17.342377 38699 rpc.c:71] starting driver rpc service
I0506 06:42:17.381254 38697 rpc.c:135] driver rpc service terminated with signal 15
nvidia-container-cli: initialization error: nvml error: driver/library version mismatch
I0506 06:42:17.381392 38697 nvc.c:455] shutting down library context