CUDA driver version is insufficient for CUDA runtime version [WSL2, Ubuntu 18.04]

manojonline · May 23, 2021, 12:27pm

Hi,

I’m getting CUDA driver version is insufficient for CUDA runtime version when trying to run the sample deviceQuery app.

OS:
Ubuntu 18.04 on WSL2 through the Windows Insider’s program
GPU:

CUDA Toolkit:
Followed the instructions https://docs.nvidia.com/cuda/wsl-user-guide/index.html#installing-nvidia-drivers

Could someone please help what I’m doing wrong here.

manojonline · May 24, 2021, 2:20pm

Gah, i did something very silly when I changed my C Drive from my old HD to a new HD. I will fix this and post it if my issue was fixed.

Cheers

manojonline · May 24, 2021, 8:42pm

I have the correct build now.

I followed the https://docs.nvidia.com/cuda/wsl-user-guide/index.html#running-cuda
and the
/usr/lib/wsl/lib folder is available now.

However, when i try to run the sample deviceQuery, i still get the “CUDA driver version is insufficient”

running the BlackScholes, gives the “CUDA error at …/…/common/inc/helper_cuda.h:779 code=35(cudaErrorInsufficientDriver) “cudaGetDeviceCount(&device_count)”” error

strace on ./BlackScholes seems not to load the libcuda from the /usr/lib/wsl/lib folder

execve(“./BlackScholes”, [“./BlackScholes”], 0x7ffedff8adc0 /* 21 vars /) = 0
brk(NULL) = 0x55fadbdd2000
arch_prctl(0x3001 / ARCH_??? /, 0x7ffc17622eb0) = -1 EINVAL (Invalid argument)
access(“/etc/ld.so.preload”, R_OK) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/usr/local/cuda-11.0/lib64/tls/haswell/x86_64/librt.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/usr/local/cuda-11.0/lib64/tls/haswell/x86_64”, 0x7ffc17622100) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/usr/local/cuda-11.0/lib64/tls/haswell/librt.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/usr/local/cuda-11.0/lib64/tls/haswell”, 0x7ffc17622100) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/usr/local/cuda-11.0/lib64/tls/x86_64/librt.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/usr/local/cuda-11.0/lib64/tls/x86_64”, 0x7ffc17622100) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/usr/local/cuda-11.0/lib64/tls/librt.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/usr/local/cuda-11.0/lib64/tls”, 0x7ffc17622100) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/usr/local/cuda-11.0/lib64/haswell/x86_64/librt.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/usr/local/cuda-11.0/lib64/haswell/x86_64”, 0x7ffc17622100) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/usr/local/cuda-11.0/lib64/haswell/librt.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/usr/local/cuda-11.0/lib64/haswell”, 0x7ffc17622100) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/usr/local/cuda-11.0/lib64/x86_64/librt.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/usr/local/cuda-11.0/lib64/x86_64”, 0x7ffc17622100) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/usr/local/cuda-11.0/lib64/librt.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/usr/local/cuda-11.0/lib64”, {st_mode=S_IFDIR|0755, st_size=4096, …}) = 0
openat(AT_FDCWD, “tls/haswell/x86_64/librt.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “tls/haswell/librt.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “tls/x86_64/librt.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “tls/librt.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “haswell/x86_64/librt.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “haswell/librt.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “x86_64/librt.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “librt.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/etc/ld.so.cache”, O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=40759, …}) = 0
mmap(NULL, 40759, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7ff476b82000
close(3) = 0
openat(AT_FDCWD, “/lib/x86_64-linux-gnu/librt.so.1”, O_RDONLY|O_CLOEXEC) = 3
read(3, “\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0 7\0\0\0\0\0\0”…, 832) = 832
fstat(3, {st_mode=S_IFREG|0644, st_size=40040, …}) = 0
mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7ff476b80000
mmap(NULL, 44000, PROT_READ, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7ff476b75000
mprotect(0x7ff476b78000, 24576, PROT_NONE) = 0
mmap(0x7ff476b78000, 16384, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x3000) = 0x7ff476b78000
mmap(0x7ff476b7c000, 4096, PROT_READ, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x7000) = 0x7ff476b7c000
mmap(0x7ff476b7e000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x8000) = 0x7ff476b7e000
close(3) = 0
openat(AT_FDCWD, “/usr/local/cuda-11.0/lib64/libpthread.so.0”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “tls/haswell/x86_64/libpthread.so.0”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “tls/haswell/libpthread.so.0”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “tls/x86_64/libpthread.so.0”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “tls/libpthread.so.0”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “haswell/x86_64/libpthread.so.0”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “haswell/libpthread.so.0”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “x86_64/libpthread.so.0”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “libpthread.so.0”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/lib/x86_64-linux-gnu/libpthread.so.0”, O_RDONLY|O_CLOEXEC) = 3
read(3, “\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\220\201\0\0\0\0\0\0”…, 832) = 832
pread64(3, “\4\0\0\0\24\0\0\0\3\0\0\0GNU\0\345Ga\367\265T\320\374\301V)Yf]\223\337”…, 68, 824) = 68
fstat(3, {st_mode=S_IFREG|0755, st_size=157224, …}) = 0
pread64(3, “\4\0\0\0\24\0\0\0\3\0\0\0GNU\0\345Ga\367\265T\320\374\301V)Yf]\223\337”…, 68, 824) = 68
mmap(NULL, 140408, PROT_READ, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7ff476b52000
mmap(0x7ff476b59000, 69632, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x7000) = 0x7ff476b59000
mmap(0x7ff476b6a000, 20480, PROT_READ, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x18000) = 0x7ff476b6a000
mmap(0x7ff476b6f000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1c000) = 0x7ff476b6f000
mmap(0x7ff476b71000, 13432, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7ff476b71000
close(3) = 0
openat(AT_FDCWD, “/usr/local/cuda-11.0/lib64/libdl.so.2”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “tls/haswell/x86_64/libdl.so.2”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “tls/haswell/libdl.so.2”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “tls/x86_64/libdl.so.2”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “tls/libdl.so.2”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “haswell/x86_64/libdl.so.2”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “haswell/libdl.so.2”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “x86_64/libdl.so.2”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “libdl.so.2”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/lib/x86_64-linux-gnu/libdl.so.2”, O_RDONLY|O_CLOEXEC) = 3
read(3, “\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0 \22\0\0\0\0\0\0”…, 832) = 832
fstat(3, {st_mode=S_IFREG|0644, st_size=18816, …}) = 0
mmap(NULL, 20752, PROT_READ, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7ff476b4c000
mmap(0x7ff476b4d000, 8192, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1000) = 0x7ff476b4d000
mmap(0x7ff476b4f000, 4096, PROT_READ, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x3000) = 0x7ff476b4f000
mmap(0x7ff476b50000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x3000) = 0x7ff476b50000
close(3) = 0
openat(AT_FDCWD, “/usr/local/cuda-11.0/lib64/libstdc++.so.6”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “tls/haswell/x86_64/libstdc++.so.6”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “tls/haswell/libstdc++.so.6”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “tls/x86_64/libstdc++.so.6”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “tls/libstdc++.so.6”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “haswell/x86_64/libstdc++.so.6”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “haswell/libstdc++.so.6”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “x86_64/libstdc++.so.6”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “libstdc++.so.6”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/lib/x86_64-linux-gnu/libstdc++.so.6”, O_RDONLY|O_CLOEXEC) = 3
read(3, “\177ELF\2\1\1\3\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\240\341\t\0\0\0\0\0”…, 832) = 832
fstat(3, {st_mode=S_IFREG|0644, st_size=1952928, …}) = 0
mmap(NULL, 1968128, PROT_READ, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7ff47696b000
mprotect(0x7ff476a01000, 1286144, PROT_NONE) = 0
mmap(0x7ff476a01000, 983040, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x96000) = 0x7ff476a01000
mmap(0x7ff476af1000, 299008, PROT_READ, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x186000) = 0x7ff476af1000
mmap(0x7ff476b3b000, 57344, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1cf000) = 0x7ff476b3b000
mmap(0x7ff476b49000, 10240, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7ff476b49000
close(3) = 0
openat(AT_FDCWD, “/usr/local/cuda-11.0/lib64/libm.so.6”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “tls/haswell/x86_64/libm.so.6”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “tls/haswell/libm.so.6”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “tls/x86_64/libm.so.6”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “tls/libm.so.6”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “haswell/x86_64/libm.so.6”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “haswell/libm.so.6”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “x86_64/libm.so.6”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “libm.so.6”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/lib/x86_64-linux-gnu/libm.so.6”, O_RDONLY|O_CLOEXEC) = 3
read(3, “\177ELF\2\1\1\3\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\300\363\0\0\0\0\0\0”…, 832) = 832
fstat(3, {st_mode=S_IFREG|0644, st_size=1369352, …}) = 0
mmap(NULL, 1368336, PROT_READ, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7ff47681c000
mmap(0x7ff47682b000, 684032, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0xf000) = 0x7ff47682b000
mmap(0x7ff4768d2000, 618496, PROT_READ, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0xb6000) = 0x7ff4768d2000
mmap(0x7ff476969000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x14c000) = 0x7ff476969000
close(3) = 0
openat(AT_FDCWD, “/usr/local/cuda-11.0/lib64/libgcc_s.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “tls/haswell/x86_64/libgcc_s.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “tls/haswell/libgcc_s.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “tls/x86_64/libgcc_s.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “tls/libgcc_s.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “haswell/x86_64/libgcc_s.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “haswell/libgcc_s.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “x86_64/libgcc_s.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “libgcc_s.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/lib/x86_64-linux-gnu/libgcc_s.so.1”, O_RDONLY|O_CLOEXEC) = 3
read(3, “\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\3405\0\0\0\0\0\0”…, 832) = 832
fstat(3, {st_mode=S_IFREG|0644, st_size=104984, …}) = 0
mmap(NULL, 107592, PROT_READ, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7ff476801000
mmap(0x7ff476804000, 73728, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x3000) = 0x7ff476804000
mmap(0x7ff476816000, 16384, PROT_READ, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x15000) = 0x7ff476816000
mmap(0x7ff47681a000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x18000) = 0x7ff47681a000
close(3) = 0
openat(AT_FDCWD, “/usr/local/cuda-11.0/lib64/libc.so.6”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “tls/haswell/x86_64/libc.so.6”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “tls/haswell/libc.so.6”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “tls/x86_64/libc.so.6”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “tls/libc.so.6”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “haswell/x86_64/libc.so.6”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “haswell/libc.so.6”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “x86_64/libc.so.6”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “libc.so.6”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/lib/x86_64-linux-gnu/libc.so.6”, O_RDONLY|O_CLOEXEC) = 3
read(3, “\177ELF\2\1\1\3\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\360q\2\0\0\0\0\0”…, 832) = 832
pread64(3, “\6\0\0\0\4\0\0\0@\0\0\0\0\0\0\0@\0\0\0\0\0\0\0@\0\0\0\0\0\0\0”…, 784, 64) = 784
pread64(3, “\4\0\0\0\20\0\0\0\5\0\0\0GNU\0\2\0\0\300\4\0\0\0\3\0\0\0\0\0\0\0”, 32, 848) = 32
pread64(3, “\4\0\0\0\24\0\0\0\3\0\0\0GNU\0\t\233\222%\274\260\320\31\331\326\10\204\276X>\263”…, 68, 880) = 68
fstat(3, {st_mode=S_IFREG|0755, st_size=2029224, …}) = 0
mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7ff4767ff000
pread64(3, “\6\0\0\0\4\0\0\0@\0\0\0\0\0\0\0@\0\0\0\0\0\0\0@\0\0\0\0\0\0\0”…, 784, 64) = 784
pread64(3, “\4\0\0\0\20\0\0\0\5\0\0\0GNU\0\2\0\0\300\4\0\0\0\3\0\0\0\0\0\0\0”, 32, 848) = 32
pread64(3, “\4\0\0\0\24\0\0\0\3\0\0\0GNU\0\t\233\222%\274\260\320\31\331\326\10\204\276X>\263”…, 68, 880) = 68
mmap(NULL, 2036952, PROT_READ, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7ff47660d000
mprotect(0x7ff476632000, 1847296, PROT_NONE) = 0
mmap(0x7ff476632000, 1540096, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x25000) = 0x7ff476632000
mmap(0x7ff4767aa000, 303104, PROT_READ, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x19d000) = 0x7ff4767aa000
mmap(0x7ff4767f5000, 24576, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1e7000) = 0x7ff4767f5000
mmap(0x7ff4767fb000, 13528, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7ff4767fb000
close(3) = 0
mmap(NULL, 12288, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7ff47660a000
arch_prctl(ARCH_SET_FS, 0x7ff47660aa00) = 0
mprotect(0x7ff4767f5000, 12288, PROT_READ) = 0
mprotect(0x7ff47681a000, 4096, PROT_READ) = 0
mprotect(0x7ff476969000, 4096, PROT_READ) = 0
mprotect(0x7ff476b3b000, 45056, PROT_READ) = 0
mprotect(0x7ff476b50000, 4096, PROT_READ) = 0
mprotect(0x7ff476b6f000, 4096, PROT_READ) = 0
mprotect(0x7ff476b7e000, 4096, PROT_READ) = 0
mprotect(0x55fada3c3000, 16384, PROT_READ) = 0
mprotect(0x7ff476bb9000, 4096, PROT_READ) = 0
munmap(0x7ff476b82000, 40759) = 0
set_tid_address(0x7ff47660acd0) = 196
set_robust_list(0x7ff47660ace0, 24) = 0
rt_sigaction(SIGRTMIN, {sa_handler=0x7ff476b59bf0, sa_mask=[], sa_flags=SA_RESTORER|SA_SIGINFO, sa_restorer=0x7ff476b673c0}, NULL, 8) = 0
rt_sigaction(SIGRT_1, {sa_handler=0x7ff476b59c90, sa_mask=[], sa_flags=SA_RESTORER|SA_RESTART|SA_SIGINFO, sa_restorer=0x7ff476b673c0}, NULL, 8) = 0
rt_sigprocmask(SIG_UNBLOCK, [RTMIN RT_1], NULL, 8) = 0
prlimit64(0, RLIMIT_STACK, NULL, {rlim_cur=81921024, rlim_max=RLIM64_INFINITY}) = 0
brk(NULL) = 0x55fadbdd2000
brk(0x55fadbdf3000) = 0x55fadbdf3000
futex(0x55fada3c7a98, FUTEX_WAKE_PRIVATE, 2147483647) = 0
futex(0x7ff476b496bc, FUTEX_WAKE_PRIVATE, 2147483647) = 0
futex(0x7ff476b496c8, FUTEX_WAKE_PRIVATE, 2147483647) = 0
fstat(1, {st_mode=S_IFCHR|0620, st_rdev=makedev(0x88, 0x2), …}) = 0
write(1, “[./BlackScholes] - Starting…\n”, 31[./BlackScholes] - Starting…
) = 31
futex(0x7ff476b510c8, FUTEX_WAKE_PRIVATE, 2147483647) = 0
openat(AT_FDCWD, “/usr/local/cuda-11.0/lib64/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “tls/haswell/x86_64/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “tls/haswell/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “tls/x86_64/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “tls/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “haswell/x86_64/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “haswell/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “x86_64/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/etc/ld.so.cache”, O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=40759, …}) = 0
mmap(NULL, 40759, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7ff476b82000
close(3) = 0
openat(AT_FDCWD, “/lib/x86_64-linux-gnu/tls/haswell/x86_64/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/lib/x86_64-linux-gnu/tls/haswell/x86_64”, 0x7ffc17622270) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/lib/x86_64-linux-gnu/tls/haswell/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/lib/x86_64-linux-gnu/tls/haswell”, 0x7ffc17622270) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/lib/x86_64-linux-gnu/tls/x86_64/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/lib/x86_64-linux-gnu/tls/x86_64”, 0x7ffc17622270) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/lib/x86_64-linux-gnu/tls/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/lib/x86_64-linux-gnu/tls”, 0x7ffc17622270) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/lib/x86_64-linux-gnu/haswell/x86_64/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/lib/x86_64-linux-gnu/haswell/x86_64”, 0x7ffc17622270) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/lib/x86_64-linux-gnu/haswell/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/lib/x86_64-linux-gnu/haswell”, 0x7ffc17622270) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/lib/x86_64-linux-gnu/x86_64/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/lib/x86_64-linux-gnu/x86_64”, 0x7ffc17622270) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/lib/x86_64-linux-gnu/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/lib/x86_64-linux-gnu”, {st_mode=S_IFDIR|0755, st_size=36864, …}) = 0
openat(AT_FDCWD, “/usr/lib/x86_64-linux-gnu/tls/haswell/x86_64/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/usr/lib/x86_64-linux-gnu/tls/haswell/x86_64”, 0x7ffc17622270) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/usr/lib/x86_64-linux-gnu/tls/haswell/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/usr/lib/x86_64-linux-gnu/tls/haswell”, 0x7ffc17622270) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/usr/lib/x86_64-linux-gnu/tls/x86_64/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/usr/lib/x86_64-linux-gnu/tls/x86_64”, 0x7ffc17622270) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/usr/lib/x86_64-linux-gnu/tls/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/usr/lib/x86_64-linux-gnu/tls”, 0x7ffc17622270) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/usr/lib/x86_64-linux-gnu/haswell/x86_64/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/usr/lib/x86_64-linux-gnu/haswell/x86_64”, 0x7ffc17622270) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/usr/lib/x86_64-linux-gnu/haswell/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/usr/lib/x86_64-linux-gnu/haswell”, 0x7ffc17622270) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/usr/lib/x86_64-linux-gnu/x86_64/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/usr/lib/x86_64-linux-gnu/x86_64”, 0x7ffc17622270) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/usr/lib/x86_64-linux-gnu/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/usr/lib/x86_64-linux-gnu”, {st_mode=S_IFDIR|0755, st_size=36864, …}) = 0
openat(AT_FDCWD, “/lib/tls/haswell/x86_64/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/lib/tls/haswell/x86_64”, 0x7ffc17622270) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/lib/tls/haswell/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/lib/tls/haswell”, 0x7ffc17622270) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/lib/tls/x86_64/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/lib/tls/x86_64”, 0x7ffc17622270) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/lib/tls/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/lib/tls”, 0x7ffc17622270) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/lib/haswell/x86_64/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/lib/haswell/x86_64”, 0x7ffc17622270) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/lib/haswell/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/lib/haswell”, 0x7ffc17622270) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/lib/x86_64/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/lib/x86_64”, 0x7ffc17622270) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/lib/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/lib”, {st_mode=S_IFDIR|0755, st_size=4096, …}) = 0
openat(AT_FDCWD, “/usr/lib/tls/haswell/x86_64/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/usr/lib/tls/haswell/x86_64”, 0x7ffc17622270) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/usr/lib/tls/haswell/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/usr/lib/tls/haswell”, 0x7ffc17622270) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/usr/lib/tls/x86_64/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/usr/lib/tls/x86_64”, 0x7ffc17622270) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/usr/lib/tls/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/usr/lib/tls”, 0x7ffc17622270) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/usr/lib/haswell/x86_64/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/usr/lib/haswell/x86_64”, 0x7ffc17622270) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/usr/lib/haswell/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/usr/lib/haswell”, 0x7ffc17622270) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/usr/lib/x86_64/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/usr/lib/x86_64”, 0x7ffc17622270) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, “/usr/lib/libcuda.so.1”, O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
stat(“/usr/lib”, {st_mode=S_IFDIR|0755, st_size=4096, …}) = 0
munmap(0x7ff476b82000, 40759) = 0
futex(0x55fada3c7a90, FUTEX_WAKE_PRIVATE, 2147483647) = 0
write(2, “CUDA error at …/…/common/inc/h”…, 123CUDA error at …/…/common/inc/helper_cuda.h:777 code=35(cudaErrorInsufficientDriver) “cudaGetDeviceCount(&device_count)”
) = 123
exit_group(1) = ?
+++ exited with 1 +++

Any help is appreciated

mehmetdeniz · May 25, 2021, 7:16am

Hello @manojonline

In my opinion, your CUDA versions of GPU driver and CUDA libraries are different. Can you check them out with these commands:

nvidia-smi.exe

dpkg -l | grep cuda-toolkit

Regards

manojonline · May 25, 2021, 8:45am

nvidia-smi

image643×952 26.9 KB

dpkg -l | grep cuda-toolkit
Note: installing toolkit 11.3 automatically created the 11.0 folder as well.

image1172×127 5.03 KB

mehmetdeniz · May 25, 2021, 8:48am

After installing cuda-toolkit-11.3, does it working now?

manojonline · May 25, 2021, 8:49am

Nope, same error

mehmetdeniz · May 26, 2021, 7:36am

Today, I got the same error. I have not installed any packages or modified any files since yesterday. But this problem happened.

I checked the WSL installation. I tried to reinstall the driver package and I saw that, the Graphics driver not available.

After only this driver installed, I checked the examples again and it worked. (In my opinion, this may cause daily updates but I’m not sure)

Hope it works your device too
Regards

manojonline · May 26, 2021, 7:46am

After installing the new driver, the examples worked for me as well. But I was facing errors with the nvidia containers.

In my opinion, WSL2 is not in any shape or form. I have been spending too much time on setting up the machine, rather than working on my project.
Also, the WIP makes my machine really really laggy, it is not just worth it for me.

Really appreciate your help.

Cheers
Manoj

epalidda · October 7, 2022, 2:06pm

I seem to have the exact same issue. Is there any update on this? I am on Quadro P520, installed the corresponding driver with cuda 11.7 or 11.8

patchu · August 26, 2023, 7:57pm

One very obvious thing is to reboot your computer after installing the drivers. I got this error right after installing new drivers, but after a reboot (of course!) it worked.