NVRM: API mismatch

Accelerated Computing CUDA CUDA Setup and Installation
1

I have installed CUDA7.5. Now I have driver version mismatch. When I run

sudo dmesg |grep NVRM
[ 9.168098] NVRM: loading NVIDIA UNIX x86_64 Kernel Module 352.41 Fri Aug 21 23:09:52 PDT 2015
[ 46.984880] NVRM: API mismatch: the client has the version 352.39, but
[ 46.984880] NVRM: this kernel module has the version 352.41. Please
[ 46.984880] NVRM: make sure that this kernel module and all NVIDIA driver
[ 46.984880] NVRM: components have the same version.
[ 46.984883] NVRM: nvidia_frontend_ioctl: minor 255, module->ioctl failed, error -22
[ 658.817643] NVRM: API mismatch: the client has the version 352.39, but
[ 658.817643] NVRM: this kernel module has the version 352.41. Please
[ 658.817643] NVRM: make sure that this kernel module and all NVIDIA driver
[ 658.817643] NVRM: components have the same version.
[ 658.817655] NVRM: nvidia_frontend_ioctl: minor 255, module->ioctl failed, error -22
[ 893.515205] NVRM: API mismatch: the client has the version 352.39, but
[ 893.515205] NVRM: this kernel module has the version 352.41. Please
[ 893.515205] NVRM: make sure that this kernel module and all NVIDIA driver
[ 893.515205] NVRM: components have the same version.
[ 893.515216] NVRM: nvidia_frontend_ioctl: minor 255, module->ioctl failed, error -22
[ 1526.097007] NVRM: API mismatch: the client has the version 304.125, but
[ 1526.097007] NVRM: this kernel module has the version 352.41. Please
[ 1526.097007] NVRM: make sure that this kernel module and all NVIDIA driver
[ 1526.097007] NVRM: components have the same version.
[ 1526.097020] NVRM: nvidia_frontend_ioctl: minor 255, module->ioctl failed, error -22

Then I checked
nvidia-smi -a
NVIDIA: API mismatch: the NVIDIA kernel module has version 352.41,
but this NVIDIA driver component has version 304.125. Please make
sure that the kernel module and all NVIDIA driver components
have the same version.
Failed to initialize NVML: Unknown Error

When I checked package list,
I have
sudo dpkg --list | grep nvidia
ii nvidia-304-updates 304.125-0ubuntu0.0.2 amd64 NVIDIA legacy binary driver - version 304.125
ii nvidia-current-updates 304.125-0ubuntu0.0.2 amd64 Transitional package for nvidia-current-updates
ii nvidia-opencl-icd-304-updates 304.125-0ubuntu0.0.2 amd64 NVIDIA OpenCL ICD
ii nvidia-settings 355.11-0ubuntu0~gpu14.04.1 amd64 Tool for configuring the NVIDIA graphics driver

I know my kernel has 352.41. How can I match to that version?
Thanks

2

I removed nvidia-304 version and reinstalled 352 version as

$ sudo add-apt-repository ppa:xorg-edgers/ppa -y
$ sudo apt-get update
$ sudo apt-get install nvidia-352

Now sudo dpkg --list | grep nvidia gave me
rc nvidia-304 304.128-0ubuntu0~gpu14.04.2 amd64 NVIDIA legacy binary driver - version 304.128
rc nvidia-304-updates 304.125-0ubuntu0.0.2 amd64 NVIDIA legacy binary driver - version 304.125
ii nvidia-352 352.41-0ubuntu0~gpu14.04.1 amd64 NVIDIA binary driver - version 352.41
rc nvidia-opencl-icd-304 304.128-0ubuntu0~gpu14.04.2 amd64 NVIDIA OpenCL ICD
rc nvidia-opencl-icd-304-updates 304.125-0ubuntu0.0.2 amd64 NVIDIA OpenCL ICD
ii nvidia-opencl-icd-352 352.41-0ubuntu0~gpu14.04.1 amd64 NVIDIA OpenCL ICD
ii nvidia-prime 0.6.2 amd64 Tools to enable NVIDIA’s Prime
ii nvidia-settings 355.11-0ubuntu0~gpu14.04.1 amd64 Tool for configuring the NVIDIA graphics driver

So it should match.

But I checked
$ sudo dmesg |grep NVRM
[ 9.168098] NVRM: loading NVIDIA UNIX x86_64 Kernel Module 352.41 Fri Aug 21 23:09:52 PDT 2015
[ 46.984880] NVRM: API mismatch: the client has the version 352.39, but
[ 46.984880] NVRM: this kernel module has the version 352.41. Please
[ 46.984880] NVRM: make sure that this kernel module and all NVIDIA driver
[ 46.984880] NVRM: components have the same version.
[ 46.984883] NVRM: nvidia_frontend_ioctl: minor 255, module->ioctl failed, error -22

Still mismatch as 352.41 and 352.39.
Now
$ nvidia-smi -a
==============NVSMI LOG==============

Timestamp : Mon Sep 14 11:10:08 2015
Driver Version : 352.41

Attached GPUs : 1
GPU 0000:05:00.0
Product Name : Quadro K2000
Product Brand : Quadro
Display Mode : Enabled
Display Active : Enabled
Persistence Mode : Disabled
Accounting Mode : Disabled
Accounting Mode Buffer Size : 1920
Driver Model
Current : N/A
Pending : N/A
Serial Number : 0323413053374
GPU UUID : GPU-caf26082-102c-ef43-8e39-f162fdcaa716
Minor Number : 0
VBIOS Version : 80.07.9B.00.07
MultiGPU Board : No
Board ID : 0x500
Inforom Version
Image Version : 2095.0500.00.01
OEM Object : 1.1
ECC Object : N/A
Power Management Object : N/A
GPU Operation Mode
Current : N/A
Pending : N/A
PCI
Bus : 0x05
Device : 0x00
Domain : 0x0000
Device Id : 0x0FFE10DE
Bus Id : 0000:05:00.0
Sub System Id : 0x094C103C
GPU Link Info
PCIe Generation
Max : 2
Current : 1
Link Width
Max : 16x
Current : 16x
Bridge Chip
Type : N/A
Firmware : N/A
Replays since reset : 0
Tx Throughput : N/A
Rx Throughput : N/A
Fan Speed : 30 %
Performance State : P8
Clocks Throttle Reasons
Idle : Active
Applications Clocks Setting : Not Active
SW Power Cap : Not Active
HW Slowdown : Not Active
Unknown : Not Active
FB Memory Usage
Total : 2047 MiB
Used : 230 MiB
Free : 1817 MiB
BAR1 Memory Usage
Total : 256 MiB
Used : 4 MiB
Free : 252 MiB
Compute Mode : Default
Utilization
Gpu : 0 %
Memory : 6 %
Encoder : 0 %
Decoder : 0 %
Ecc Mode
Current : N/A
Pending : N/A
ECC Errors
Volatile
Single Bit
Device Memory : N/A
Register File : N/A
L1 Cache : N/A
L2 Cache : N/A
Texture Memory : N/A
Total : N/A
Double Bit
Device Memory : N/A
Register File : N/A
L1 Cache : N/A
L2 Cache : N/A
Texture Memory : N/A
Total : N/A
Aggregate
Single Bit
Device Memory : N/A
Register File : N/A
L1 Cache : N/A
L2 Cache : N/A
Texture Memory : N/A
Total : N/A
Double Bit
Device Memory : N/A
Register File : N/A
L1 Cache : N/A
L2 Cache : N/A
Texture Memory : N/A
Total : N/A
Retired Pages
Single Bit ECC : N/A
Double Bit ECC : N/A
Pending : N/A
Temperature
GPU Current Temp : 33 C
GPU Shutdown Temp : 103 C
GPU Slowdown Temp : 98 C
Power Readings
Power Management : N/A
Power Draw : N/A
Power Limit : N/A
Default Power Limit : N/A
Enforced Power Limit : N/A
Min Power Limit : N/A
Max Power Limit : N/A
Clocks
Graphics : 324 MHz
SM : 324 MHz
Memory : 324 MHz
Applications Clocks
Graphics : N/A
Memory : N/A
Default Applications Clocks
Graphics : N/A
Memory : N/A
Max Clocks
Graphics : 954 MHz
SM : 954 MHz
Memory : 2000 MHz
Clock Policy
Auto Boost : N/A
Auto Boost Default : N/A
Processes
Process ID : 1238
Type : G
Name : /usr/bin/X
Used GPU Memory : 183 MiB
Process ID : 2100
Type : G
Name : compiz
Used GPU Memory : 37 MiB

But now,deviceQuery has unknown error
./deviceQuery Starting…

CUDA Device Query (Runtime API) version (CUDART static linking)

cudaGetDeviceCount returned 30
→ unknown error
Result = FAIL
coie@coie-HP-Z420-Workstation:~/Softwares/NVIDIA_CUDA-7.5_Samples/bin/x86_64/li

3

Thanks now, it works.
I forgot sudo at ./deviceQuery