CUDA 8.0 with Nvidia driver 367.44 on Ubuntu 16.04

I have two GPUs on this machine with Ubuntu 16.04, and am having issue with CUDA 8.0RC

Output of nvidia-smi
Sun Sep 4 23:07:48 2016
±----------------------------------------------------------------------------+
| NVIDIA-SMI 367.44 Driver Version: 367.44 |
|-------------------------------±---------------------±---------------------+
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
|===============================+======================+======================|
| 0 GeForce GTX TIT… Off | 0000:01:00.0 On | N/A |
| 22% 40C P8 16W / 250W | 518MiB / 12203MiB | 0% Default |
±------------------------------±---------------------±---------------------+
| 1 TITAN X (Pascal) Off | 0000:02:00.0 Off | N/A |
| 23% 33C P8 8W / 250W | 1MiB / 12189MiB | 0% Default |
±------------------------------±---------------------±---------------------+

±----------------------------------------------------------------------------+
| Processes: GPU Memory |
| GPU PID Type Process name Usage |
|=============================================================================|
| 0 4320 G /usr/lib/xorg/Xorg 273MiB |
| 0 5309 G compiz 147MiB |
| 0 6562 G …rdSeparatedSigninFlow<PasswordSeparatedSi 96MiB |
±----------------------------------------------------------------------------+

cat /proc/driver/nvidia/version
NVRM version: NVIDIA UNIX x86_64 Kernel Module 367.44 Wed Aug 17 22:24:07 PDT 2016
GCC version: gcc version 5.4.0 20160609 (Ubuntu 5.4.0-6ubuntu1~16.04.2)

I installed CUDA 8.0RC using runfile and also installed the patch for gcc 5.4. However, after I compiled CUDA samples (no issues), I can’t run any of them. For example:
bin/x86_64/linux/release/deviceQuery Starting…

CUDA Device Query (Runtime API) version (CUDART static linking)

cudaGetDeviceCount returned 35
→ CUDA driver version is insufficient for CUDA runtime version
Result = FAIL

By the way, I installed nvidia driver using deb not runfile.

Please help.

Your driver install is broken.

Follow the instructions in the linux install guide for CUDA 8.

Start over with a clean load of the OS, or or follow the instructions in the install guide for removing old installations.

Remove nouveau.

Install the correct driver for your GPU using the runfile installer from www.nvidia.com

Then install CUDA 8RC and answer “no” when prompted to install the driver.

How do I know my driver is broken? X window is fine, nvidia-smi shows the GPUs correctly, nvidia module is loaded.

In deed it’s the driver, apparently driver installed using deb has some cuda issue. Thanks, txbob.