Unable to enable CUDA - Double Precision on GeForce GTX Titan Black

Accelerated Computing CUDA CUDA Setup and Installation
1

Hello,

My configuration:
Ubuntu 16.04
Xeon E5 2680 v2 (2.8 GHz 10 core)
ASRock mobo EPC602D8A
32 GB DDR3 1866 MHz
Tesla K20
GeForce GTX Titan Black
CUDA 8.0 GA2
Nvidia 384.11 driver

I am trying to use the GeForce Titan Black for double precision compute purposes (SuiteSparse) since it is capable of 1.7 TFLOPS. However, when I run ./nbody -benchmark -fp64 (from cuda/samples), I see 1/10 of that performance:

Windowed mode
Simulation data stored in video memory
Double precision floating point simulation
1 Devices used for simulation
gpuDeviceInit() CUDA Device [1]: "GeForce GTX TITAN
Compute 3.5 CUDA device: [GeForce GTX TITAN]
12288 bodies, total time for 10 iterations: 326.616 ms
= 4.623 billion interactions per second
= 138.690 double-precision GFLOP/s at 30 flops per interaction

My Tesla K20 is capable of 1.1 TFLOPS and at manages about 7/10s of that:

Windowed mode
Simulation data stored in video memory
Double precision floating point simulation
1 Devices used for simulation
gpuDeviceInit() CUDA Device [0]: "Tesla K20c
Compute 3.5 CUDA device: [Tesla K20c]
13312 bodies, total time for 10 iterations: 69.488 ms
= 25.502 billion interactions per second
= 765.067 double-precision GFLOP/s at 30 flops per interaction

I spent time researching the activation of double precision performance on the Titan Black, they recommended I use:

sudo nvidia-settings

And check the box that says “CUDA - Double precision”, in the GeForce GTX Titan tab.

However, when I check the box, it fails to set double precision - it reads out:

“Failed to set CUDA - Double precision configuration!”

I also tried to set the double precision attribute via terminal with:

sudo nvidia-settings -a [gpu:1]/GPUDoublePrecisionBoostImmediate=1

But the benchmark results posted above for the Titan Black remain the same. That same thread (https://devtalk.nvidia.com/default/topic/534302/turning-on-dp-for-nvidia-titan-on-headless-server-/) mentions the source code for nvidia-settings, so I tried to track this error message down in the ctkpowermizer.c, but I was unable to find the true origin of the failure:

https://github.com/NVIDIA/nvidia-settings/blob/d9436550d5e2bb227d94bd132df3b2800ed5c251/src/gtk%2B-2.x/ctkpowermizer.c

Does anyone have any idea why I am unable to set the Double Precision Boost for my Titan Black?

Cheers,

Robert