Compute Mode "Prohibited" (GRID M60)

Virtual GPU Forums More vGPU Forums NVIDIA Virtual GPU Technology
1

Dear all,
I´ve virtualized a NVIDIA Tesla M60 in order to use it from several virtual machines.
When I apply the GRID M60-8Q GPU Profile for a virtual machine I can see, with the "nvidia-smi.exe", that the Compute Mode is "Default":

C:\Program Files\NVIDIA Corporation\NVSMI>nvidia-smi
Thu Sep 07 18:11:22 2017
±----------------------------------------------------------------------------+
| NVIDIA-SMI 370.12 Driver Version: 370.12 |
|-------------------------------±---------------------±---------------------+
| GPU Name TCC/WDDM | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
|===============================+======================+======================|
| 0 GRID M60-8Q WDDM | 0000:02:04.0 On | N/A |
| N/A N/A P0 N/A / N/A | 755MiB / 8192MiB | 4% Default |
±------------------------------±---------------------±---------------------+

±----------------------------------------------------------------------------+
| Processes: GPU Memory |
| GPU PID Type Process name Usage |
|=============================================================================|
| 0 1600 C+G Insufficient Permissions N/A |
±----------------------------------------------------------------------------+

But when I apply any other GPU Profile (for instance, GRID M60-2Q), the Compute Mode is "Prohibited" and I can´t manage to change it to "Default" (although the result from "nvidia-smi -c 0" is "Set compute mode to DEFAULT for GPU 0000:02:04.0. All done", "nvidia-smi.exe" and "nvidia-smi -q -d compute" continue to report "Prohibited":

C:\Program Files\NVIDIA Corporation\NVSMI>nvidia-smi
Thu Sep 07 17:51:57 2017
±----------------------------------------------------------------------------+
| NVIDIA-SMI 370.12 Driver Version: 370.12 |
|-------------------------------±---------------------±---------------------+
| GPU Name TCC/WDDM | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
|===============================+======================+======================|
| 0 GRID M60-2Q WDDM | 0000:02:04.0 On | N/A |
| N/A N/A P0 N/A / N/A | 355MiB / 2048MiB | 0% Prohibited |
±------------------------------±---------------------±---------------------+

±----------------------------------------------------------------------------+
| Processes: GPU Memory |
| GPU PID Type Process name Usage |
|=============================================================================|
| 0 4432 C+G Insufficient Permissions N/A |
±----------------------------------------------------------------------------+

C:\Program Files\NVIDIA Corporation\NVSMI>nvidia-smi -c 0
Set compute mode to DEFAULT for GPU 0000:02:04.0.
All done.

C:\Program Files\NVIDIA Corporation\NVSMI>nvidia-smi
Thu Sep 07 17:52:26 2017
±----------------------------------------------------------------------------+
| NVIDIA-SMI 370.12 Driver Version: 370.12 |
|-------------------------------±---------------------±---------------------+
| GPU Name TCC/WDDM | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
|===============================+======================+======================|
| 0 GRID M60-2Q WDDM | 0000:02:04.0 On | N/A |
| N/A N/A P0 N/A / N/A | 355MiB / 2048MiB | 0% Prohibited |
±------------------------------±---------------------±---------------------+

±----------------------------------------------------------------------------+
| Processes: GPU Memory |
| GPU PID Type Process name Usage |
|=============================================================================|
| 0 4432 C+G Insufficient Permissions N/A |
±----------------------------------------------------------------------------+

C:\Program Files\NVIDIA Corporation\NVSMI>nvidia-smi -q -d compute

==============NVSMI LOG==============

Timestamp : Thu Sep 07 17:53:08 2017
Driver Version : 370.12

Attached GPUs : 1
GPU 0000:02:04.0
Compute Mode : Prohibited

So, could somebody tell me how to set Compute Mode "Default" for this GRID M60-2Q Profile?
Thank you very much!

2

Hi

Same answer as this post: https://gridforums.nvidia.com/default/topic/1603/nvidia-grid-vgpu/compute-m-prohibited-in-tesla-vgrid-m60-2q/

You guys posted the same thing 3 hours apart :-)

If you want to run CUDA on vGPU profiles other than 8Q, you need a Pascal GPU.

I’m inquiring with NVIDIA Engineering to understand whether this is a technical limitation between Maxwell / Pascal GPUs

Regards

3

Nice quick response from the NVIDIA Engineering Team as to why CUDA is only available with multiple vGPU profiles on Pascal GPUs:

"… Pascal has a new hardware feature called Preemption that allows Compute on vGPU profiles. Preemption is a feature that allows task Context switching. It gives the GPU the ability to essentially pause and resume a task …"

This feature doesn’t exist on Maxwell, which is why you can only use CUDA with an 8Q vGPU profile or Passthrough.

Regards

4

Yes, we posted the same task by mistake! We work together but it seems we are a little "disconnected" :-)

Thank you very much both of you BJones and mcerveny for your great help. It was very useful for us!

Kind regards