3 brand new dell r730 with an m60 in each (factory shipped) each of them throwing the same error with nvidia-smi:
Unable to determine the device handle for GPU 0000:05:00.0: Unable to communicate with GPU because it is insufficiently powered.
This may be because not all required external power cables are attached, or the attached cables are not seated properly.
running latest esxi 3825889, applied Dell recommended BIOS settings as per http://www.nvidia.com/content/grid/pdf/grid-vgpu-deployment-guide.pdf
installed latest grid driver: 361.45.09-1OEM.600.0.0.2494585 from licensing portal
ran gpumodeswitch on all hosts to switch all gpu’s to graphics mode and confirmed with lspci -n | grep 10de:
0000:05:00.0 Class 0300: 10de:13f2 [vmgfx0]
0000:06:00.0 Class 0300: 10de:13f2 [vmgfx1]
A VM with vGPU starts on one host but not on another > Failed to start the virtual machine.
Module DevicePowerOn power on failed.
Could not initialize plugin ‘/usr/lib64/vmware/plugin/libnvidia-vgx.so’ for vGPU ‘grid_m60-0b’.
No graphics device is available for vGPU ‘grid_m60-0b’.
maybe it’s just a wiring issue, I will have to check that tomorrow when going on site