nvidia-smi not fully supported on GTX 1060

Hello.

I am building a mining rig running under Ubuntu 16.04 LTS server (no graphics shell installed). Driver version is 375.66. I have two GTX 970 cards and two GTX 1060 cards. My objective is to get the best mining performance out of these GPUs.

I can put GTX 970’s into P0 state by first quering SUPPORTED_CLOCKS and then issuing the nvidia-smi -i -ac 3505,1455. However, for the GTX 1060 I cannot either query supported clocks nor set them.

nvidia-smi -i 0 -q -d SUPPORTED_CLOCKS for GTX 1060 returns:

Supported Clocks: N/A

nvidia-smi -i 0 -ac 3505,1455 gives msg:

Settings applications clocks is not supported for GPU 0000:01:00.0.

However, I can set the power limit with the -pl command for both 970s and 1060s. But I cannot put 1060 into P0 state. I cannot overclock any of the cards, if I try any value besides 3505,1455 (which is default for that card), I get:

Specified clock combination (MEM 3505, SM 1555) is not supported for GPU 0000:06:00.0. Run ‘nvidia-smi…’ to see list of supported clock combinations.

I have exactly the very same problem. My gtx 1060 card is marked as OC, that is I assume OverClocked (by manufacturer already) so I assume for that reason further overclocking is disabled on purpose? Is your card labeled OC as well?

Well, most card are marked as OC these days, it’s a marketing gimmick, nothing more, really. ))

same problem here. model is evga 1060 sc…

Ok, I just installed a graphical Linux (Lubuntu 16.04) to check if it had anything to do with the absence of X, but it is still the same :(
However, this time I got another error message when I tried to set clocks with nvidia-settings:

(nvidia-settings:3520): WARNING **: Error retrieving accessibility bus address: org.freedesktop.DBus.Error.ServiceUnknown: The name org.a11y.Bus was not provided by any .service files

maybe this helps to track the issue…

I would really like to know if it’s a problem that the vendor of the card needs to fix (like with a bios update) or if this can be fixed on the driver side.

I’d also like to suggest to implement the overclocking features from nvidia-settings into nvidia-smi to let people without a graphical system also overclock.

I’m sure it’s driver issue. In fact, if I install an even older GPU (e.g. GTX 780), it DOES work with this driver, however, I cannot even set the power limit. No tweaks at all, nothing.

Setting the power limit works with my EVGA 1060 SC. But I cannot switch power state, set clocks etc.
Without any of the NVidia guys we are stuck I guess. So lets just hope we’ll get an answer here.

Yep. Funny thing, GTX 780 is the opposite: it can set clocks, but cannot set power limit. :)

My MSI GTX 960just works fine. I can set PL, push it into P0 by setting the clocks manually and overclock core/memory without problems under Ubuntu 16.04. Only my 1060 are making problems.

Maybe one of the nvidia guys can give us a statement? At the moment, I do not 100% know if it’s the driver, gpu-bios or whatever…

I am also not able to set the power limit of my GTX 1060 cards on my Ubuntu 16.04 mining rig. I already opened a thread here: https://devtalk.nvidia.com/default/topic/1011633/linux/nvidia-smi-power-limit-on-gtx-1060-/
and unfortunately the support wasn’t able to reproduce the issue

-pl switch works for me on MSI GTX 1060. Setting clocks does not. Driver ver 381.22. I don’t see how this is dependent on the card manufacturer, though. Is it limitation in your vbios?

I have the same issue

Cards: Gigabyte gtx 1060, Asus Dual gtx 1060 3Gb

Drivers:
375.66
381.22

I’ve also found out something weird. Whatever cards do support the -ac command, they do not support it fully. For GTX 970 I can use the -ac key, but the only thing it does, is put the card in P0 state. It does not really set clock values. I can specify any clocks from the supported table (albeit very low values), but the videocard always goes into P0 state and works to its full potential. I can get it back to P2 state using the -rac key.

application clocks are not at all made for the overclocking. the -ac P0 thing was more a bug on the maxwell than a feature…

The only way to do “OC” (or the reverse) on linux is to use clock offsets via nvidia-settings and Coolbits

well…setting the clocks should work via nvidia-smi -ac (no matter if it changes to P0 or not, this was just a side-effect). However, the current bug is, that it’s not possible for the 1060 (and maybe other cards).

I don’t really care if it shows P2, P0 or P1000 as long as I can set the clocks. Too bad that there is not even a reply from the devs.

If it’s a problem with nvidia-smi and it will take a while for a fix, that’s ok, as long as I know where the problem is. It’s just very time consuming to try all the drivers, install new OS, check google etc.

This is what I’ve been discovering on my 1070. The downclock has become a thorn in the side of us using GeForce cards for GPU rendering. But I was trying to set the clocks for mining and I kept getting told that I can’t set application clocks with 375.26. I can set a clock offset in nvidia-settings with no issue, however. And everything seems to be working fine.

still no answer

Put me down for a Me Too. 375.66 on Ubuntu 17.04.

On 1060s I can not change application clocks nor can I effect clock offsets. I have no problem changing these on a 970 or 980. I can change the power limit OK.

Recently purchased three PNY 1060 3GB and having the same problem. I can get them limited to about 80 watts but nothing less and even at -pl 80, it exceeds this threshold for limited power. Below are the specs for my specific cards.

Learn more about the PNY Technologies, Inc. VCGGTX10603PB

Model
Brand
PNY
Model
VCGGTX10603PB

Interface
Interface
PCI Express 3.0 x16

Chipset
Chipset Manufacturer
NVIDIA
GPU Series
NVIDIA GeForce GTX 10 Series
GPU
GeForce GTX 1060
Core Clock
1506 MHz
Boost Clock
1708 MHz
CUDA Cores
1152

Memory
Effective Memory Clock
8 Gbps
Memory Size
3GB
Memory Interface
192-Bit
Memory Type
GDDR5

3D API
DirectX
DirectX 12
OpenGL
OpenGL 4.5

Ports
HDMI
1 x HDMI 2.0b
Multi-Monitor Support
Yes
DisplayPort
3 x DisplayPort 1.4
DVI
1 x DL-DVI

Details
Max Resolution
7680 x 4320
Virtual Reality Ready
Yes
Cooler
With Fan
System Requirements
PCI Express-compliant motherboard with one dual-width x16 graphics slot

One 6-pin PCI Express supplementary power connectors

Minimum 400W or greater system power supply

300MB of available hard-disk space

2GB system memory (4GB or higher recommended)

Windows 7 - 10, Linux, FreeBSDx86

DVD-ROM drive and Internet connection

TDP: 120W
Power Connector
6-Pin
Dual-Link DVI Supported
Yes

Features
Features
VR Ready

Simultaneous Multi-Projection

NVIDIA Ansel Support

NVIDIA G-SYNC

NVIDIA GameStream

NVIDIA GPU Boost 3.0

Microsoft DirectX 12 Support

Vulkan API Support

Open GL 4.5 Support

PCI Express 3.0

Max Digital Resolution: 7680 x 4320 at 60Hz

Display Connectors:
3 x DisplayPort 1.4
HDMI 2.0b
DL-DVI

Form Factor & Dimensions
Max GPU Length
251 mm
Card Dimensions (L x H)
9.85" x 4.53"
Slot Width
Dual Slot

Here is some output from nvidia-smi after changing the power limit on the card, happens when using a single card or multiple cards. It seems to me that the min allowed power of 60W (shown with nvidia-smi -q) is actually 80W???

This is what I get after changing just one card to 75W -pl:

#After -pl 75
Sun Jun 18 18:15:30 2017       
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 375.66                 Driver Version: 375.66                    |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|===============================+======================+======================|
|   0  GeForce GTX 106...  Off  | 0000:01:00.0      On |                  N/A |
| 42%   66C    P2    82W /  75W |    823MiB /  3013MiB |    100%      Default |
+-------------------------------+----------------------+----------------------+
|   1  GeForce GTX 106...  Off  | 0000:02:00.0     Off |                  N/A |
| 25%   36C    P8     4W / 120W |      3MiB /  3013MiB |      0%      Default |
+-------------------------------+----------------------+----------------------+
|   2  GeForce GTX 106...  Off  | 0000:04:00.0     Off |                  N/A |
| 25%   32C    P8     4W / 120W |      3MiB /  3013MiB |      0%      Default |
+-------------------------------+----------------------+----------------------+
|   3  GeForce GTX 750 Ti  Off  | 0000:08:00.0     Off |                  N/A |
| 33%   31C    P8     1W /  38W |      3MiB /  2000MiB |      0%      Default |
+-------------------------------+----------------------+----------------------+

And after setting all cards to 65W power limit:

#After setting rest of cards to 65
disilicate@disilicate:~$ nvidia-smi
Sun Jun 18 18:20:13 2017       
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 375.66                 Driver Version: 375.66                    |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|===============================+======================+======================|
|   0  GeForce GTX 106...  Off  | 0000:01:00.0      On |                  N/A |
| 32%   55C    P2    81W /  65W |    828MiB /  3013MiB |    100%      Default |
+-------------------------------+----------------------+----------------------+
|   1  GeForce GTX 106...  Off  | 0000:02:00.0     Off |                  N/A |
| 26%   49C    P2    82W /  65W |    576MiB /  3013MiB |    100%      Default |
+-------------------------------+----------------------+----------------------+
|   2  GeForce GTX 106...  Off  | 0000:04:00.0     Off |                  N/A |
| 25%   44C    P2    86W /  65W |    576MiB /  3013MiB |     98%      Default |
+-------------------------------+----------------------+----------------------+
|   3  GeForce GTX 750 Ti  Off  | 0000:08:00.0     Off |                  N/A |
| 33%   38C    P0    19W /  38W |    539MiB /  2000MiB |    100%      Default |
+-------------------------------+----------------------+----------------------+

I am also using these card for mining purposes. Have been mining for 2+ years and never had an issue with a card as badly as I am having with these. My six 960s stay super cool without effort, and pull very little wattage. The 1070s in my miners are not even as hot as these. I’m having difficulty keeping the cards under 74C when under load.

Just thought I would share as another who is having the same issue. I’d be more than happy to provide any information needed to help troubleshoot this particular issue. I’m using Linux Ubuntu 16.04 with their latest driver 375.66.