I am having a few issues currently with compute speed on GTX 1080s and Titan XPs slowing down significantly during computation. The variations in speed change from trial to trial, and are enormous (slowdowns of a factor of 60 or more for periods of time that vary in length). When I run the code through nvvp the kernel execution speeds seem reasonable, but large “white-spaces” open up between kernel launches. These gaps are not explainable in terms of waiting for synchronous events to complete or any other host code in-between. I am guessing it could be heat related, but am surprised at that because the box sits in a cold server room. Interestingly a slightly older version of the code compiled with CUDA 7.5 doesn’t seem to have this problem, but the development code compiled with either 9.2 and 10.1 does. Has anyone else noticed erratic compute performance in their code?