I am using nvidia-smi for collecting CUDA application runtime statistics. The utility nvidia-smi gives the utilization of GPU core and memory like following:
==============NVSMI LOG==============
Timestamp : Mon Feb 21 17:43:56 2011
Driver Version : 260.19.26
GPU 0:
Product Name : GeForce 8800 GTX
PCI Device/Vendor ID : 19110de
PCI Location ID : 0:4:0
Board Serial : 211561763875
Display : Connected
Temperature : 57 C
Fan Speed : 60%
Utilization
GPU : 47%
Memory : 1%
My question is how are the ‘Utilization of GPU’ and ‘Utilization of memory’ defined? For example, GPU core’s utilization is 47%. It means there are 47% of SMs active working? Or all the GPU cores are busy in 47% time while idle other 53% time? For memory, the utilization stands for the ratio between current bandwidth and max bandwidth, or the busy time ratio in last time unit?
Thanks for any suggestion.