Nvidia-smi: gpm-metrics not populated

Development Tools Other Tools System Management and Monitoring (NVML)
1

When running ‘nvidia-smi dmon --gpm-metrics=2,3,4,5’ (other metric choices present the same issue)
each gpm metric is reported as ‘0’ for the first update and ‘-’ thereafter.

System:
Ubuntu 20.04.5 LTS (GNU/Linux 5.15.0-1013-oracle x86_64)
NVIDIA A100-SXM4-80GB
NVIDIA-SMI 525.60.13

and same result on Windows:
Windows 10 Pro 64-bit
NVIDIA GeForce RTX 3090
NVIDIA-SMI 526.47

Is a specific version of nvml / debug mode / system configuration required for accessing these stats?

2

Since nvidia-smi wraps nvml, I wrote a quick C++ nvml program to test gpm-metrics queries. ‘nvmlGpmQueryDeviceSupport’ returns isSupportedDevice=0 for both cards listed above (both Ampere).

From the NVML API ref, Ampere is not listed as a fully supported device architecture.

nvidia-smi man page also states “If any of the metric is not supported on the device or any other error in fetching the metric is reported as “-” in the output data.”