Question about nvmlDeviceGetPowerUsage and gpu power consumption

Developer Tools Other Tools System Management and Monitoring (NVML)
1

Hi everyone.

I found nvmlDeviceGetPowerUsage api from nvml. And as far as I know the power usage in nvidia-smi is based on it.

So I’m wondering, what does its value contain? The GPU itself, or GPU and its associated pcie and nvlink power consumption?

From the doc, it counts the power consumption of the GPU and its associated circuitry. Does the circuitry include pcie and nvlink?

Does anyone know?

Thanks in advance.

2

Yes, both NVLINK and PCIE are interfaces that are built directly into the GPU chip itself. So GPU power includes NVLINK and PCIE.

1 Like
3

OK. Thanks.

4

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.