nvmlDeviceSetPowerManagementLimit_v2 with NVML_POWER_SCOPE_MEMORY with H100

Hi,

According NVML API reference guide (NVML API Reference Guide :: GPU Deployment and Management Documentation), the function “nvmlDeviceSetPowerManagementLimit_v2” was added in v535 and NVML_POWER_SCOPE_MEMORY was added in v545. I am using NVML v550.54.15 shipped with CUDA 12.4, with H100 GPU and V100 GPU.

However, nvmlDeviceSetPowerManagementLimit_v2 with NVML_POWER_SCOPE_MEMORY always returns error (NVML_ERROR_NOT_SUPPORTED). By the way, nvmlDeviceSetPowerManagementLimit_v2 with NVML_POWER_SCOPE_GPU works well.

So, would you address following questions? I didn’t find any docs for this.

  1. What NVML version do I need for H100 support?
  2. What NVML version do I need for V100 support?

Thanks,
Jingoo