Monitoring GPUs in Kubernetes with DCGM

Technical Blogs & Events Technical Blog
4

Hi ydh0924,

Thanks for reading the blog. Unfortunately, only the profiling metrics are limited to datacenter (previously “Tesla”) branded GPUs such as A100, V100 and T4. However, you can still use dcgm-exporter to get access to other GPU telemetry on GTX and RTX series. For this, you will have to override the ‘arguments’ variable and set it to nil in the Helm chart during installation. For e.g or you can modify values.yaml directly in the Helm chart.

helm install \
  --generate-name \
  gpu-helm-charts/dcgm-exporter \
  --set arguments=null

Doing so, will allow dcgm-exporter to give you all the GPU telemetry (just not the profiling metrics) and not result in an error during startup.
Hope that helps!

1 Like