I wanna profile GPU SM active and SM occupancy to view acutal load of GPU. As we know, nsight or nvprofil can get this metrics, but this tools are bind with CUDA application. How can I get this metrics from device aspect like dcgm or nvml api? NVML API had already support SM active and SM occupancy on Hopper or newer devices(NVML API Reference Guide :: GPU Deployment and Management Documentation). However, Ampere architecture is not support. what should I do to get real GPU util for my nvidia A10?
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| How to monitor SM utilization and SM occupancy? | 7 | 12024 | January 12, 2024 | |
| How to get real-time SM occupancy | 1 | 2292 | August 16, 2022 | |
| Measuring the GPU Occupancy of Multi-stream Workloads | 1 | 221 | April 20, 2024 | |
| Utilization report in Nsight Systems | 2 | 402 | July 4, 2024 | |
| Measure SM utilization per process | 1 | 1365 | January 11, 2024 | |
| GPU utilization | 8 | 6904 | August 21, 2019 | |
| Does nvidia-smi & nvml and cudaMemGetInfo return the totoal GPU memory utilization including OpenGL when CUDA-OpenGL-interop? | 0 | 421 | December 19, 2023 | |
| How to monitor the GPU hardware resources usage state at any time? | 3 | 1263 | April 4, 2019 | |
| Is there any way to see SM activity/SM util on P100？ | 3 | 419 | November 7, 2023 | |
| How to profile overall SM utilization of the program by Nsight Compute? | 9 | 2366 | July 27, 2023 |