Get tensor core usage through nvml

Is there a way to monitor real time usage of tensor cores through some API? I couldn’t find anything on the nvml api, with the only option being nsight, which isn’t able to do real time monitoring.

1 Like

The CUPTI Metric API seems to have some tensor utilization functions.

You can do this with Data Center GPU Manager (DCGM)

Download from here: