How to monitor tensor cores utilization?

Is it possible to monitor tensor cores usage like “nvidia-smi dmon”?

Hi ,
We recommend you to check the supported features from the below link.
https://docs.nvidia.com/deeplearning/tensorrt/support-matrix/index.html
You can refer below link for all the supported operators list.
For unsupported operators, you need to create a custom plugin to support the operation

Thanks!

I need to monitoring of utilization of tensor cores, is it possible?

Hi @kirpasaccessory,

You can use profiler to monitor utilization, Please refer
https://docs.nvidia.com/deeplearning/frameworks/dlprof-user-guide/index.html
https://docs.nvidia.com/deeplearning/tensorrt/best-practices/index.html#nvprof

So without profiler is it impossible?
For example I want to check if my tensorflow model actualy used tensor cores under training…

Yes, to monitor Tensor cores utilization we have to use profiler. Please refer above docs for more details.