I want to measure the energy consumed while doing inference on Xavier’s GPU.
I have read Jetson AGX Xavier Thermal Design Guide, so there are sysfs nodes which report voltage and current plus an averaged power over 512 sample.
Now in that doc:
It is recommended to set the sample interval to 1 second or longer.
Given that the inference time is very short, say 30ms, I can’t even get a few power measurements to have an averaged power.
Then the question is, if you wanted to see the energy efficiency of a given model, how would you go for it?