Energy consumption for inference

Robotics & Edge Computing Jetson & Embedded Systems Jetson AGX Xavier
1

Hello All,

I want to measure the energy consumed while doing inference on Xavier’s GPU.

I have read Jetson AGX Xavier Thermal Design Guide, so there are sysfs nodes which report voltage and current plus an averaged power over 512 sample.

Now in that doc:

It is recommended to set the sample interval to 1 second or longer.

Given that the inference time is very short, say 30ms, I can’t even get a few power measurements to have an averaged power.

Then the question is, if you wanted to see the energy efficiency of a given model, how would you go for it?

Thanks,

2

Hi, is it possible to run this inference repeatedly? If yes, there should be enough sampled values for average power calculating with 1 second interval.