Thanks for the quick response, Robert.
It’s interesting, the power consumption of the FP8 test actually never goes above 300 watts in nvidia-smi, despite 450W default power limit for the 4090. Of my 4 tests, the most power intensive one is the INT8 → INT32 which hits around 380 watts. I’ve also been able to max out the power limit in other applications. Clock speeds also seem reasonably close to the rated boost clock (~2.5GHz).
Any chance you could get some additional clarification from someone within NVIDIA?