My GPU RTX A6000 is used full available power due to report from nvtop (300W of 300W). If I understand correctly it must use less power because we use tensor cores instead of cuda cores. Whats going on and how to fix power consumption?
Hi,
Request you to share the ONNX model and the script if not shared already so that we can assist you better.
Alongside you can try few things:
validating your model with the below snippet
check_model.py
import sys
import onnx
filename = yourONNXmodel
model = onnx.load(filename)
onnx.checker.check_model(model).
2) Try running your model with trtexec command.
In case you are still facing issue, request you to share the trtexec “”–verbose"" log for further debugging
Thanks!