Hey I am having similar issues with the same Board.
Running two A6000 and they wont go over 480 mhz. But when I benchmark those GPUs with the render I am using they land in the predicted time estimate (even faster). So I wonder if thats something nvidia-smi related, with reporting wrong clocks?