Nvidia A2 not being used for computing

Hi guys,

I got a virtual machine running with windows server 2016 (also tried it on win srv 2022) with an nvidia A2 GPU passed through to it. The passthrough of the GPU is working correctly as vmware support confirmed in a remote session.
So the nvidia A2 shows up in my device manager etc. I can see it in GPU Z.
But when I run benchmarks there is no difference between running them with or without the gpu. So it is obviously not doing anything.
Did someone experience similar?

I already tried clean installing the driver.