NVML issue with virtual A100

Hi, I’m using torchserve and they rely on nvml to monitor some GPU metrics. For the GPU we have it looks like the driver is not exporting that information. Is this a the expected behavior? Depending on your answer we’ll have to modify torchserve code or wait for a bugfix on your side.

The related github issue (with more info) can be found here: