Slow performance on Azure VM (NVS12v3) with Nvidia Tesla M60 (8GB)

Hello forum,

looks like i´m very stuck here. I´m trying to run a VM in Azure with a Nvidia Tesla M60. The performance is hell (i think about 1-4 frames per second). I followed the Guidelines on how to enable the dedicated GPU but with no effort. I´m using Citrix Workspace (2109) to access the Windows 10 multisession. Wether i use RDP or bastion the problem stays, i did run a test on WebGL water, the performance is very low. Even on my Laptop with non-dedicated graphics the perfomance is compared to the VM very well.

I´m using the Nvidia GRID driver from microsoft (471.83 for Server 2019), dxdiag shows the correct adapter (NVIDIA Tesla M60 instead of the Indirect Display Adapter).

What is the problem here? I wanted to run some 3D, CAD-Application - but i have no luck using the M60. The Graphics utilization monitor always shows (Inactive), it seems that the dedicated GPU is not used at all.

Can you post the output from nvidia-smi -q from within the VM? I’m wondering if the VM is properly licensed…

==============NVSMI LOG==============

Timestamp : Thu Dec 2 12:30:06 2021
Driver Version : 471.68
CUDA Version : 11.4

Attached GPUs : 1
GPU 00000001:00:00.0
Product Name : Tesla M60
Product Brand : Quadro
Display Mode : Enabled
Display Active : Disabled
Persistence Mode : N/A
MIG Mode
Current : N/A
Pending : N/A
Accounting Mode : Disabled
Accounting Mode Buffer Size : 4000
Driver Model
Current : WDDM
Pending : WDDM
Serial Number : 0322718043881
GPU UUID : GPU-e69f6e29-27d2-14ae-1ed2-4e1eefeb37ef
Minor Number : N/A
VBIOS Version : 84.04.9f.00.12
MultiGPU Board : No
Board ID : 0x10000
GPU Part Number : 900-2G402-0000-000
Module ID : 0
Inforom Version
Image Version : G402.0040.00.04
OEM Object : 1.1
ECC Object : 3.0
Power Management Object : N/A
GPU Operation Mode
Current : N/A
Pending : N/A
GSP Firmware Version : N/A
GPU Virtualization Mode
Virtualization Mode : Pass-Through
Host VGPU Mode : N/A
vGPU Software Licensed Product
Product Name : NVIDIA RTX Virtual Workstation
License Status : Licensed (Expiry: N/A)
IBMNPU
Relaxed Ordering Mode : N/A
PCI
Bus : 0x00
Device : 0x00
Domain : 0x0001
Device Id : 0x13F210DE
Bus Id : 00000001:00:00.0
Sub System Id : 0x113A10DE
GPU Link Info
PCIe Generation
Max : 3
Current : 3
Link Width
Max : 16x
Current : 16x
Bridge Chip
Type : N/A
Firmware : N/A
Replays Since Reset : 0
Replay Number Rollovers : 0
Tx Throughput : 0 KB/s
Rx Throughput : 0 KB/s
Fan Speed : N/A
Performance State : P8
Clocks Throttle Reasons
Idle : Active
Applications Clocks Setting : Not Active
SW Power Cap : Not Active
HW Slowdown : Not Active
HW Thermal Slowdown : N/A
HW Power Brake Slowdown : N/A
Sync Boost : Not Active
SW Thermal Slowdown : Not Active
Display Clock Setting : Not Active
FB Memory Usage
Total : 8192 MiB
Used : 206 MiB
Free : 7986 MiB
BAR1 Memory Usage
Total : 256 MiB
Used : 2 MiB
Free : 254 MiB
Compute Mode : Default
Utilization
Gpu : 0 %
Memory : 0 %
Encoder : 0 %
Decoder : 0 %
Encoder Stats
Active Sessions : 0
Average FPS : 0
Average Latency : 0
FBC Stats
Active Sessions : 0
Average FPS : 0
Average Latency : 0
Ecc Mode
Current : Disabled
Pending : Disabled
ECC Errors
Volatile
Single Bit
Device Memory : N/A
Register File : N/A
L1 Cache : N/A
L2 Cache : N/A
Texture Memory : N/A
Texture Shared : N/A
CBU : N/A
Total : N/A
Double Bit
Device Memory : N/A
Register File : N/A
L1 Cache : N/A
L2 Cache : N/A
Texture Memory : N/A
Texture Shared : N/A
CBU : N/A
Total : N/A
Aggregate
Single Bit
Device Memory : N/A
Register File : N/A
L1 Cache : N/A
L2 Cache : N/A
Texture Memory : N/A
Texture Shared : N/A
CBU : N/A
Total : N/A
Double Bit
Device Memory : N/A
Register File : N/A
L1 Cache : N/A
L2 Cache : N/A
Texture Memory : N/A
Texture Shared : N/A
CBU : N/A
Total : N/A
Retired Pages
Single Bit ECC : 0
Double Bit ECC : 0
Pending Page Blacklist : No
Remapped Rows : N/A
Temperature
GPU Current Temp : 26 C
GPU Shutdown Temp : 91 C
GPU Slowdown Temp : 88 C
GPU Max Operating Temp : N/A
GPU Target Temperature : 85 C
Memory Current Temp : N/A
Memory Max Operating Temp : N/A
Power Readings
Power Management : Supported
Power Draw : 16.14 W
Power Limit : 150.00 W
Default Power Limit : 150.00 W
Enforced Power Limit : 150.00 W
Min Power Limit : 112.50 W
Max Power Limit : 162.00 W
Clocks
Graphics : 405 MHz
SM : 405 MHz
Memory : 324 MHz
Video : 405 MHz
Applications Clocks
Graphics : 557 MHz
Memory : 2505 MHz
Default Applications Clocks
Graphics : 557 MHz
Memory : 2505 MHz
Max Clocks
Graphics : 1177 MHz
SM : 1177 MHz
Memory : 2505 MHz
Video : 1083 MHz
Max Customer Boost Clocks
Graphics : N/A
Clock Policy
Auto Boost : On
Auto Boost Default : On
Voltage
Graphics : N/A
Processes
GPU instance ID : N/A
Compute instance ID : N/A
Process ID : 2596
Type : C+G
Name : Insufficient Permissions
Used GPU Memory : Not available in WDDM driver model
GPU instance ID : N/A
Compute instance ID : N/A
Process ID : 2712
Type : C+G
Name : Insufficient Permissions
Used GPU Memory : Not available in WDDM driver model
GPU instance ID : N/A
Compute instance ID : N/A
Process ID : 8348
Type : C+G
Name : C:\Windows\explorer.exe
Used GPU Memory : Not available in WDDM driver model
GPU instance ID : N/A
Compute instance ID : N/A
Process ID : 12800
Type : C+G
Name : Insufficient Permissions
Used GPU Memory : Not available in WDDM driver model
GPU instance ID : N/A
Compute instance ID : N/A
Process ID : 13008
Type : C+G
Name : C:\Windows\SystemApps\Microsoft.Windows.Search_cw5n1h2txyewy\SearchApp.exe
Used GPU Memory : Not available in WDDM driver model
GPU instance ID : N/A
Compute instance ID : N/A
Process ID : 13988
Type : C+G
Name : C:\Program Files (x86)\Autodesk\Autodesk Desktop App\AutodeskDesktopApp.exe
Used GPU Memory : Not available in WDDM driver model

GPU is licesend properly. I’m wondering if you enabled the GPU as default graphics adapter for RDSH? You need to configure a local policy. Otherwise you won’t see GPU utilization in RDP sessions.

Hello Simon,

i don´t intent to use rdp - i´m using Citrix Workspace App to connect remote to my VM.

But i guess you meant this setting:

Correct :)

Right now, i´m reading your article about setting up the right configuration for citrix… (choosing the right remoting protocol…)i found it somewhere on the nvidia-website.

In addition I wouldn’t disable the WDDM driver policy in your screenshot above. Never did this and I don’t really know how this affects the OS.

The Citrix-Support told me to disable it, but i see it´s for VDAs 2006 or later. I´m disabling it now.

I´m using WDDM now. I look at the graphic status bar now, shouldn´t it say GPU:Nvidia?

image

No idea. Never used that indicator bar :) Why not simply check with nvidia-smi if you see GPU load ?
Or use a tool like GPUProfiler to make sure everything works as expected.