Tesla T4 - Low FPS during video and overall session latency

NVIDIA Virtual GPU Forums Virtual GPU XenDesktop
#1

GPU Tesla T4
CISCO UCS C240M5
VMware ESXI 6.7
CPU Xeon Gold 6146 x2
Citrix Xen Desktop 7.15
Citrix Receiver 1911
Citrix VDA 1912 LTSR
GPU Driver Version 441.66
vGPU Profile used - grid_t4-2b and also grid_t4-2a
ICA Network Latency is 1-2 MS
ICA Round Trip Time is 5-100 MS
Display is 3x 2560x1440p Monitors. Same behavior with only 1x 2560x1440p

Playback via YouTube or any other stream is choppy, even at 1080p

FPS is often around 15-18 which seems quite low. I’ve tried both codecs (H.264 4:4:4 and H.264 2:2:0) (same behavior)

If anyone has any insight or ideas, let me know.

https://www.nvidia.com/content/dam/en-zz/Solutions/design-visualization/solutions/resources/documents1/NVIDIA-vgpu-choosing-the-right-remoting-protocol-whitepaper.pdf

#2

First of all it would be helpful to figure out the difference between rendered frames and remoted frames.
Check with "nvidia-smi encodersessions" how many frames are rendered and if you are properly using video codec with NVENC.

#3

Thanks - See the output below and images.

https://imgur.com/a/7nVDgEW

https://imgur.com/a/UiUVV9k

https://imgur.com/a/9KIvC5u

GPU Session Process Codec H V Average Average

Idx Id Id Type Res Res FPS Latency(us)

0      65       2156   H.264    2560    1440      14       11513
0      66       2156   H.264    2560    1440      73       12596
0      67       2156   H.264    2560    1440      49        9348
0      65       2156   H.264    2560    1440      23       10527
0      66       2156   H.264    2560    1440      69        9903
0      67       2156   H.264    2560    1440      47       10926
0      65       2156   H.264    2560    1440      23       10621
0      66       2156   H.264    2560    1440      20       10323
0      67       2156   H.264    2560    1440      44       10221
0      65       2156   H.264    2560    1440      27       10590
0      66       2156   H.264    2560    1440      32       11146
0      67       2156   H.264    2560    1440      32       10844
0      65       2156   H.264    2560    1440      22        9287
0      66       2156   H.264    2560    1440      24       12186
0      67       2156   H.264    2560    1440      40       10161
0      65       2156   H.264    2560    1440      13       10905
0      66       2156   H.264    2560    1440     100        9909
0      67       2156   H.264    2560    1440      50       10152
0      65       2156   H.264    2560    1440      10       10218
0      66       2156   H.264    2560    1440      10       10152
0      67       2156   H.264    2560    1440      44        9993
0      65       2156   H.264    2560    1440      14        9605
0      66       2156   H.264    2560    1440       7       10288
0      67       2156   H.264    2560    1440      53       10146
0      65       2156   H.264    2560    1440      15        7578
0      66       2156   H.264    2560    1440     100        5728
0      67       2156   H.264    2560    1440      63        7646
0      65       2156   H.264    2560    1440      23        4546
0      66       2156   H.264    2560    1440      31        4433
0      67       2156   H.264    2560    1440       0           0

GPU Session Process Codec H V Average Average

Idx Id Id Type Res Res FPS Latency(us)

0      65       2156   H.264    2560    1440      12        5196
0      66       2156   H.264    2560    1440       0           0
0      67       2156   H.264    2560    1440       0           0
0      65       2156   H.264    2560    1440      31        4512
0      66       2156   H.264    2560    1440     131        4454
0      67       2156   H.264    2560    1440      95        4504
0      65       2156   H.264    2560    1440      19        8485
0      66       2156   H.264    2560    1440       0           0
0      67       2156   H.264    2560    1440       0           0
0      65       2156   H.264    2560    1440      13        8737
0      66       2156   H.264    2560    1440       0           0
0      67       2156   H.264    2560    1440       0           0
0      65       2156   H.264    2560    1440       7        8644
0      66       2156   H.264    2560    1440       0           0
0      67       2156   H.264    2560    1440       0           0

[root@HBC-DC1-ESX13:~] nvidia-smi encodersessions

GPU Session Process Codec H V Average Average

Idx Id Id Type Res Res FPS Latency(us)

0      65       2156   H.264    2560    1440      15       10616
0      66       2156   H.264    2560    1440       0           0
0      67       2156   H.264    2560    1440      47       10615
0      65       2156   H.264    2560    1440       6        9249
0      66       2156   H.264    2560    1440       0           0
0      67       2156   H.264    2560    1440      57        9541
0      65       2156   H.264    2560    1440      11       10534
0      66       2156   H.264    2560    1440       0           0
0      67       2156   H.264    2560    1440      56        9757
0      65       2156   H.264    2560    1440      13       10009
0      66       2156   H.264    2560    1440       0           0
0      67       2156   H.264    2560    1440      54        9662
0      65       2156   H.264    2560    1440       9        9200
0      66       2156   H.264    2560    1440       0           0
0      67       2156   H.264    2560    1440      56        9585
0      65       2156   H.264    2560    1440      13       10333
0      66       2156   H.264    2560    1440       0           0
0      67       2156   H.264    2560    1440      53        9759
0      65       2156   H.264    2560    1440      11        9826
0      66       2156   H.264    2560    1440       0           0
0      67       2156   H.264    2560    1440      55        9981
0      65       2156   H.264    2560    1440       8       12013
0      66       2156   H.264    2560    1440       0           0
0      67       2156   H.264    2560    1440      51        9686
0      65       2156   H.264    2560    1440       8       10967
0      66       2156   H.264    2560    1440       0           0
0      67       2156   H.264    2560    1440      56       10536
0      65       2156   H.264    2560    1440       7        9894
0      66       2156   H.264    2560    1440       0           0
0      67       2156   H.264    2560    1440      54        9682

GPU Session Process Codec H V Average Average

Idx Id Id Type Res Res FPS Latency(us)

0      65       2156   H.264    2560    1440       8       12130
0      66       2156   H.264    2560    1440      91       10868
0      67       2156   H.264    2560    1440      49        9755
0      65       2156   H.264    2560    1440      99       10070
0      66       2156   H.264    2560    1440       0           0
0      67       2156   H.264    2560    1440      59        9849
0      65       2156   H.264    2560    1440      13       11407
0      66       2156   H.264    2560    1440       0           0
0      67       2156   H.264    2560    1440      49       10220
0      65       2156   H.264    2560    1440      16       10127
0      66       2156   H.264    2560    1440       0           0
0      67       2156   H.264    2560    1440      54       10540
0      65       2156   H.264    2560    1440      12       11520
0      66       2156   H.264    2560    1440       0           0
0      67       2156   H.264    2560    1440      55        9914
0      65       2156   H.264    2560    1440      12       11352
0      66       2156   H.264    2560    1440       0           0
0      67       2156   H.264    2560    1440      54       10005
0      65       2156   H.264    2560    1440      10       11601
0      66       2156   H.264    2560    1440       0           0
0      67       2156   H.264    2560    1440      58        9936
0      65       2156   H.264    2560    1440       8       11175
0      66       2156   H.264    2560    1440       0           0
0      67       2156   H.264    2560    1440      56        9688
0      65       2156   H.264    2560    1440      13       10256
0      66       2156   H.264    2560    1440       0           0
0      67       2156   H.264    2560    1440      57       10131
0      65       2156   H.264    2560    1440       6       13011
0      66       2156   H.264    2560    1440       0           0
0      67       2156   H.264    2560    1440      60        9963
#4

Hi

Your encoding latency is all over the place, and it’s actually quite high. Can you try something not from YouTube. Use a local source, something loaded locally on to the VM to rule out your streaming source.

What are you using as a Client and how is it connected to the network? If WiFi, use a physical cable. You may also want to try a completely different network connection as well. Ping times don’t tell the whole story.

Regards

MG