CloudXR streaming from VMWare instance with Quadro RTX 8000-16Q encoder not powerful enough

Hi there,

We’re trying to stream from a Windows instance in VMWare. The stream will connect, but then will freeze/crash the client after a few seconds. Looking at logs, we are seeing that CloudXR doesn’t think the video encoder is powerful enough to encode the stream:

#1(M)[2022-07-21 12:30:33,731]=08:30:33=*00001*{5752}&8BAD092A&<VideoEncoder>     Initializing NvEnc10VideoEncoder.
#2(M)[2022-07-21 12:30:33,731]=08:30:33=*00000*{5752}&2A6D6983&<NvEnc10VideoEnco> Using NvEnc header version 10.0.
#3(W)[2022-07-21 12:30:33,846]=08:30:33=*00114*{5752}&5855CDE4&<Utils>            Failed to get primary display ID, error code: -6
#4(I)[2022-07-21 12:30:33,846]=08:30:33=*00000*{5752}&63E4AB2C&<NvEncUtil>        Generating SPS/PPS header for 1280x720@30 FPS in video format H.264.
#5(I)[2022-07-21 12:30:33,847]=08:30:33=*00001*{5752}&06B0CEE1&<NvEnc10VideoEnco> Encoder maxLumaPixelsPerSec[0] 0
#6(I)[2022-07-21 12:30:33,847]=08:30:33=*00000*{5752}&06B0CEE1&<NvEnc10VideoEnco> Encoder maxLumaPixelsPerSec[1] 0
#7(W)[2022-07-21 12:30:33,847]=08:30:33=*00000*{5752}&6474EB61&<NvEncUtil>        Encoder does not have enough performance to support this format.
#8(I)[2022-07-21 12:30:33,848]=08:30:33=*00000*{5752}&63E4AB2C&<NvEncUtil>        Generating SPS/PPS header for 1280x720@60 FPS in video format H.264.
#9(W)[2022-07-21 12:30:33,848]=08:30:33=*00000*{5752}&6474EB61&<NvEncUtil>        Encoder does not have enough performance to support this format.
#0(I)[2022-07-21 12:30:33,848]=08:30:33=*00000*{5752}&63E4AB2C&<NvEncUtil>        Generating SPS/PPS header for 1920x1080@30 FPS in video format H.264.
#1(W)[2022-07-21 12:30:33,848]=08:30:33=*00000*{5752}&6474EB61&<NvEncUtil>        Encoder does not have enough performance to support this format.
#2(I)[2022-07-21 12:30:33,848]=08:30:33=*00000*{5752}&63E4AB2C&<NvEncUtil>        Generating SPS/PPS header for 1920x1080@60 FPS in video format H.264.
#3(W)[2022-07-21 12:30:33,848]=08:30:33=*00000*{5752}&6474EB61&<NvEncUtil>        Encoder does not have enough performance to support this format.
#4(I)[2022-07-21 12:30:33,848]=08:30:33=*00000*{5752}&63E4AB2C&<NvEncUtil>        Generating SPS/PPS header for 3840x2160@30 FPS in video format H.264.
#5(W)[2022-07-21 12:30:33,848]=08:30:33=*00000*{5752}&6474EB61&<NvEncUtil>        Encoder does not have enough performance to support this format.
#6(I)[2022-07-21 12:30:33,848]=08:30:33=*00000*{5752}&63E4AB2C&<NvEncUtil>        Generating SPS/PPS header for 3840x2160@60 FPS in video format H.264.
#7(W)[2022-07-21 12:30:33,848]=08:30:33=*00000*{5752}&6474EB61&<NvEncUtil>        Encoder does not have enough performance to support this format.
#8(I)[2022-07-21 12:30:33,848]=08:30:33=*00000*{5752}&63E4AB2C&<NvEncUtil>        Generating SPS/PPS header for 1280x720@30 FPS in video format HEVC.
#9(W)[2022-07-21 12:30:33,848]=08:30:33=*00000*{5752}&6474EB61&<NvEncUtil>        Encoder does not have enough performance to support this format.
#0(I)[2022-07-21 12:30:33,849]=08:30:33=*00000*{5752}&63E4AB2C&<NvEncUtil>        Generating SPS/PPS header for 1280x720@60 FPS in video format HEVC.
#1(W)[2022-07-21 12:30:33,849]=08:30:33=*00000*{5752}&6474EB61&<NvEncUtil>        Encoder does not have enough performance to support this format.
#2(I)[2022-07-21 12:30:33,849]=08:30:33=*00000*{5752}&63E4AB2C&<NvEncUtil>        Generating SPS/PPS header for 1920x1080@30 FPS in video format HEVC.
#3(W)[2022-07-21 12:30:33,849]=08:30:33=*00000*{5752}&6474EB61&<NvEncUtil>        Encoder does not have enough performance to support this format.
#4(I)[2022-07-21 12:30:33,849]=08:30:33=*00000*{5752}&63E4AB2C&<NvEncUtil>        Generating SPS/PPS header for 1920x1080@60 FPS in video format HEVC.
#5(W)[2022-07-21 12:30:33,849]=08:30:33=*00000*{5752}&6474EB61&<NvEncUtil>        Encoder does not have enough performance to support this format.
#6(I)[2022-07-21 12:30:33,849]=08:30:33=*00000*{5752}&63E4AB2C&<NvEncUtil>        Generating SPS/PPS header for 3840x2160@30 FPS in video format HEVC.
#7(I)[2022-07-21 12:30:33,850]=08:30:33=*00000*{5752}&15146C37&<VideoEncoder>     Encoder supports encoding 10 bit
#8(W)[2022-07-21 12:30:33,850]=08:30:33=*00000*{5752}&6474EB61&<NvEncUtil>        Encoder does not have enough performance to support this format.
#9(I)[2022-07-21 12:30:33,850]=08:30:33=*00000*{5752}&63E4AB2C&<NvEncUtil>        Generating SPS/PPS header for 3840x2160@60 FPS in video format HEVC.
#0(W)[2022-07-21 12:30:33,850]=08:30:33=*00000*{5752}&6474EB61&<NvEncUtil>        Encoder does not have enough performance to support this format.
#1(I)[2022-07-21 12:30:33,896]=08:30:33=*00046*{5752}&94F8CC76&<AdapterContext>   Deinitialized context for adapter 0
#2(W)[2022-07-21 12:30:33,897]=08:30:33=*00000*{5752}&FB11B4FE&<VideoEncoder>     VideoEncoder was not deinitialized prior to destruction!
#3(M)[2022-07-21 12:30:33,897]=08:30:33=*00000*{5752}&B4368309&<NvEncUtil>        Finished computing SPS/PPS headers.

Should this setup be powerful enough? Is there something I can look for in the NVIDIA driver setup, or in the VMWare hypervisor setup to change this? When looking at nvidia-smi -q I’m seeing that the driver is properly licensed and is in vGPU mode:

==============NVSMI LOG==============

Timestamp                                 : Tue Oct  4 11:13:50 2022
Driver Version                            : 511.65
CUDA Version                              : 11.6

Attached GPUs                             : 1
GPU 00000000:02:02.0
    Product Name                          : GRID RTX8000-16Q
    Product Brand                         : NVIDIA RTX Virtual Workstation
    Product Architecture                  : Turing
    Display Mode                          : Enabled
    Display Active                        : Enabled

...

    GPU Virtualization Mode
        Virtualization Mode               : VGPU
        Host VGPU Mode                    : N/A
    vGPU Software Licensed Product
        Product Name                      : NVIDIA RTX Virtual Workstation
        License Status                    : Licensed (Expiry: 2022-10-5 16:27:9 GMT)

Thanks!

/marc

I’m experiencing the samething with a T4 GPU on VmWare vSphere 6.7. I am streaming a very light version of a VR app and the GPU is maxed out and app is freezing.
Were you able to find a solution?

Regarding the RTX 8000 what version of vGPU are you using?

Regarding the T4, what vGPU license do you have enabled (use nvidia-smi -q)?