Cloud XR Audio Connection not working

Gaming and Visualization Technologies XR – VR/AR/MR CloudXR (VR and AR Streaming)
1

Hi,

We use CloudXR on AWS with EC2 Instances (g5.4xlarge). We now have a voice server running that we can use for collaboration and it works fine using NICE DCV. Currently we need also NICE DCV, because we want to allow to turn VR on and off as needed. So we also wanted to test it in VR with CloudXR, but we found the problem that actually there audio seems to not work yet. Both not hearing audio as well as sending audio through the mic. Interestingly, sometimes in the SteamVR Menu (which I guess is also streamed) I get some sounds when I press on buttons, but that is only sometimes the case and so for I was not able to reproduce when exactly. However inside of the apps when we activate VR it keeps using the regular Microphone and Speakers (there we can still hear stuff).

Now we looked through the stuff required and seem to have everything, the required ports are open, we use the needed console parameter on server and client and we installed the CloudXR server plus Subcomponents after the GPU driver. However to be sure that the installation of the audio driver also worked, we see this on the instances:

image

In some forum posts we saw that there should probably be a “Nvidia Virtual Audio Device” ? (like here: No virtual audio devices on AWS cloudXR - #9 by huong) Is it possible that the automated installation does not install the audio driver? We did use the /S Option. Can we ensure somehow it was correctly installed?

Best
Xaver

2

You need to disable all AWS virtual audio devices(you can use windows script) in order to avoid miss-using by CloudXR Server

3

Hi,
thank you for the info! Is there a specific time when the VIrtual Audio Devices would need to be deactivated? In an ideal world we could still use them whenever VR mode is not activated in an app, and only deactivate once the user activates VR. But I assume it must be turned off already before SteamVR is started? Or just before the Client connects?

Best
Xaver

4

We digged a bit deeper and found CloudXR complains that NvAudCapAudioSource is missing. We install the Nvidia driver as suggested here Install NVIDIA drivers on Windows instances - Amazon Elastic Compute Cloud

Should it not be included? Any way to ensure it is installed with the driver?

5

Hi, so we got the driver issue fixed and now audio in general works. The only problem we found that voice input does not directly work, even though it does create the virtual device and it gets set as the default the app seems to not use it. If we restart the app after connecting cloud Xr it does work. So I am wondering if there is a way to make the app detect it when we connect the first time, like it works for the audio device.

6

Ensure you’ve enabled the audio mic on the client and sever is the -ra and -sa options:

https://docs.nvidia.com/cloudxr-sdk/usr_guide/cmd_line_options.html?highlight=microphone

As for detecting headset states, there should be something you could write using the OpenVR API instead: unity - Check if OpenVR / SteamVR / OculusVR headset is mounted on your head - Game Development Stack Exchange