Streaming to a Unity CloudXR Client application using CloudXR in Omniverse

Gaming and Visualization Technologies XR – VR/AR/MR CloudXR (VR and AR Streaming)
1

As the title reads, is it currently possible to stream from Omniverse to a unity client application using CloudXR? If yes, are there any resources?

2

Sorry, I missed this new topic when I wrote my answer on your other post:

3

Thanks for the debug guide. I found a video regarding streaming from Omniverse to a VR device using Steam VR and tried following the same but using CloudXR instead of steam and also a Unity client application. Here’s the video that I found: [https://www.youtube.com/watch?v=saX-H7S0HgE]
Also, in the Omniverse System requirements guide, For AR, is the AR client application made using Unity? I tried it before but for a VR device and this is what I came across.

com.oculus.vrshell-20241009-103028
com.oculus.vrshell-20241009-1030281872×1872 180 KB

4

Thanks for the info, especially the debug guide. It’s very detailed and will definitely be useful.

5

Omniverse complicates things.

In the 4.0.1 update to CloudXR documentation, there’s some details on what works with what:
https://docs.nvidia.com/cloudxr-sdk/usr_guide/system_requirements.html#nvidia-omniverse-server-requirements

Omniverse can stream:

  • VR with SteamVR (with CloudXR installed)
  • VR with CloudXR (directly; no SteamVR or CloudXR install)
  • AR with CloudXR (directly; no SteamVR or CloudXR install)

BUT.

  • Most Omniverse versions:
    • AR with CloudXR only works on iOS devices with the single client available on the App Store, because it uses a non-published CloudXR version (3.3).
  • Very recent Omniverse versions:
    • AR with CloudXR should work with any correctly compiled/working CloudXR 4.0 AR tablet client

As for Unity: The CloudXR Unity Client Plugin is in beta and only supports Android-based HMDs, that implement the OpenXR API, in VR mode. There is no support for tablet AR.