I’ve managed to build and run both the NVIDIA and Apple samples, a couple of suggestions and questions I have.
-
In the Stream Manager docs , there’s no mention of the
CloudXrService.exethat comes with Stream Manager. My understanding is thatNvStreamManager.exelaunches this executable to host and dynamically link with the actual CloudXR runtime in thereleases\6.0.xfolder. This would help in the architectural explanations. -
I notice the number of video cards supported is limited, though it still works (I have a 5070 ti).
-
Is there a way to configure/tweak settings such as refresh rate (90 vs 120hz), or OpenXR emulated resolution vs. NVENC encoding resolution and presets? I see foveation ratio is adjustable which is good. I have used ALVR community open source a lot for Vision Pro streaming in the past, we can usually tweak these (e.g. taking advantage of 120hz on Vision Pro M5 often requires NVENC Ultra Low Latency set), I see for example: (a) NVENC is set to HEVC, Low Latency Preset, P2 Preset, Multi-Pass disabled in my logs. and (b) resolution is generally dependent on the video card, but it seems to default to 4096x4096 per eye, but then is downward negotiated at connection time to warped: 1200x960 unwarped: 3800x3040 instead of the expected warped: 2400x1920 unwarped:3800x3040. (c) 10-bit color, not clear if we’re getting it.
In my experience with Fixed Foveated Rendering in ALVR we can get stable streaming of unwarped 3800px on a 5070, or even higher on a 5090 (upwards of 4576x4416). So this looks like a good default, but the headset emulated & encoded resolution we’d want to be able to adjust to get the best picture for the latency.
-
the unwarped resolution seems to be a weird x/y ratio (3800x3040) compared to the typical lens ratio of 1.14375 , though maybe I am misunderstanding how that is chosen
-
Has CloudXR moved entirely away from a SteamVR plugin (as you had in CloudXR 4.x) in favor of the Stream Manager?