I managed to combine a few tech stacks together recently to get a working proof of concept for rendering the Blender viewport spatially on an Apple Vision Pro.
Using CloudXR + Stream Manager to trick Blenders OpenXR runtime into thinking my CXR stream was a connected device I was able to push the stream through the network onto the AVP which was running a simple visionOS app built around the CXR simple window found on github.
The results were great. Streaming OTA through two floor levels, managing around 100mb/s and it still feeling smooth. The system was able to stream animations inside Blender at a steady framerate and I could preserve the spatial features of AVP without harming the experience.
More information (and a video) here on my linkedin - Blender to Apple Vision Pro Pipeline via NVIDIA CloudXR | Scott Rafferty posted on the topic | LinkedIn?
I also did a deep dive breakdown on the technology on my substack here - Streaming a Live Blender Scene into Apple Vision Pro?
I’m really keen to talk more and develop this further. I just want to get it out there and shown to the masses. The cool thing is this was running on an MSI Titan 4090 gpu laptop so technically the cloudxr / visionOS runtime I used does not support 4000 series officially. But it still works effortlessly.