It seems that XR extensions are broken with latest KIT versions, for example XR extensions don’t work correctly with Isaac Sim 4.1 but they work perfectly fine with Isaac Sim 2023.1.1. The issue happnes both on Linux and Windows.
With Isaac Sim 4.2, launching VR with either OpenXR or SteamVR results in no tracked controllers and incorrect position/rotation for the XR device. The rendering to buffer itself seems to work ok (I can see display output for both eyes).
You will need to first manually enable the VR extension after Isaac Sim starts (don’t auto load), then load/open a new scene after enabling the extension. Seem like certain things dont initialize until you load a new scene.
Update#2: With Isaac Sim 4.2 it now seems possible to have the VR Experience extension auto load on start, and with that controllers and headsets are now correctly tracked.
Only issue now is that teleportation mechanic is a little bit jittery compared to 2023.1.1, I wonder if it’s possible to disable teleportation mechanic all together? Since they occupy the joystick and we want to use the joystik for robot control instead
Ok was able to disable the joystick teleportation mechanics by modifying the metaquest python extension (removing the key bindings)
VR experience now works really nice with 4.2, performance is great, especially with async rendering + cpu physics, it’s possible to get stable 90hz with the H1 Humanoid demo scene. Very fun to play with!