It seems that XR extensions are broken with latest KIT versions, for example XR extensions don’t work correctly with Isaac Sim 4.1 but they work perfectly fine with Isaac Sim 2023.1.1. The issue happnes both on Linux and Windows.
With Isaac Sim 4.1, launching VR with either OpenXR or SteamVR results in no tracked controllers and incorrect position/rotation for the XR device. Additionally, I get per frame errors in console:
[omni.kit.xr.core.plugin] ERROR getting world matrix from RT xformable
I have the same problem, at least when I try to combine Kit XR Samples Extensions + 106 Kit
Looks like camera drop to the floor and controls didn’t do anything.
Logs
2024-09-05 17:53:31 [62,344ms] [Warning] [omni.usd] Warning (secondary thread): in SdfPath at line 81 of W:\ac88d7d902b57417\USD\pxr\usd\sdf\path.cpp – Ill-formed SdfPath <>: syntax error
2024-09-05 17:53:31 [62,344ms] [Warning] [omni.usd] Warning (secondary thread): in SdfPath at line 81 of W:\ac88d7d902b57417\USD\pxr\usd\sdf\path.cpp – Ill-formed SdfPath <>: syntax error
2024-09-05 17:53:31 [62,367ms] [Info] [omni.kit.xr.system.openxr.plugin] [OpenXR] updateControllerState [frame:3913] [thread:17832]
2024-09-05 17:53:31 [62,368ms] [Info] [omni.kit.xr.system.openxr.plugin] [OpenXR] updateControllerState [frame:3913] [thread:17832]
2024-09-05 17:53:31 [62,368ms] [Warning] [omni.kit.xr.core.plugin] unable to set local transform via extand USDRT prim
2024-09-05 17:53:31 [62,368ms] [Warning] [omni.kit.xr.core.plugin] unable to set local transform via extand USDRT prim
2024-09-05 17:53:31 [62,368ms] [Warning] [omni.kit.xr.core.plugin] unable to set local transform via extand USDRT prim
2024-09-05 17:53:31 [62,369ms] [Warning] [omni.kit.xr.core.plugin] unable to set local transform via extand USDRT prim
2024-09-05 17:53:31 [62,369ms] [Error] [omni.kit.xr.core.plugin] ERROR getting world matrix from RT xformable
2024-09-05 17:53:31 [62,370ms] [Error] [omni.kit.xr.core.plugin] INVALID RT anchor matrix attr
Ok figured out how to get things to work (Isaac Sim 4.2)
You will need to first manually enable the VR extension after Isaac Sim starts (don’t auto load), then load/open a new scene after enabling the extension. Seem like certain things dont initialize until you load a new scene.