Isaac Sim Version
6.0.1
Operating System
Windows 11
GPU Information
- Model: NVIDIA RTX 2000 Ada Generation
- Driver Version: 32.0.15.8180
Topic Description
Detailed Description
I am trying to view an Isaac Sim scene in VR using an HTC VIVE Pro 2.
The HMD works correctly. After launching Isaac Sim in XR/VR mode and pressing Start XR, I can see the scene properly through the headset.
However, I am having an issue with the controllers. In the HMD view, controller-like objects(not VIVE Pro 2 controllers) are displayed, but they do not follow the actual physical movement of the VIVE controllers. Also, when I press any buttons on the controllers, nothing happens in Isaac Sim.
What I expected:
- The controllers in the VR scene should move according to the real VIVE controller motion
- Button input should trigger some response, such as pointer interaction, UI response, or other controller-related behavior
What actually happens:
- The controller objects are only visible in the HMD view
- They appear static and do not track the real controller pose
- Pressing controller buttons produces no visible response
At this point, VR viewing through the headset works, but controller tracking and controller input do not appear to function in Isaac Sim
Steps to Reproduce
-
Connect HTC VIVE Pro 2 to the PC
-
Confirm that the HMD and controllers are recognized in SteamVR
-
Launch Isaac Sim XR VR
-
Open a scene in Isaac Sim
-
Press Start XR
-
Wear the headset and check the VR scene
-
Observe that controller-like objects appear in the HMD view
-
Move the physical VIVE controllers and press their buttons
-
Notice that the controller objects do not follow the real controller movement and no button input seems to have any effect
Error Messages
I found the following warnings/errors in the Isaac Sim log. I am not sure whether they are directly related to the controller issue.
One of the timeout messages may have been caused by a delay between pressing Start XR and actually wearing the headset, since the PC and headset setup are physically separated and it sometimes takes time before I put the headset on.
-
2026-07-28 01:20:18 [Warning] [omni.kit.xr.system.openxr.plugin] [XR] Failed to create OpenXR instance with API version 1.1.53: XR_ERROR_API_VERSION_UNSUPPORTED -
2026-07-28 01:20:52 [Error] [omni.kit.xr.system.openxr.plugin] Non fatal OXR error: XR_UNKNOWN_SUCCESS_2 C:\g\339414760\kit\source\extensions\omni.kit.xr.system.openxr\plugins\omni.ext-system.openxr\OxrInputManager.cpp:497 -
2026-07-28 01:23:08 [Error] [omni.kit.xr.system.openxr.plugin] Non fatal OXR error: XR_TIMEOUT_EXPIRED C:\g\339414760\kit\source\extensions\omni.kit.xr.system.openxr\plugins\omni.ext-system.openxr\OxrSessionManager.cpp:124
Additional Information
What I’ve Tried
-
Confirmed that the VIVE Pro 2 HMD and controllers are detected in SteamVR
-
Confirmed that the Isaac Sim scene is visible correctly in the headset
-
Enabled XR-related extensions in Isaac Sim, including:
omni.kit.xr.coreomni.kit.xr.system.openxromni.kit.xr.bundle.genericomni.kit.xr.ui.window.profileomni.kit.xr.ui.window.viewportomni.kit.xr.ui.stageomni.kit.xr.system.simulatedxromni.kit.scene_view.xr_utilsomni.kit.scene_view.xr
-
Checked that OpenXR Input/Output is enabled
-
Checked the SteamVR controller binding page
-
Installed
omni.kit.xr.bundle.generic, after which controller-like objects became visible in the HMD view -
However, those controller objects still do not follow real controller movement and button presses still have no effect
