Blank screen in VR with Isaac Sim 4.1 & 4.0 [Windows and Linux]

Omniverse Isaac Sim
1

With Isaac Sim 4.1, VR experience extension load correctly without errors. I can also enter the VR mode with SteamVR as backend. However the VR rendered textures appear black / blue / some other random color depending on the scene. I can see that the very first frame when entering VR renders correctly. But subsequent frames are blank.

Same setup works fine with Isaac 2023

This blocks ability to use Isaac Sim for teleoperation, which is an important component.

Any ideas how to fix this?

2

Unfortunatly exact same issue on Linux. Isaac Sim 2023.1.1 works fine but not 4.0 or 4.1

3

Issue seems to be from the headset position and controllers not being acquired correctly by the XR extension. From doing more experiments, rendering seems to be working fine. Itäs just the position acquisiton from the XR system being broken (causing camera to be stuck at 0,0,0 or other random position).