Low FPS and Wobbling When Running Isaac Sim in VR with Meta Quest Pro — Possible DLSS or Thunderbolt Limitation?

Omniverse Isaac Sim
1

I’m running a robotic simulation in Isaac Sim using VR (Meta Quest Pro), but I’m experiencing very low FPS and noticeable wobbling or motion instability when viewing the simulation through the headset.

Here are the details and issues I’m trying to understand:

  1. Simulation FPS vs Headset FPS:
    My simple Isaac Sim scene only contains a humanoid robot with minimal visual effects. On my RTX 5090 Founders Edition, the simulation runs at around 20–25 FPS, even after disabling ray tracing and shadows. However, when viewing it through the Meta Quest Pro headset, the frame rate should be around 70 FPS in VR, creating a severe mismatch between the simulation FPS and the headset FPS. This mismatch results in noticeable wobbling, latency, and discomfort during head movement.

  2. DLSS and Frame Generation:
    I’ve tried enabling DLSS and Frame Generation through the NVIDIA App, but it seems DLSS isn’t applied to the VR display or Isaac Sim’s VR runtime. Does DLSS currently work with Isaac Sim in VR mode or with Meta Quest Pro in general? Or is DLSS limited to traditional monitor-based rendering?

  3. Connection and Bandwidth Concerns:
    Since the RTX 5090 Founders Edition lacks a Thunderbolt port, I’m wondering if this might limit bandwidth when streaming to the Meta Quest Pro via Link Cable or Air Link. Could the absence of Thunderbolt connectivity be causing reduced VR performance or unstable motion tracking?

  4. General Performance Question:
    How do large companies or NVIDIA’s internal teams achieve smooth, real-time VR robotic simulations in Isaac Sim? Are there recommended optimization techniques (e.g., asynchronous time warp, GPU stream separation, or adaptive render resolution) that can stabilize FPS between Isaac Sim and the VR headset?

For context, I’m an independent researcher working alone on my personal PC, trying to build a real-time VR robotics demo to showcase how VR interaction can assist robots in collecting data for training. I’m not part of a large lab or company setup — I’m simply trying to make this work smoothly on my workstation for demonstration and research purposes.

Any advice or best practices for improving VR performance in Isaac Sim or correctly integrating DLSS/Frame Generation would be greatly appreciated.

3

Hi @sepahyarsoheil — the 20–25 FPS in Isaac Sim is expected, and the wobble may be just the headset’s 72 Hz refresh trying to interpolate a 20 FPS feed. The fix is to launch through Isaac Sim’s dedicated VR/OpenXR experience file

For VR, don’t enable VR inside the standard viewport. In Isaac Sim 5.1, enable the omni.kit.xr.profile.vr extension, open the VR tab, set the Output Plugin to OpenXR (Quest Pro’s native path via the Meta OpenXR runtime; SteamVR also works over Link), and press Start VR. This loads the XR render path with async reprojection, so the headset stays at 72 Hz even while the sim steps slowly.

Enable DLSS inside Isaac Sim (Render Settings → DLSS, Performance mode) — the NVIDIA App’s injection doesn’t hook Kit/Vulkan apps. Leave Frame Generation off. Thunderbolt is irrelevant — Quest Pro Link runs over USB 3.x, Air Link over Wi-Fi, neither uses GPU display ports.

For more headroom: switch to RaytracedLighting (not path tracing), single Skydome light, disable shadows/AO/reflections. If your demo doesn’t need live physics, bake the simulation to USD animation tracks and play back without the physics engine — that hits headset framerate trivially.