Enabling physics iniside VR in Omniverse

I’m trying to add physics inside VR, so that we can enable interaction. So first I wanted to add collision and rigid body so that it falls on the ground. so when I do it on desktop app, it falls and collides and they behave as in real life, but inside VR, the objects pass through each other and do not collide.
Any suggestions on how to make this work? or please help me connect to someone working on XR related projects in VR so I can know if there are any other workarounds.