Rather than zooming in and out, I would recommend you just move your position in camera space forward and backward. At least when in VR mode. Once you are out of VR mode, you can bring up the camera controls manually and directly adjust the focus length. But in VR mode, when “live”, I would stick to the normal movement controls to physically pull closer, or further away.