I tried to train a reinforcement learning policy using OmniIsaacGymEnvs in Isaac Sim and using IsaacGymEnvs in Isaac Gym Preview Release. I also tried this example: 6. Custom RL Example using Stable Baselines — Omniverse Robotics documentation. Is there a difference between the policy generated in Isaac Gym Preview Release and Isaac Sim due to simulation accuracy being different in the two tools?
Hi @kellyg, thank you very much for the response. Please correct me if I am wrong but I am assuming that Isaac Sim provides better physics accuracy. Does this effect the accuracy of the trained policies in some way?
We haven’t noticed any visible differences in terms of accuracy in the trained policies between Isaac Sim and Isaac Gym Preview. We have also done examples of transferring policies trained in Isaac Gym Preview to Isaac Sim and have observed similar behaviors with the two tools. Hope this helps!