Isaac GYM, How to perform Sim2Real

Hi~ Anybody has done Sim2Real works by utilizing isaac gym(isaac gym environments examples). I would appreciate it, if some can provide me some help about the pytorch neuron nerwork transplanting and isaac gym framework communicating with real robot.

3 Likes

I am doing Sim2real too.But I still can’t deal with it,can I have your email,we can discuss for it.

please check your message, i’v sent you my email :)

Can I have your email too? I’m also quite care about this problem, and we can exchange our idea.

Does anyone success?

Hi,

I am grappling with the same issue. Simulation to Real robot RL deployment seems to be well guarded secret. One solution I am attempting is logging the position velocity and torque values from the play scripts of the example files and putting that onto the robot in a loop.

I don’t think this is ideal but something to start with.

Sanket

Hi @slokhande and others,

Lots of domain randomization is important for Sim2Real transfer. You can read more about what we have done in our own research on this here: https://dextreme.org/

Actually hooking up the Sim model with your real robot is going to be very dependent on the way you have your robot control system set up. Simply playing back a log of position or torque commands isn’t likely to be enough. You will need to feed observations from your real robot sensors back into the policy in your control loop.

Take care,
-Gav

1 Like