Teleoperation of a franka with a 3D mouse in isaac sim is possible?

Omniverse Isaac Sim
1

Hello,

Lately I’m trying to find information about how to perform a teleoperation with a Franka robot, but all I see is information for mobile robots like the jetson or so. Besides, the information I have found talks about gamepads or keyboards but I don’t see anything related to a 3D mouse. The tutorial talks about gamepads and keyboards too:

https://docs.omniverse.nvidia.com/isaacsim/latest/gui_tutorials/tutorial_advanced_input_devices.html

I want to use my SpaceMouse Compact to perform a teleoperation task moving the end effector of the robot using this mouse. Is possible to do so?

2

@mlasa chiming in here as another user - there was a long thread where users have been wanting the support, but it appears to be a dream where it’s most likely not going to happen without further development/cooperation between the orgs. see more here:

3

You can try to use the Orbit framework.
I saw that they have this:
https://isaac-orbit.github.io/orbit/source/api/orbit/omni.isaac.orbit.devices.html#omni.isaac.orbit.devices.Se3SpaceMouse

4

oh, that’s pretty cool. thanks for sharing! i haven’t worked much with Orbit, so will have to keep this in mind in the future.

5

Thank you for this input! I will check it!