Isaac Sim mouse hover mesh highlight

Omniverse Isaac Sim
1

I want to create a functionality to highlight a particular mesh when mouse hover over in Isaac sim.
For trial I am using a simple cube mesh. And want to highlight the mesh by changing color of the cube when mouse hover over it.

I am new to omniverse and linux so don’t know how to proceed and what steps to follow for the same.

Isaac Sim Version

4.5.0

Operating System

Ubuntu 22.04

3

Hi @anubhav.negi Please checkout this tutorial Reusable Light Panel — Omniverse Workflows

4

Thanks @zhengwang Can it be done using raycast? Do you have any examples for implementing the raycast for the same?

Raycast, All — Omniverse Extensions

5

@anubhav.negi why do you want to do it using raycast?
I am not aware of any examples using raycast to react to mouse movement. Let me reach out to the internal team.

6

@zhengwang we are working with omniverse composer to create a digital twin.
We are looking to highlight a model when mouse is hovering over it. So, we are looking at raycast option. Please suggest if there are any other workflows.

We are working with action graphs, as we are new to omniverse.

7

Hi @anubhav.negi. Here is an example python script to highlight/change color on the object that is clicked by mouse
test.py (3.3 KB)
You can run it under where you installed Isaac Sim 4.5 (for example, ~/isaacsim) with command
./python.sh path/to/script/test.py

Here is a video:

8

Here is a hover example script with HoverGesture.
Untitled.py (1.7 KB)

You can get an action graph example using raycast by enabling extension omni.physx.demos and go to window->examples->physics examples. Then open the Physics Demo Scenes tab, expand Raycast(OmniGraph).
There is also a node On Viewport Hovered that might be helpful for your case. But I haven’t found an example/demo yet.

Unfortunately I don’t find any example/demo that performs what you are looking for. But if you really want to use action graph, feel free to check the above example and see if you can put them together. If there is a missing node, you can create a customized action graph node. Here is a tutorial Custom Python Nodes — Isaac Sim Documentation

Hopefully the above information is helpful

1 Like
9

Thanks @zhengwang It worked like a charm. Used the same script as per our use case.