Show numpy/torch/matplotlib images


I want to show some images from synthetic data sensor u others… inside the simulator. They can be:

  1. “in memory” images like numpy/torch/matplotlib data
  2. stored images like .png, .jpg, etc.

Is there a way to do it with the omni.kit.ui module (UI Toolkit)?
I tried to show a .png with the omni.kit.ui.Image widget but I got the next warning for this code:

 self._window.layout.add_child(omni.kit.ui.Image(url=url, width=320, height=240))

2020-07-26 18:36:47 [1,744,604ms] [Warning] [rtx.resourcemanager.plugin] Failed to load asset /isaac-sim/_build/target-deps/kit_sdk_release/_build/linux-x86_64/release/isaac-sim/_build/target-deps/kit_sdk_release/_build/manuals/py/_images/ProgrammingKitExtensionBundle.png for /isaac-sim/_build/target-deps/kit_sdk_release/_build/linux-x86_64/release/isaac-sim/_build/target-deps/kit_sdk_release/_build/manuals/py/_images/ProgrammingKitExtensionBundle.png

Thanks in advance

Hi, I’m afraid this will only be possible with the new omni.ui module in 2020.2.

:( Ok

Is there an approximate date for that release…?

The release would be towards end of August.


Hello for anyone interested

There is an extension that helps to generate and visualize OpenCV, Matplotlib and Omniverse native images and data in a quick and popular way (OpenCV-like and Maplotlib-like interface). This is very useful for remote workstation deployment (I think 😅)…

This extension uses as backend the new omni.ui module in 2020.2

You can find it here: GitHub - Toni-SM/omni.add_on.visualizer: Data visualizer for NVIDIA Omniverse Isaac Sim (Matplotlib and OpenCV based interface)

Some images about the functionalities:

OpenCV-like interface

2D Matplotlib-like interface

3D Matplotlib-like interface

Omniverse native interface


Thanks~ Toni Helpful~