Show numpy/torch/matplotlib images

[toni.sm]

Hi.

I want to show some images from synthetic data sensor u others… inside the simulator. They can be:

1. “in memory” images like numpy/torch/matplotlib data
2. stored images like .png, .jpg, etc.

Is there a way to do it with the omni.kit.ui module (UI Toolkit)?
I tried to show a .png with the omni.kit.ui.Image widget but I got the next warning for this code:

 url="/isaac-sim/_build/target-deps/kit_sdk_release/_build/manuals/py/_images/ProgrammingKitExtensionBundle.png"
 self._window.layout.add_child(omni.kit.ui.Image(url=url, width=320, height=240))

2020-07-26 18:36:47 [1,744,604ms] [Warning] [rtx.resourcemanager.plugin] Failed to load asset /isaac-sim/_build/target-deps/kit_sdk_release/_build/linux-x86_64/release/isaac-sim/_build/target-deps/kit_sdk_release/_build/manuals/py/_images/ProgrammingKitExtensionBundle.png for /isaac-sim/_build/target-deps/kit_sdk_release/_build/linux-x86_64/release/isaac-sim/_build/target-deps/kit_sdk_release/_build/manuals/py/_images/ProgrammingKitExtensionBundle.png

Thanks in advance

[Sheikh_Dawood]

Hi, I’m afraid this will only be possible with the new omni.ui module in 2020.2.

[toni.sm]

:( Ok

Is there an approximate date for that release…?

[ltorabi]

The release would be towards end of August.

[toni.sm]

(ﾉ◕ヮ◕)ﾉ*:・ﾟ✧

[toni.sm]

Hello for anyone interested

There is an extension that helps to generate and visualize OpenCV, Matplotlib and Omniverse native images and data in a quick and popular way (OpenCV-like and Maplotlib-like interface). This is very useful for remote workstation deployment (I think 😅)…

This extension uses as backend the new omni.ui module in 2020.2

You can find it here: GitHub - Toni-SM/semu.data.visualizer: Display Matplotlib graphics and OpenCV images inside NVIDIA Omniverse apps

---

Some images about the functionalities:

OpenCV-like interface

2D Matplotlib-like interface

3D Matplotlib-like interface

Omniverse native interface

[rosy.luo]

Thanks~ Toni Helpful~