Realtime Texture Updates in Omniverse (Bypassing Disk IO)

Omniverse Core Platform Core APIs
1

Hi,

I am developing an extension to stream real-time reconstructed 3D data (triangles and textures) into Omniverse at 15–30 FPS.

While I’ve successfully implemented geometry updates using the USDRT API, I am struggling with the texture pipeline. Currently, the only way I can update a material’s texture is by:

  1. Saving the incoming image frame to disk as an uncompressed RGBA DDS.

  2. Updating the file path on the shader input.

This approach results in flickering, which seems to be due to slow read times.

It seems like HPU Foundation use to be an option but the interface is no longer available.

Are there any other options available?**

Operating System:**
Linux
Kit Version:
109 (Kit App Template)
Kit Template:
Base Kit Editor
GPU Hardware:
30 series
GPU Driver:
Latest

2

Hi there and welcome. Before we get into the technical, can you explain why you are trying to “stream” in data into Kit, rather than just import it and use it there. Anything with realtime streaming is going to be incredible slow and create problems.

Normally you are either:

  1. Live linking to Omniverse kit
  2. Fully importing geometry into kit and running directly there
  3. Streaming the kit viewport out of kit into a web browser