Thermal Infrared Synthetic Data Generation

Hello,
I’m new to this area of expertise and I was wondering if has anyone tried using Omniverse for generating thermal infrared (NIR, MW or LW) scenarios. If that’s the case can you explain the process a little bit and if that’s not the case is there recommended process for converting visible RGB scenarios to thermal infrared ones.
I’m asking this question because as far as I know AirSim was able to achieve this and since it is no longer updated I was thinking about giving Omniverse a shot.
Thanks in advance.

2 Likes

I would also be interested in such possibility.

2 Likes

I would also be very interested in such a possibility.

1 Like

Anyone has news on this @Tungdil99 , @Turowicz , @tjwhitten25 ?

I don’t think its on the roadmap. Likely a 3rd party solution is the only chance.

Hi @Tungdil99 and others. We don’t currently have a solution for this. We’ve had this tracked as a feature request for a long while, and no shortage of companies asking.

From my personal perspective, its not a simple feature, since there’s a heavy content dependency, and in order to do it robustly, a solution would need to work with different frequencies of IR, and incorporate rendering as well.

In the past, I’ve worked on shader solutions that use Signed Distance Fields to paint greyscale values as volumes across geometry then output as an AOV, but that was more of a hack from necessity.

Thanks for the heads up on AirSim, I’ll pass this around so others can take a look internally.

Your best bet is to do custom shader authoring, or look into spectral renderers that also support blackbody radiation.

@pcallender @krsd What about this approach using the current set of available tools:

-Track how objects heat up over time based on their exposure to light sources, ambient temperature, and conduction from other objects. (Use PhysX or Flow)
-Simulate heat transfer using a solver.
-Assign heat capacity, thermal conductivity, and emissivity to materials using USD metadata.
-Convert temperature to emissivity based on blackbody radiation. (Plank’s blackbody radiation formula)
-Adding some sensor-specific IR post-processing if required.