GTC 2020: Medical Volume Raytracing in Virtual Reality

GTC 2020 S22030
Presenters: Jeroen Stinstra,NVIDIA
Abstract
Raytracing voxels in medical images is a relatively new technique that lets us see medical images in a new light. It allows for creating realistic-looking light effects, like soft shadows. Exploring medical images in virtual reality benefits because these advances make objects look more real, making it easier for a physician to interpret what they are seeing. We’ll discuss the challenges with doing volume raytracing in VR, and will demonstrate a solution in CUDA involving rendering to an eye-tracked foveated/warped space. We’ll discuss how we can stream this warped space from a server to a head-mounted display, and how to effectively de-noise the results for VR. We’ll also show how to use the extra GPU budget that we created by foveated/warped rendering to improve visuals by including better material choices based on DL-generated label maps and define less stair-stepped implicit surfaces based on tricubic interpolation.

Watch this session
Join in the conversation below.

1 Like

Thank you very much for this excellent presentation Dr. Stinstra. I really enjoyed learning so many technical details on you voxel ray tracer.
I have one question, how did you implement the voxel acceleration structure for maximum efficiency?
Have a nice day!