Best workflow for 3D Gaussian Splatting + Collision Proxies + Segmentation in Isaac Sim?

[pekka3]

Hi everyone,

I am working on building photorealistic robotics environments in Isaac Sim using 3D Gaussian Splatting (3DGS). I’m currently using a custom Lyra-2 pipeline (VIPE + DA3) to generate my .ply splats from video.

My very first test resulted in the classic “billboard effect” so Lyra2 just could not generate a solid splat from the video it created, above.

Any advice, plugin recommendations, or workflow tips would be hugely appreciated. Thanks!

[pekka3]

So when I opened the first 3 Gb .ply that Lyra2 created from the video it created ( above in my first post ) with postshot, it looks like this:

[Aharpster]

Hi there,

Going to move this post to the correct forum for better viz. Thanks for posting!

Best,

Aharpster