I’m using the Omniverse Streaming Client with isaac sim running on an AWS g5.2xlarge ec2 with A10G GPU. Using the NVIDIA Omniverse GPU-Optimized AMI and the latest http://nvcr.io/nvidia/isaac-sim:4.1.0 docker image.
My question is: is this a solid setup to use Isaac Sim? Or - is the streaming client deprecated and the only viable way to use the Isaac Sim is locally?
Using AWS makes the whole hardware setup easy and attractive… easy to setup and to scale. But if the streaming client is deprecated and cannot support many of the working methodologies (vscode?) and a local GPU may be the only way to go.
Yes. I just answered this on another page. Just use ordinary remote viewing software. The streaming client is no different from VNC, remote desktop etc.
It works great but it does recommend to use the streaming client and use runheadless.native.sh.
I’ve installed VNC and made sure basic GUI apps work.
But not sure how to invoke Isaac sim now? if I run “runapp.sh” it crashes:
2024-09-07 09:17:16 [7,912ms] [Warning] [carb.windowing-glfw.plugin] GLFW initialization failed.
2024-09-07 09:17:16 [7,912ms] [Warning] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.4]) (impl: carb.windowing-glfw.plugin)
2024-09-07 09:17:16 [7,964ms] [Warning] [omni.platforminfo.plugin] failed to open the default display. Can’t verify X Server version.
2024-09-07 09:17:18 [10,358ms] [Warning] [carb.windowing-glfw.plugin] GLFW initialization failed.
2024-09-07 09:17:18 [10,358ms] [Warning] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.4]) (impl: carb.windowing-glfw.plugin)
2024-09-07 09:17:21 [13,201ms] [Error] [omni.appwindow.plugin] Failed to acquire IWindowing interface
Segmentation fault (core dumped)
Obviously it expects a standard workstation installation but this is the NVIDIA Omniverse GPU-Optimized AMI on an ec2 instance.
Not sure what is the recommendation method to work with isaac sim remotely? what do I need to install and configure for this to work? and how to invoke isaac sim?
Maybe I should continue to use the “NVIDIA Omniverse GPU-Optimized AMI” but instead of using the nvcr.io/nvidia/isaac-sim:4.1.0 docker image, I should just install isaac sim using the OmniVerse Launcher, just as if this was a regular workstation (i’ll add a full windows manager like GNOME for that to work)?