We are pleased to announce that the latest chapter in the Isaac Sim story is now available here. The Isaac Sim 2020.1 Early Access release has many new features, examples, assets and additional documentation compared to the previous Leonardo Preview release. Manipulation and navigation integration with IsaacSDK is now available, as well as sensors such as RGB and depth cameras, and lidar. Local installation on Ubuntu-18.04 is now supported along with Docker containerized version.
If you already signed up for the EA access program, just download the local Linux package or Docker container to get going. If you haven’t signed up yet, start the process here.
Everything works very well! It was mentioned that other hydra compliant renderers can be integrate (possibly just eventually). RTX is fantastic, but it’s very useful to have a standard GL/Vulkan renderer for layout. Is it possible to integrate as a standard USD plugin?
We have two hydra-compliant rendering pipelines today, the real-time ray tracer as well as the path tracer. We are investigating other implementations but we don’t have a specific announcement at this time. Your point is well taken though, thanks for the feedback.
–>Is it possible to integrate as a standard USD plugin?
The question is not clear to me, would you please elaborate?
Sure. Omniverse being usd based and Hydra compliant is kind of like a pumped up usdview editor. No? Hydra pretty easily can be set up for another renderer. So is it perhaps the case that the usdview gl renderer is an easy drop in?
I suppose it’s possible, but ‘drop-in’ to me sounds optimistic. I’m not the rendering expert around here, and I know we have projects ongoing for other Hydra-compliant pipelines, but most of our focus today is on the RTX pipelines for a combination of practical reasons (can’t spread ourselves too thin etc.) and a desire for image quality. You can run OV Kit via container streamed to a notebook or tablet, to enable low-end hardware for the end user interaction.
Hi. I installed omniverse EA yesterday ,tried some samples included and rendering looks fantastic! Nice Work!
I noticed there is some issue with mdl when i try export from UE4.25. After connect to omniverse server, I can export all level but in the kit , the model just looks no material on it and no texture. Just a gray color. I try the starter content and several other scenes , same result.
The astronaut and sol and AEC demo works fine with all mdl and textures. But the attic demo has the same issue with no material and texture. I also noticed if I open some demos and reopen the astronaut demo, the mdl and textures will also broken. I have to restart the kit to make it right.
Is there anything I should do to make mdl working?
thanks
Yang
I will bring this to the attention of an expert on the UE4 exporter. The fact that you are having a problem with the attic demo makes me wonder if you have a driver issue or something to that effect. Tell me more about your PC, which GPU are you using, what is the driver version?
Hi. Are you seeing this issue only when running Isaac Sim? Do you see similar issues when loading the assets in the main Omniverse Kit app or View app?
hi Mike:
Thanks for the fast respond. My gpu is 2080 on ubuntu 18.04 LTS with 440 driver. I made some efforts to make the gpu work since it’s a egpu. I have to switch the prime gpu to this eGPU since the prime gpu is intel on my computer. (by modify the xorg.conf). If prime gpu is not nvidia, kit will just quit. (but the container works fine , don’t know why). I hope to try the windows build when it’s available to evaluate.
Hi Sheikh:
Yes i’m testing the isaac sim build on ubuntu 18.04lts. I have try both container and standalone kit come from the isaac sim EA. The UE4.25 connect also from the isaac sim EA page. The kit file is isaac-sim-2020.1.1920-4b1097bc-linux-x86_64-release and UE4 plugin is omniverse-ue4-4.25-plugins-installer-2020.1.234.68. I attached some warning from the log hope it’s helpful.
2020-06-17 17:31:42 [3,534ms] [Warning] [omni.usd] Warning: in _AdapterLookup at line 312 of /buildAgent/work/da639afa0455b478/USD/pxr/usdImaging/lib/usdImaging/delegate.cpp -- Selected hydra renderer doesn't support prim type 'Camera'
2020-06-17 17:31:42 [3,546ms] [Warning] [omni.usd] Warning: in _ProcessFile at line 240 of /buildAgent/work/da639afa0455b478/USD/pxr/imaging/lib/hio/glslfx.cpp -- File doesn't exist: ""
2020-06-17 17:31:42 [3,546ms] [Warning] [omni.usd] Warning: in _ProcessFile at line 240 of /buildAgent/work/da639afa0455b478/USD/pxr/imaging/lib/hio/glslfx.cpp -- File doesn't exist: ""
2020-06-17 17:31:44 [4,928ms] [Warning] [carb.graphics-vulkan.plugin] getBufferGpuPointerVulkan used without device support
2020-06-17 17:31:48 [9,667ms] [Error] [carb.livestream.plugin] nvstPushStreamData error for eye 0, stream 0x7f124030e8e0: 0x800b001c
2020-06-17 17:31:51 [12,805ms] [Warning] [omni.kit.window.auth.plugin] Nucleus Cache is not running or reachable! Consider enabling Nucleus Cache to speed up data transfer.
2020-06-17 17:31:51 [12,807ms] [Error] [omni.tagging.plugin] Tagging Service Connection Error: 7
2020-06-17 17:31:55 [16,791ms] [Warning] [omni.kit.window.content.plugin] ContentExplorer only supports ONE datasource for protocol omni: at a time, overriding existing datasource
2020-06-17 17:31:55 [16,791ms] [Warning] [omni.kit.window.content.plugin] ContentExplorer only supports ONE datasource for protocol omni: at a time, overriding existing datasource
Acquired interface 'carb::physics::PhysX', version 0.2
2020-06-17 17:32:04 [24,991ms] [Warning] [omni.usd] Warning: in _AdapterLookup at line 312 of /buildAgent/work/da639afa0455b478/USD/pxr/usdImaging/lib/usdImaging/delegate.cpp -- Selected hydra renderer doesn't support prim type 'Camera'
2020-06-17 17:32:04 [25,068ms] [Warning] [carb] Acquiring non optional plugin interface which is not listed as dependency: [carb::tasking::ITasking v0.4] (plugin: (null)), by client: omni.connection.plugin. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client.
2020-06-17 17:32:04 [25,077ms] [Warning] [omni.usd] Warning: in _ProcessFile at line 240 of /buildAgent/work/da639afa0455b478/USD/pxr/imaging/lib/hio/glslfx.cpp -- File doesn't exist: ""
2020-06-17 17:32:04 [25,077ms] [Warning] [omni.usd] Warning: in _ProcessFile at line 240 of /buildAgent/work/da639afa0455b478/USD/pxr/imaging/lib/hio/glslfx.cpp -- File doesn't exist: ""
Hi Sheikh:
I can load sol and astro scene without any issue (mdl and textures) . Only Attic has mdl issue. Also UE4 exported scenes have mdl issue.
Sometimes I have to force close the kit. and when restart. it show some error message. seems a memory leak to me with certain scenes.
Active user not found. Using default user [kiosk]2020-06-17 18:05:07 [4,648ms] [Warning] [carb.audio.context] 1 contexts were leaked
Thanks for the egpu switch tool.
I didn’t see any error with out of memory.
this 3 error are only errors i receive when I open a issue scene.
I also use nvidia-smi to check the remain gpu memory. Attic only use 3.7GB gpu memory and the UE4 starter content only 2.2GB.
We can ignore the first two errors. The 3rd one should only pop-up if you have not installed nvidia-docker and running the container version.
Can you confirm seeing the “GLFW initialization failed.” when running Isaac Sim standalone on Ubuntu?
A full log would help and which Attic asset you are loading (there seems to be and Attic and NVIDIA_Attic folder).
I think we take this offline or into a PM or email to debug into which specific UE4 starter content is having the issues.
thanks. it’s not so much the power as it is the flexibility to incorporate custom, deep learning oriented rendering as the current pipes are closed source.