Fail to open existed USD and use with cuRobo

Omniverse Isaac Sim
1

Hello, after I edited files and opened up Isaac Sim from python file several times this morning, it failed to work normally and needed force quit. Then I tried to find the problem and found that the existed USD I edited yesterday could not be opened. The warning in the terminal is as below.

omni::ui::GpuResourcesCache: trying to release non-existent cached GPU resource '/home/yangfan/.local/share/ov/pkg/isaac_sim-2022.2.1/kit/exts/omni.kit.window.filepicker/data/thumbnails/usd_stage_256.png:2024-02-23@09:57:48'
2024-03-14 07:22:32 [17,417ms] [Warning] [omni.ui] omni::ui::GpuResourcesCache: trying to release non-existent cached GPU resource '/home/yangfan/.local/share/ov/pkg/isaac_sim-2022.2.1/kit/exts/omni.kit.window.filepicker/data/thumbnails/usd_stage_256.png:2024-02-23@09:57:48'
2024-03-14 07:22:32 [17,417ms] [Warning] [omni.ui] omni::ui::GpuResourcesCache: trying to release non-existent cached GPU resource '/home/yangfan/.local/share/ov/pkg/isaac_sim-2022.2.1/kit/exts/omni.kit.window.filepicker/data/thumbnails/usd_stage_256.png:2024-02-23@09:57:48'
2024-03-14 07:25:50 [215,739ms] [Warning] [omni.client.plugin]  HTTP Client: provider_http: CC-493: Request through cache failed. Retrying without cache for http://omniverse-content-production.s3-us-west-2.amazonaws.com/Materials/Base/Glass/Clear_Glass.mdl
2024-03-14 07:25:50 [215,739ms] [Warning] [omni.client.plugin]  HTTP Client: omniclient: CC-873: Bypassing cache until the application is restarted
2024-03-14 07:26:21 [246,171ms] [Warning] [rtx.neuraylib.plugin] MATERIAL http://omniverse-content-production.s3-us-west-2.amazonaws.com/Materials/Base/Glass/Clear_Glass.mdl?watch=00000000235c91d0 not found
2024-03-14 07:26:21 [246,171ms] [Error] [rtx.neuraylib.plugin] [MDLC:COMPILER]   1.0   MDLC   comp error: http://omniverse-content-production.s3-us-west-2.amazonaws.com/Materials/Base/Glass/Clear_Glass.mdl?watch=00000000235c91d0(1,1): C100 "mdl" expected
2024-03-14 07:26:21 [246,171ms] [Error] [rtx.neuraylib.plugin] Compiler Core: http://omniverse-content-production.s3-us-west-2.amazonaws.com/Materials/Base/Glass/Clear_Glass.mdl?watch=00000000235c91d0(1,1): C100 "mdl" expected
2024-03-14 07:26:21 [246,171ms] [Warning] [rtx.neuraylib.plugin] Loading MdlModule to DB (rtx_scope) failed: ::Z6Ahttp_3A_2F::Z58omniverse_2Dcontent_2Dproduction_2Es3_2Dus_2Dwest_2D2_2Eamazonaws_2Ecom::Materials::Base::Glass::ZCEClear_5FGlass_2Emdl
2024-03-14 07:26:21 [246,171ms] [Warning] [rtx.neuraylib.plugin] Loading transaction committed (this thread). MdlModule is NOT in the DB (rtx_scope): ::Z6Ahttp_3A_2F::Z58omniverse_2Dcontent_2Dproduction_2Es3_2Dus_2Dwest_2D2_2Eamazonaws_2Ecom::Materials::Base::Glass::ZCEClear_5FGlass_2Emdl
2024-03-14 07:27:06 [291,978ms] [Warning] [omni.client.plugin]  HTTP Client: provider_http: CC-493: Request through cache failed. Retrying without cache for http://omniverse-content-production.s3-us-west-2.amazonaws.com/Materials/Base/Metals/Aluminum_Anodized_Black.mdl

I could not find out the problem so I reinstalled the Isaac sim. But the problem still exist. Below is another warning after trial.

2024-03-14 07:39:13 [25,287ms] [Warning] [omni.ui] omni::ui::GpuResourcesCache: trying to release non-existent cached GPU resource '/home/yangfan/.local/share/ov/pkg/isaac_sim-2022.2.1/kit/exts/omni.kit.window.filepicker/data/thumbnails/usd_stage_256.png:2024-03-14@15:37:49'
2024-03-14 07:39:13 [25,349ms] [Warning] [omni.usd] Warning (secondary thread): in _ReportErrors at line 2830 of /buildAgent/work/ca6c508eae419cf8/USD/pxr/usd/usd/stage.cpp -- Could not open asset @/home/yangfan/simulation/box_empty.usd@ for payload on prim @/home/yangfan/simulation/total_all.usd@,@anon:0x2162ea20@</World/box_empty>. (instantiating stage on stage @/home/yangfan/simulation/total_all.usd@ <0x154c85e0>)2024-03-14 07:39:13 [25,287ms] [Warning] [omni.ui] omni::ui::GpuResourcesCache: trying to release non-existent cached GPU resource '/home/yangfan/.local/share/ov/pkg/isaac_sim-2022.2.1/kit/exts/omni.kit.window.filepicker/data/thumbnails/usd_stage_256.png:2024-03-14@15:37:49'
2024-03-14 07:39:13 [25,349ms] [Warning] [omni.usd] Warning (secondary thread): in _ReportErrors at line 2830 of /buildAgent/work/ca6c508eae419cf8/USD/pxr/usd/usd/stage.cpp -- Could not open asset @/home/yangfan/simulation/box_empty.usd@ for payload on prim @/home/yangfan/simulation/total_all.usd@,@anon:0x2162ea20@</World/box_empty>. (instantiating stage on stage @/home/yangfan/simulation/total_all.usd@ <0x154c85e0>)

2024-03-14 07:39:13 [25,349ms] [Warning] [omni.usd] Warning (secondary thread): in _ReportErrors at line 2830 of /buildAgent/work/ca6c508eae419cf8/USD/pxr/usd/usd/stage.cpp -- Could not open asset @/home/yangfan/simulation/flexiv_rizon4_total.usd@ for payload on prim @/home/yangfan/simulation/total_all.usd@,@anon:0x2162ea20@</World/flexiv_rizon4_total_01>. (instantiating stage on stage @/home/yangfan/simulation/total_all.usd@ <0x154c85e0>)

2024-03-14 07:39:13 [25,349ms] [Warning] [omni.usd] Warning (secondary thread): in _ReportErrors at line 2830 of /buildAgent/work/ca6c508eae419cf8/USD/pxr/usd/usd/stage.cpp -- Could not open asset @/home/yangfan/simulation/box_exact.usd@ for payload on prim @/home/yangfan/simulation/total_all.usd@,@anon:0x2162ea20@</World/box_exact>. (instantiating stage on stage @/home/yangfan/simulation/total_all.usd@ <0x154c85e0>)

I am using Isaac sim 2022.2.1, with ubuntu 22.04, NVIDIA driver 545.23.08. Limited by the supported version of cuRobo, I cannot upgrade Isaac Sim to the latest version. This is my latest trial log file.
kit_20240314_162756.log (1.4 MB)

Could you give me some advice? Thanks!

1 Like
2

Hello, I am also experiencing the same problem at this time, but I can open smaller files. Moreover, yesterday’s running speed was very fast, and today it took ten minutes to open a small file. What has my computer gone through?

3

Have you checked the VRAM consumption?

5

I can also open small files like components, but when it comes to the whole scene file it is totally stuck.

6

The VRAM consumption seems just as normal.
03142022

7

At present, I think there is a problem with the process of applying the asset. If we save it locally and open it, the effect will be better. Unfortunately, the previously designed applications that used USD files are difficult to open again, What I mean is those files that reference asset files

8

I have good news for you, I have successfully opened it. The bad news is that the consumption was opened for half an hour. As long as kite.exe continues to call the CPU, there is hope

9

Actually, all my assets used are local files…At first I thought it was the problem with RAM. But I now restart my computer and even have difficulty running the Isaac Sim fluently from python script.

10

That sounds good. But I still wonder what happened to my Isaac Sim. As I need to modify my python script, taking so much time for one time run is also a big trouble.

11

Just now I tried to run it from my python script. After maybe two minutes, Isaac Sim was loaded. However, every time it needs force quit and the ‘play/pause’ button hardly works…

12

Are you using Isaac Sim 2022.2.1? Just now I opened up this version on another computer but encountered the same problem. However the 2023.1.1 works well. I wonder whether there is some problems with this version.

13

No, I’m using the latest version - 2023.1.1. I’m trying to reinstall everything

16

Strange. I have reinstalled Isaac Sim without any changes. Then I consider reinstalling the Omniverse, but I failed to uninstall on Linux.

17

During the uninstallation process, I discovered the GPUCache folder that had always worried me, as well as many residual cache files. I hope to solve the problem this time.

18

I am very frustrated, the problem still exists

19

Sorry to hear that. I’m still testing my code with long time simulation loading. Hope it will return to normal suddenly just as how it went wrong…

20

Have you solved it ? I’m facing the same problem

21

Not yet. I am considering reinstalling the omniverse.