[Warning] [omni.kit.app.plugin] No crash reporter present, dumps uploading isn't available. [Info] [carb] Logging to file: /home/zzj/.local/share/ov/pkg/isaac_sim-2022.1.0/kit/logs/Kit/Isaac-Sim/2022.1/kit_20220621_160231.log [0.172s] [ext: omni.stats-0.0.0] startup [0.219s] [ext: omni.gpu_foundation-0.0.0] startup 2022-06-21 08:02:32 [220ms] [Warning] [carb] FrameworkImpl::setDefaultPlugin(client: omni.gpu_foundation_factory.plugin, desc : [carb::graphics::Graphics v2.5], plugin : carb.graphics-vulkan.plugin) failed. Plugin selection is locked, because the interface was previously acquired by: [0.230s] [ext: carb.windowing.plugins-1.0.0] startup [0.242s] [ext: omni.assets.plugins-0.0.0] startup [0.243s] [ext: omni.kit.renderer.init-0.0.0] startup |---------------------------------------------------------------------------------------------| | Driver Version: 470.57.2 | Graphics API: Vulkan |=============================================================================================| | GPU | Name | Active | LDA | GPU Memory | Vendor-ID | LUID | | | | | | | Device-ID | UUID | |---------------------------------------------------------------------------------------------| | 0 | NVIDIA GeForce RTX 2080 Ti | Yes: 0 | | 11510 MB | 10de | 0 | | | | | | | 1e07 | 3290ab32.. | |---------------------------------------------------------------------------------------------| | 1 | NVIDIA GeForce RTX 2080 Ti | | | 11510 MB | 10de | 0 | | | | | | | 1e07 | ced825f2.. | |=============================================================================================| | OS: Linux zzj, Version: 5.13.0-51-generic | Processor: Intel(R) Core(TM) i9-9820X CPU @ 3.30GHz | Cores: Unknown | Logical: 20 |---------------------------------------------------------------------------------------------| | Total Memory (MB): 63992 | Free Memory: 58693 | Total Page/Swap (MB): 47679 | Free Page/Swap: 47679 |---------------------------------------------------------------------------------------------| [1.203s] [ext: omni.kit.pipapi-0.0.0] startup [1.218s] [ext: omni.kit.pip_archive-0.0.0] startup [1.232s] [ext: omni.isaac.core_archive-0.3.0] startup [1.422s] [ext: omni.usd.config-1.0.0] startup [1.424s] [ext: omni.usd.libs-1.0.0] startup [1.559s] [ext: omni.isaac.ml_archive-0.1.0] startup [1.618s] [ext: omni.kit.loop-isaac-0.1.0] startup [1.619s] [ext: omni.kit.async_engine-0.0.0] startup [1.620s] [ext: omni.appwindow-1.0.0] startup [1.623s] [ext: omni.client-0.1.0] startup [1.632s] [ext: omni.kit.test-0.0.0] startup [1.672s] [ext: omni.kit.renderer.core-0.0.0] startup [1.761s] [ext: omni.ui-2.10.3] startup [1.778s] [ext: carb.audio-0.1.0] startup [1.799s] [ext: omni.kit.mainwindow-0.0.0] startup [1.801s] [ext: omni.uiaudio-1.0.0] startup [1.804s] [ext: omni.kit.uiapp-0.0.0] startup [1.804s] [ext: omni.usd.schema.physics-1.0.0] startup [1.849s] [ext: omni.usd.schema.audio-0.0.0] startup [1.856s] [ext: omni.usd.schema.semantics-0.0.0] startup [1.866s] [ext: omni.usd.schema.omnigraph-1.0.0] startup [1.874s] [ext: omni.usd.schema.anim-0.0.0] startup [1.911s] [ext: omni.kit.commands-1.2.2] startup [1.916s] [ext: omni.timeline-1.0.2] startup [1.918s] [ext: omni.hydra.scene_delegate-0.2.0] startup [1.924s] [ext: omni.kit.audiodeviceenum-1.0.0] startup [1.926s] [ext: omni.usd-1.5.3] startup [1.982s] [ext: omni.kit.asset_converter-1.2.30] startup [2.006s] [ext: omni.usd.schema.isaac-0.2.0] startup [2.045s] [ext: omni.usd.schema.physx-0.0.0] startup [2.072s] [ext: omni.kit.search_core-1.0.2] startup [2.073s] [ext: omni.renderer-rtx-0.0.0] startup [2.074s] [ext: omni.kit.widget.graph-1.4.2] startup [2.082s] [ext: omni.kit.widget.filebrowser-2.2.26] startup [2.088s] [ext: omni.kit.window.popup_dialog-2.0.7] startup [2.093s] [ext: omni.mdl.neuraylib-0.1.0] startup [2.096s] [ext: omni.kit.widget.path_field-2.0.3] startup [2.097s] [ext: omni.kit.widget.versioning-1.3.8] startup [2.099s] [ext: omni.kit.notification_manager-1.0.5] startup [2.105s] [ext: omni.kit.widget.browser_bar-2.0.3] startup [2.106s] [ext: omni.kit.menu.utils-1.2.11] startup [2.117s] [ext: omni.kit.window.filepicker-2.4.29] startup OmniAssetFileFormat [2.165s] [ext: omni.mdl-0.1.0] startup [2.229s] [ext: omni.kit.menu.create-1.0.2] startup [2.230s] [ext: omni.kit.window.file_exporter-1.0.4] startup [2.232s] [ext: omni.kit.window.drop_support-1.0.0] startup [2.232s] [ext: omni.kit.material.library-1.3.10] startup [2.235s] [ext: omni.kit.window.property-1.6.3] startup [2.236s] [ext: omni.kit.context_menu-1.3.9] startup [2.240s] [ext: omni.kit.window.file_importer-1.0.4] startup [2.240s] [ext: omni.kit.stage_templates-1.1.2] startup [2.242s] [ext: omni.kit.widget.stage-2.6.15] startup [2.246s] [ext: omni.kit.window.file-1.3.16] startup [2.248s] [ext: omni.debugdraw-0.1.0] startup [2.254s] [ext: omni.kit.window.content_browser-2.4.28] startup [2.271s] [ext: omni.kit.widget.prompt-1.0.1] startup [2.271s] [ext: omni.kit.property.usd-3.14.8] startup [2.302s] [ext: omni.hydra.engine.stats-1.0.0] startup [2.307s] [ext: omni.kit.widget.settings-1.0.0] startup [2.309s] [ext: omni.graph.tools-1.3.5] startup [2.331s] [ext: omni.graph.core-2.27.0] startup [2.335s] [ext: omni.hydra.rtx-0.1.0] startup [2.343s] [ext: omni.kit.viewport.legacy_gizmos-1.0.0] startup [2.345s] [ext: omni.ui_query-1.1.1] startup [2.347s] [ext: omni.graph-1.22.1] startup [2.397s] [ext: omni.kit.window.viewport-0.0.0] startup 2022-06-21 08:02:34 [2,510ms] [Error] [rtx.neuraylib.plugin] [DYNLIB:IO] 0.1 DYNLIB io error: /home/zzj/.local/share/ov/pkg/isaac_sim-2022.1.0/kit/python/bin/libs/iray/libnvindex.so: cannot open shared object file: No such file or directory 2022-06-21 08:02:34 [2,510ms] [Error] [rtx.neuraylib.plugin] [INDEX:MAIN] 0.1 INDEX main error: Failed to load /home/zzj/.local/share/ov/pkg/isaac_sim-2022.1.0/kit/python/bin/libs/iray/libnvindex.so 2022-06-21 08:02:34 [2,826ms] [Warning] [carb.graphics-vulkan.plugin] NGX does not support feature SuperSampling.Available. 2022-06-21 08:02:34 [2,826ms] [Warning] [rtx.postprocessing.plugin] NGX could not find DLSS feature. Check if 'libnvidia-ngx-dlss.so.*' is available and have compatible version. 2022-06-21 08:02:34 [2,826ms] [Error] [rtx.postprocessing.plugin] createDLSSContext error: unable to initialize context. Optional DLSS feature is disabled. [3.696s] [ext: omni.kit.window.preferences-1.2.1] startup [3.729s] [ext: omni.kit.ui_test-1.2.0] startup [3.731s] [ext: omni.graph.ui-1.6.1] startup [3.753s] [ext: omni.kvdb-0.0.0] startup [3.756s] [ext: omni.kit.widget.searchfield-1.0.6] startup [3.757s] [ext: omni.convexdecomposition-1.4.12] startup [3.760s] [ext: omni.graph.action-1.17.0] startup [3.772s] [ext: omni.localcache-0.0.0] startup [3.775s] [ext: omni.usdphysics-1.4.12] startup [3.777s] [ext: omni.graph.scriptnode-0.5.0] startup [3.780s] [ext: omni.physx-1.4.12-5.1] startup [3.828s] [ext: omni.kit.usd_undo-0.1.0] startup [3.833s] [ext: omni.graph.nodes-1.25.0] startup [3.863s] [ext: omni.physx.commands-1.4.12-5.1] startup [3.915s] [ext: omni.syntheticdata-0.2.1] startup [3.945s] [ext: omni.physx.ui-1.4.12-5.1] startup [4.033s] [ext: omni.warp-0.2.1] startup [5.666s] [ext: omni.kit.renderer.capture-0.0.0] startup [5.669s] [ext: omni.kit.property.material-1.8.5] startup [5.672s] [ext: omni.physx.demos-1.4.12-5.1] startup [5.675s] [ext: omni.physics.tensors-0.1.0] startup [5.682s] [ext: omni.kit.property.physx-0.1.0] startup 2022-06-21 08:02:37 [5,776ms] [Warning] [omni.physx.plugin] Deprecated: getSimulationEventStream is deprecated, please use getSimulationEventStreamV2 [5.786s] [ext: omni.kit.window.toolbar-1.2.4] startup [5.791s] [ext: omni.physx.tensors-0.1.0] startup [5.797s] [ext: omni.physx.vehicle-1.4.12-5.1] startup [5.808s] [ext: omni.physx.tests-1.4.12-5.1] startup [5.850s] [ext: omni.kit.numpy.common-0.1.0] startup [5.853s] [ext: omni.physx.camera-1.4.12-5.1] startup [5.873s] [ext: omni.physx.cct-1.4.12-5.1] startup [5.925s] [ext: omni.isaac.version-1.0.0] startup [5.926s] [ext: omni.isaac.dynamic_control-1.0.0] startup [5.933s] [ext: omni.physx.bundle-1.4.12-5.1] startup [5.933s] [ext: omni.kit.primitive.mesh-1.0.0] startup [5.937s] [ext: omni.command.usd-1.0.1] startup [5.940s] [ext: omni.isaac.core-1.15.1] startup [6.131s] [ext: omni.replicator.core-1.2.0] startup [6.311s] [ext: omni.kit.window.extensions-1.1.0] startup [6.316s] [ext: omni.isaac.core_nodes-0.9.0] startup [6.326s] [ext: omni.isaac.ui-0.2.1] startup [6.328s] [ext: omni.kit.window.script_editor-1.6.2] startup [6.335s] [ext: omni.isaac.wheeled_robots-0.5.4] startup [6.345s] [ext: omni.kit.menu.common-1.0.0] startup [6.346s] [ext: omni.kit.graph.delegate.default-1.0.15] startup [6.348s] [ext: omni.kit.graph.delegate.modern-1.6.0] startup [6.350s] [ext: omni.kit.widget.zoombar-1.0.3] startup [6.351s] [ext: omni.kit.graph.editor.core-1.3.3] startup [6.354s] [ext: omni.kit.widget.stage_icons-1.0.2] startup [6.355s] [ext: omni.kit.browser.core-2.0.12] startup [6.359s] [ext: omni.kit.graph.widget.variables-2.0.2] startup [6.361s] [ext: omni.kit.window.stage-2.3.7] startup [6.364s] [ext: omni.kit.browser.folder.core-1.1.13] startup [6.367s] [ext: omni.graph.window.core-1.22.1] startup [6.373s] [ext: omni.isaac.lula-1.1.0] startup [6.382s] [ext: omni.graph.instancing-1.1.4] startup [6.388s] [ext: omni.graph.window.action-1.3.8] startup [6.389s] [ext: omni.graph.tutorials-1.1.2] startup [6.404s] [ext: omni.rtx.window.settings-0.6.1] startup [6.409s] [ext: omni.isaac.motion_planning-0.2.0] startup [6.416s] [ext: omni.graph.bundle.action-1.0.0] startup [6.416s] [ext: omni.rtx.settings.core-0.5.5] startup [6.421s] [ext: omni.isaac.motion_generation-3.1.2] startup [6.425s] [ext: omni.isaac.kit-0.1.9] startup [6.426s] [ext: omni.isaac.debug_draw-0.1.2] startup [6.431s] [ext: omni.kit.selection-0.1.0] startup [6.432s] [ext: omni.isaac.franka-0.0.0] startup [6.433s] [ext: omni.kit.widget.layers-1.5.17] startup [6.446s] [ext: omni.kit.menu.edit-1.0.6] startup [6.448s] [ext: omni.isaac.isaac_sensor-0.3.4] startup 2022-06-21 08:02:38 [6,446ms] [Warning] [omni.physx.plugin] Deprecated: getSimulationEventStream is deprecated, please use getSimulationEventStreamV2 [6.455s] [ext: omni.kit.widget.live-0.1.0] startup [6.459s] [ext: omni.isaac.surface_gripper-0.1.2] startup [6.464s] [ext: omni.kit.property.layer-1.1.2] startup [6.466s] [ext: omni.isaac.range_sensor-0.4.2] startup [6.492s] [ext: omni.graph.wiStarting kit application with the fillowing args: ['/home/zzj/.local/share/ov/pkg/isaac_sim-2022.1.0/exts/omni.isaac.kit/omni/isaac/kit/simulation_app.py', '/home/zzj/.local/share/ov/pkg/isaac_sim-2022.1.0/apps/omni.isaac.sim.python.kit', '--/app/tokens/exe-path=/home/zzj/.local/share/ov/pkg/isaac_sim-2022.1.0/kit', '--/persistent/app/viewport/displayOptions=3094', '--/rtx/materialDb/syncLoads=True', '--/rtx/hydra/materialSyncLoads=True--/omni.kit.plugin/syncUsdLoads=True', '--/app/renderer/resolution/width=1024', '--/app/renderer/resolution/height=1024', '--/app/window/width=1440', '--/app/window/height=900', '--/renderer/multiGpu/enabled=False', '--ext-folder', '/home/zzj/.local/share/ov/pkg/isaac_sim-2022.1.0/exts', '--ext-folder', '/home/zzj/.local/share/ov/pkg/isaac_sim-2022.1.0/apps', '--/renderer/activeGpu=0', '--portable', '--no-window'] Passing the following args to the base kit application: [] Warp initialized: Version: 0.2.1 Using CUDA device: NVIDIA GeForce RTX 2080 Ti Using CPU compiler: /usr/bin/g++ ndow.generic-1.3.8] startup [6.494s] [ext: omni.isaac.utils-0.1.11] startup [6.497s] [ext: omni.isaac.universal_robots-0.2.1] startup [6.498s] [ext: omni.kit.property.audio-1.0.5] startup [6.499s] [ext: omni.kit.property.skel-1.0.1] startup [6.501s] [ext: omni.kit.property.render-1.1.0] startup [6.502s] [ext: omni.kit.property.camera-1.0.3] startup [6.503s] [ext: omni.kit.property.geometry-1.2.0] startup [6.505s] [ext: omni.kit.property.light-1.0.5] startup [6.506s] [ext: omni.kit.property.transform-1.0.2] startup [6.509s] [ext: omni.isaac.occupancy_map-0.2.4] startup [6.523s] [ext: omni.ui.scene-1.4.6] startup [6.529s] [ext: omni.kit.window.console-0.2.0] startup [6.535s] [ext: omni.kit.window.status_bar-0.1.1] startup [6.543s] [ext: omni.kit.property.bundle-1.2.4] startup [6.544s] [ext: omni.kit.menu.file-1.0.8] startup [6.546s] [ext: omni.kit.manipulator.viewport-1.0.6] startup [6.549s] [ext: omni.isaac.urdf-0.2.2] startup [6.580s] [ext: omni.isaac.dofbot-0.2.0] startup [6.580s] [ext: omni.kit.window.title-1.1.1] startup [6.581s] [ext: omni.kit.profiler.window-1.4.4] startup [6.587s] [ext: omni.graph.visualization.nodes-1.1.1] startup [6.590s] [ext: omni.isaac.synthetic_utils-0.2.1] startup [6.600s] [ext: semantics.schema.editor-0.2.2] startup [6.607s] [ext: omni.isaac.sim.python-2022.1.0] startup [6.608s] Simulation App Starting [7.532s] app ready [25.328s] Simulation App Startup Complete [25.349s] [ext: omni.services.facilities.base-1.0.2] startup [25.368s] [ext: omni.services.core-1.2.0] startup [25.509s] [ext: omni.services.transport.server.base-1.0.2] startup [25.510s] [ext: omni.services.transport.server.http-1.1.2] startup [25.542s] [ext: omni.kit.livestream.core-0.0.0] startup [25.552s] [ext: omni.services.streaming.manager-0.2.2] startup [25.555s] [ext: omni.kit.livestream.websocket-2.5.5] startup 2022-06-21 08:02:57 [25,554ms] [Warning] [omni.livestream-websocket.plugin] Starting websocket server on :8899 port. 2022-06-21 08:02:57 [25,554ms] [Warning] [omni.livestream-websocket.plugin] WebSocket server listening on port 8899 2022-06-21 08:02:57 [25,564ms] [Warning] [omni.livestream-websocket.plugin] Streaming server started. [25.571s] [ext: omni.services.streamclient.websocket-1.4.4] startup 2022-06-21 08:02:57 [25,624ms] [Warning] [omni.client.python] Waiting for a request that has taken longer than 20ms to complete: File "standalone_examples/replicator/offline_generation-test.py", line 81, in File "standalone_examples/replicator/offline_generation-test.py", line 53, in prefix_with_isaac_asset_server File "/home/zzj/.local/share/ov/pkg/isaac_sim-2022.1.0/exts/omni.isaac.core/omni/isaac/core/utils/nucleus.py", line 494, in get_assets_root_path File "/home/zzj/.local/share/ov/pkg/isaac_sim-2022.1.0/exts/omni.isaac.core/omni/isaac/core/utils/nucleus.py", line 183, in check_server File "/home/zzj/.local/share/ov/pkg/isaac_sim-2022.1.0/kit/extscore/omni.client/omni/client/__init__.py", line 133, in stat 2022-06-21 08:02:58 [26,515ms] [Warning] [carb.flatcache.plugin] Type tag does not have a corresponding USD type 2022-06-21 08:03:00 [28,207ms] [Warning] [rtx.neuraylib.plugin] [MDLC:COMPILER] 1.0 MDLC comp warn : omniverse://localhost/NVIDIA/Assets/Isaac/2022.1/Isaac/Environments/Simple_Warehouse/Materials/MaterialInstanceDynamic_1220.mdl(61,8): C181 unused variable 'Local15' 2022-06-21 08:03:00 [28,209ms] [Warning] [rtx.neuraylib.plugin] [MDLC:COMPILER] 1.0 MDLC comp warn : omniverse://localhost/NVIDIA/Assets/Isaac/2022.1/Isaac/Environments/Simple_Warehouse/Materials/MaterialInstanceDynamic_1220.mdl(61,8): C181 unused variable 'Local15' 2022-06-21 08:03:00 [28,210ms] [Warning] [rtx.neuraylib.plugin] [MDLC:COMPILER] 1.0 MDLC comp warn : omniverse://localhost/NVIDIA/Assets/Isaac/2022.1/Isaac/Environments/Simple_Warehouse/Materials/MaterialInstanceDynamic_1220.mdl(61,8): C181 unused variable 'Local15' 2022-06-21 08:03:00 [28,210ms] [Warning] [rtx.neuraylib.plugin] [MDLC:COMPILER] 1.0 MDLC comp warn : omniverse://localhost/NVIDIA/Assets/Isaac/2022.1/Isaac/Environments/Simple_Warehouse/Materials/MaterialInstanceDynamic_1220.mdl(61,8): C181 unused variable 'Local15' 2022-06-21 08:03:00 [28,210ms] [Warning] [rtx.neuraylib.plugin] Compiler Core: omniverse://localhost/NVIDIA/Assets/Isaac/2022.1/Isaac/Environments/Simple_Warehouse/Materials/MaterialInstanceDynamic_1220.mdl(61,8): C181 unused variable 'Local15' 2022-06-21 08:03:00 [28,210ms] [Warning] [rtx.neuraylib.plugin] Compiler Core: omniverse://localhost/NVIDIA/Assets/Isaac/2022.1/Isaac/Environments/Simple_Warehouse/Materials/MaterialInstanceDynamic_1220.mdl(61,8): C181 unused variable 'Local15' 2022-06-21 08:03:04 [32,509ms] [Warning] [carb.flatcache.plugin] No source has valid data elemSize=8 array=0x18d24be8 usdValid=0 cpuValid=0 gpuValid=0 gpuAllocedWithCuda=0 2022-06-21 08:03:04 [32,509ms] [Warning] [carb.flatcache.plugin] No source has valid data elemSize=8 array=0x7fb617287c08 usdValid=0 cpuValid=0 gpuValid=0 gpuAllocedWithCuda=0 2022-06-21 08:03:04 [32,509ms] [Warning] [carb.flatcache.plugin] No source has valid data elemSize=8 array=0x18d24608 usdValid=0 cpuValid=0 gpuValid=0 gpuAllocedWithCuda=0 2022-06-21 08:03:04 [32,509ms] [Warning] [carb.flatcache.plugin] No source has valid data elemSize=8 array=0x18d25068 usdValid=0 cpuValid=0 gpuValid=0 gpuAllocedWithCuda=0 2022-06-21 08:03:04 [32,509ms] [Warning] [carb.flatcache.plugin] No source has valid data elemSize=8 array=0x18d24ee8 usdValid=0 cpuValid=0 gpuValid=0 gpuAllocedWithCuda=0 2022-06-21 08:03:04 [32,510ms] [Warning] [carb.flatcache.plugin] No source has valid data elemSize=8 array=0x18d25068 usdValid=0 cpuValid=0 gpuValid=0 gpuAllocedWithCuda=0 2022-06-21 08:03:04 [32,510ms] [Warning] [omni.syntheticdata.plugin] OgnSdInstanceMapping missing valid input renderVar InstanceSemanticMapSD 2022-06-21 08:03:04 [32,510ms] [Warning] [carb.flatcache.plugin] No source has valid data elemSize=8 array=0x18d25068 usdValid=0 cpuValid=0 gpuValid=0 gpuAllocedWithCuda=0 2022-06-21 08:03:04 [32,510ms] [Warning] [carb.flatcache.plugin] No source has valid data elemSize=8 array=0x18d25068 usdValid=0 cpuValid=0 gpuValid=0 gpuAllocedWithCuda=0 2022-06-21 08:03:04 [33,038ms] [Error] [omni.syntheticdata.plugin] CUDA error 801: cudaErrorNotSupported - operation not supported) 2022-06-21 08:03:04 [33,038ms] [Error] [omni.syntheticdata.plugin] CUDA error 801: cudaErrorNotSupported - operation not supported) 2022-06-21 08:03:04 [33,068ms] [Error] [omni.syntheticdata.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:04 [33,069ms] [Error] [omni.syntheticdata.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:04 [33,069ms] [Error] [omni.syntheticdata.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:04 [33,070ms] [Error] [omni.syntheticdata.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:04 [33,070ms] [Warning] [carb.flatcache.plugin] No source has valid data elemSize=8 array=0x18d24be8 usdValid=0 cpuValid=0 gpuValid=0 gpuAllocedWithCuda=0 2022-06-21 08:03:04 [33,070ms] [Warning] [carb.flatcache.plugin] No source has valid data elemSize=8 array=0x7fb617287c08 usdValid=0 cpuValid=0 gpuValid=0 gpuAllocedWithCuda=0 2022-06-21 08:03:04 [33,070ms] [Warning] [carb.flatcache.plugin] No source has valid data elemSize=8 array=0x18d24608 usdValid=0 cpuValid=0 gpuValid=0 gpuAllocedWithCuda=0 2022-06-21 08:03:04 [33,070ms] [Warning] [carb.flatcache.plugin] No source has valid data elemSize=8 array=0x18d25068 usdValid=0 cpuValid=0 gpuValid=0 gpuAllocedWithCuda=0 2022-06-21 08:03:04 [33,070ms] [Warning] [carb.flatcache.plugin] No source has valid data elemSize=8 array=0x18d24ee8 usdValid=0 cpuValid=0 gpuValid=0 gpuAllocedWithCuda=0 2022-06-21 08:03:04 [33,073ms] [Error] [omni.gpucompute-cuda.plugin] CUDA error in mallocAsync: an illegal memory access was encountered: ../../../source/plugins/omni.gpucompute-cuda/GpuCompute-Cuda.cpp: 123 (device 0) 2022-06-21 08:03:04 [33,074ms] [Error] [omni.gpucompute-cuda.plugin] CUDA error in mallocAsync: an illegal memory access was encountered: ../../../source/plugins/omni.gpucompute-cuda/GpuCompute-Cuda.cpp: 123 (device 0) 2022-06-21 08:03:04 [33,074ms] [Error] [omni.gpucompute-cuda.plugin] CUDA error in memcpyAsync: an illegal memory access was encountered: ../../../source/plugins/omni.gpucompute-cuda/GpuCompute-Cuda.cpp: 168 (device 0) 2022-06-21 08:03:04 [33,074ms] [Error] [omni.gpucompute-cuda.plugin] cudaMemcpyAsync failed to copy 8 bytes from 0x18f26150 to (nil) - kind=1 Warp: Loading PTX module failed with error: 700 2022-06-21 08:03:04 [33,077ms] [Error] [omni.graph.core.plugin] Assertion raised in compute - Could not load ptx from cache path: /home/zzj/.local/share/ov/pkg/isaac_sim-2022.1.0/exts/omni.warp-0.2.1+cp37/warp/bin/wp_omni.replicator.core.ogn.python._impl.nodes.OgnInstanceSegmentation.ptx File "/home/zzj/.local/share/ov/pkg/isaac_sim-2022.1.0/exts/omni.replicator.core-1.2.0+cp37/omni/replicator/core/ogn/python/_impl/nodes/OgnInstanceSegmentation.py", line 168, in compute segmentation_data_gpu, len(instance_tokens), db.inputs.height * db.inputs.width, min_index File "/home/zzj/.local/share/ov/pkg/isaac_sim-2022.1.0/exts/omni.replicator.core-1.2.0+cp37/omni/replicator/core/ogn/python/_impl/nodes/OgnInstanceSegmentation.py", line 76, in get_unique_ids kernel=find_visible_instances, dim=dim, inputs=[instance_segmentation, unique_mask, min_index], device="cuda" File "/home/zzj/.local/share/ov/pkg/isaac_sim-2022.1.0/exts/omni.warp-0.2.1+cp37/warp/context.py", line 788, in launch success = kernel.module.load() File "/home/zzj/.local/share/ov/pkg/isaac_sim-2022.1.0/exts/omni.warp-0.2.1+cp37/warp/context.py", line 291, in load raise Exception(f"Could not load ptx from cache path: {ptx_path}") 2022-06-21 08:03:05 [33,206ms] [Warning] [gpu.foundation.plugin] Requesting texture to use texture streaming, but the service isn't available.The texture will be created as a regular resource. 2022-06-21 08:03:05 [34,057ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:05 [34,057ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:05 [34,057ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:05 [34,058ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:05 [34,062ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:05 [34,062ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:05 [34,062ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:05 [34,063ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:05 [34,063ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:06 [34,494ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:06 [34,494ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:06 [34,494ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:06 [34,495ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:06 [34,499ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:06 [34,499ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:06 [34,499ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:06 [34,500ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:06 [34,500ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:07 [35,513ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:07 [35,513ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:07 [35,513ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:07 [35,513ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:07 [35,514ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:07 [35,514ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:07 [35,514ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:07 [35,514ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:07 [35,514ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:07 [35,820ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:07 [35,821ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:07 [35,821ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:07 [35,821ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:07 [35,822ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:07 [35,822ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:07 [35,822ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:07 [35,822ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:07 [35,822ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:07 [36,086ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:07 [36,086ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:07 [36,087ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:07 [36,087ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:07 [36,088ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:07 [36,088ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:07 [36,088ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:07 [36,088ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:07 [36,088ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:08 [36,301ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:08 [36,301ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:08 [36,301ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:08 [36,301ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:08 [36,302ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:08 [36,302ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:08 [36,302ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:08 [36,302ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:08 [36,302ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:08 [36,672ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:08 [36,672ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:08 [36,672ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:08 [36,673ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:08 [36,673ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:08 [36,673ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:08 [36,673ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:08 [36,673ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:08 [36,673ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:08 [36,897ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:08 [36,897ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:08 [36,897ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:08 [36,897ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:08 [36,898ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:08 [36,898ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:08 [36,898ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:08 [36,898ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:08 [36,898ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:09 [37,280ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:09 [37,280ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:09 [37,280ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:09 [37,280ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:09 [37,281ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:09 [37,281ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:09 [37,281ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:09 [37,281ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:09 [37,281ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:09 [37,506ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:09 [37,506ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:09 [37,506ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:09 [37,507ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:09 [37,507ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:09 [37,508ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:09 [37,508ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:09 [37,508ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:09 [37,508ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:09 [37,887ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:09 [37,888ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:09 [37,888ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:09 [37,888ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:09 [37,889ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:09 [37,889ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:09 [37,889ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:09 [37,889ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:09 [37,890ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:09 [38,148ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:09 [38,148ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:09 [38,148ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:09 [38,148ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:09 [38,149ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:09 [38,149ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:09 [38,149ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:09 [38,149ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:09 [38,149ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:10 [38,550ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:10 [38,550ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:10 [38,550ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:10 [38,551ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:10 [38,551ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:10 [38,551ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:10 [38,551ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:10 [38,552ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:10 [38,552ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:10 [38,831ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:10 [38,831ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:10 [38,831ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:10 [38,832ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:10 [38,837ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:10 [38,837ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:10 [38,837ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:10 [38,837ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:10 [38,837ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:10 [39,002ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:10 [39,002ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:10 [39,002ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:10 [39,003ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:10 [39,008ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:10 [39,009ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:10 [39,009ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:10 [39,009ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:10 [39,009ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:11 [39,471ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:11 [39,471ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:11 [39,471ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:11 [39,472ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:11 [39,473ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:11 [39,473ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:11 [39,473ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:11 [39,473ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:11 [39,473ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:11 [39,722ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:11 [39,722ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:11 [39,722ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:11 [39,723ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:11 [39,723ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:11 [39,723ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:11 [39,723ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:11 [39,723ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:11 [39,723ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:11 [40,031ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:11 [40,031ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:11 [40,031ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:11 [40,031ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:11 [40,032ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:11 [40,032ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:11 [40,032ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:11 [40,032ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:11 [40,032ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:12 [40,334ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:12 [40,334ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:12 [40,334ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:12 [40,334ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:12 [40,335ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:12 [40,335ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:12 [40,335ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:12 [40,336ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:12 [40,336ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:12 [40,568ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:12 [40,568ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:12 [40,568ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:12 [40,569ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:12 [40,570ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:12 [40,570ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:12 [40,570ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:12 [40,570ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:12 [40,570ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:12 [40,652ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:12 [40,652ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:12 [40,652ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:12 [40,652ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:12 [40,653ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:12 [40,653ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:12 [40,653ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:12 [40,653ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:12 [40,653ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:12 [40,798ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:12 [40,798ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:12 [40,798ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:12 [40,798ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:12 [40,799ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:12 [40,799ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:12 [40,799ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:12 [40,799ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:12 [40,799ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:12 [40,903ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:12 [40,903ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:12 [40,903ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:12 [40,904ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:12 [40,905ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:12 [40,905ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:12 [40,905ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:12 [40,905ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:12 [40,905ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:12 [41,011ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:12 [41,011ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:12 [41,011ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:12 [41,012ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:12 [41,012ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:12 [41,012ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:12 [41,012ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:12 [41,012ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:12 [41,012ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:13 [41,263ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:13 [41,264ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:13 [41,264ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:13 [41,264ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:13 [41,264ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:13 [41,264ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:13 [41,264ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:13 [41,264ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:13 [41,264ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:13 [41,431ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:13 [41,431ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:13 [41,431ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:13 [41,432ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:13 [41,433ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:13 [41,433ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:13 [41,433ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:13 [41,433ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:13 [41,433ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:13 [41,736ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:13 [41,736ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:13 [41,736ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:13 [41,737ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:13 [41,738ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:13 [41,738ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:13 [41,738ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:13 [41,738ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:13 [41,738ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:13 [41,923ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:13 [41,923ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:13 [41,923ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:13 [41,923ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:13 [41,924ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:13 [41,924ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:13 [41,924ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:13 [41,924ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:13 [41,924ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:14 [42,192ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:14 [42,192ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:14 [42,192ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:14 [42,192ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:14 [42,193ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:14 [42,193ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:14 [42,193ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:14 [42,193ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:14 [42,193ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:14 [42,382ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:14 [42,382ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:14 [42,383ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:14 [42,383ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:14 [42,384ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:14 [42,384ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:14 [42,384ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:14 [42,384ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:14 [42,384ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:14 [42,591ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:14 [42,591ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:14 [42,591ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:14 [42,591ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:14 [42,592ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:14 [42,592ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:14 [42,592ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:14 [42,593ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:14 [42,593ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:14 [42,924ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:14 [42,924ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:14 [42,924ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:14 [42,925ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:14 [42,925ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:14 [42,925ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:14 [42,925ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:14 [42,926ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:14 [42,926ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:14 [43,099ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:14 [43,099ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:14 [43,099ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:14 [43,099ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:14 [43,100ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:14 [43,100ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:14 [43,100ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:14 [43,101ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:14 [43,101ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:15 [43,188ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:15 [43,189ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:15 [43,189ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:15 [43,189ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:15 [43,190ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:15 [43,190ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:15 [43,190ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:15 [43,190ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:15 [43,190ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:15 [43,350ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:15 [43,350ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:15 [43,350ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:15 [43,350ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:15 [43,351ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:15 [43,351ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:15 [43,351ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:15 [43,351ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:15 [43,351ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:15 [43,447ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:15 [43,447ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:15 [43,447ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:15 [43,447ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:15 [43,448ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:15 [43,448ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:15 [43,448ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:15 [43,449ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:15 [43,449ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:15 [43,877ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:15 [43,877ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:15 [43,877ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:15 [43,878ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:15 [43,879ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:15 [43,879ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:15 [43,879ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:15 [43,879ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:15 [43,879ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:16 [44,578ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:16 [44,578ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:16 [44,578ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:16 [44,578ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:16 [44,579ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:16 [44,579ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:16 [44,579ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:16 [44,579ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:16 [44,579ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:16 [44,653ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:16 [44,653ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:16 [44,653ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:16 [44,653ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:16 [44,654ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:16 [44,654ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:16 [44,654ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:16 [44,654ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:16 [44,655ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:16 [44,875ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:16 [44,875ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:16 [44,875ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:16 [44,875ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:16 [44,876ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:16 [44,876ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:16 [44,876ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:16 [44,876ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:16 [44,876ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:16 [45,087ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:16 [45,088ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:16 [45,088ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:16 [45,088ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:16 [45,089ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:16 [45,089ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:16 [45,089ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:16 [45,090ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:16 [45,090ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:17 [45,528ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:17 [45,528ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:17 [45,528ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:17 [45,528ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:17 [45,528ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:17 [45,528ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:17 [45,528ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:17 [45,528ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:17 [45,528ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:17 [45,918ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:17 [45,918ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:17 [45,918ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:17 [45,919ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:17 [45,919ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:17 [45,920ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:17 [45,920ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:17 [45,920ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:17 [45,920ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:17 [46,022ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:17 [46,022ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:17 [46,022ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:17 [46,023ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:17 [46,024ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:17 [46,024ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:17 [46,024ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:17 [46,024ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:17 [46,024ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:17 [46,131ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:17 [46,131ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:17 [46,131ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:17 [46,131ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:17 [46,132ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:17 [46,132ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:17 [46,132ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:17 [46,132ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:17 [46,132ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:18 [46,218ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:18 [46,218ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:18 [46,218ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:18 [46,219ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:18 [46,220ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:18 [46,220ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:18 [46,220ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:18 [46,220ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:18 [46,220ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:18 [46,316ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:18 [46,316ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:18 [46,316ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:18 [46,316ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:18 [46,318ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:18 [46,318ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:18 [46,318ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:18 [46,319ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:18 [46,319ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:18 [46,353ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:18 [46,353ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:18 [46,353ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:18 [46,354ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:18 [46,355ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:18 [46,355ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:18 [46,355ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:18 [46,355ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:18 [46,356ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:18 [46,496ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:18 [46,497ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:18 [46,497ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:18 [46,497ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:18 [46,498ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:18 [46,498ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:18 [46,498ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:18 [46,498ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:18 [46,498ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:18 [46,768ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:18 [46,769ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:18 [46,769ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:18 [46,769ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:18 [46,770ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:18 [46,770ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:18 [46,770ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:18 [46,770ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:18 [46,770ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:18 [46,975ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:18 [46,975ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:18 [46,975ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:18 [46,975ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:18 [46,976ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:18 [46,976ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:18 [46,977ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:18 [46,977ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:18 [46,977ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:19 [47,182ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:19 [47,182ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:19 [47,182ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:19 [47,182ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:19 [47,182ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:19 [47,182ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:19 [47,182ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:19 [47,183ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:19 [47,183ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:19 [47,316ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:19 [47,316ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:19 [47,316ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:19 [47,316ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:19 [47,317ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:19 [47,317ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:19 [47,317ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:19 [47,317ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:19 [47,318ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:19 [47,522ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:19 [47,522ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:19 [47,522ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:19 [47,522ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:19 [47,523ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:19 [47,523ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:19 [47,523ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:19 [47,524ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:19 [47,524ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:19 [47,755ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:19 [47,756ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:19 [47,756ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:19 [47,756ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:19 [47,757ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:19 [47,757ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:19 [47,757ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:19 [47,757ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:19 [47,757ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:19 [48,048ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:19 [48,049ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:19 [48,049ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:19 [48,049ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:19 [48,050ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:19 [48,050ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:19 [48,050ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:19 [48,050ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:19 [48,050ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:20 [48,259ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:20 [48,259ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:20 [48,259ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:20 [48,259ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:20 [48,259ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:20 [48,259ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:20 [48,259ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:20 [48,259ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:20 [48,259ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:20 [48,480ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:20 [48,480ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:20 [48,480ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:20 [48,481ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:20 [48,481ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:20 [48,481ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:20 [48,481ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:20 [48,481ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:20 [48,481ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:20 [48,802ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:20 [48,802ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:20 [48,802ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:20 [48,803ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:20 [48,804ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:20 [48,804ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:20 [48,804ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:20 [48,804ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:20 [48,804ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:20 [49,046ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:20 [49,046ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:20 [49,046ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:20 [49,047ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:20 [49,048ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:20 [49,048ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:20 [49,048ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:20 [49,048ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:20 [49,048ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:20 [49,092ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:20 [49,092ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:20 [49,092ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:20 [49,093ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:20 [49,094ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:20 [49,094ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:20 [49,094ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:20 [49,095ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:20 [49,095ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:21 [49,237ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:21 [49,237ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:21 [49,237ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:21 [49,237ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:21 [49,238ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:21 [49,238ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:21 [49,238ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:21 [49,239ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:21 [49,239ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:21 [49,366ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:21 [49,367ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:21 [49,367ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:21 [49,367ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:21 [49,368ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:21 [49,368ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:21 [49,368ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:21 [49,368ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:21 [49,368ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:21 [49,670ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:21 [49,670ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:21 [49,670ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:21 [49,671ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:21 [49,672ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:21 [49,672ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:21 [49,672ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:21 [49,673ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:21 [49,673ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:21 [49,796ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:21 [49,796ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:21 [49,796ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:21 [49,796ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:21 [49,797ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:21 [49,797ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:21 [49,797ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:21 [49,797ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:21 [49,797ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:21 [49,863ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:21 [49,864ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:21 [49,864ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:21 [49,864ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:21 [49,865ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:21 [49,865ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:21 [49,865ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:21 [49,865ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:21 [49,865ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:21 [50,003ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:21 [50,003ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:21 [50,003ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:21 [50,003ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:21 [50,004ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:21 [50,004ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:21 [50,004ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:21 [50,004ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:21 [50,004ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:22 [50,293ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:22 [50,293ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:22 [50,293ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:22 [50,296ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:22 [50,297ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:22 [50,297ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:22 [50,297ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:22 [50,297ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:22 [50,297ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:22 [50,308ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:22 [50,308ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:22 [50,308ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:22 [50,308ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:22 [50,309ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:22 [50,309ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:22 [50,309ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:22 [50,309ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:22 [50,309ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:22 [50,374ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:22 [50,374ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:22 [50,374ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:22 [50,375ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:22 [50,375ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:22 [50,375ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:22 [50,375ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:22 [50,376ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:22 [50,376ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:22 [50,487ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:22 [50,487ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:22 [50,487ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:22 [50,488ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:22 [50,489ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:22 [50,489ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:22 [50,489ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:22 [50,489ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:22 [50,489ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:22 [50,627ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:22 [50,627ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:22 [50,627ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:22 [50,627ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:22 [50,628ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:22 [50,628ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:22 [50,628ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:22 [50,629ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:22 [50,629ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:22 [50,922ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:22 [50,923ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:22 [50,923ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:22 [50,923ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:22 [50,924ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:22 [50,924ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:22 [50,924ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:22 [50,924ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:22 [50,924ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:23 [51,170ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:23 [51,170ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:23 [51,170ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:23 [51,171ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:23 [51,172ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:23 [51,172ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:23 [51,172ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:23 [51,172ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:23 [51,173ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:23 [51,284ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:23 [51,284ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:23 [51,284ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:23 [51,284ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:23 [51,285ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:23 [51,285ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:23 [51,285ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:23 [51,285ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:23 [51,285ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:23 [51,437ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:23 [51,437ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:23 [51,437ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:23 [51,437ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:23 [51,438ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:23 [51,438ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:23 [51,438ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:23 [51,439ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:23 [51,439ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:23 [51,464ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:23 [51,464ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:23 [51,464ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:23 [51,464ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:23 [51,465ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:23 [51,465ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:23 [51,465ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:23 [51,465ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:23 [51,465ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:23 [51,483ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:23 [51,483ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:23 [51,483ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:23 [51,483ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:23 [51,484ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:23 [51,484ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:23 [51,484ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:23 [51,484ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:23 [51,484ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:23 [52,110ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:23 [52,110ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:23 [52,110ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:23 [52,111ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:23 [52,112ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:23 [52,112ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:23 [52,112ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:23 [52,113ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:23 [52,113ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:24 [52,330ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:24 [52,331ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:24 [52,331ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:24 [52,331ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:24 [52,333ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:24 [52,333ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:24 [52,333ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:24 [52,333ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:24 [52,333ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:24 [52,649ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:24 [52,649ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:24 [52,649ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:24 [52,650ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:24 [52,651ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:24 [52,651ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:24 [52,651ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:24 [52,651ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:24 [52,651ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:24 [52,884ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:24 [52,884ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:24 [52,884ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:24 [52,885ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:24 [52,886ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:24 [52,886ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:24 [52,886ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:24 [52,886ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:24 [52,886ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:24 [52,943ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:24 [52,943ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:24 [52,943ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:24 [52,944ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:24 [52,945ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:24 [52,946ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:24 [52,946ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:24 [52,946ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:24 [52,946ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:24 [52,991ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:24 [52,991ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:24 [52,991ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:24 [52,991ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:24 [52,992ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:24 [52,992ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:24 [52,992ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:24 [52,993ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:24 [52,993ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:24 [53,136ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:24 [53,136ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:24 [53,136ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:24 [53,136ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:24 [53,137ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:24 [53,137ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:24 [53,137ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:24 [53,137ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:24 [53,137ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:25 [53,538ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:25 [53,538ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:25 [53,539ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:25 [53,539ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:25 [53,540ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:25 [53,540ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:25 [53,540ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:25 [53,540ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:25 [53,540ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:25 [53,817ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:25 [53,817ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:25 [53,817ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:25 [53,817ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:25 [53,818ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:25 [53,818ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:25 [53,818ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:25 [53,818ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:25 [53,818ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:25 [54,071ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:25 [54,071ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:25 [54,072ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:25 [54,072ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:25 [54,073ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:25 [54,073ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:25 [54,073ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:25 [54,073ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:25 [54,073ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:26 [54,306ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:26 [54,306ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:26 [54,307ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:26 [54,307ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:26 [54,308ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:26 [54,308ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:26 [54,308ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:26 [54,308ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:26 [54,308ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:26 [54,510ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:26 [54,510ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:26 [54,510ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:26 [54,510ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:26 [54,511ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:26 [54,511ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:26 [54,511ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:26 [54,511ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:26 [54,512ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:26 [54,758ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:26 [54,758ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:26 [54,758ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:26 [54,759ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:26 [54,759ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:26 [54,760ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:26 [54,760ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:26 [54,760ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:26 [54,760ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:26 [55,059ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:26 [55,059ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:26 [55,059ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:26 [55,060ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:26 [55,061ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:26 [55,061ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:26 [55,061ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:26 [55,061ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:26 [55,062ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:27 [55,278ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:27 [55,278ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:27 [55,278ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:27 [55,278ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:27 [55,279ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:27 [55,279ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:27 [55,279ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:27 [55,279ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:27 [55,280ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:27 [55,392ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:27 [55,392ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:27 [55,392ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:27 [55,392ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:27 [55,393ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:27 [55,393ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:27 [55,393ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:27 [55,394ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:27 [55,394ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:27 [55,519ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:27 [55,519ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:27 [55,519ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:27 [55,520ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:27 [55,521ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:27 [55,521ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:27 [55,521ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:27 [55,521ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:27 [55,521ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:27 [55,829ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:27 [55,829ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:27 [55,829ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:27 [55,830ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:27 [55,831ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:27 [55,831ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:27 [55,831ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:27 [55,831ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:27 [55,831ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:27 [56,024ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:27 [56,024ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:27 [56,024ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:27 [56,024ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:27 [56,025ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:27 [56,025ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:27 [56,025ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:27 [56,026ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:27 [56,026ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:28 [56,215ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:28 [56,215ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:28 [56,215ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:28 [56,216ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:28 [56,217ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:28 [56,217ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:28 [56,217ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:28 [56,217ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:28 [56,217ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:28 [56,408ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:28 [56,408ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:28 [56,409ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:28 [56,409ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:28 [56,409ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:28 [56,409ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:28 [56,409ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:28 [56,409ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:28 [56,409ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:28 [56,758ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:28 [56,758ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:28 [56,758ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:28 [56,758ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:28 [56,759ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:28 [56,759ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:28 [56,759ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:28 [56,760ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:28 [56,760ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:28 [56,919ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:28 [56,919ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:28 [56,919ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:28 [56,920ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:28 [56,921ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:28 [56,921ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:28 [56,921ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:28 [56,921ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:28 [56,921ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:28 [57,155ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:28 [57,155ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:28 [57,155ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:29 [57,155ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:29 [57,155ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:29 [57,156ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:29 [57,156ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:29 [57,156ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:29 [57,156ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:29 [57,330ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:29 [57,330ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:29 [57,330ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:29 [57,332ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:29 [57,343ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:29 [57,343ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:29 [57,343ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:29 [57,343ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:29 [57,343ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:29 [57,400ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:29 [57,400ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:29 [57,400ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:29 [57,401ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:29 [57,402ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:29 [57,402ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:29 [57,402ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:29 [57,402ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:29 [57,402ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:29 [57,594ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:29 [57,594ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:29 [57,594ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:29 [57,594ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:29 [57,596ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:29 [57,596ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:29 [57,596ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:29 [57,596ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:29 [57,596ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:29 [57,671ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:29 [57,672ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:29 [57,672ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:29 [57,672ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:29 [57,679ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:29 [57,679ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:29 [57,679ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:29 [57,679ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:29 [57,679ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:29 [57,682ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:29 [57,682ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:29 [57,682ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:29 [57,682ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:29 [57,683ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:29 [57,683ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:29 [57,683ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:29 [57,684ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:29 [57,684ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:29 [57,694ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:29 [57,694ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:29 [57,694ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:29 [57,694ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:29 [57,696ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:29 [57,696ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:29 [57,696ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:29 [57,696ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:29 [57,696ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:29 [57,707ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:29 [57,707ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:29 [57,707ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:29 [57,707ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:29 [57,708ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:29 [57,708ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:29 [57,708ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:29 [57,708ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:29 [57,708ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:29 [57,840ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:29 [57,840ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:29 [57,840ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:29 [57,841ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:29 [57,842ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:29 [57,842ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:29 [57,842ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:29 [57,842ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:29 [57,842ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:29 [57,922ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:29 [57,922ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:29 [57,923ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:29 [57,923ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:29 [57,925ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:29 [57,925ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:29 [57,925ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:29 [57,925ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:29 [57,925ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:30 [58,263ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:30 [58,263ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:30 [58,263ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:30 [58,263ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:30 [58,264ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:30 [58,264ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:30 [58,264ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:30 [58,265ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:30 [58,265ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:30 [58,467ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:30 [58,467ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:30 [58,467ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:30 [58,468ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:30 [58,470ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:30 [58,470ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:30 [58,470ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:30 [58,470ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:30 [58,470ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:30 [58,546ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:30 [58,546ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:30 [58,546ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:30 [58,546ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:30 [58,548ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:30 [58,548ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:30 [58,548ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:30 [58,548ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:30 [58,548ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:30 [58,701ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:30 [58,701ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:30 [58,701ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:30 [58,701ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:30 [58,702ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:30 [58,702ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:30 [58,702ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:30 [58,703ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:30 [58,703ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:31 [59,183ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:31 [59,183ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:31 [59,183ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:31 [59,183ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:31 [59,184ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:31 [59,184ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:31 [59,184ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:31 [59,184ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:31 [59,184ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:31 [60,059ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:31 [60,059ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:31 [60,059ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:31 [60,060ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:31 [60,060ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:31 [60,060ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:31 [60,060ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:31 [60,060ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:31 [60,060ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:31 [60,101ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:31 [60,101ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:31 [60,101ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:31 [60,102ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:31 [60,102ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:31 [60,102ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:31 [60,102ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:31 [60,102ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:31 [60,102ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:32 [60,767ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:32 [60,767ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:32 [60,767ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:32 [60,767ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:32 [60,768ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:32 [60,768ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:32 [60,768ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:32 [60,769ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:32 [60,769ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression 2022-06-21 08:03:32 [60,953ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:32 [60,953ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:32 [60,953ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:32 [60,953ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:32 [60,954ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered) 2022-06-21 08:03:32 [60,954ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA 2022-06-21 08:03:32 [60,954ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource! 2022-06-21 08:03:32 [60,954ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0. 2022-06-21 08:03:32 [60,954ms] [Error] [gpu.foundation.plugin] Failed to allocate buffers for block-compression ./python.sh: line 46: 9772 Segmentation fault (core dumped) $python_exe "$@" $args There was an error running python