# Reducing GPU memory usage for multi-camera uses

**URL:** <https://forums.developer.nvidia.com/t/reducing-gpu-memory-usage-for-multi-camera-uses/184980>\
**Category:** Isaac Sim\
**Tags:** python, ros, camera\
**Created:** [July 28, 2021, 2:47pm UTC](https://forums.developer.nvidia.com/t/reducing-gpu-memory-usage-for-multi-camera-uses/184980 "2021-07-28T14:47:32Z")\
**Posts on this page:** 19\
**Page:** 1

<div class="post-metadata">

**Author:** ![wchen](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@wchen](https://forums.developer.nvidia.com/u/wchen)\
**Post date:** [July 28, 2021, 2:47pm UTC](https://forums.developer.nvidia.com/t/reducing-gpu-memory-usage-for-multi-camera-uses/184980/1 "2021-07-28T14:47:32Z")

</div>

I’m currently trying to simulate 8 or so cameras at once while having them all publish with ROS. However, it seems like doing so causes my GPU to run out of memory (RTX 2080, 8 GB). I’ve found that I can get up to around 4 cameras working at the same time, using up ~7.2 GB. Are there any methods for lowering the memory usage for many-camera use cases?

EDIT: I thought I should mention that I am effectively only using the cameras for ROS. If there’s a way to disable them rendering to viewports while still updating in ROS, that might also help.

---

<div class="post-metadata">

**Author:** ![ltorabi](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/ltorabi/32/14043_2.png) [@ltorabi](https://forums.developer.nvidia.com/u/ltorabi)\
**Post date:** [July 29, 2021, 1:45am UTC](https://forums.developer.nvidia.com/t/reducing-gpu-memory-usage-for-multi-camera-uses/184980/2 "2021-07-29T01:45:07Z")

</div>

Hi wchen,

We are aware of the memory usage of the multi camera, and also about the limitation that the camera is tied to the viewport. We are working on it for the next release.

Kindly,  
Liila

---

<div class="post-metadata">

**Author:** ![wchen](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@wchen](https://forums.developer.nvidia.com/u/wchen)\
**Post date:** [July 29, 2021, 1:55pm UTC](https://forums.developer.nvidia.com/t/reducing-gpu-memory-usage-for-multi-camera-uses/184980/3 "2021-07-29T13:55:24Z")

</div>

Thanks! Do you guys have an estimate for when the next release is?

---

<div class="post-metadata">

**Author:** ![ltorabi](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/ltorabi/32/14043_2.png) [@ltorabi](https://forums.developer.nvidia.com/u/ltorabi)\
**Post date:** [July 30, 2021, 5:43pm UTC](https://forums.developer.nvidia.com/t/reducing-gpu-memory-usage-for-multi-camera-uses/184980/4 "2021-07-30T17:43:21Z")

</div>

Next release will be in October

---

<div class="post-metadata">

**Author:** ![fzg7919](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@fzg7919](https://forums.developer.nvidia.com/u/fzg7919)\
**Post date:** [June 14, 2022, 3:16am UTC](https://forums.developer.nvidia.com/t/reducing-gpu-memory-usage-for-multi-camera-uses/184980/5 "2022-06-14T03:16:57Z")

</div>

I meet the same issue, multi camera leads to core dump, beacause of not enough GPU memory .

here is the isaacsim app log  
[kit\_20220614\_110632.log](https://forums.developer.nvidia.com/uploads/short-url/akhpk8wHbrJAciqcA9fzsDOUmxP.log) (3.2 MB)

---

<div class="post-metadata">

**Author:** ![ltorabi](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/ltorabi/32/14043_2.png) [@ltorabi](https://forums.developer.nvidia.com/u/ltorabi)\
**Post date:** [June 14, 2022, 3:10pm UTC](https://forums.developer.nvidia.com/t/reducing-gpu-memory-usage-for-multi-camera-uses/184980/6 "2022-06-14T15:10:15Z")

</div>

for multi camera with high resolution, you do require multi GPU

---

<div class="post-metadata">

**Author:** ![fzg7919](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@fzg7919](https://forums.developer.nvidia.com/u/fzg7919)\
**Post date:** [June 14, 2022, 3:22pm UTC](https://forums.developer.nvidia.com/t/reducing-gpu-memory-usage-for-multi-camera-uses/184980/7 "2022-06-14T15:22:11Z")

</div>

Thanks ! but how to set multi camera with multi GPU ? I run my robot in isaacsim container on remote headless machine with 8 X 3080TI ? It runs normally but the omnigraph’s publisher rate is very low , less than 10hz

---

<div class="post-metadata">

**Author:** ![ltorabi](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/ltorabi/32/14043_2.png) [@ltorabi](https://forums.developer.nvidia.com/u/ltorabi)\
**Post date:** [June 14, 2022, 3:59pm UTC](https://forums.developer.nvidia.com/t/reducing-gpu-memory-usage-for-multi-camera-uses/184980/8 "2022-06-14T15:59:17Z")

</div>

Hopefully this will help you: [Rendering Basics — Omniverse Materials and Rendering documentation](https://docs.omniverse.nvidia.com/prod_materials-and-rendering/prod_materials-and-rendering/manual.html#multi-gpu)

---

<div class="post-metadata">

**Author:** ![loic.sacre](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@loic.sacre](https://forums.developer.nvidia.com/u/loic.sacre)\
**Post date:** [October 20, 2022, 1:44pm UTC](https://forums.developer.nvidia.com/t/reducing-gpu-memory-usage-for-multi-camera-uses/184980/9 "2022-10-20T13:44:14Z")

</div>

We have 2 GeForce RTX 3080. Having only 6 robots, each with a camera (with which we capture a depth image), results in taking half of the memory of each GPU. The camera resolution is only 171 x 224… Is it normal that it takes so much GPU RAM ? Or are we doing something wrong ?

Without the cameras, we can easily have 100 robots.

Here are some memory snapshots (from nvidia-smi):

6 robots:

![NVIDIA GeForce](https://global.discourse-cdn.com/nvidia/original/3X/a/7/a750e105a9504f2daf5b3593dbc797c53bd586d6.png)

11 robots:

![35 66C P2 114W 320W](https://global.discourse-cdn.com/nvidia/original/3X/a/8/a8e2fcd9f4daca57b471d3efec5b88efdade85ee.png)

21 robots:

![P2 117W 320W](https://global.discourse-cdn.com/nvidia/original/3X/4/b/4baadfed3e3bb05c3c185847ca186889d1356534.png)

26 robots: Out of memory

---

<div class="post-metadata">

**Author:** ![rthaker](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/rthaker/32/171374_2.png) [@rthaker](https://forums.developer.nvidia.com/u/rthaker)\
**Post date:** [March 28, 2023, 2:57am UTC](https://forums.developer.nvidia.com/t/reducing-gpu-memory-usage-for-multi-camera-uses/184980/11 "2023-03-28T02:57:43Z")

</div>

Hi - Sorry for the delay in the response. Let us know if you still having this issue with the latest Isaac Sim 2022.2.1 release.

---

<div class="post-metadata">

**Author:** ![christianbarcelo](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@christianbarcelo](https://forums.developer.nvidia.com/u/christianbarcelo)\
**Post date:** [March 28, 2023, 2:58pm UTC](https://forums.developer.nvidia.com/t/reducing-gpu-memory-usage-for-multi-camera-uses/184980/12 "2023-03-28T14:58:09Z")

</div>

Hi!  
I’m having the same issue, still with the latest version.  
Cameras are tied to its viewport, and I still don’t find a way of deactivating them on runtime or even after stopping the simulation when it has already run once.  
Is there any known workaround?

---

<div class="post-metadata">

**Author:** ![rthaker](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/rthaker/32/171374_2.png) [@rthaker](https://forums.developer.nvidia.com/u/rthaker)\
**Post date:** [March 29, 2023, 10:08pm UTC](https://forums.developer.nvidia.com/t/reducing-gpu-memory-usage-for-multi-camera-uses/184980/13 "2023-03-29T22:08:05Z")

</div>

Hi @christianbarcelo - Can you provide more information about how big is the scene?

The GPU memory usage has more to do with the geometry and textures in the scene, than with the resolution of the camera.

---

<div class="post-metadata">

**Author:** ![christianbarcelo](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@christianbarcelo](https://forums.developer.nvidia.com/u/christianbarcelo)\
**Post date:** [March 30, 2023, 12:11am UTC](https://forums.developer.nvidia.com/t/reducing-gpu-memory-usage-for-multi-camera-uses/184980/14 "2023-03-30T00:11:48Z")

</div>

Hi @rthaker  
My scene is not that big, tho the cameras still consume a lot. My problem is not a matter of how much they consume, but how to get the VRAM back when pausing the simulation.  
Currently, once the simulation is run and the cameras start rendering, it does not matter if you pause or stop the simulation, the viewport will keep rendering and your VRAM never gets freed.

---

<div class="post-metadata">

**Author:** ![rthaker](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/rthaker/32/171374_2.png) [@rthaker](https://forums.developer.nvidia.com/u/rthaker)\
**Post date:** [March 30, 2023, 4:41pm UTC](https://forums.developer.nvidia.com/t/reducing-gpu-memory-usage-for-multi-camera-uses/184980/15 "2023-03-30T16:41:46Z")

</div>

Hi @christianbarcelo - Will it be possible to share the USD file and the log files of all the scenarios you described earlier?

---

<div class="post-metadata">

**Author:** ![mike.niemaz](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@mike.niemaz](https://forums.developer.nvidia.com/u/mike.niemaz)\
**Post date:** [February 4, 2024, 9:55am UTC](https://forums.developer.nvidia.com/t/reducing-gpu-memory-usage-for-multi-camera-uses/184980/16 "2024-02-04T09:55:15Z")

</div>

Any news on this?

The OOM bug when adding cameras into the scene is still here, even with the latest version 2023.1.1 :-(

---

<div class="post-metadata">

**Author:** ![rthaker](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/rthaker/32/171374_2.png) [@rthaker](https://forums.developer.nvidia.com/u/rthaker)\
**Post date:** [February 8, 2024, 10:23pm UTC](https://forums.developer.nvidia.com/t/reducing-gpu-memory-usage-for-multi-camera-uses/184980/17 "2024-02-08T22:23:12Z")

</div>

Hi @mike.niemaz - Can you share more details and repro steps/log file?

---

<div class="post-metadata">

**Author:** ![mike.niemaz](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@mike.niemaz](https://forums.developer.nvidia.com/u/mike.niemaz)\
**Post date:** [February 9, 2024, 8:58am UTC](https://forums.developer.nvidia.com/t/reducing-gpu-memory-usage-for-multi-camera-uses/184980/18 "2024-02-09T08:58:09Z")

</div>

Here you go:

> [@Orbit multiple cameras (per env) performances optimization](https://forums.developer.nvidia.com/t/orbit-multiple-cameras-per-env-performances-optimization/280180):
>
> Hello, I’m planning to train skills using the latest orbit(+isaacsim) RL framework. For this I need to add cameras into the scene et then train using those visual tensor data. As a dummy test, I created a simple test code (See below) to validate the fact that I can retrieve visual data as expected. And it works indeed! My concerns are the following: it seems rather slow: around 10 FPS with 2 cameras and 24 environments (num\_envs) it gets OOM if I try more than 32 envs on my a RTX A6000 wit…

---

<div class="post-metadata">

**Author:** ![rthaker](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/rthaker/32/171374_2.png) [@rthaker](https://forums.developer.nvidia.com/u/rthaker)\
**Post date:** [February 9, 2024, 5:05pm UTC](https://forums.developer.nvidia.com/t/reducing-gpu-memory-usage-for-multi-camera-uses/184980/19 "2024-02-09T17:05:06Z")

</div>

Hi @mike.niemaz - As I mentioned in that thread that devs are looking into it. I would request you to not put same question in older threads :). You are happy to look into them but don’t post in those if you already have posted your question.

Thank you for your support on this.

---

<div class="post-metadata">

**Author:** ![system](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/system/32/68080_2.png) [@system](https://forums.developer.nvidia.com/u/system)\
**Post date:** [April 5, 2024, 3:36pm UTC](https://forums.developer.nvidia.com/t/reducing-gpu-memory-usage-for-multi-camera-uses/184980/20 "2024-04-05T15:36:33Z")

</div>


