Large memory usage of camera sensors

I am using Isaac Gym with visual observations. I noticed that without creating camera sensors, it took me around 1700MB for 1800 environments. Once I created camera sensors for each environment, it took me around 10000MB for 1800 environments.

Is this expected? Is there any other way to get around the memory limit other than buying extra GPUs?

Thank you!