I am using the 64GB version of the Jetson AGX Orin. If I use it for training, I would like to know how much memory the graphics card has. Is it sharing the 64GB with the CPU? If not, can you tell me how much memory the graphics card has?
Hi,
Yes, Jetson is a sharing memory system.
The 64GB is shared by CPU and GPU.
Thanks.
Trivia: The Jetson GPU is integrated to the memory controller (an iGPU), whereas a desktop PC has its own memory (VRAM), and is going through the PCI bus as a discrete GPU (dGPU). The system RAM is used with the iGPU, and mostly it can use that RAM, but some restrictions exist, e.g., the iGPU needs contiguous blocks of memory, and might also need to be aligned with some starting address. That means the iGPU cannot use virtual memory…and fragmented memory won’t be useful. A dGPU can use all of the VRAM since it is dedicated to the GPU, and this is one reason why people training AI models will pay more for a dGPU with lots of VRAM.
1 Like
This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.