Does the memory by cudaHostAlloc(addr, size, cudaHostAllocMapped) included in the result of /sys/kernel/debug/nvmap/iovmm/clients on Thor

Autonomous Vehicles DRIVE AGX Thor DRIVE AGX Thor General
1

DRIVE OS Version: Provide DRIVE OS version. Example: 7.0.3

If I want to monitor the CPU RAM and GPU VRAM usage, what kind of memory is counted in the result of /sys/kernel/debug/nvmap/iovmm/clients?
As the memory allocated by cudaHostAlloc(addr, size, cudaHostAllocMapped) could be accessed by CPU and GPU on Drive Thor, is it included in the result of /sys/kernel/debug/nvmap/iovmm/clients?

4

It indicates device memory. Please see 1. CUDA for Tegra — CUDA for Tegra 13.2 documentation

5

So, the device allocated memory means the total used memory, no matter whether the memory is allocated by by malloc(), cudaMalloc() and cudaHostAlloc(), Or just by CUDA allocation functions?

According to my understanding, the memory allocated by cudaHostAlloc() with cudaHostAllocMapped should be unified memory. Does the device allocated memory count it?

@SivaRamaKrishnaNV

6

Hi @tjliupeng

This forum is exclusively for developers who are part of the NVIDIA DRIVE™ AGX SDK Developer Program. To post in the forum, please use an account associated with your corporate or university email address.
This helps us ensure that the forum remains a platform for verified members of the developer program.
Thanks.