Mem usage not match for device&process after calling cudaMallocManaged+cudaMemPrefetch

Accelerated Computing CUDA CUDA Programming and Performance
1

I found that after prefetching a block of memory allocated by cudaMallocManaged with cudaMemPrefetch, memory usage of device will increase but memory usage of process just keep the same. And I can reproduce it with the test code below, Is it designed to be like this?

image
image689×855 24.2 KB

test code
test.cu (5.6 KB)

system info:
Debian GNU/Linux 9
driver: 450.80.02
cuda: 11.0
nvcc:
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2020 NVIDIA Corporation
Built on Thu_Jun_11_22:26:38_PDT_2020
Cuda compilation tools, release 11.0, V11.0.194
Build cuda_11.0_bu.TC445_37.28540450_0
gcc: 8.3.0

2

I’m not sure why there would be any expectation that process memory usage would change based on a call to cudaMemPrefetchAsync().

3

Cuz the memory prefetched was allocated by that process?

It confused me as cudaMallocManagedis called in a third party library, and I can’t tell whether anything goes wrong in my program.

Anyway, thank you for your explanation! Maybe I just need a deeper understanding of Unified-Memory !

4

My expectation is that a process reservation of the (host) memory will take place at the point of cudaMallocManaged call. I wouldn’t expect migrating that memory from one place to another would change the process reservation, but I haven’t studied it closely.