Introducing Low-Level GPU Virtual Memory Management

Originally published at: https://developer.nvidia.com/blog/introducing-low-level-gpu-virtual-memory-management/

Figure 1. Example of using the cuMem* CUDA APIs to resize a GPU buffer. There is a growing need among CUDA applications to manage memory as quickly and as efficiently as possible. Before CUDA 10.2, the number of options available to developers has been limited to the malloc-like abstractions that CUDA provides.  CUDA 10.2 introduces…