I understand that the Jetson Nano has a max of 4096MB memory available for the GPU, and SWAP-space cannot be used for GPU.
Some of the 4096MB memory is used for ‘non-GPU’ functions.
If I am not mistaken, memory assigned to the GPU cannot be released.
So I wonder what are best practices to have a maximum amount of memory available for the GPU.
- how to ‘assign’ other (CPU-) processes to SWAP,
- configurations for common tools like OpenCV, Tensorflow.
- headless modes,
- is there some ‘trick’ to release GPU-memory between operations …
Looking at the amount and frequency of related questions, a ‘Sticky Topic’ might be very helpful