I added swap memory for my Jetson Nano because the 4GB was not enough. Because GPU memory is not shared with the swap memory, I instead tried to do inferencing with cpu and did:
os.environ['CUDA_VISIBLE_DEVICES'] = '-1'
However, only 25% of swap memory is used and then out of memory error. Does this mean I was not using the CPU all along?