How to use the Unified Memory when doing inference with the TX2 and PyCUDA?

Robotics & Edge Computing Jetson & Embedded Systems Jetson TX2
3

Hi,

Unified memory can support Jetson and TX2.
You can find some C++ based sample in the CUDA sample foler:

/usr/local/cuda-10.2/samples/0_Simple/UnifiedMemoryStreams/

For pyCUDA, the corresponding function is listed here:
https://documen.tician.de/pycuda/driver.html#managed-memory

Sorry, we don’t have an example to demonstrate unified memory + inference in the python interface.
But the above document can give you some information about implementing it.

Thanks.

1 Like