I am trying to run two docker containers, each with a neural network application on a single Jetson nano (4.9.201-tegra). Both containers will use GPU for computations. I have observed that almost every time one or both containers stop responding after execution of the first statement that calls any GPU function.
It is like the process is silently killed. There is nothing in ‘dmesg’. Also, around 1GB of RAM is still free.
Is it impossible for two processes to access GPU concurrently on tegra architecture?
Any help on how to do this will be appreciated.
Thanks!
You can launch two kernel codes but GPU used from different processes are time-slicing.
Have you tried the same thing without containers to see if the same behavior occurs?