Mixing CUDA and openMPI

New to CUDA, and was wondering if one can mix CUDA and openMPI.
And if so, what are the pitfalls.


There’s no problem with mixing them.

The pitfall is that as your nodes get more powerful, more of the strain is placed on the network.