CudaOpenMP CPU and GPU simultaneously?

Accelerated Computing GPU-Accelerated Libraries
1

I am new to the cuda programming, but before I start my next project (I am hoping to use openmp) does cuda-openmp also give you the ability to run multiple GPUs AND multiple cpu cores at the same time? Or, does it only allow for multi-GPU function? Is it separate from the CPU?

Any advice on this would be appreciated.

2

You can combine GPU programming with OpenMP programming. You can use CUDA with multiple GPUs AND use multiple CPU cores via OpenMP. In fact, the cudaOpenMP cuda sample app demonstrates exactly this.