GPU pool


I’m trying to build a multi GPU system, where each gpu is running several tasks in different threads.
So far i haven’t had any luck finding a ready made solution.

Does any know of a GPU/thread pool i can use?
Or should i roll up my sleeves and start writing one?

GPU threads are not equivalent to cpu threads. The power of gpu comes from vectorization which requires that at least 32 threads do the same instructions (kind of like an assembly line). The 3.5 cc and higher support HyperQ which supports concurrent running of several kernels from different cpu threads.
The nvidia samples contains one simple example of how to implement it.