Finding Idle GPU in Multi-GPU System

[tachyon_john]

Hi,

I filed a CUDA feature request (# 298834) along these lines many moons ago, but I’m not sure where it stands. It’s undoubtedly one of hundreds of such feature requests. I’m sure the NVIDIA staff will get to this at some point when they’ve dealt with more pressing issues and more highly-requested features.

Cheers,

John Stone

A couple issues I’m trying to solve.

A) If I want to use the full resources of a multi-gpu system, is there any way to determine dynamically which GPUs I’m already using without explicitly tracking device id?

i.e. start one thread, it picks the first available device and executes, a second thread starts, how can it pick the next gpu

Ideally it would be nice to launch a thread and have it scheduled to an idle device.

B) Similar idea, can I track which device is being used as a primary display and avoid using it?

[snapback]297039[/snapback]