A couple issues I’m trying to solve.
A) If I want to use the full resources of a multi-gpu system, is there any way to determine dynamically which GPUs I’m already using without explicitly tracking device id?
i.e. start one thread, it picks the first available device and executes, a second thread starts, how can it pick the next gpu
Ideally it would be nice to launch a thread and have it scheduled to an idle device.
B) Similar idea, can I track which device is being used as a primary display and avoid using it?