CUDA stream priority across processes(Windows OS)

Accelerated Computing CUDA CUDA Programming and Performance
1

Dear all,
How do I control the priorities of different streams in different processes?
Just like in stream priorities, kernel in different streams can set different priorities using cudaStreamCreateWithPriority. How can i set priorities of stream in different processes? Sometimes, i’d like kernels in a process have higher priority than kernels in anothor process, how can i do it?

Thank you for your answer！

2

You can’t.

Kernels launched from separate processes have no knowledge of each other, whatsoever. The priority of activity is set by the driver, and it is not published. On later GPUs it is a time-slicing system.

You can improve the situation with CUDA MPS but you still don’t have direct control over inter-process priority. Also, MPS is not available on Windows.