CUDA Stream

Accelerated Computing CUDA CUDA Programming and Performance
1

Is stream concept per GPU? i.e. stream can’t be setup for multiple GPU, each GPU should its separate stream?

2

Yes, stream creation has an inherent device association: