Ok, thank you very much for your help.
In addition, could you tell me why I call cudaStreamSynchronize/cudaEventSynchronize waiting for all streams complete, have suggested solution to this problem?
I want to wait only for one stream to complete, not for all streams to complete.