Hi, is there a limitation on how many streams I can use in an application? If I increase the number of streams in the simpleStreams example from the Cuda SDK to 256, the test fails. I want to use several hundreds of streams in my application. Is that possible? And how expensive is stream creation…

How many streams? Maximum number of streams

Fugl November 27, 2008, 12:46pm 2

I’m curious about this too. Anyone with working experience on this?

Topic		Replies	Views
Question on Stream, Connection and Performance CUDA Programming and Performance hw , cuda	6	1569	February 23, 2024
cudaStream_t what is the maximum number of streams that can be CREATED (not run at the same time) CUDA Programming and Performance	6	1774	October 19, 2022
How many cuda streams can be launched at a time CUDA Programming and Performance	3	12240	December 14, 2011
confusions about CUDA streams CUDA Programming and Performance	5	921	July 30, 2017
Cuda Streams and multiple processes CUDA Programming and Performance	1	2054	May 3, 2020
CUDA Maximum number of streams / Bug? CUDA Programming and Performance	0	1886	March 4, 2010
Is 40000 cuda streams an issue? TensorRT	3	425	September 13, 2021
Maximum number of operations in a stream CUDA Programming and Performance	7	1434	June 24, 2025
Continuously send data from host to device CUDA Programming and Performance	2	2178	May 26, 2009
Processing 8 stream at the same time not 32 stream using Hyper Q on K20 CUDA Programming and Performance	3	1459	July 25, 2013