What is the actual limit on simultaneously running threads? Asin, is it possible for more than one b

Accelerated Computing CUDA CUDA Programming and Performance
21

No, it’s concurrent, but just because you say that there are no dependencies between launches doesn’t mean the machine will run them all simultaneously because of other resource limits.