I want to know the total number of warps my GPU can run at once.
I’m using Quadro RTX 6000.
According to https://images.nvidia.com/aem-dam/en-zz/Solutions/design-visualization/technologies/turing-architecture/NVIDIA-Turing-Architecture-Whitepaper.pdf ,
Quadro RTX 6000 have 72 SMs
The TU102 (Turing) of the Quadro RTX 6000 can have up to 32 warps per SM.
Then, Quadro RTX 6000 can execute up to 2304(72X32) warps?