How GPU execute threads


I am trying to understand how GPU execute threads and more exactly witch part from GPU execute them. I have search on the internet a lot and i meet a lot of terms and they confuse me : MP,SP,grid,blocks, threads, warp.
I understand that is form a block of threads and this is send to the GPU where is executed.
Let’s say for example we have a GPU with 10 MP and each MP has 100 SP.
This means my GPU can execute 1000 (10 MP * 1000 SP) blocks in parallel?
Here is a very simple image about how i see GPU.

Can somebody give me a clue ? :)