shared memory banks

It’s not clear to me what the size of a shared memory bank is. The programming guide says

Does this mean that a shared memory bank is 32 bits? Don’t think so…

Also what’s an example of some code that will cause memory bank conflicts?

Ok I did some further reading and I think I see how it works now. There are 16 memory banks of 1KB each per multiprocessor. So when you access something in shared memory using, for example, a stride of 4 bytes eg:

Assume s is pointing to a uint32_t array.

In thread0:


In thread1:


In thread 2:



Then those individual accesses are mapped to the physical memory banks 0-15 on the hardware. So, for example the absolute address of s[1] would be, roughly speaking, at the base_address_of_the_banks + sizeof(bank) + 4. Now because a bank is 1KB in size, then s[1] points to the 4th byte in the 1st memory bank. Does that sound right?

No, it points to the 1st byte of the 2nd memory bank.

Sorry, my initial post may not have been clear. Firstly s is a pointer to a uint32_t array so s[1] will point to the 4th byte of that bank. Also I was counting memory banks from index 0 - 15, so I meant the bank at index 1 which is the 2nd bank as you point out.

But why 4th byte?

Isn’t that how the array operator works? A uint32_t is 4 bytes.


uint32_t* p = …

p[0] ----> 0th byte

           1st byte

           2nd byte

           3rd byte

p[1] ----> 4th byte






if p were a pointer to a uint8_t then it would look like this

p[0] ----> 0th byte

p[1]----->1st byte

p[2]----->2nd byte

s[0] points to byte 0 of bank 0
s[1] points to byte 0 of bank 1
s[2] points to byte 0 of bank 2

s[16] points to byte 4 of bank 0
s[17] points to byte 4 of bank 1

Yes, my mistake.