CPU Cores Per GPUs

Hi Everyone,

I’m looking to create a GPU server for people to use. If I install 4 GPUs on a system, but have 8 CPU cores, could 8 simultaneous programs (threads) access the 4 GPUs concurrently? Thanks!