Use 1 GPU from multiple CPU threads

Is it possible to use 1 GPU (my case, Tesla C1060 or GTX285) from multiple CPU threads/processes on CUDA?
My routine on CPU has already been parallelized by OpenMP and each thread wants to call CUBLAS but my machine has only 1 GPU.
I’m afraid it is not possible with the current CUDA driver.