As the question says, is there an upper limit of the number of contexts which can be created on a single GPU at once, and is this information documented or able to be queried in some way?
The specific situation I have is we use a GPU-Accelerated molecular simulation software which creates either a CUDA or OpenCL context per simulation, and we often find ourselves running multiple simulations in parallel on the same GPU. We have the problem that after the 20th context, we cannot create any more, and I don’t have access to the full error error, only what the software spits out.
That said, the dev of the simulation software, and our own cluster IT folks seem to think that there is a hard upper limit, hence the question. Details of hard-/software below:
GTX-1080 and GTX-1080Ti
Driver version 384.81
CUDA and OpenCL platforms
Running in Default/Shared operation mode without MPS (of which I know there is a hard limit of 1 and 16 respectively in those modes)
Any help would be great, but I also know the details may be lacking, so I can try to get more information if requested.
Thanks in advance!