Running n concurrent instance of deepstream on a multi-GPU machine

• Hardware Platform (Jetson / GPU) GPU Tesla T4
• DeepStream Version SDK 5.0.1


I am trying to run 12 deepstream pipelines in parallel (note that I am not using the feature of deepstream by which you can set up multiple sources because for each deepstream I am using different weight files and configs). I have 4 GPUs on a machine, I assign 3 deepstream to each GPU. However, the problem is that the number of concurrent deepstream pipelines cannot go above 9, i.e. the 10th pipeline kills one of the previous pipelines and then starts.

I was wondering if there is a way to increase this limit?

Thank you

1 do your have 4 telsa t4? please redirect your logs to file, then check if there is any exit printing.
2 I will reproduce on my machine.

Hi @fanzh , thanks for your response. Yes, I do have 4 tesla T4. I will do so and update.