I’m new to TensorRT. I’ve just been going through the examples and tutorial and I can’t find any mention of what to do in a multi-GPU environment (I have 4 GPUs in a single machine).
Does TensorRT automatically use all GPUs? or just one? Can this be configured?
If it uses just one, can you select which one? (so can implement multi-GPU myself)
Thanks in advance!