I am implementing plugin layers in tensorrt and would like to know if it’s possible to create multiple streams in plugin layers ?
I am asking it because I want to parallelize computation in a batch. By running samples with dffierent streams, I can speed up the operations.