Trtexec streams

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

Hi,

–streams = Instantiate N engines to use concurrently (default = 1)

What does N engines means? Does it means it loads the engine as multiple instances?

Thanks.

2

Hi,

It creates N ExecutionContexts to run the engine in different streams.

Thank you.