I currently use tensorrt 18.104.22.168.
What usage of the trtexec option “threads”?
The trtexec help descripts it as “Enable multithreading to drive engines with independent threads or speed up refitting (default = disabled)”. I can’t understand it.
What difference is with/without “threads” option? Is this option used for trt engine conversion? Or it is only used in trtexec to inference?
Does it have any effect on the trt engine inference in multiple OS threads? Or it just impact the trt engine conversion?