Given that we implement an Algorithm Selection class that only provides 1 tactic per layer among the list of choices:
Is tactic profiling still needed?
If not, does TRT builder subscribe to system resources when building?
If not, can we now have multiple TRT builder instances (threads) building in parallel? It’s not the case otherwise, Nvidia claims it’s “undefined behavior”.
If profiling is not needed (we know in advance which tactics to use for each layer) - can we cross-build plan files for different GPU architectures? For example, given the tactic list for a Xavier architecture, can we build a plan file for that architecture on a regular x86 computer? (Instead of having to run TRT builder on the Xavier).