After the optimization of the network, how can we obtain the number of the parameters in the final TRT model? Is there some API call or something? Thank you.
Please check the below link, as they might answer your concerns
@NVES Thanks! Could you please give some more detail? I do not understand if there is actually an API that can help me to get the number of the parameters.
I don’t think we have APIs for this (assuming that parameters mean weights). But if you dump the kDETAILED EngineInspector output, it shows the weight size for each layer, so you can sum them up.