Hello all,
Is there a way to calculate the number of floating-point operations for executing a model using TensorRT?
Tensoflow has a very convenient way to see how many fp operations a network has (https://stackoverflow.com/a/51082939/2794625):
flops = tf.profiler.profile(graph, options=tf.profiler.ProfileOptionBuilder.float_operation())
print('FLOP = ', flops.total_float_ops)
Is there any similar approach for an optimized TensorRT model too?
Thanks,