Unable to find the overall accuracy of TFv2_TF_TRT FP32, 16 and 08 based classification model

Hi,

model.evaluate(.) requires a Keras model but TF-TRT is a TensorFlow model.
The simplest way is to do the inference and compare the output with the testing label manually.

Some TF-TRT inference examples can be found in the below link:
https://docs.nvidia.com/deeplearning/frameworks/tf-trt-user-guide/index.html#worflow-with-savedmodel

Thanks.

1 Like