How can I optimize Tensorflow models on windows OS? The TF models are saved in the SavedModel format

rohansada000 · December 10, 2021, 3:14pm

Description

I currently have a custom model which is to be optimized for inference. As TensorRT is not supported for windows how can I optimize my model?
TensorFlow version 2.5

NVES · December 13, 2021, 12:33pm

Hi,
We recommend you to check the below samples links in case of tf-trt integration issues.

If issue persist, We recommend you to reach out to Tensorflow forum.
Thanks!

Topic		Replies	Views
Tensorrt issue with Tensorflow 2.6 on Windows 11 TensorRT	3	988	July 19, 2022
Inference time using TF-TRT is the same as Native Tensorflow for Object Detection Models TensorRT tensorrt , tf-trt	4	1000	March 31, 2022
Error converting TensorFlow model to TensorRT on Windows 10 TensorRT	8	4896	October 12, 2021
Examples for porting from Tensorflow to TensorRT4 object detection inference TensorRT	4	2457	April 26, 2018
[D] The future of pytorch-quantization? TensorRT	1	382	November 14, 2021
NVIDIA RTX A5000 and Tensorflow TensorRT	1	1412	July 28, 2021
TF-TRT Saved Model Optimization Flow Input Signature Defs TensorRT	4	493	January 28, 2021
TensorRT and Tensor.js TensorRT	1	825	September 17, 2021
TensorRT can't speed on TensorFlow model Frameworks tensorflow	1	848	August 7, 2019
Tensorflow inference using TRT converted model TensorRT	10	1050	May 25, 2021

How can I optimize Tensorflow models on windows OS? The TF models are saved in the SavedModel format

Description

Related topics