Generating TensorRT engine from TAO deploy

Hi.

When converting models using tao deploy from onnx to tensorrt engine if we need to convert to FR16. Will it convert to FP32 and convert to FP16 or will it convert directly to FP16? If there are any documentations to get further information on conversion, it will be highly appreciated.

Thank you.

Convert to FP16 directly. You can refer to doc : YOLOv4 with TAO Deploy - NVIDIA Docs or https://docs.nvidia.com/tao/tao-toolkit/text/trtexec_integration/trtexec_yolo_v4.html.

There is no update from you for a period, assuming this is not an issue anymore. Hence we are closing this topic. If need further support, please open a new one. Thanks

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.