TensorflowRT

Where can I find Turotial/Reference Guide or Documentation/Developer’s guide on TensorflowRT?

Hi,

Do you mean TensorRT? https://developer.nvidia.com/tensorrt
TensorRT document can be found in ‘/usr/share/doc/tensorrt/doc’

Thanks.

Hi I have already read the link provided by you. I want to learn more about TensorRT so what should I do? Are here any tutorials which shows how to implement quantizations and Graph optimization steps such as vertical fusion and horizontal fusion?

Hi,

For quantization:
We follow standard fp16 format: https://en.wikipedia.org/wiki/Half-precision_floating-point_format
Conversion code from float to FP16 is available in the NVIDIA® CUDA® library for GPU execution.

For fusion:
Please check this page:
https://devblogs.nvidia.com/parallelforall/production-deep-learning-nvidia-gpu-inference-engine/

Thanks.

Thanks for the Info