TensorflowRT

Autonomous Machines Jetson & Embedded Systems Jetson TX2
1

Where can I find Turotial/Reference Guide or Documentation/Developer’s guide on TensorflowRT?

2

Hi,

Do you mean TensorRT? TensorRT SDK | NVIDIA Developer
TensorRT document can be found in ‘/usr/share/doc/tensorrt/doc’

Thanks.

3

Hi I have already read the link provided by you. I want to learn more about TensorRT so what should I do? Are here any tutorials which shows how to implement quantizations and Graph optimization steps such as vertical fusion and horizontal fusion?

4

Hi,

For quantization:
We follow standard fp16 format: Half-precision floating-point format - Wikipedia
Conversion code from float to FP16 is available in the NVIDIA® CUDA® library for GPU execution.

For fusion:
Please check this page:
https://devblogs.nvidia.com/parallelforall/production-deep-learning-nvidia-gpu-inference-engine/

Thanks.

5

Thanks for the Info