Convert trained model to tensorRT / uff

Autonomous Vehicles DRIVE PX 2 DriveWorks
1

We trained our model using Keras (tf.keras or keras) and converted the model to ONNX.
The question is, how to create the tensorrt representation of the model on the DPX2?

The tool tensorRT_optimization needs the model as uff, but it’s not mentioned how to get the uff file.

2

Hi,

Suppose you are using a TensorFlow-based Keras(tf.keras), is it correct?
If yes, you can follow this tutorial to convert your model(.pb) into uff.
https://docs.nvidia.com/deeplearning/sdk/tensorrt-developer-guide/index.html#mnist_uff_sample

Thanks.

3

Ok I’ll try this.
One question: on the host system, tensorrt is not installed by DriveInstall, right?
The path /usr/src/tensorrt/samples/sampleUffMNIST is not existing.

4

Hi,

You can get the package installed with sdkmanager:
[url]https://developer.nvidia.com/nvidia-drive-downloads[/url]

Thanks.

5

Dear JHaselberger,
You can find TensorRT samples at /usr/local/cuda/dl/samples after installing using SDKmanager.
Please check [url]https://docs.nvidia.com/deeplearning/sdk/tensorrt-developer-guide/index.html#working_tf[/url] for converting your keras model to UFF. For this, You require convert-to-uff tool which gets installed from the wheel file provided in /usr/local/cuda/dl/uff (Refer point 7 in [url]https://docs.nvidia.com/deeplearning/sdk/tensorrt-install-guide/index.html#installing-tar[/url])