ONNX Output in TAO 5.0 - how to get an .etlt-model in TAO 5.0.0

The etlt file is actually encryption of onnx file.
Before TAO 5.0, etlt file is generated during exporting.
Since TAO 5.0, onnx file is generated during exporting.

To deploy the onnx file in Jetson devices, you can use trtexec in Jetson to generate tensorrt engine, then config it in model-engine-file. Comment out tlt-encoded-model and tlt-model-key.

Another trick is to encrypt onnx file to etlt file. Refer to
https://github.com/NVIDIA/tao_tensorflow2_backend/blob/main/internal/encode.eff.py.

2 Likes