TensorFlow UFF model to TensorRT. Missing NvUffParser.h on Jetson TX1

Robotics & Edge Computing Jetson & Embedded Systems Jetson TX1
1

I’m trying to run a trained TensorFlow model with TensorRT on my TX1.

I properly flashed/Installed my Jetson TX1 and host system with the latest JetPack 3.2.

I trained my TensorFlow model on my host and created an UFF file, which I now want to run for inference with TensorRT on my TX1.
Therefore I’m trying to load the UFF file on my TX1 through the C++ API to create an TensorRT engine on the TX1. The loading and conversion of the UFF is done with a parser, which is according to the tutorials done as follows:

...
#include "NvUffParser.h"
#include "NvUtils.h"

using namespace nvinfer1;
using namespace nvuffparser;

int main(int argc, char** argv)
{
  auto parser = createUffParser();
  ...
}

The problem I’m encountering is that there is no NvUffParser.h on my Jetson system, so the build fails. On my host System (Ubunutu 16.04, after TensorRT installation there is a NvUffParser.h (located in installationfolder/include)).
On Jetson there is only NvUtils.h, NvInfer.h (usr/include/aarch64-linux-gnu/) and so on. Even the sample “samleUffMNIST” is missing on the Jetson, but is in the samples folder on my host.

Is there something wrong with my Jetson installation?
Or if else how do i correctly create an TensorRT Engine / load from UFF on my Jetson TX1 with C++?

Thanks in advance.

2

Hi,

Here is a sample to load UFF model on Jetson for your reference:
https://github.com/NVIDIA-Jetson/JEP_ChatBot/blob/master/src/tensorNet.cpp

Thanks.

3

Hi,

thanks much for your quick response!

The example you’re suggesting is one I already tried. It was’nt working on my Jetson TX1 cause of the missing NvUffParser.h file, which is included in this example also for doing the UFF parsing.

But in the meantime I was able to find the reason for my error: Someone just re-flashed my Jetson with an older JetPack version without my knowledge (as older versions hadn’t TensorFlow support…). Recognized it trough randomly checking CUDA Version on the device which was 8.0. Was 100% sure that there was CUDA 9.0 installed when I flashed it myself.

So now after I re-flashed my device with the latest JetPack everything is working fine. The missing sampleUffMNIST and the NvUffParser.h are now on the device.