WARNING:tensorflow:TensorRT mismatch

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

Provide details on the platforms you are using:
Linux distro and version: Ubuntu 18.04
GPU type: NVIDIA GeForce GTX 1080 Ti Founder’s Edition
nvidia driver version: 418.56
CUDA version: 10.0
CUDNN version: 7.5.0
Python version [if using python]: 3.6.7
Tensorflow version:1.13.1
TensorRT version: 5.1.5

Following the instructions per the TensorRT manual, I used the frozen model to implement Tensorflow-RT:

import tensorflow.contrib.tensorrt as trt

trt_graph = trt.create_inference_graph(input_graph_def=frozen_graph, outputs=[out.op.name for out in model.outputs], max_batch_size=1,max_workspace_size_bytes=2 << 20, precision_mode=“fp16”)
tf.train.write_graph(trt_graph, “model”, “tfrt_model.pb”, as_text=False)

However, then I get the error: WARNING:tensorflow:TensorRT mismatch. Compiled against version 5.0.2, but loaded 5.1.5. Things may not work.

What exactly is not lining up? Does CUDA need to be upgraded to 10.1? Or should I downgrade my TensorRT? Am I missing something? Any help would be greatly appreciated.

2

Found a solution?

I am facing the same issue with Nvidia Jetson TX2.

Linux distro and version: Ubuntu 18.04
GPU type: NVIDIA Jetson TX2
CUDA version: 10.0
Python version : 3.6.8
Tensorflow version:1.13.1
TensorRT version: 5.1.6

------------- Optimize the model with TensorRT -------------
WARNING:tensorflow:TensorRT mismatch. Compiled against version 5.0.6, but loaded 5.1.6. Things may not work

3

I had a similar issue on TX2:

WARNING:tensorflow:TensorRT mismatch. Compiled against version 5.1.6, but loaded 5.0.6. Things may not work

Note, that I have TensorRT 5.0.6.
When the error occurred I had TF 1.15 installed.

peter@jetson2:/SSD/ML/tf_trt_models$ pip3 show tensorflow-gpu
Name: tensorflow-gpu
Version: 1.15.0+nv19.11.tf1

I downgraded TF to tensorflow_gpu-1.13.1+nv19.5 (downloaded wheel file from here
https://developer.nvidia.com/embedded/downloads#?search=tensorflow.

It fixed the error for me.

Since you have the opposite situation—you have TensorRT 5.1.6 installed—installing TF 1.15 may fix your issue.

4

Hi all,

I have a problem similar to pyotr777.

WARNING:tensorflow:TensorRT mismatch. Compiled against version 5.0.6, but loaded 5.1.6. Things may not work

Linux distro and version: Ubuntu 18.04 LTS
GPU type: NVIDIA Jetson Nano
CUDA version: 10.0
Python version : 3.6.9
TensorFlow version:1.13.1 + nv19.3(I installed from here https://developer.download.nvidia.com/compute/redist/jp/v42 tensorflow-gpu==1.13.1+nv19.3 .

TensorRT version:5.1.6

Any help would be much appreciated.