tensorRT run error on Tesla T4

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

when tensorRT5.0.2.6 run Tesla T4,The following error occurs:
tensorflow/contrib/tensorrt/log/trt_logger.cc:38] DefaultLogger The engine plan file is incompatible with this version of TensorRT, expecting 5.0.2.6got 0.0.0.0, please rebuild.

when same code run in Geforce 1080ti,it is functioning normally. so What caused the error on T4?

2

Hello,

A TensorRT PLAN is GPU-specific. A generated TensorRT PLAN is valid for a specific GPU — more precisely, a specific CUDA Compute Capability. For example, if you generate a PLAN for an NVIDIA P4 (compute capability 6.1) you can’t use that PLAN on an NVIDIA Tesla V100 (compute capability 7.0).

In this case, Tesla T4 is SM 7.5, 1080Tis is SM 6.1. You’ll need to generate the PLAN file for T4.

3

I met the same problem ,So how to solve it
The engine plan file is incompatible with this version of TensorRT, expecting 5.0.2.6got 61341696.0.0.40, please rebuild.