Tensorrt calibration error :../builder/caskConvolutionTraits.cpp (337) - Cask Error in createConstants: 0 (canImplement)

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

Description

Hello,I encountered a problem when using tensorrt calibration. After I input the calibration set, I can successfully obtain the calibration cache, but when I use the calibration cache to build the engine , it will fail, and tensorrt will give an error:“../builder/caskConvolutionTraits.cpp (337) - Cask Error in createConstants: 0 (canImplement)”.What is the reason for this problem?

Environment

TensorRT Version: 5.1.3
GPU Type: gtx2060
Nvidia Driver Version:
CUDA Version: 10.0
CUDNN Version: 7.5
Operating System + Version: 16.04
Python Version (if applicable):
TensorFlow Version (if applicable):
PyTorch Version (if applicable):
Baremetal or Container (if container which image + tag):

Relevant Files

Here is the tensorrt info about this problem

image
image1691×313 86.3 KB

Steps To Reproduce

Please include:

  • Exact steps/commands to build your repro
  • Exact steps/commands to run your repro
  • Full traceback of errors encountered
2

Hello @lyw199441,
Request you to try the same on latest TensorRT release 7.
You can check the below link for reference -
https://github.com/NVIDIA/TensorRT/tree/master/samples/opensource/sampleINT8

If the issue persist even then, please share your model.
Thanks!