Conversion from ONNX to TensorRT fails

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

Description

My model is failing when converting from onnx to tensorrt with the following message ‘Builder timing cache: created 0 entries, 0 hit(s)
../builder/cudnnBuilder2.cpp (2025) - Assertion Error in getSupportedFormats: 0 (!formats.empty())
create engine failed
Aborted (core dumped)’

Environment

TensorRT Version: 7.1.3
GPU Type: 2080ti
Nvidia Driver Version: 460.39
CUDA Version: 11.2
CUDNN Version: 8.0.0
Operating System + Version: ubuntu 18.04
Python Version (if applicable):
TensorFlow Version (if applicable):
PyTorch Version (if applicable):
Baremetal or Container (if container which image + tag):

Relevant Files

running script specified in here: BiSeNet/tensorrt at master · CoinCheung/BiSeNet · GitHub

Steps To Reproduce

please use my onnx model if possible to convert to tensorrt.Please ask me for model if needed.

image
image1353×752 153 KB

2

Hi, Request you to share the ONNX model and the script so that we can assist you better.

Alongside you can try validating your model with the below snippet

check_model.py

import sys
import onnx
filename = yourONNXmodel
model = onnx.load(filename)
onnx.checker.check_model(model).

Alternatively, you can try running your model with trtexec command.
https://github.com/NVIDIA/TensorRT/tree/master/samples/opensource/trtexec

Thanks!