Loading an ONNX model (attached) via the C++ API, triggers the exception upon calling
[E] [TRT] 1: Unexpected exception vector<bool>::_M_range_check: __n (which is 0) >= this->size() (which is 0)
This is also reproducible using the released sampleOnnxMNIST code. I am attaching both the ONNX file and the code file to reproduce it here.
trtexec --onnx=palm.onnx can load the model just fine, so it seems that there’s a way to get this working via the C++ API, but I’m unable to pinpoint what it is.
Use the docker container per instructions from the TensorRT repository.
TensorRT Version: 8.6.1
GPU Type: NVIDIA GeForce RTX 3090
Nvidia Driver Version: 535.54.03
CUDA Version: 12.0 (but also reproducible on 11.6)
CUDNN Version: 8.8
Operating System + Version: Ubuntu 20.04
Python Version (if applicable): N/A
TensorFlow Version (if applicable): N/A
PyTorch Version (if applicable): N/A
Baremetal or Container (if container which image + tag):
palm.onnx (3.9 MB)
Source code file:
sampleOnnxMNIST.cpp (12.4 KB)
- Set up & launch the docker container build environment for TensorRT samples per instructions.
- Replace the attached code file
- Compile (instructions) and run the executable located at
- Exception is raised:
Creating execution context [09/01/2023-06:58:59] [E] [TRT] 1: Unexpected exception vector<bool>::_M_range_check: __n (which is 0) >= this->size() (which is 0) Created execution context &&&& FAILED TensorRT.sample_onnx_mnist [TensorRT v8601] # ./sample_onnx_mnist