A clear and concise description of the bug or issue.
TensorRT Version : 7.1.3-1GPU Type : Volta GPUNvidia Driver Version : 32.5.1CUDA Version : cuda 10.2CUDNN Version : 8.0.0.180Operating System + Version : Ubuntu 18.02Python Version (if applicable) : Python 3.6TensorFlow Version (if applicable) : 1.15.5+nv21.6PyTorch Version (if applicable) :Baremetal or Container (if container which image + tag) :
Relevant Files - I am trying to run the jupyter notebook detection.ipynb file in tf_trt_models/examples/detection at master · NVIDIA-AI-IOT/tf_trt_models · GitHub
Repository used → GitHub - NVIDIA-AI-IOT/tf_trt_models: TensorFlow models accelerated with NVIDIA TensorRT
After I Run the jupyter notebook file, everything works file until I run this block below
trt_graph = trt.create_inference_graph(
input_graph_def=frozen_graph,
outputs=output_names,
max_batch_size=1,
max_workspace_size_bytes=1 << 25,
precision_mode='FP16',
minimum_segment_size=50
)
Below is the error I am getting
Kernel Restarting
I am not sure why it dies. Please help.
NVES
October 5, 2021, 7:38pm
2
Hi,https://github.com/NVIDIA/TensorRT/tree/master/samples/opensource/trtexec
You can refer below link for all the supported operators list, in case any operator is not supported you need to create a custom plugin to support that operation
<!--- SPDX-License-Identifier: Apache-2.0 -->
# Supported ONNX Operators
TensorRT 8.4 supports operators up to Opset 17. Latest information of ONNX operators can be found [here](https://github.com/onnx/onnx/blob/master/docs/Operators.md)
TensorRT supports the following ONNX data types: DOUBLE, FLOAT32, FLOAT16, INT8, and BOOL
> Note: There is limited support for INT32, INT64, and DOUBLE types. TensorRT will attempt to cast down INT64 to INT32 and DOUBLE down to FLOAT, clamping values to `+-INT_MAX` or `+-FLT_MAX` if necessary.
See below for the support matrix of ONNX operators in ONNX-TensorRT.
## Operator Support Matrix
| Operator | Supported | Supported Types | Restrictions |
|---------------------------|------------|-----------------|------------------------------------------------------------------------------------------------------------------------|
| Abs | Y | FP32, FP16, INT32 |
| Acos | Y | FP32, FP16 |
| Acosh | Y | FP32, FP16 |
| Add | Y | FP32, FP16, INT32 |
show original
Also, request you to share your model and script if not shared already so that we can help you better.
Meanwhile, for some common errors and queries please refer to below link:
Thanks!
@NVES Looks like Tensor RT 7.x.x versions is not tested against TensorFlow 1.15.5(which is the version) I am using.
Probably I have to upgrade my Tensor RT to 8.x.x version(because I see it is tested against TensorFlow 1.15.5) in the release notes. Hopefully that fixes my issue…