The latest tensorRT version, TensorRT 8.5 GA Update 2 for x86_64 Architecture supports only till CUDA 11.8. What should I do if I want to install TensorRT but have CUDA 12.0 toolkit installed?
https://developer.nvidia.com/nvidia-tensorrt-8x-download
NVES
March 14, 2023, 7:37am
2
Hi ,
These support matrices provide a look into the supported platforms, features, and hardware capabilities of the NVIDIA TensorRT 8.5.3 APIs, parsers, and layers.
You can refer below link for all the supported operators list.
<!--- SPDX-License-Identifier: Apache-2.0 -->
# Supported ONNX Operators
TensorRT 8.5 supports operators up to Opset 17. Latest information of ONNX operators can be found [here](https://github.com/onnx/onnx/blob/master/docs/Operators.md)
TensorRT supports the following ONNX data types: DOUBLE, FLOAT32, FLOAT16, INT8, and BOOL
> Note: There is limited support for INT32, INT64, and DOUBLE types. TensorRT will attempt to cast down INT64 to INT32 and DOUBLE down to FLOAT, clamping values to `+-INT_MAX` or `+-FLT_MAX` if necessary.
See below for the support matrix of ONNX operators in ONNX-TensorRT.
## Operator Support Matrix
| Operator | Supported | Supported Types | Restrictions |
|---------------------------|------------|-----------------|------------------------------------------------------------------------------------------------------------------------|
| Abs | Y | FP32, FP16, INT32 |
| Acos | Y | FP32, FP16 |
| Acosh | Y | FP32, FP16 |
| Add | Y | FP32, FP16, INT32 |
show original
Thanks!