Description Hi I am tring to update my code from TRT 7.1 to TRT 7.2. I found add_matrix_multiply give right answer on TensorRT 7.1.3.4,but fail on TensorRT 7.2.1.6 with error log: [TensorRT] INTERNAL ERROR: Assertion failed: cublasStatus == CUBLAS_STATUS_SUCCESS ../rtSafe/cublas/cublasLtWrapper.…

Hi TRT 7.2.1 switches to use cuBLASLt (previously it was cuBLAS). cuBLASLt is the defaulted choice for SM version >= 7.0. However,you may need CUDA-10.2 Patch 1 (Released Aug 26, 2020) to resolve some cuBLASLt issues. Another option is to use the new TacticSource API and disable cuBLASLt tactics if…

MatrixMultiply failed on TensorRT 7.2.1

AI & Data Science Deep Learning (Training & Inference) TensorRT

kel1 November 11, 2020, 4:15am 4

Getting same issue here. Tensorrt 7.2.1

1 Like

Topic		Replies	Views
[TensorRT] INTERNAL ERROR: Assertion failed: cublasStatus == CUBLAS_STATUS_SUCCESS ../rtSafe/cublas/cublasLtWrapper.cpp:279 TensorRT tensorrt	1	1965	March 29, 2021
[E] 2: [ltWrapper.cpp::setupHeuristic::349] Error Code 2: Internal Error (Assertion cublasStatus == CUBLAS_STATUS_SUCCESS failed. ) TensorRT tensorrt , cuda , ubuntu , python	1	1111	July 8, 2022
TensorRT was linked against cuBLAS/cuBLAS LT 10.2.3 but loaded cuBLAS/cuBLAS LT 10.2.2 CUDA Setup and Installation	9	3174	May 20, 2022
Error when sum multiple tensor TensorRT	7	982	July 16, 2021
Python serialized TensorRT engine output wrong data at TensorRT C++ runtime TensorRT	4	995	April 20, 2020
Errors with reading pb file in TensorRT and readNetFromTensorflow in C++ TensorRT	3	1235	January 26, 2021
Tensorrt ONNX build engine ERROR Jetson Xavier NX tensorrt	5	1019	October 18, 2021
CUBLAS Error During ONNX -> TRT conversion TensorRT	7	2549	February 21, 2022
Tensorflow 2.3.1 + CUDA 10.1.105 + cuDNN 7.6.5.32 failed to create cublas handle: CUBLAS_STATUS_ALLOC_FAILED cuDNN tensorflow	1	2306	November 20, 2020
TensorRT 8.2.0.6 Python parse report an error - Failed to add input to the network TensorRT	2	779	December 7, 2021

MatrixMultiply failed on TensorRT 7.2.1

Related topics