Device: Jetson AGX Orin Development Kit
SDK: nvidia-jetpack (6.1)
CUDA: 12.6
cuDNN: 9.3.0-1
onnxruntime: 1.19.0
I am trying to use GPU to execute ML model with below code, but getting this error
Fail: [ONNXRuntimeError] : 1 : FAIL : Non-zero status code returned while running FusedConv node. Name:‘StatefulPartitionedCall/sequential_1_1/conv2d_3_1/convolution’ Status Message: CUDNN failure 8: CUDNN_STATUS_EXECUTION_FAILED ; GPU=0
My code:
mport onnxruntime as ort
import h5py
import numpy as np
hdf_eva = h5py.File(“/home/siuspace/wd/edge_ai/dataset/SIMULU_dataset_028_shuffled.h5”, “r”)
iq_eva = hdf_eva.get(‘iq’)
iq_eva = np.array(iq_eva, dtype=np.float32)
iq_eva = iq_eva[0:4200]
sess_opt = ort.SessionOptions()
sess_opt.intra_op_num_threads = 3
session = ort.InferenceSession(‘./sequential_1.onnx’, sess_opt, providers=[‘CUDAExecutionProvider’])
input_name = session.get_inputs()[0].name
output_name = session.get_outputs()[0].name
onnx_pred = session.run([output_name], {input_name: iq_eva})[0]