Invalid resource handle when doing inference with TensorRT

[spolisetty]

Hi,

@supaiku

Error Code 1: Cuda Runtime (invalid resource handle)

This error is more related to the CUDA context issue.
Please make sure you’re handling the CUDA context/stream correctly.

Following a similar issue may help you.

TensorRT error: Cuda Runtime (invalid resource handle), Torchaudio on GPU & trt engine，get wrong result

Description a simple audio classifier model. First extracts Mel spectrogram with torchaudio on GPU. Second do the model inference on the same GPU, but get the wrong result. it is strange that if I extract the Mel spectrogram on the CPU and inference on GPU, the result is correct. HERE is my code: def wav_to_frames(wave_data, win_len=int(16000 * 6.5)): num_frames = round(len(wave_data) / win_len) frame_len, wave_len = num_frames * win_len, len(wave_data) if frame_len > wave_len: …

@supaiku

Is there a reason why Nvidia isn’t providing a conda package for TensorRT

Currently, we do not have info on this.

Thank you.