Onnxruntime Initialization Issue with silero-vad on Jetson

Autonomous Machines Jetson & Embedded Systems Jetson AGX Orin
1

Hello everyone,

I’m encountering an issue while trying to run silero-vad using onnxruntime on my Jetson device. I hope to get some assistance or advice from this community.

Problem

When running the code, I get the following error:

/opt/rh/gcc-toolset-12/root/usr/include/c++/12/bits/stl_vector.h:1123: std::vector<_Tp, _Alloc>::reference std::vector<_Tp, _Alloc>::operator[](size_type) [with _Tp = unsigned int; _Alloc = std::allocator<unsigned int>; reference = unsigned int&; size_type = long unsigned int]: Assertion '__n < this->size()' failed.

This error occurs during the initialization of the InferenceSession.

Code Used

Here’s the snippet of code I’m using to initialize the InferenceSession:

opts = onnxruntime.SessionOptions()
opts.inter_op_num_threads = 1
opts.intra_op_num_threads = 1
opts.log_severity_level = 4

providers = ["CPUExecutionProvider"]

self.session = onnxruntime.InferenceSession(
    path,
    providers=providers,
    sess_options=opts,
)

Environment

What I’ve Tried

I’ve attempted to use different versions of onnxruntime:

  1. Built from source for version 1.18.1
  2. Built from source for version 1.20.0

However, the results remain the same, and the error persists.

Questions

  1. Has anyone experienced a similar issue?
  2. Is there a configuration error that I might have made?
  3. Are there any suggestions or solutions I could try?

Thank you for your help and time!

4

Hi,

Have you tried to initial the model on other platforms?
If not, could you help to verify the functionality of the ONNX file first?

Since onnxruntime is provided by the team directly, could you also raise an issue on their side?

Thanks.

5

I have run the same model and code on an A100 and it can run well.

6

Hi,

If so, it’s recommended to report an issue to the onnxruntime time so they can give it a check.

Thanks.

7

Issue solved, thank you.