Errors while reading ONNX file produced by TAO 5

Accelerated Computing Intelligent Video Analytics TAO Toolkit
7

It seems like the ONNX model contains an unsupported layer that performs NMS (Non-Max-Suppresion). This is some proprietary piece that is not supported by a popular ONNX runtime framework like OnnxRuntime.

I just got the same error. This raises several questions for me:

  1. Can I export the model without the included NMS layer? I can perform NMS of Soft-NMS by myself.
  2. If not, how do you propose we run the ONNX model? If it does not support OnnxRuntime, is there any other runtime that is supported that runs on non-Nvidia hardware?

Best regards,
Ben

1 Like