Jeson Xavier NX, Triton 2.10, Deepstream 5.1

[Icancode]

• Hardware Platform (Jetson / GPU)
• DeepStream Version: 5.1
• JetPack Version: 4.5(valid for Jetson only)
• TensorRT Version
• NVIDIA GPU Driver Version (valid for GPU only)
• Issue Type( questions, new requirements, bugs)

Docker images: nvcr.io/nvidia/deepstream-l4t:5.1-21.02-samples
Triton server 2.10 Releases · triton-inference-server/server · GitHub

All samples works fine when I run deepstream 5.1 with triton 2.5 (default version in above container)
But above container doesn’t support ONNX runtime so I did update to triton 2.10 (Releases · triton-inference-server/server · GitHub)
All samples are down with same error when I run deepstream-app -c <any-config-file.txt>
error: Input or ouput layers are empty.

Any idea to fix it? Thank you so much.

[windy60j34]

Deepstream-5.1 Triton(Gst-nvinferserver) plugin does not have forward-compatibility support for Triton versions. This is a known issue and plan to fix in next DS release(maybe 6.0). for now DS5.1 is based on triton-2.5(20.11) interface. For DS5.1, it’s recommended to use same triton version’s lib/backends. If you have to upgrade of triton-libs, it might at most support triton 2.7(21.02).