Is there a suitable version of triton server for jetson xavier (arm)?

Autonomous Machines Jetson & Embedded Systems Jetson Xavier NX
1

Is there a suitable version of triton server for jetson xavier (arm)?
Just check the NGC, but have not seen any.

Also, it will be better that sharing how to deploy tensorrt model on triton server on Jetson Xavier NX.

2

Triton with DeepStream on x86 only works with -triton containers.

For the NVIDIA Jetson platform, Triton shared libraries come preinstalled as part of DeepStream. It can be used from any deepstream-l4t:5.0-20.07 container.

Please refer to Deploying Models from TensorFlow Model Zoo Using NVIDIA DeepStream and NVIDIA Triton Inference Server - Intelligent Video Analytics / DeepStream SDK - NVIDIA Developer Forums

3

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.