NVIDIA Developer Forums

Triton inference server on jetson xavier

Robotics & Edge Computing Jetson & Embedded Systems Jetson Xavier NX

kayccc May 31, 2021, 11:38pm 2

Please refer to Deploying Models from TensorFlow Model Zoo Using NVIDIA DeepStream and NVIDIA Triton Inference Server - Intelligent Video Analytics / DeepStream SDK - NVIDIA Developer Forums

Topic		Replies	Views	Activity
Support for Triton Inference Server on Jetson NX Jetson Xavier NX cuda , jetson-inference , inference-server-triton , jetson , deepstream61	2	888	November 2, 2022
Can Triton be pre-installed on the Jetson platform? Jetson Xavier NX inference-server-triton	4	789	January 26, 2022
Is there a suitable version of triton server for jetson xavier (arm)? Jetson Xavier NX	2	689	November 3, 2021
How to Run Triton Inference Server on Jetson Xavier NX Triton Inference Server - archived inference-server-triton	0	616	May 31, 2021
Triton Server Support for Jetson Nano Jetson Nano jetson-inference , inference-server-triton	3	2318	October 15, 2021
NVIDIA Triton inference server on Jetson Webinar on Sept 21st Announcements	2	960	September 23, 2021
Tensorflow Serving on Xavier NX? Jetson Xavier NX tensorflow	2	773	October 18, 2021
Triton on Jetson Orin Jetson AGX Orin	12	1998	January 4, 2024
Using nvinfer(TensorRT) or nvinferserver on deepstream DeepStream SDK	4	939	October 5, 2021
Which container shoulf be used for inference of trt files in Jetsons? Jetson Xavier NX containers	2	379	June 27, 2022