I am using the Triton release for Jetpack 4.4 on a Jetson AGX Xavier, however, looking in the backends directory I only find backends for Tensorflow 1 and 2. Does this Triton release supports backends for other frameworks like TensorRT and ONNX? If so, how can I add them to the backends directory.
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
Tensorflow Serving on Xavier NX? | 2 | 775 | October 18, 2021 | |
How to Run Triton Inference Server on Jetson Xavier NX | 0 | 621 | May 31, 2021 | |
Jeson Xavier NX, Triton 2.10, Deepstream 5.1 | 2 | 878 | October 12, 2021 | |
Tensorflow_model_server at jetson nano | 2 | 375 | October 15, 2021 | |
Is there a suitable version of triton server for jetson xavier (arm)? | 2 | 696 | November 3, 2021 | |
TensorRT model deployement on Triton Inference | 2 | 595 | May 31, 2023 | |
Triton and/or Docker Serving support for JetPack, e.g. Xavier | 0 | 502 | December 18, 2020 | |
JetPack 4.2:: TensorRT , CUDA, CuDNN version | 2 | 835 | August 19, 2022 | |
JetPack 4.4 Developer Preview - L4T R32.4.2 released | 9 | 889 | July 8, 2020 | |
Official TensorFlow for Jetson AGX Xavier installed with JetPack 4.6 | 2 | 621 | December 12, 2021 |