# Inference Server on Jetson TX2

**URL:** <https://forums.developer.nvidia.com/t/inference-server-on-jetson-tx2/79376>\
**Category:** Triton Inference Server (archived)\
**Created:** [August 5, 2019, 7:06pm UTC](https://forums.developer.nvidia.com/t/inference-server-on-jetson-tx2/79376 "2019-08-05T19:06:45Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![ivan.ralasic](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@ivan.ralasic](https://forums.developer.nvidia.com/u/ivan.ralasic)\
**Post date:** [August 5, 2019, 7:06pm UTC](https://forums.developer.nvidia.com/t/inference-server-on-jetson-tx2/79376/1 "2019-08-05T19:06:45Z")

</div>

Hello,

I’m wondering whether it is possible to run Inference Server on Jetson TX2 since it has all the frameworks included out-of-the-box and should eliminate building tensorflow C++ from source that is pretty cumbersome on TX2?

I’m interested in running custom object detection models which I couldn’t convert into .uff/.plan format to run in pure TRT, and it seems that C++ tensorflow isn’t supported on TX2. So I ran into this sentence: “It is possible to execute your TF-TRT accelerated model using TensorRT’s C++ API or through the TensorRT Inference Server, without needing TensorFlow at all.” on this link [Accelerating Inference In TF-TRT User Guide :: NVIDIA Deep Learning Frameworks Documentation](https://docs.nvidia.com/deeplearning/frameworks/tf-trt-user-guide/index.html#tensorrt-plan) and it seems as a possible solution.

Thank you very much.

---

<div class="post-metadata">

**Author:** ![David\_Goodwin](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/david_goodwin/32/14043_2.png) [@David\_Goodwin](https://forums.developer.nvidia.com/u/David_Goodwin)\
**Post date:** [August 8, 2019, 8:37pm UTC](https://forums.developer.nvidia.com/t/inference-server-on-jetson-tx2/79376/2 "2019-08-08T20:37:12Z")

</div>

Currently TensorRT Inference Server builds for x86. We will likely build for ARM (and specifically Jetson) in the future but we don’t have any specific plans. There is a PR on the repo to enable ARM builds but we haven’t tested or merged that yet: [Code change for compilation on JetPack 4.2 by alfreds-nv · Pull Request #414 · triton-inference-server/server · GitHub](https://github.com/NVIDIA/tensorrt-inference-server/pull/414)

---

<div class="post-metadata">

**Author:** ![ivan.ralasic](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@ivan.ralasic](https://forums.developer.nvidia.com/u/ivan.ralasic)\
**Post date:** [August 9, 2019, 6:13am UTC](https://forums.developer.nvidia.com/t/inference-server-on-jetson-tx2/79376/3 "2019-08-09T06:13:37Z")

</div>

Thank you very much for your answer. I hope that the official support will come soon. Until then, I’ll take a look at the PR you linked.