@dxyjob et al:
See https://github.com/helmuthva/jetson/tree/master/workflow/deploy/tensorflow-serving-base/src for a Dockerfile and .bazelrc file showing how to get TensorFlow Serving running on Jetson edge devices.
The image is based on https://github.com/helmuthva/jetson/tree/master/workflow/deploy/ml-base which provides prerequisites.
See https://github.com/helmuthva/jetson for the bigger picture of this project.