Running TensorFlowLite on GPU

I am running a tensorflow lite model on my Xavier but I see that it is only running on the CPU. I would like it to run on the GPU. The tutorials provided by Google only provide instructions for running on a GPU on Android/iPhone. Is it possible to run on the GPU on the Xavier?


First, you will need to install a TensorFlow package with GPU support.
It’s recommended to use our pre-built here:

Then, it should use GPU implementation by default.