How can i run TFLite model using GPU support on Jetson Nano?

Hi, I would like to run a .tflite model on my Jetson Nano using GPU support. I tried to follow these instructions Inicio rápido de Python  |  TensorFlow Lite but seems that there’s no matching distribution for tflite-runtime. How can i do to run these models?

Python v3.6.9
Numpy v1.19.5
JetPack 4.5.1
CUDA 10.2.89
CUDNN: 8.0.0.180
Model architectures: LSTM and Echo State Network

Thanks

Hi,

It seems that Jetson doesn’t on the supported platform list.
So you will need to build it from the source manually.

Thanks.

I tried to do as explained here Build TensorFlow Lite for ARM boards but seems that builds a C (or C++) library and when I do import tensorflow, seems that there’s no module named tensorflow. How can i do to install it and use in python 3.6?

Thanks

Hi,

Based on the doc you shared, the GPU delegate only supports the Android platform.
This indicates that running TFLite with GPU is not available currently.

Thanks.

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.