How can i run TFLite model using GPU support on Jetson Nano?

Autonomous Machines Jetson & Embedded Systems Jetson Nano
1

Hi, I would like to run a .tflite model on my Jetson Nano using GPU support. I tried to follow these instructions Quickstart for Linux-based devices with Python  |  TensorFlow Lite but seems that there’s no matching distribution for tflite-runtime. How can i do to run these models?

Python v3.6.9
Numpy v1.19.5
JetPack 4.5.1
CUDA 10.2.89
CUDNN: 8.0.0.180
Model architectures: LSTM and Echo State Network

Thanks

3

Hi,

It seems that Jetson doesn’t on the supported platform list.
So you will need to build it from the source manually.

Thanks.

4

I tried to do as explained here Xây dựng TensorFlow Lite cho bảng ARM but seems that builds a C (or C++) library and when I do import tensorflow, seems that there’s no module named tensorflow. How can i do to install it and use in python 3.6?

Thanks

5

Hi,

Based on the doc you shared, the GPU delegate only supports the Android platform.
This indicates that running TFLite with GPU is not available currently.

Thanks.

7

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.