And there are the update of my issue. I try to run the origin code in Terminal, there are the error message.
Default Logger The engine plan file is incompatible with this version of TensorRT, expecting 5.0.6.3 got 5.0.2.6, please rebuild
It told me that the version of TensorRT was incompatible, acturally I optimized the model in PC which has GTX 1066 TensorRT 5.0.2.6, and the Jeston Nano’s TensorRT version is 5.0.6.3.
I try to follow the repo but stopped in the environment, this repo use pycuda, but when I try to install the pycuda by pip3, the wheel told me that cuda.h: No such file or directory.
In file included from src/cpp/cuda.cpp:1:0:
src/cpp/cuda.hpp:14:10: fatal error: cuda.h: No such file or directory
#include <cuda.h>
compilation terminated.
error: command 'aarch64-linux-gnu-gcc' failed with exit status 1