I am trying to run series of models as part of my application which are of following size on nano
I am using jetson nano with the DC barrel jack
Model 1 : 4.2 MB (Object Detection)
Model 2 : 3.2 MB (Landmarks)
Model 3,4: 9.2 Mb (MobileNet v2)
Model 5 : 6 Mb (facenet)
I was trying to load all these models in separate tensorflow session and that is where it fails to load or it will take usually more than 10-15 minutes. I often have to restart the board and after multiple attempts of restart it will run.
I usually get around 2-2.5 GB of free memory in RAM which can be seen using the command free but tensorflow report only less than what is shown using free command
I used following commands to increase the performance
sudo nvpmodel -m 0
but these commands did not reduce the loading time.
Once it loads all the models then my application runs at quite good fps, but the loading time is unpredictable which is a big concern for us.
what could be the reason or if anybody have any suggestion kindly share