I currently have a pretrained keras model for a tracker with the .h5 format that’s around 3GB. This model works great loading and running on the computer but I wish to use it on the Jetson Nano aswell, together with the camera.
I’ve tried to load the model simply by doing "model = keras.models.load_model(‘model.h5’) and using that, but the memory appears to be an issue. I wonder if there is any preoptimization steps that I could perform or different alternative or if I need to make my model smaller?
I only wish to use the model for inference on nano, not any training.