Look at this in the context of my above forum question, I am looking to achieve 15 FPS for 30 cameras. This would mean the sum of my compute time, d2h and h2d latencies should come down by more than half from my current value of roughly 5.45ms.
I am looking to bring down the inference time for the model.