I have a GPU code of mine working on the MX450 GPU (laptop) at maximum 20 milliseconds. For 100 features, it gives 15 milliseconds.
When I compile and run the same code for Jetson Xavier NX, I get about 25 milliseconds latency at maximum but most of the cases the code runs about 5-6 milliseconds even if the feature count is large (about 20 features). Sometimes, with the same feature count, it can give about 25 milliseconds latency (for 20 features) .
On Jetson side, the code takes the real time camera images and runs the algorithm parallel on GPU.
Is the variation of the latency normal?