Object Detection Performance Jetson Tx2 slower than expected

Hey Snarky, The GPU in laptop is NVIDIA GTX 1050 Ti. The base core clock is 1290 MHZ and the max value goes till 1900. The number of cuda cores are 768 and the GPU architecture is NVIDIA Pascal. The TX2 has 256 cores and pascal architecture too and the frequency is 1300 MHZ.

You explained exactly the 25 fps vs 6 fps difference yourself!

Your laptop has (7681900)/(2561300) or about 4.4 times as much GPU power as the Jetson.

I don’t know if there is a difference in memory speed, too, but one thing that’s true is that the Laptop probably has dedicated video RAM, whereas the Jetson shares RAM with the CPU. That seems to be in the noise, though, because the difference is almost exactly explained by GPU cores and clock speed.