We have run the detectnet application on Jetson nano and we are getting 30-32FPS. Now we have written our own custom opencv code which uses yolov5s. We can see there is not much lag or delay in inferencing but when calculating the FPS, we are only getting around 6-7FPS, which actually doesn’t make sense as video is getting processed fine without any lag. So FPS should be around 20-25FPS.
When tested the same code on PC, FPS looks fine but on Nano it drops down while video inferencing is happening without any lag.
I understand that GetNetworkFPS is calculating the time GPU took to inferenced the frame but our code is only using CPU to calculate the FPS and thus our FPS is very low while video inferencing is fine. Is this understanding correct.? If yes, how can we calculate FPS using GPU?