Anyway to boost yolo performance on Jetson Orin?

Robotics & Edge Computing Jetson & Embedded Systems Jetson Orin Nano
17

Yes, as we think, most of time is on predict function, which is model.predict.

capture_image() execution time: 0.000179 seconds
cudaToNumpy() execution time: 0.000015 seconds
predict_frame() execution time: 0.023093 seconds
imshow() execution time: 0.001939 seconds
output() execution time: 0.001069 seconds

Note: The record matches real FPS.

Currently, I’m moving forward, and going to try deempstream.

Thanks for all your effect and help!

PS:
Request python deepstream demo based on RTP video feed