Hello everyone,
Recently I hired someone on Freelancer, to teach a custom model, which I could use for object detection.
He provided me with Yolov8, Onnx and Tensorlite model. Probably Onnx is converted from Pytorch.
I was able to run the inference with Yolov8 and Ultralytics. However the speed was extremely slow (up to 8 FPS). I was never able to run it on GPU. And according to this makes sense.
Could anyone help me to get the inference faster? I need at least 20FPS.
Can it be done with Onnx?
I’m really a beginner and would appreciate if you could point me to an example.
Thank you and kind regards