I have trained mobilenet and detectnet_v2 with TLT app, they both gives high accuracy with test dataset, but Detectnet_v2 model makes a lots of false positive predictions, however when i deploy models and use them with deepstream , they gives very poor detection performance with camera.
When i did not prune models, FPS decreases to 10-14 while the model size just 8MB and still poor detection performance.
1)What can i do to get accabtable FPS with good accuracy of detections?
I had trained Pytorch mobilenet_V1 with the same dataset and inference with it with same camera settings, and this model was more accurate than the TLT models, also it had more performance speed than TLT models without prune process with TRT , but unfortunately i could not integrate to deepstream so i had to use with opencv but at this time there is no change to use multiple video sources with good fps.
- How can i include onnx model to make predictions but get video source with Deepstream?
Thank you for your support