Deep search is taking time to populate results

I have an enterprise nucleus server with deep search enabled. It is working fine in the browser but when searching for assets in Deep Search extension it takes around 5-10 minutes to populate the results.

Any possible reasons for the same.