Hello jasonpgf2a,
The lingering problem will be resolved if you add the following field in tracker_config.yml This additional param will be added when we release DS 5.0 GA.
minTrackingConfidenceDuringInactive: 99
Your issue is very similar to an existing topic, so it would be helpful if you take a look at here; Deepstream 5.0 nvdcf tracker behavior - #7 by pshin
Hope the existing comments/answers to that thread is also applicable to you. Please let us know if you have any further questions.