Yes, you can use nvtracker without nvinfer, here is one example which can run for your reference, KLT NvMOT usage