It should be possible.
My reason:
- you only train one class.
- you can prune more to get a smaller trt engine.
Reference: Accelerating Peoplnet with tlt for jetson nano - #13 by Morganh
In that link, see “Pruning ratio (pruned model / original model): 0.143”. The pruned tlt model is 14.3% of unpruned tlt model. You can prune more.
More, the peoplenet is trained with resnet34 backbone. If change to resnet18, the fps will be larger.