I have currently tried yolov5 using pytorch and nvidia ssd300 (pytorch, no trt acceleration).
Please feel free to comment, criticise, yell or stare in awe either here or on github.
The idea is to measure only the object detection speed, without multithreading, gstreamer, cheating with postprocessing, etc.
next on my list is tensortx (I need to disentangle their example code which is pipelined and multithreaded) and perhaps tensorflow.
Let me know if there is anything specific you would like me to try.