Currently in DINO, you can use (DINO+ Resnet50) as the student. Please try to follow notebeook to run distillation. I am afraid this student can get expected fps when comparing to YOLOv4.
Performance table can be found in Overview - NVIDIA Docs.
More info can be found in https://arxiv.org/pdf/2004.10934