Sorry that we don’t have too much experience on d2go.
But the backend frameworks, PyTorch and Detectron2, are all working on the Jetson Nano.
PyTorch: PyTorch for Jetson - version 1.8.0 now available
Detectron: Unable to set up detectron2 on Jetson NX
You can just give it a try: