IIRC the last pre-built PyTorch wheel for JetPack with USE_DISTRIBUTED was PyTorch 1.11:
PyTorch v1.11.0
- JetPack 5.0 (L4T R34.1.0) / JetPack 5.0.1 (L4T R34.1.1) / JetPack 5.0.2 (L4T R35.1.0)
- Python 3.8 -
torch-1.11.0-cp38-cp38-linux_aarch64.whl
For newer PyTorch versions that that, you would need to build it from source (instructions are in this source)