Installing torchvision from pip won’t have CUDA enabled and may run into other errors, as the torchvision wheels on PyPi for aarch64 architecture are built for generic ARM platforms and not JetPack. Instead, uninstall it and try again building it from source (linked to above)
Or if you keep having problems, you can use one of the containers and simply mount in your YOLO project code.