With great difficulty i was able to get cuda and torch working on my system
wget https://nvidia.box.com/shared/static/i8pukc49h3lhak4kkn67tg9j4goqm0m7.whl -O torch-2.0.0+nv23.05-cp38-cp38-linux_aarch64.whl
sudo apt-get install python3-pip libopenblas-base libopenmpi-dev libomp-dev libopenblas-dev
pip3 install 'Cython<3'
pip3 install numpy torch-2.0.0+nv23.05-cp38-cp38-linux_aarch64.whl
Now i correctly get torch.cuda.is_available() True
Next i wanted to have torchvision and timm on the system, however
$ sudo apt-get install libjpeg-dev zlib1g-dev libpython3-dev libopenblas-dev libavcodec-dev libavformat-dev libswscale-dev
$ git clone --branch v0.15.1 https://github.com/pytorch/vision torchvision # see below for version of torchvision to download
$ cd torchvision
$ export BUILD_VERSION=0.15.1
$ python3 setup.py install --user #command that goes wrong
$ cd ../ # attempting to load torchvision from build dir will result in import error
raises ValueError(f"Unknown CUDA arch ({arch}) or GPU not supported")
ValueError: Unknown CUDA arch (8.7+PTX) or GPU not supported
Also, how do i install timm? Just using pip3 install timm errors in :
Modulenotfounderror: no module named ‘torch._custom_ops’