How to use PyTorch on Holoscan AGX dev kit?

Healthcare & Life Sciences Holoscan SDK
,
1

We are installing the PyTorch on Holoscan SDK with AGX Orin platform, but we failed to enable the CUDA acc. on PyTorch, following are the steps we’ve tried:

conda install pytorch==1.11.0 torchvision==0.12.0 torchaudio==0.11.0 cudatoolkit=11.3 -c pytorch

our CUDA version is 11.6:
NVIDIA-SMI 510.73.08 Driver Version: 510.73.08 CUDA Version: 11.6

we install the torch version and cuda version:
pip install torch==1.12.0+cu113 torchvision==0.13.0+cu113 torchaudio==0.12.0 --extra-index-url https://download.pytorch.org/whl/cu113

but we tried with the installation python=3.8， pytorch=1.12.0, torchvision=0.13.0。test with torch.cuda.is_availiable() the return value is false

image4
image41919×831 216 KB

2

Hello, as there are no pre-built PyTorch wheels for arm+dGPU at this moment, please see the info in another post Pytorch for Clara AGX - #2 by jinl and Pytorch for Clara AGX - #5 by jinl.