Hi, I’ve been working with a Jetson Orin Nano and recently installed PyTorch v1.11.0. While testing the distributed capabilities, I noticed that torch.distributed.is_available() returns True and torch.distributed.is_nccl_available() returns False. This led me to wonder if Jetson Orin Nano supports …

Hi @m.tharani.193 , Jetson is single-GPU architecture and doesn’t support NCCL: [image] Can Jetson Orin support nccl? Jetson Orin NX Can Jetson Orin support NCCL for communication among processes on the same chip or among pcie connected different chips? Also, what is the …

Jetson Orin Nano Compatibility with NCCL for PyTorch

Robotics & Edge Computing Jetson & Embedded Systems Jetson Orin Nano

dusty_nv November 7, 2023, 7:35pm 3

Hi @m.tharani.193, Jetson is single-GPU architecture and doesn’t support NCCL:

You can recompile PyTorch with USE_DISTRIBUTED enabled (try mounting additional swap if it hangs), but it will use MPI instead of NCCL.

Any PyTorch versions supporting torch.distributed and nccl backend on jetson orin nano?

Topic		Replies	Views
Pytorch does not support NCCL Jetson AGX Orin pytorch	3	1264	October 17, 2023
Pytorch is not compiled with NCCL support Jetson AGX Orin pytorch	6	5384	August 10, 2023
Any PyTorch versions supporting torch.distributed and nccl backend on jetson orin nano? Jetson Orin Nano pytorch	18	530	February 27, 2025
Support for the PyTorch distributed package Jetson Nano	10	2201	October 14, 2021
Not able to install Pytorch on Jetson Nano Jetson Nano	5	865	October 14, 2021
Torch distributed not supported on Orin? Jetson AGX Orin pytorch , containers , ngc	2	2132	July 14, 2022
pyTorch 2.0.0.nv23.05 Jetson Orin Nano pytorch	7	817	November 27, 2023
Can Jetson Orin support nccl? Jetson Orin NX	9	2475	December 7, 2022
Torch.distributed is not available on Jetson PyTorch Jetson Orin NX pytorch	3	3228	July 12, 2023
PyTorch, Jetpack 3.3 and Python3.5 - install issues Jetson TX2	7	2180	October 18, 2021

Jetson Orin Nano Compatibility with NCCL for PyTorch

Related topics