Originally published at: https://developer.nvidia.com/blog/doubling-all2all-performance-with-nvidia-collective-communication-library-2-12/
The NCCL 2.12 release significantly improves all2all communication collective performance, with the PXN feature.