I am wondering if NCCL reduce and allreduce support user defined operations?
I looked at the nccl.h, the ncclRedOp_t is a enum, not a function pointer, so I guess the answer is No?
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| can NCCL be used in distributed environment? across machines. | 0 | 522 | August 10, 2018 | |
| can NCCL be used in distributed environment? across machines. | 0 | 495 | August 10, 2018 | |
| User defined reduction OpenACC example | 1 | 492 | January 4, 2023 | |
| Fast Multi-GPU collectives with NCCL | 14 | 1447 | May 11, 2018 | |
| Cublas reduce operation? | 1 | 612 | October 22, 2021 | |
| What is the expected behavior of NCCL allreduce with NaN input? | 3 | 381 | April 15, 2024 | |
| NCCL allreduce in a high performance DGX A100 cluster | 1 | 518 | May 18, 2024 | |
| Networking Reliability and Observability at Scale with NCCL 2.24 | 1 | 146 | August 11, 2025 | |
| How can I tell whether NCCL is using PCIe or IB network interface while doing AllReduce? | 0 | 840 | March 6, 2020 | |
| NCCL 2.27을 활용한 빠른 추론과 안정적인 학습 구현 | 0 | 75 | July 22, 2025 |