In NCCL, how to understand the relationship between message, channel, chunk, and QP?

Infrastructure & Networking Switches and Gateways Ethernet Switches
1

For example, when calling ncclAllReduce in the framework layer, the data passed in is a message, while ncclIbIsend is called in the underlying layer to send the data, which is associated with QP. The intermediate layer also involves the concepts of Channel and Chunk. So what is the relationship between message, channel, chunk, and QP? How do they affect communication performance respectively?

if anything wrong, please correct me, thanks

2

It is internal design concept, we will not explain.

3

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.