Stupid question but how do I transfer data using an IB switch?

Infrastructure & Networking Switches and Gateways
1

I have an MSB78XX 4x EDR IB switch and I am trying to figure out how I can transfer data over it since it isn’t an ethernet switch.

In order for me to pass data between my compute nodes, would I have to set up something like NFSoIB?

If so, how would I do that?

The guide here only shows how to do it for NFSoROCE.

Your help is greatly appreciated.

Thank you.

2

You can refer MLNX_OFED UM

http://www.mellanox.com/related-docs/prod_software/Mellanox_OFED_Linux_User_Manual_v4_5.pdf

3

Tried that as well.

Doesn’t say.

And what I meant by “transfer data” - like I know that there is an article on here that describes the procedure for setting up NFSoRoCE. But there isn’t something here that describes the procedure, for example, for setting up a NFSoIB.

And the two reasons why I am asking this is because my applications are able to run in RDMA mode over IB, but then when I am trying to move the files that are necessary for the run to a local scratch/run directory on the node, I am trying to figure out how I can execute those data transfers over IB as well.

So it isn’t in reference to the application RDMA execution, but rather the transfer of the run files to a local scratch directory.

Hope that helps to clarify my question.

Thank you.