Is it possible to run sFTP (secure FTP) over IPoIB?
Be sure that once you switch to IB configuration, you have subnet manager running on the fabric. The simple way is install complete Mellanox OFED, verify that devices to to IB, run ‘ibv_devinfo |grep state’, if it is in ‘INIT’, run on one of the hosts ‘/etc/init.d/opensm start’ and check state again. If it is ‘ACTIVE’, TCP connection should work, if it is ACTIVE, but TCP/IP connection doesn’t work, the problem is somewhere else, for example firewall.
I don’t recall the error mode or the failure state, but that might have something to do with the switch that I was using at the time, which turned out to be defective or had a problem with it.
Since then, I’ve replaced it with an unmanaged switch, and one of the compute nodes is now responsible for running the subnet manager and that seems to be working better.
it should work , you can try
I did. And it didn’t work.
So I didn’t know if there was something that I did wrong or if there is some special, specific procedure that I needed to execute in order to get it to work.
It works when the ports on my ConnectX-4 VPI card are set to LINK_TYPE_P1=2 (ethernet), but when I change it back to LINK_TYPE_P1=1 (IB), then it doesn’t work anymore.
So I am trying to understand which is “better” (across a variety of metrics) between running the port in IB mode vs. running the port in ETH mode.