So regular switch vendors have “show mac-address” or something alike to to show which ports connect to which mac-address and even hostnames that are connected.
Is there an equivalent command or view via the web session for this Infiniband?
I need to find which ports connect to which servers without physically tracing them like we’re in stone age.
For example, Oracle ILOM Infiniband switches seem to show the port mapping to hostnames and their ip/mac-address.
Thanks.
HI Snd,
there is the fabric inspector feature ( which requires a license for $) that will show this in the switch WebUI in a textual format and In the switch CLI.
You can also run “iblinkinfo” or “ibnetdiscover” ( for free) from any host connected to the IB network.
Thank you very much!
So do all hosts connecting to same IB switch show the same outputs of “iblinkinfo” and “ibnetdiscover” ?
As in host-1 isn’t going to link a port to a different host then host-2 would?
Also, how do you interpret the output? Mine seems a bit different than what’s out there.
If I have " MLNX-OS SXX512" and “SX_PPC_M460EX”
Switch: 0x0002c90300980490 MF0;which-a:SX6512/L07/U1:
60 1 ==( 4X 14.0625 Gbps Active/ LinkUp)==> 204 1 “which091 HCA-1” ( )
60 2 ==( 4X 14.0625 Gbps Active/ LinkUp)==> 174 1 “which092 HCA-1” ( )
60 3 ==( 4X 14.0625 Gbps Active/ LinkUp)==> 189 1 “which093 HCA-1” ( )
60 4 ==( 4X 14.0625 Gbps Active/ LinkUp)==> 222 1 “which094 HCA-1” ( )
60 5 ==( 4X 14.0625 Gbps Active/ LinkUp)==> 186 1 “which095 HCA-1” ( )
60 6 ==( 4X 14.0625 Gbps Active/ LinkUp)==> 202 1 “which096 HCA-1” ( )
60 16 ==( 4X 14.0625 Gbps Active/ LinkUp)==> 129 2 “which070 HCA-1” ( )
60 17 ==( 4X 14.0625 Gbps Active/ LinkUp)==> 127 2 “which071 HCA-1” ( )
60 18 ==( 4X 14.0625 Gbps Active/ LinkUp)==> 143 2 “which072 HCA-1” ( )
60 19 ==( 4X 14.0625 Gbps Active/ LinkUp)==> 52 19 “MF0;which-a:SX6512/S01/U1” ( )
60 20 ==( 4X 14.0625 Gbps Active/ LinkUp)==> 52 20 “MF0;which-a:SX6512/S01/U1” ( )
60 21 ==( 4X 14.0625 Gbps Active/ LinkUp)==> 52 21 “MF0;which-a:SX6512/S01/U1” ( )
60 22 ==( 4X 14.0625 Gbps Active/ LinkUp)==> 51 19 “MF0;which-a:SX6512/S02/U1” ( )
60 23 ==( 4X 14.0625 Gbps Active/ LinkUp)==> 51 20 “MF0;which-a:SX6512/S02/U1” ( )
60 24 ==( 4X 14.0625 Gbps Active/ LinkUp)==> 51 21 “MF0;which-a:SX6512/S02/U1” ( )
60 25 ==( 4X 14.0625 Gbps Active/ LinkUp)==> 54 19 “MF0;which-a:SX6512/S03/U1” ( )
60 26 ==( 4X 14.0625 Gbps Active/ LinkUp)==> 54 20 “MF0;which-a:SX6512/S03/U1” ( )
60 27 ==( 4X 14.0625 Gbps Active/ LinkUp)==> 54 21 “MF0;which-a:SX6512/S03/U1” ( )
60 28 ==( 4X 14.0625 Gbps Active/ LinkUp)==> 66 19 “MF0;which-a:SX6512/S04/U1” ( )
60 29 ==( 4X 14.0625 Gbps Active/ LinkUp)==> 66 20 “MF0;which-a:SX6512/S04/U1” ( )
60 35 ==( 4X 14.0625 Gbps Active/ LinkUp)==> 64 20 “MF0;which-a:SX6512/S06/U1” ( )
60 36 ==( 4X 14.0625 Gbps Active/ LinkUp)==> 64 21 “MF0;which-a:SX6512/S06/U1” ( )
CA: which100 HCA-1:
0xf4521403002a3900 214 1 ==( 4X 14.0625 Gbps Active/ LinkUp)==> 60 9 “MF0;which-a:SX6512/L07/U1” ( )
0xf4521403002a3908 216 2 ==( 4X 14.0625 Gbps Active/ LinkUp)==> 43 9 “MF0;which-a:SX6512/L08/U1” ( )
“36” is the port#, I’m assuming? Since there are 36 ports?
Thanks again!
Hi SND,
So do all hosts connecting to same IB switch show the same outputs of “iblinkinfo” and “ibnetdiscover” ?
Answer - yes,maybe in a different order, but the data is the same
As in host-1 isn’t going to link a port to a different host then host-2 would?
Answer - same as above - the data should the same, the order may be different
I dug up some old explanation that I did for the output of iblinkinfo, hopefully this will make it more clear:
Description of each column in the output:
Switch
Switch name:
Switch type and model:
Switch 0x0002c90200430e20 MF0;SUPP-5100:IS5100/L01/U1:
Switch
LID
Port Number
Width
Speed
Logical
state
Physical State
LID of connected device
Physical Port in the connected device
for voltaire chassis - the external port number if external
Name of connected device
Type of connected device
4 1 ==( Down/ Polling)==> “” ( )
4 2 ==( Down/ Polling)==> “” ( )
4 3 ==( 4X 10.0 Gbps Active/ LinkUp)==> 13 1 “supp102 HCA-1” ( )
4 4 ==( Down/ Polling)==> “” ( )
4 5 ==( Down/ Polling)==> “” ( )
4 6 ==( Down/ Polling)==> “” ( )
4 7 ==( Down/ Polling)==> “” ( )
4 8 ==( Down/ Polling)==> “” ( )
4 9 ==( Down/ Polling)==> “” ( )
4 10 ==( Down/ Polling)==> “” ( )
4 11 ==( Down/ Polling)==> “” ( )
4 12 ==( 4X 10.0 Gbps Active/ LinkUp)==> 22 1 “supp100 HCA-2” ( )
4 13 ==( Down/ Polling)==> “” ( )
4 14 ==( Down/ Polling)==> “” ( )
4 15 ==( Down/ Polling)==> “” ( )
4 16 ==( 4X 10.0 Gbps Active/ LinkUp)==> 14 34[16] “Voltaire sLB-4018 Line 4 Chip 1 4700 #4700-SUPPORT” ( )
4 17 ==( 4X 10.0 Gbps Active/ LinkUp)==> 14 35[17] “Voltaire sLB-4018 Line 4 Chip 1 4700 #4700-SUPPORT” ( )
4 18 ==( Down/Disabled)==> “” ( )
4 19 ==( 4X 10.0 Gbps Active/ LinkUp)==> 15 1 “MF0;SUPP-5100:IS5100/S01/U1” ( )
4 20 ==( 4X 10.0 Gbps Active/ LinkUp)==> 15 2 “MF0;SUPP-5100:IS5100/S01/U1” ( )
4 21 ==( 4X 10.0 Gbps Active/ LinkUp)==> 15 3 “MF0;SUPP-5100:IS5100/S01/U1” ( )
4 22 ==( 4X 10.0 Gbps Active/ LinkUp)==> 15 4 “MF0;SUPP-5100:IS5100/S01/U1” ( )
4 23 ==( 4X 10.0 Gbps Active/ LinkUp)==> 15 5 “MF0;SUPP-5100:IS5100/S01/U1” ( )
4 24 ==( 4X 10.0 Gbps Active/ LinkUp)==> 15 6 “MF0;SUPP-5100:IS5100/S01/U1” ( )
4 25 ==( 4X 10.0 Gbps Active/ LinkUp)==> 2 1 “MF0;SUPP-5100:IS5100/S02/U1” ( )
4 26 ==( 4X 10.0 Gbps Active/ LinkUp)==> 2 2 “MF0;SUPP-5100:IS5100/S02/U1” ( )
4 27 ==( 4X 10.0 Gbps Active/ LinkUp)==> 2 3 “MF0;SUPP-5100:IS5100/S02/U1” ( )
4 28 ==( 4X 10.0 Gbps Active/ LinkUp)==> 2 4 “MF0;SUPP-5100:IS5100/S02/U1” ( )
4 29 ==( 4X 10.0 Gbps Active/ LinkUp)==> 2 5 “MF0;SUPP-5100:IS5100/S02/U1” ( )
4 30 ==( 4X 10.0 Gbps Active/ LinkUp)==> 2 6 “MF0;SUPP-5100:IS5100/S02/U1” ( )
4 31 ==( 4X 10.0 Gbps Active/ LinkUp)==> 19 1 “MF0;SUPP-5100:IS5100/S03/U1” ( )
4 32 ==( 4X 10.0 Gbps Active/ LinkUp)==> 19 2 “MF0;SUPP-5100:IS5100/S03/U1” ( )
4 33 ==( 4X 10.0 Gbps Active/ LinkUp)==> 19 3 “MF0;SUPP-5100:IS5100/S03/U1” ( )
4 34 ==( 4X 10.0 Gbps Active/ LinkUp)==> 19 4 “MF0;SUPP-5100:IS5100/S03/U1” ( )
4 35 ==( 4X 10.0 Gbps Active/ LinkUp)==> 19 5 “MF0;SUPP-5100:IS5100/S03/U1” ( )
4 36 ==( 4X 10.0 Gbps Active/ LinkUp)==> 19 6 “MF0;SUPP-5100:IS5100/S03/U1” ( )