How could I know exactly which speed of IB my adapter supports, 10, 40, or 56Gb/s?
Hi Kai,
It seems that you have a Mitac server, correct?
From the PSID I can safely say that it’s MAX speed is QDR (40Gbps)
Hi, eddie.notz,
I have edit a script as this；
#!/bin/bash
for i in lspci -d 15b3: | awk '{print $1}' ; do mstvpd $i ; done
And then I run it in root. But I got the error as this:
-E- Mandatory End(0xF) tag not found.
Could you give me some help?
Thanks!
Hi Kai,
can you please provide the below output:
mstvpd -v
lspci -d 15b3:
lspci -d 15b3: -vv
Thanks!
I run the command and got this:
root@gpu-cluster-2:/home/run# mstflint -d 82:00.0 q
Image type: FS2
FW Version: 2.11.500
Device ID: 4099
Description: Node Port1 Port2 Sys image
GUIDs: 00e08100002ae92f 00e08100002ae930 00e08100002ae931 00e08100002ae932
MACs: a0423f232d68 a0423f232d69
VSD:
PSID: MITAC_QDR
So, how to analyze the result? Could I know the speed from it?
在 2015年5月25日，下午10:30，eddie.notz <community@mellanox.com mailto:community@mellanox.com > 写道：
Mellanox Interconnect Community <http://jiveon.jivesoftware.com/mpss/c/owA/PDcDAA/t.1nb/FWBWjrKNQv2aMwFvDofa7A/h0/eqhG5v9o4WV1pCmWaB03cfyztINWh6xRdBkUZtbQl9tBUbL3HECnVGQUTD9rPgS239JTkHzyXFury1uBdj75qQ-3D-3D http://jiveon.jivesoftware.com/mpss/c/owA/PDcDAA/t.1nb/FWBWjrKNQv2aMwFvDofa7A/h0/eqhG5v9o4WV1pCmWaB03cfyztINWh6xRdBkUZtbQl9tBUbL3HECnVGQUTD9rPgS239JTkHzyXFury1uBdj75qQ-3D-3D >
How could I know exactly which speed of IB my adapter supports, 10, 40, or 56Gb/s?
reply from eddie.notz <http://jiveon.jivesoftware.com/mpss/c/owA/PDcDAA/t.1nb/FWBWjrKNQv2aMwFvDofa7A/h1/eqhG5v9o4WV1pCmWaB03cX4lB72IlnWMn-2FzpXHP4DiLfBMudqveuXEuNzx6-2Fvuvx-2FMrCJzsYzv39LC-2BZulo8u6YXhCuxKRR7LSleKT95dHQ-3D http://jiveon.jivesoftware.com/mpss/c/owA/PDcDAA/t.1nb/FWBWjrKNQv2aMwFvDofa7A/h1/eqhG5v9o4WV1pCmWaB03cX4lB72IlnWMn-2FzpXHP4DiLfBMudqveuXEuNzx6-2Fvuvx-2FMrCJzsYzv39LC-2BZulo8u6YXhCuxKRR7LSleKT95dHQ-3D > in Mellanox OFED - View the full discussion <http://jiveon.jivesoftware.com/mpss/c/owA/PDcDAA/t.1nb/FWBWjrKNQv2aMwFvDofa7A/h2/eqhG5v9o4WV1pCmWaB03cbwv1A38KD4RZXD1l6VjU-2BWj8Su-2BinUD-2Fvr5KBBAv7lviFHGwdfhSh1iVyIhPxbpsK-2F9voNhBcHO4pjhkc7jXZw-3D http://jiveon.jivesoftware.com/mpss/c/owA/PDcDAA/t.1nb/FWBWjrKNQv2aMwFvDofa7A/h2/eqhG5v9o4WV1pCmWaB03cbwv1A38KD4RZXD1l6VjU-2BWj8Su-2BinUD-2Fvr5KBBAv7lviFHGwdfhSh1iVyIhPxbpsK-2F9voNhBcHO4pjhkc7jXZw-3D >
Thanks,
It seems that the VPD isn’t identified by the server,
we have another method of identifying the HCA type:
mstflint -d 82:00.0 q
Reply to this message by replying to this email, or go to the message on Mellanox Interconnect Community <http://jiveon.jivesoftware.com/mpss/c/owA/PDcDAA/t.1nb/FWBWjrKNQv2aMwFvDofa7A/h3/eqhG5v9o4WV1pCmWaB03cbwv1A38KD4RZXD1l6VjU-2BWj8Su-2BinUD-2Fvr5KBBAv7lviFHGwdfhSh1iVyIhPxbpsK-2F9voNhBcHO4pjhkc7jXZw-3D http://jiveon.jivesoftware.com/mpss/c/owA/PDcDAA/t.1nb/FWBWjrKNQv2aMwFvDofa7A/h3/eqhG5v9o4WV1pCmWaB03cbwv1A38KD4RZXD1l6VjU-2BWj8Su-2BinUD-2Fvr5KBBAv7lviFHGwdfhSh1iVyIhPxbpsK-2F9voNhBcHO4pjhkc7jXZw-3D >
Start a new discussion in Mellanox OFED by email <mailto:discussions-community-support-softwaredrivers-mellanoxofed@mail.mellanoxexternal.jiveon.com mailto:ofed@mail.mellanoxexternal.jiveon.com > or at Mellanox Interconnect Community <http://jiveon.jivesoftware.com/mpss/c/owA/PDcDAA/t.1nb/FWBWjrKNQv2aMwFvDofa7A/h4/eqhG5v9o4WV1pCmWaB03cReBeZqtjxlvimMmM5ACTcMuQCyQsFeICw78AOZRcLmoJEMoAcsrhswUBG8jNFS-2FSkRqiZCgCUWq74vbAK3JGBSdAXPiFiO18V-2FOuvVNsxjRyROgA-2FgBFQa-2FQyy38oYV-2B57yYx7nIzU8k61cs5F-2Fb2s-3D http://jiveon.jivesoftware.com/mpss/c/owA/PDcDAA/t.1nb/FWBWjrKNQv2aMwFvDofa7A/h4/eqhG5v9o4WV1pCmWaB03cReBeZqtjxlvimMmM5ACTcMuQCyQsFeICw78AOZRcLmoJEMoAcsrhswUBG8jNFS-2FSkRqiZCgCUWq74vbAK3JGBSdAXPiFiO18V-2FOuvVNsxjRyROgA-2FgBFQa-2FQyy38oYV-2B57yYx7nIzU8k61cs5F-2Fb2s-3D >
Following How could I know exactly which speed of IB my adapter supports, 10, 40, or 56Gb/s? <http://jiveon.jivesoftware.com/mpss/c/owA/PDcDAA/t.1nb/FWBWjrKNQv2aMwFvDofa7A/h5/eqhG5v9o4WV1pCmWaB03cbwv1A38KD4RZXD1l6VjU-2BWj8Su-2BinUD-2Fvr5KBBAv7lviFHGwdfhSh1iVyIhPxbpsK-2F9voNhBcHO4pjhkc7jXZw-3D http://jiveon.jivesoftware.com/mpss/c/owA/PDcDAA/t.1nb/FWBWjrKNQv2aMwFvDofa7A/h5/eqhG5v9o4WV1pCmWaB03cbwv1A38KD4RZXD1l6VjU-2BWj8Su-2BinUD-2Fvr5KBBAv7lviFHGwdfhSh1iVyIhPxbpsK-2F9voNhBcHO4pjhkc7jXZw-3D > in these streams: Inbox
This email was sent by Mellanox Interconnect Community because you are a registered user.
You may unsubscribe <http://jiveon.jivesoftware.com/mpss/c/owA/PDcDAA/t.1nb/FWBWjrKNQv2aMwFvDofa7A/h6/eqhG5v9o4WV1pCmWaB03cXrpCaz7yLdymwWO27BzTtMhDGT-2BG716ZIIxakfHEaPrDT7jbWPfXovjwQLyMAUA8fsK0SJnFD2-2FwHUAzqOLkmKu0YXbRqbvrK0UOWOM8z5YaS43wAR5Pif18u0oml9yiJRuzi9f9a-2BlGvQZFJvQRKmgoBoRv0nT2u17M7FwjESjcJ5GlpEDhYHQuQW7liCwQg-3D-3D http://jiveon.jivesoftware.com/mpss/c/owA/PDcDAA/t.1nb/FWBWjrKNQv2aMwFvDofa7A/h6/eqhG5v9o4WV1pCmWaB03cXrpCaz7yLdymwWO27BzTtMhDGT-2BG716ZIIxakfHEaPrDT7jbWPfXovjwQLyMAUA8fsK0SJnFD2-2FwHUAzqOLkmKu0YXbRqbvrK0UOWOM8z5YaS43wAR5Pif18u0oml9yiJRuzi9f9a-2BlGvQZFJvQRKmgoBoRv0nT2u17M7FwjESjcJ5GlpEDhYHQuQW7liCwQg-3D-3D > instantly from Mellanox Interconnect Community, or adjust email frequency in your email preferences <http://jiveon.jivesoftware.com/mpss/c/owA/PDcDAA/t.1nb/FWBWjrKNQv2aMwFvDofa7A/h7/eqhG5v9o4WV1pCmWaB03cXrpCaz7yLdymwWO27BzTtNZRZXdJxt-2B24NAIMkRPdsPpjPAQp0Yk-2FIPtGK26lR6bw-3D-3D http://jiveon.jivesoftware.com/mpss/c/owA/PDcDAA/t.1nb/FWBWjrKNQv2aMwFvDofa7A/h7/eqhG5v9o4WV1pCmWaB03cXrpCaz7yLdymwWO27BzTtNZRZXdJxt-2B24NAIMkRPdsPpjPAQp0Yk-2FIPtGK26lR6bw-3D-3D >
Thanks,
It seems that the VPD isn’t identified by the server,
we have another method of identifying the HCA type:
mstflint -d 82:00.0 q
Hi Kai Ma,
you can know the speed according to the Part number of the adapter.
Here is a nice 1 liner to get the PN with Linux (with MLNX_OFED or mstflint utility installed):
for i in lspci -d 15b3: | awk '{print $1}' ; do mstvpd $i ; done
Hi, eddie.notz,
I have edit a script as this；
#!/bin/bash
for i in lspci -d 15b3: | awk '{print $1}' ; do mstvpd $i ; done
And then I run it in root. But I got the error as this:
-E- Mandatory End(0xF) tag not found.
Could you give me some help?
Thanks!
在 2015年5月25日，下午9:42，eddie.notz <community@mellanox.com mailto:community@mellanox.com > 写道：
Mellanox Interconnect Community <http://jiveon.jivesoftware.com/mpss/c/fAA/PDcDAA/t.1nb/97aitBRmQ3mODnZeqm7w3w/h0/eqhG5v9o4WV1pCmWaB03cfyztINWh6xRdBkUZtbQl9tBUbL3HECnVGQUTD9rPgS239JTkHzyXFury1uBdj75qQ-3D-3D http://jiveon.jivesoftware.com/mpss/c/fAA/PDcDAA/t.1nb/97aitBRmQ3mODnZeqm7w3w/h0/eqhG5v9o4WV1pCmWaB03cfyztINWh6xRdBkUZtbQl9tBUbL3HECnVGQUTD9rPgS239JTkHzyXFury1uBdj75qQ-3D-3D >
How could I know exactly which speed of IB my adapter supports, 10, 40, or 56Gb/s?
reply from eddie.notz <http://jiveon.jivesoftware.com/mpss/c/fAA/PDcDAA/t.1nb/97aitBRmQ3mODnZeqm7w3w/h1/eqhG5v9o4WV1pCmWaB03cX4lB72IlnWMn-2FzpXHP4DiLfBMudqveuXEuNzx6-2Fvuvx-2FMrCJzsYzv39LC-2BZulo8u6YXhCuxKRR7LSleKT95dHQ-3D http://jiveon.jivesoftware.com/mpss/c/fAA/PDcDAA/t.1nb/97aitBRmQ3mODnZeqm7w3w/h1/eqhG5v9o4WV1pCmWaB03cX4lB72IlnWMn-2FzpXHP4DiLfBMudqveuXEuNzx6-2Fvuvx-2FMrCJzsYzv39LC-2BZulo8u6YXhCuxKRR7LSleKT95dHQ-3D > in Mellanox OFED - View the full discussion <http://jiveon.jivesoftware.com/mpss/c/fAA/PDcDAA/t.1nb/97aitBRmQ3mODnZeqm7w3w/h2/eqhG5v9o4WV1pCmWaB03cbwv1A38KD4RZXD1l6VjU-2BUnzg5W0IiThwUGiT3AHJJvrJ-2B4Oizsj7lLp3OVI2kjHaYyMdsOTESNbcAzZl01xTY-3D http://jiveon.jivesoftware.com/mpss/c/fAA/PDcDAA/t.1nb/97aitBRmQ3mODnZeqm7w3w/h2/eqhG5v9o4WV1pCmWaB03cbwv1A38KD4RZXD1l6VjU-2BUnzg5W0IiThwUGiT3AHJJvrJ-2B4Oizsj7lLp3OVI2kjHaYyMdsOTESNbcAzZl01xTY-3D >
Hi Kai Ma,
you can know the speed according to the Part number of the adapter.
Here is a nice 1 liner to get the PN with Linux (with MLNX_OFED or mstflint utility installed):
for i in lspci -d 15b3: | awk '{print $1}' ; do mstvpd $i ; done
Reply to this message by replying to this email, or go to the message on Mellanox Interconnect Community <http://jiveon.jivesoftware.com/mpss/c/fAA/PDcDAA/t.1nb/97aitBRmQ3mODnZeqm7w3w/h3/eqhG5v9o4WV1pCmWaB03cbwv1A38KD4RZXD1l6VjU-2BUnzg5W0IiThwUGiT3AHJJvrJ-2B4Oizsj7lLp3OVI2kjHaYyMdsOTESNbcAzZl01xTY-3D http://jiveon.jivesoftware.com/mpss/c/fAA/PDcDAA/t.1nb/97aitBRmQ3mODnZeqm7w3w/h3/eqhG5v9o4WV1pCmWaB03cbwv1A38KD4RZXD1l6VjU-2BUnzg5W0IiThwUGiT3AHJJvrJ-2B4Oizsj7lLp3OVI2kjHaYyMdsOTESNbcAzZl01xTY-3D >
Start a new discussion in Mellanox OFED by email <mailto:discussions-community-support-softwaredrivers-mellanoxofed@mail.mellanoxexternal.jiveon.com mailto:ofed@mail.mellanoxexternal.jiveon.com > or at Mellanox Interconnect Community <http://jiveon.jivesoftware.com/mpss/c/fAA/PDcDAA/t.1nb/97aitBRmQ3mODnZeqm7w3w/h4/eqhG5v9o4WV1pCmWaB03cReBeZqtjxlvimMmM5ACTcMuQCyQsFeICw78AOZRcLmoJEMoAcsrhswUBG8jNFS-2FSkRqiZCgCUWq74vbAK3JGBSdAXPiFiO18V-2FOuvVNsxjRyROgA-2FgBFQa-2FQyy38oYV-2B57yYx7nIzU8k61cs5F-2Fb2s-3D http://jiveon.jivesoftware.com/mpss/c/fAA/PDcDAA/t.1nb/97aitBRmQ3mODnZeqm7w3w/h4/eqhG5v9o4WV1pCmWaB03cReBeZqtjxlvimMmM5ACTcMuQCyQsFeICw78AOZRcLmoJEMoAcsrhswUBG8jNFS-2FSkRqiZCgCUWq74vbAK3JGBSdAXPiFiO18V-2FOuvVNsxjRyROgA-2FgBFQa-2FQyy38oYV-2B57yYx7nIzU8k61cs5F-2Fb2s-3D >
Following How could I know exactly which speed of IB my adapter supports, 10, 40, or 56Gb/s? <http://jiveon.jivesoftware.com/mpss/c/fAA/PDcDAA/t.1nb/97aitBRmQ3mODnZeqm7w3w/h5/eqhG5v9o4WV1pCmWaB03cbwv1A38KD4RZXD1l6VjU-2BUnzg5W0IiThwUGiT3AHJJvrJ-2B4Oizsj7lLp3OVI2kjHaYyMdsOTESNbcAzZl01xTY-3D http://jiveon.jivesoftware.com/mpss/c/fAA/PDcDAA/t.1nb/97aitBRmQ3mODnZeqm7w3w/h5/eqhG5v9o4WV1pCmWaB03cbwv1A38KD4RZXD1l6VjU-2BUnzg5W0IiThwUGiT3AHJJvrJ-2B4Oizsj7lLp3OVI2kjHaYyMdsOTESNbcAzZl01xTY-3D > in these streams: Inbox
This email was sent by Mellanox Interconnect Community because you are a registered user.
You may unsubscribe <http://jiveon.jivesoftware.com/mpss/c/fAA/PDcDAA/t.1nb/97aitBRmQ3mODnZeqm7w3w/h6/eqhG5v9o4WV1pCmWaB03cXrpCaz7yLdymwWO27BzTtMhDGT-2BG716ZIIxakfHEaPrDT7jbWPfXovjwQLyMAUA8fsK0SJnFD2-2FwHUAzqOLkmKu0YXbRqbvrK0UOWOM8z5YaS43wAR5Pif18u0oml9yiJRuzi9f9a-2BlGvQZFJvQRKmgoBoRv0nT2u17M7FwjESjcJ5GlpEDhYHQuQW7liCwQg-3D-3D http://jiveon.jivesoftware.com/mpss/c/fAA/PDcDAA/t.1nb/97aitBRmQ3mODnZeqm7w3w/h6/eqhG5v9o4WV1pCmWaB03cXrpCaz7yLdymwWO27BzTtMhDGT-2BG716ZIIxakfHEaPrDT7jbWPfXovjwQLyMAUA8fsK0SJnFD2-2FwHUAzqOLkmKu0YXbRqbvrK0UOWOM8z5YaS43wAR5Pif18u0oml9yiJRuzi9f9a-2BlGvQZFJvQRKmgoBoRv0nT2u17M7FwjESjcJ5GlpEDhYHQuQW7liCwQg-3D-3D > instantly from Mellanox Interconnect Community, or adjust email frequency in your email preferences <http://jiveon.jivesoftware.com/mpss/c/fAA/PDcDAA/t.1nb/97aitBRmQ3mODnZeqm7w3w/h7/eqhG5v9o4WV1pCmWaB03cXrpCaz7yLdymwWO27BzTtNZRZXdJxt-2B24NAIMkRPdsPpjPAQp0Yk-2FIPtGK26lR6bw-3D-3D http://jiveon.jivesoftware.com/mpss/c/fAA/PDcDAA/t.1nb/97aitBRmQ3mODnZeqm7w3w/h7/eqhG5v9o4WV1pCmWaB03cXrpCaz7yLdymwWO27BzTtNZRZXdJxt-2B24NAIMkRPdsPpjPAQp0Yk-2FIPtGK26lR6bw-3D-3D >
Hi, eddie.notz,
The following is the result:
root@gpu-cluster-2:/home/run# mstvpd -v
mstvpd 2.0.0, mstflint 3.7.1, built on Nov 6 2014, 13:31:37. Git SHA Hash: 4354a45
root@gpu-cluster-2:/home/run# lspci -d 15b3:
82:00.0 Network controller: Mellanox Technologies MT27500 Family
root@gpu-cluster-2:/home/run# lspci -d 15b3: -vv
82:00.0 Network controller: Mellanox Technologies MT27500 Family
Subsystem: Mellanox Technologies Device 0028
Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- SERR- <PERR- INTx-
Latency: 0, Cache Line Size: 64 bytes
Interrupt: pin A routed to IRQ 50
Region 0: Memory at fb200000 (64-bit, non-prefetchable)
Region 2: Memory at f5800000 (64-bit, prefetchable)
Capabilities: Power Management version 3
Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
Capabilities: Vital Product Data
No end tag found
Capabilities: MSI-X: Enable+ Count=128 Masked-
Vector table: BAR=0 offset=0007c000
PBA: BAR=0 offset=0007d000
Capabilities: Express (v2) Endpoint, MSI 00
DevCap: MaxPayload 256 bytes, PhantFunc 0, Latency L0s <64ns, L1 unlimited
ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset+
DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop- FLReset-
MaxPayload 256 bytes, MaxReadReq 512 bytes
DevSta: CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
LnkCap: Port #8, Speed 8GT/s, Width x8, ASPM L0s, Exit Latency L0s unlimited, L1 unlimited
ClockPM- Surprise- LLActRep- BwNot-
LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk+
ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
LnkSta: Speed 8GT/s, Width x8, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
DevCap2: Completion Timeout: Range ABCD, TimeoutDis+, LTR-, OBFF Not Supported
DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled
LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-
Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
Compliance De-emphasis: -6dB
LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
Capabilities: Alternative Routing-ID Interpretation (ARI)
ARICap: MFVC- ACS-, Next Function: 0
ARICtl: MFVC- ACS-, Function Group: 0
Capabilities: Device Serial Number 00-e0-81-00-00-2a-e9-2f
Capabilities: Advanced Error Reporting
UESta: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
UESvrt: DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
CESta: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
CEMsk: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
AERCap: First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
Capabilities: #19
Kernel driver in use: mlx4_core
在 2015年5月25日，下午10:17，eddie.notz <community@mellanox.com mailto:community@mellanox.com > 写道：
Mellanox Interconnect Community <http://jiveon.jivesoftware.com/mpss/c/iAA/PDcDAA/t.1nb/dYH9ZLMSTASiIuponWhWAA/h0/eqhG5v9o4WV1pCmWaB03cfyztINWh6xRdBkUZtbQl9tBUbL3HECnVGQUTD9rPgS239JTkHzyXFury1uBdj75qQ-3D-3D http://jiveon.jivesoftware.com/mpss/c/iAA/PDcDAA/t.1nb/dYH9ZLMSTASiIuponWhWAA/h0/eqhG5v9o4WV1pCmWaB03cfyztINWh6xRdBkUZtbQl9tBUbL3HECnVGQUTD9rPgS239JTkHzyXFury1uBdj75qQ-3D-3D >
How could I know exactly which speed of IB my adapter supports, 10, 40, or 56Gb/s?
reply from eddie.notz <http://jiveon.jivesoftware.com/mpss/c/iAA/PDcDAA/t.1nb/dYH9ZLMSTASiIuponWhWAA/h1/eqhG5v9o4WV1pCmWaB03cX4lB72IlnWMn-2FzpXHP4DiLfBMudqveuXEuNzx6-2Fvuvx-2FMrCJzsYzv39LC-2BZulo8u6YXhCuxKRR7LSleKT95dHQ-3D http://jiveon.jivesoftware.com/mpss/c/iAA/PDcDAA/t.1nb/dYH9ZLMSTASiIuponWhWAA/h1/eqhG5v9o4WV1pCmWaB03cX4lB72IlnWMn-2FzpXHP4DiLfBMudqveuXEuNzx6-2Fvuvx-2FMrCJzsYzv39LC-2BZulo8u6YXhCuxKRR7LSleKT95dHQ-3D > in Mellanox OFED - View the full discussion <http://jiveon.jivesoftware.com/mpss/c/iAA/PDcDAA/t.1nb/dYH9ZLMSTASiIuponWhWAA/h2/eqhG5v9o4WV1pCmWaB03cbwv1A38KD4RZXD1l6VjU-2BUopz1EW0-2FJ4hWJyt4aXW5ZlsqEirurg8QLotar3LQ3o6YEPOXmODaOW1oEeeIL0JU-3D http://jiveon.jivesoftware.com/mpss/c/iAA/PDcDAA/t.1nb/dYH9ZLMSTASiIuponWhWAA/h2/eqhG5v9o4WV1pCmWaB03cbwv1A38KD4RZXD1l6VjU-2BUopz1EW0-2FJ4hWJyt4aXW5ZlsqEirurg8QLotar3LQ3o6YEPOXmODaOW1oEeeIL0JU-3D >
Hi Kai,
can you please provide the below output:
mstvpd -v
lspci -d 15b3:
lspci -d 15b3: -vv
Reply to this message by replying to this email, or go to the message on Mellanox Interconnect Community <http://jiveon.jivesoftware.com/mpss/c/iAA/PDcDAA/t.1nb/dYH9ZLMSTASiIuponWhWAA/h3/eqhG5v9o4WV1pCmWaB03cbwv1A38KD4RZXD1l6VjU-2BUopz1EW0-2FJ4hWJyt4aXW5ZlsqEirurg8QLotar3LQ3o6YEPOXmODaOW1oEeeIL0JU-3D http://jiveon.jivesoftware.com/mpss/c/iAA/PDcDAA/t.1nb/dYH9ZLMSTASiIuponWhWAA/h3/eqhG5v9o4WV1pCmWaB03cbwv1A38KD4RZXD1l6VjU-2BUopz1EW0-2FJ4hWJyt4aXW5ZlsqEirurg8QLotar3LQ3o6YEPOXmODaOW1oEeeIL0JU-3D >
Start a new discussion in Mellanox OFED by email <mailto:discussions-community-support-softwaredrivers-mellanoxofed@mail.mellanoxexternal.jiveon.com mailto:ofed@mail.mellanoxexternal.jiveon.com > or at Mellanox Interconnect Community <http://jiveon.jivesoftware.com/mpss/c/iAA/PDcDAA/t.1nb/dYH9ZLMSTASiIuponWhWAA/h4/eqhG5v9o4WV1pCmWaB03cReBeZqtjxlvimMmM5ACTcMuQCyQsFeICw78AOZRcLmoJEMoAcsrhswUBG8jNFS-2FSkRqiZCgCUWq74vbAK3JGBSdAXPiFiO18V-2FOuvVNsxjRyROgA-2FgBFQa-2FQyy38oYV-2B57yYx7nIzU8k61cs5F-2Fb2s-3D http://jiveon.jivesoftware.com/mpss/c/iAA/PDcDAA/t.1nb/dYH9ZLMSTASiIuponWhWAA/h4/eqhG5v9o4WV1pCmWaB03cReBeZqtjxlvimMmM5ACTcMuQCyQsFeICw78AOZRcLmoJEMoAcsrhswUBG8jNFS-2FSkRqiZCgCUWq74vbAK3JGBSdAXPiFiO18V-2FOuvVNsxjRyROgA-2FgBFQa-2FQyy38oYV-2B57yYx7nIzU8k61cs5F-2Fb2s-3D >
Following How could I know exactly which speed of IB my adapter supports, 10, 40, or 56Gb/s? <http://jiveon.jivesoftware.com/mpss/c/iAA/PDcDAA/t.1nb/dYH9ZLMSTASiIuponWhWAA/h5/eqhG5v9o4WV1pCmWaB03cbwv1A38KD4RZXD1l6VjU-2BUopz1EW0-2FJ4hWJyt4aXW5ZlsqEirurg8QLotar3LQ3o6YEPOXmODaOW1oEeeIL0JU-3D http://jiveon.jivesoftware.com/mpss/c/iAA/PDcDAA/t.1nb/dYH9ZLMSTASiIuponWhWAA/h5/eqhG5v9o4WV1pCmWaB03cbwv1A38KD4RZXD1l6VjU-2BUopz1EW0-2FJ4hWJyt4aXW5ZlsqEirurg8QLotar3LQ3o6YEPOXmODaOW1oEeeIL0JU-3D > in these streams: Inbox
This email was sent by Mellanox Interconnect Community because you are a registered user.
You may unsubscribe <http://jiveon.jivesoftware.com/mpss/c/iAA/PDcDAA/t.1nb/dYH9ZLMSTASiIuponWhWAA/h6/eqhG5v9o4WV1pCmWaB03cXrpCaz7yLdymwWO27BzTtMhDGT-2BG716ZIIxakfHEaPrDT7jbWPfXovjwQLyMAUA8fsK0SJnFD2-2FwHUAzqOLkmKu0YXbRqbvrK0UOWOM8z5YaS43wAR5Pif18u0oml9yiJRuzi9f9a-2BlGvQZFJvQRKmgoBoRv0nT2u17M7FwjESjcJ5GlpEDhYHQuQW7liCwQg-3D-3D http://jiveon.jivesoftware.com/mpss/c/iAA/PDcDAA/t.1nb/dYH9ZLMSTASiIuponWhWAA/h6/eqhG5v9o4WV1pCmWaB03cXrpCaz7yLdymwWO27BzTtMhDGT-2BG716ZIIxakfHEaPrDT7jbWPfXovjwQLyMAUA8fsK0SJnFD2-2FwHUAzqOLkmKu0YXbRqbvrK0UOWOM8z5YaS43wAR5Pif18u0oml9yiJRuzi9f9a-2BlGvQZFJvQRKmgoBoRv0nT2u17M7FwjESjcJ5GlpEDhYHQuQW7liCwQg-3D-3D > instantly from Mellanox Interconnect Community, or adjust email frequency in your email preferences <http://jiveon.jivesoftware.com/mpss/c/iAA/PDcDAA/t.1nb/dYH9ZLMSTASiIuponWhWAA/h7/eqhG5v9o4WV1pCmWaB03cXrpCaz7yLdymwWO27BzTtNZRZXdJxt-2B24NAIMkRPdsPpjPAQp0Yk-2FIPtGK26lR6bw-3D-3D http://jiveon.jivesoftware.com/mpss/c/iAA/PDcDAA/t.1nb/dYH9ZLMSTASiIuponWhWAA/h7/eqhG5v9o4WV1pCmWaB03cXrpCaz7yLdymwWO27BzTtNZRZXdJxt-2B24NAIMkRPdsPpjPAQp0Yk-2FIPtGK26lR6bw-3D-3D >
Hi, eddie.notz,
I’m so sorry that I don’t know what “Mitac server” means. Does it mean the version of my machine？Or, some software service?
But I think your answer is correct. Because I run the bandwidth test of MVAPICH2 between my nodes, and I got the max speed of 3800MB/s. The result is more close to 40Gb/s.
Thanks very much!
在 2015年5月26日，上午12:58，eddie.notz <community@mellanox.com mailto:community@mellanox.com > 写道：
Mellanox Interconnect Community <http://jiveon.jivesoftware.com/mpss/c/rAA/PDcDAA/t.1nb/BmpYar8KT1-eMi6rWxwcrA/h0/eqhG5v9o4WV1pCmWaB03cfyztINWh6xRdBkUZtbQl9tBUbL3HECnVGQUTD9rPgS239JTkHzyXFury1uBdj75qQ-3D-3D http://jiveon.jivesoftware.com/mpss/c/rAA/PDcDAA/t.1nb/BmpYar8KT1-eMi6rWxwcrA/h0/eqhG5v9o4WV1pCmWaB03cfyztINWh6xRdBkUZtbQl9tBUbL3HECnVGQUTD9rPgS239JTkHzyXFury1uBdj75qQ-3D-3D >
How could I know exactly which speed of IB my adapter supports, 10, 40, or 56Gb/s?
reply from eddie.notz <http://jiveon.jivesoftware.com/mpss/c/rAA/PDcDAA/t.1nb/BmpYar8KT1-eMi6rWxwcrA/h1/eqhG5v9o4WV1pCmWaB03cX4lB72IlnWMn-2FzpXHP4DiLfBMudqveuXEuNzx6-2Fvuvx-2FMrCJzsYzv39LC-2BZulo8u6YXhCuxKRR7LSleKT95dHQ-3D http://jiveon.jivesoftware.com/mpss/c/rAA/PDcDAA/t.1nb/BmpYar8KT1-eMi6rWxwcrA/h1/eqhG5v9o4WV1pCmWaB03cX4lB72IlnWMn-2FzpXHP4DiLfBMudqveuXEuNzx6-2Fvuvx-2FMrCJzsYzv39LC-2BZulo8u6YXhCuxKRR7LSleKT95dHQ-3D > in Mellanox OFED - View the full discussion <http://jiveon.jivesoftware.com/mpss/c/rAA/PDcDAA/t.1nb/BmpYar8KT1-eMi6rWxwcrA/h2/eqhG5v9o4WV1pCmWaB03cbwv1A38KD4RZXD1l6VjU-2BVtqywQOAbB4Zpz9J0bnLu8Sf9sSWqqaYrkKxNopps7trdArVsNTNv797XEOzA46GU-3D http://jiveon.jivesoftware.com/mpss/c/rAA/PDcDAA/t.1nb/BmpYar8KT1-eMi6rWxwcrA/h2/eqhG5v9o4WV1pCmWaB03cbwv1A38KD4RZXD1l6VjU-2BVtqywQOAbB4Zpz9J0bnLu8Sf9sSWqqaYrkKxNopps7trdArVsNTNv797XEOzA46GU-3D >
Hi Kai,
It seems that you have a Mitac server, correct?
From the PSID I can safely say that it’s MAX speed is QDR (40Gbps)
Reply to this message by replying to this email, or go to the message on Mellanox Interconnect Community <http://jiveon.jivesoftware.com/mpss/c/rAA/PDcDAA/t.1nb/BmpYar8KT1-eMi6rWxwcrA/h3/eqhG5v9o4WV1pCmWaB03cbwv1A38KD4RZXD1l6VjU-2BVtqywQOAbB4Zpz9J0bnLu8Sf9sSWqqaYrkKxNopps7trdArVsNTNv797XEOzA46GU-3D http://jiveon.jivesoftware.com/mpss/c/rAA/PDcDAA/t.1nb/BmpYar8KT1-eMi6rWxwcrA/h3/eqhG5v9o4WV1pCmWaB03cbwv1A38KD4RZXD1l6VjU-2BVtqywQOAbB4Zpz9J0bnLu8Sf9sSWqqaYrkKxNopps7trdArVsNTNv797XEOzA46GU-3D >
Start a new discussion in Mellanox OFED by email <mailto:discussions-community-support-softwaredrivers-mellanoxofed@mail.mellanoxexternal.jiveon.com mailto:ofed@mail.mellanoxexternal.jiveon.com > or at Mellanox Interconnect Community <http://jiveon.jivesoftware.com/mpss/c/rAA/PDcDAA/t.1nb/BmpYar8KT1-eMi6rWxwcrA/h4/eqhG5v9o4WV1pCmWaB03cReBeZqtjxlvimMmM5ACTcMuQCyQsFeICw78AOZRcLmoJEMoAcsrhswUBG8jNFS-2FSkRqiZCgCUWq74vbAK3JGBSdAXPiFiO18V-2FOuvVNsxjRyROgA-2FgBFQa-2FQyy38oYV-2B57yYx7nIzU8k61cs5F-2Fb2s-3D http://jiveon.jivesoftware.com/mpss/c/rAA/PDcDAA/t.1nb/BmpYar8KT1-eMi6rWxwcrA/h4/eqhG5v9o4WV1pCmWaB03cReBeZqtjxlvimMmM5ACTcMuQCyQsFeICw78AOZRcLmoJEMoAcsrhswUBG8jNFS-2FSkRqiZCgCUWq74vbAK3JGBSdAXPiFiO18V-2FOuvVNsxjRyROgA-2FgBFQa-2FQyy38oYV-2B57yYx7nIzU8k61cs5F-2Fb2s-3D >
Following How could I know exactly which speed of IB my adapter supports, 10, 40, or 56Gb/s? <http://jiveon.jivesoftware.com/mpss/c/rAA/PDcDAA/t.1nb/BmpYar8KT1-eMi6rWxwcrA/h5/eqhG5v9o4WV1pCmWaB03cbwv1A38KD4RZXD1l6VjU-2BVtqywQOAbB4Zpz9J0bnLu8Sf9sSWqqaYrkKxNopps7trdArVsNTNv797XEOzA46GU-3D http://jiveon.jivesoftware.com/mpss/c/rAA/PDcDAA/t.1nb/BmpYar8KT1-eMi6rWxwcrA/h5/eqhG5v9o4WV1pCmWaB03cbwv1A38KD4RZXD1l6VjU-2BVtqywQOAbB4Zpz9J0bnLu8Sf9sSWqqaYrkKxNopps7trdArVsNTNv797XEOzA46GU-3D > in these streams: Inbox
This email was sent by Mellanox Interconnect Community because you are a registered user.
You may unsubscribe <http://jiveon.jivesoftware.com/mpss/c/rAA/PDcDAA/t.1nb/BmpYar8KT1-eMi6rWxwcrA/h6/eqhG5v9o4WV1pCmWaB03cXrpCaz7yLdymwWO27BzTtMhDGT-2BG716ZIIxakfHEaPrDT7jbWPfXovjwQLyMAUA8fsK0SJnFD2-2FwHUAzqOLkmKu0YXbRqbvrK0UOWOM8z5YaS43wAR5Pif18u0oml9yiJRuzi9f9a-2BlGvQZFJvQRKmgoBoRv0nT2u17M7FwjESjcJ5GlpEDhYHQuQW7liCwQg-3D-3D http://jiveon.jivesoftware.com/mpss/c/rAA/PDcDAA/t.1nb/BmpYar8KT1-eMi6rWxwcrA/h6/eqhG5v9o4WV1pCmWaB03cXrpCaz7yLdymwWO27BzTtMhDGT-2BG716ZIIxakfHEaPrDT7jbWPfXovjwQLyMAUA8fsK0SJnFD2-2FwHUAzqOLkmKu0YXbRqbvrK0UOWOM8z5YaS43wAR5Pif18u0oml9yiJRuzi9f9a-2BlGvQZFJvQRKmgoBoRv0nT2u17M7FwjESjcJ5GlpEDhYHQuQW7liCwQg-3D-3D > instantly from Mellanox Interconnect Community, or adjust email frequency in your email preferences <http://jiveon.jivesoftware.com/mpss/c/rAA/PDcDAA/t.1nb/BmpYar8KT1-eMi6rWxwcrA/h7/eqhG5v9o4WV1pCmWaB03cXrpCaz7yLdymwWO27BzTtNZRZXdJxt-2B24NAIMkRPdsPpjPAQp0Yk-2FIPtGK26lR6bw-3D-3D http://jiveon.jivesoftware.com/mpss/c/rAA/PDcDAA/t.1nb/BmpYar8KT1-eMi6rWxwcrA/h7/eqhG5v9o4WV1pCmWaB03cXrpCaz7yLdymwWO27BzTtNZRZXdJxt-2B24NAIMkRPdsPpjPAQp0Yk-2FIPtGK26lR6bw-3D-3D >