Jetson AGX Orin dev kit PCIe advertised power capability

Robotics & Edge Computing Jetson Systems Jetson AGX Orin
,
1

Hi,

As per Jetson AGX Orin Developer Kit Carrier Board Specification, the maximum power available on PCIe slot is 66W (5,5A @12V). But when an Nvidia ConnectX-7 is connected on the kit PCIe slot, the ConnectX-7 displays message " Detected insufficient power on the PCIe slot (27W)"

So how does it come? Does the Orin dev kit card advertise 27W only or does it lack advertising PCIe power capability?

This question arises because a Connect-X 7 installed in PCIe slot does not perform at full Ethernet throughput, RoCE v2 based, 100Gbe target, with a 100G QSFP28 module .

2

— 🤖 This is an automated AI response. I’m here to help, but please verify important details! —

I could not find clear support for that in the provided Jetson AGX Orin documentation.

— We support team will also look into your issue to have further suggestions soon. please stay tuned. —

5

Did you enable the 3.3V and 12V rails on the PCIe connector?

Carrier Net Name / CVM Conn Pin / SoC Pin Name / GPIO port/pin

PCIE_3V3_EN / L48 / UART4_RX / GPIO3_PH.04: set high to enable 3.3V

PCIE_12V_EN_N / A59 / DAP6_DOUT / GPIO3_PA.01: set low to enable 12V

6

Thanks for advice. Yes we checked PCIE_3V3_EN and PCIE_12V_EN_N GPIOs, they are set so that 3V3 and 12V are enabled.

7

So, when PCIE_3V3_EN and PCIE_12V_EN_N are set to enable 3V3 and12V, what power value can we expect to be advertised?

11

Hi,

Could you check lspci -vvv of both RP and EP and share us the result?

12

Hi Wayne

Here is the lscpci log:

0005:01:00.0 Ethernet controller: Mellanox Technologies MT2910 Family [ConnectX-7]
Subsystem: Mellanox Technologies MT2910 Family [ConnectX-7]
Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- SERR- <PERR- INTx-
Latency: 0
Interrupt: pin A routed to IRQ 204
IOMMU group: 6
Region 0: Memory at 2800000000 (64-bit, prefetchable) [size=32M]
Expansion ROM at 2b28000000 [virtual] [disabled] [size=1M]
Capabilities: [60] Express (v2) Endpoint, IntMsgNum 0
DevCap: MaxPayload 512 bytes, PhantFunc 0, Latency L0s unlimited, L1 unlimited
ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset+ SlotPowerLimit 0W
DevCtl: CorrErr- NonFatalErr- FatalErr- UnsupReq-
RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop+ FLReset-
MaxPayload 128 bytes, MaxReadReq 512 bytes
DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr- TransPend-
LnkCap: Port #0, Speed 32GT/s, Width x16, ASPM not supported
ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp+
LnkCtl: ASPM Disabled; RCB 64 bytes, LnkDisable- CommClk-
ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
LnkSta: Speed 16GT/s (downgraded), Width x8 (downgraded)
TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
DevCap2: Completion Timeout: Range ABC, TimeoutDis+ NROPrPrP- LTR-
10BitTagComp+ 10BitTagReq+ OBFF Not Supported, ExtFmt- EETLPPrefix-
EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
FRS- TPHComp- ExtTPHComp-
AtomicOpsCap: 32bit+ 64bit+ 128bitCAS+
DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
AtomicOpsCtl: ReqEn-
IDOReq- IDOCompl- LTR- EmergencyPowerReductionReq-
10BitTagReq- OBFF Disabled, EETLPPrefixBlk-
LnkCap2: Supported Link Speeds: 2.5-32GT/s, Crosslink- Retimer+ 2Retimers+ DRS-
LnkCtl2: Target Link Speed: 32GT/s, EnterCompliance- SpeedDis-
Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
Compliance Preset/De-emphasis: -6dB de-emphasis, 0dB preshoot
LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete+ EqualizationPhase1+
EqualizationPhase2+ EqualizationPhase3+ LinkEqualizationRequest-
Retimer- 2Retimers- CrosslinkRes: unsupported
Capabilities: [48] Vital Product Data
Product Name: NVIDIA ConnectX-7 Adapter Card, 200GbE / NDR200, Dual-port QSFP112, PCIe 5.0x16 with x16 PCIe extension option, Crypto Disabled, Secure Boot Enabled
Read-only fields:
[PN] Part number: MCX755106AS-HEAT
[EC] Engineering changes: A9
[V2] Vendor specific: MCX755106AS-HEAT
[SN] Serial number: MT2526600609
[V3] Vendor specific: 1cd8e602d14ff0118000d89424dbd06e
[VA] Vendor specific: MLX:MN=MLNX:CSKU=V2:UUID=V3:PCI=V0:MODL=CX755106A
[V0] Vendor specific: PCIeGen5 x16
[VU] Vendor specific: MT2526600609MLNXS0D0F0
[RV] Reserved: checksum good, 1 byte(s) reserved
End
Capabilities: [9c] MSI-X: Enable+ Count=64 Masked-
Vector table: BAR=0 offset=00002000
PBA: BAR=0 offset=00003000
Capabilities: [c0] Vendor Specific Information: Len=18
Capabilities: [3b0 v1] Physical Layer 32.0 GT/s
Kernel driver in use: mlx5_core
Kernel modules: mlx5_core

0005:01:00.1 Ethernet controller: Mellanox Technologies MT2910 Family [ConnectX-7]
Subsystem: Mellanox Technologies MT2910 Family [ConnectX-7]
Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- SERR- <PERR- INTx-
Latency: 0
Interrupt: pin B routed to IRQ 204
IOMMU group: 6
Region 0: Memory at 2802000000 (64-bit, prefetchable) [size=32M]
Expansion ROM at 2b28100000 [virtual] [disabled] [size=1M]
Capabilities: [60] Express (v2) Endpoint, IntMsgNum 0
DevCap: MaxPayload 512 bytes, PhantFunc 0, Latency L0s unlimited, L1 unlimited
ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset+ SlotPowerLimit 0W
DevCtl: CorrErr- NonFatalErr- FatalErr- UnsupReq-
RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop+ FLReset-
MaxPayload 128 bytes, MaxReadReq 512 bytes
DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr- TransPend-
LnkCap: Port #0, Speed 32GT/s, Width x16, ASPM not supported
ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp+
LnkCtl: ASPM Disabled; RCB 64 bytes, LnkDisable- CommClk-
ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
LnkSta: Speed 16GT/s (downgraded), Width x8 (downgraded)
TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
DevCap2: Completion Timeout: Range ABC, TimeoutDis+ NROPrPrP- LTR-
10BitTagComp+ 10BitTagReq+ OBFF Not Supported, ExtFmt- EETLPPrefix-
EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
FRS- TPHComp- ExtTPHComp-
AtomicOpsCap: 32bit+ 64bit+ 128bitCAS+
DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
AtomicOpsCtl: ReqEn-
IDOReq- IDOCompl- LTR- EmergencyPowerReductionReq-
10BitTagReq- OBFF Disabled, EETLPPrefixBlk-
LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete- EqualizationPhase1-
EqualizationPhase2- EqualizationPhase3- LinkEqualizationRequest-
Retimer- 2Retimers- CrosslinkRes: unsupported
Capabilities: [48] Vital Product Data
Product Name: NVIDIA ConnectX-7 Adapter Card, 200GbE / NDR200, Dual-port QSFP112, PCIe 5.0x16 with x16 PCIe extension option, Crypto Disabled, Secure Boot Enabled
Read-only fields:
[PN] Part number: MCX755106AS-HEAT
[EC] Engineering changes: A9
[V2] Vendor specific: MCX755106AS-HEAT
[SN] Serial number: MT2526600609
[V3] Vendor specific: 1cd8e602d14ff0118000d89424dbd06e
[VA] Vendor specific: MLX:MN=MLNX:CSKU=V2:UUID=V3:PCI=V0:MODL=CX755106A
[V0] Vendor specific: PCIeGen5 x16
[VU] Vendor specific: MT2526600609MLNXS0D0F1
[RV] Reserved: checksum good, 1 byte(s) reserved
End
Capabilities: [9c] MSI-X: Enable+ Count=64 Masked-
Vector table: BAR=0 offset=00002000
PBA: BAR=0 offset=00003000
Capabilities: [c0] Vendor Specific Information: Len=18
Kernel driver in use: mlx5_core
Kernel modules: mlx5_core

13

Hi,

We need to RP info too but not just the EPs.

Give us the full lspci result instead of only 0005:01:00.0 and 0005:01:00.1