Severe one-way RDMA performance regression on ASUS Ascent GX10 with kernel 6.17.0-1029-nvidia

Hi everyone,

I would like to share an issue I found while connecting two NVIDIA GB10-based systems for distributed inference.

My setup consists of:

  • One NVIDIA DGX Spark
  • One ASUS Ascent GX10
  • Two direct 200 Gb/s ConnectX-7 links
  • RoCE v2 and NCCL
  • Tensor-parallel vLLM inference across both systems

The network configuration appeared correct, but performance was severely asymmetric.

Observed performance

With the ASUS Ascent GX10 running kernel:

6.17.0-1029-nvidia

RDMA Write performance was:

DGX Spark -> ASUS GX10: approximately 13.2 Gbit/s
ASUS GX10 -> DGX Spark: approximately 111.6 Gbit/s

The same directional asymmetry was also visible with TCP testing.

We tested:

  • Both ConnectX-7 links
  • 1, 4 and 8 QPs
  • RDMA Write, Read and Send
  • PCIe link width and speed
  • IRQ affinity and queue distribution
  • ConnectX firmware
  • IOMMU/SMMU configuration
  • PCIe AER error counters

Both systems used identical ConnectX firmware:

FW Version: 28.45.4028
PSID: NVD0000000087

PCIe was operating correctly at:

PCIe 5.0
32 GT/s
x4

No PCIe or AER errors were reported.

Resolution

I installed and booted the ASUS Ascent GX10 with:

6.17.0-1026-nvidia

Without changing the network, firmware, RoCE or NCCL configuration, RDMA Write performance immediately increased from approximately:

13.2 Gbit/s

to:

111.7 Gbit/s

The result remained stable after reboot.

This strongly suggests a kernel regression in 6.17.0-1029-nvidia affecting incoming RDMA traffic or PCIe DMA writes on the ASUS Ascent GX10.

For now, I have configured the system to boot kernel 6.17.0-1026-nvidia and placed the 1029 kernel packages on hold.

Has anyone else observed this issue on an ASUS Ascent GX10, DGX Spark or another GB10-based system?

It would be helpful if NVIDIA could confirm whether this is a known regression in kernel 6.17.0-1029-nvidia.

I am supposed to get my correct QSFP cable today, can you give me the command you use to test the RDMA performances? I have two GX10.

Hi, there’s a lot of guides on this . DGX-SPARK/dual-spark at main · Sggin1/DGX-SPARK · GitHub is one I created after got my dual setup working well, you can scroll to bottom too and it has links to others in the Acknowledgments. typical setup is a single cable , max bandwidth is 200Gb/s it breaks up into 4 channels on 2 pci if memory serves. almost any AI can config it for you just point to any of the guides. Using same username on both is very helpful , jumbo frames 9k, rdma… good luck

Thanks @sggin1 , I already had the link configured, but with a 10G SFP+ ;)

@Claesbas I confirm the issue. I had to revert to 6.17.0-1026-nvidia.

On 6.17.0-1026-nvidia:

benjamin@gx10-ed9e:~$ ib_write_bw \
-d rocep1s0f1 \
-i 1 \
-p 12000 \
-F \
--report_gbits \
-D 30 \
-s 65536 \
192.168.100.11
WARNING: BW peak won't be measured in this run.
---------------------------------------------------------------------------------------
RDMA_Write BW Test
Dual-port : OFF Device : rocep1s0f1
Number of qps : 1 Transport type : IB
Connection type : RC Using SRQ : OFF
PCIe relax order: ON
ibv_wr* API : ON
TX depth : 128
CQ Moderation : 1
Mtu : 1024[B]
Link type : Ethernet
GID index : 3
Max inline data : 0[B]
rdma_cm QPs : OFF
Data ex. method : Ethernet
---------------------------------------------------------------------------------------
local address: LID 0000 QPN 0x0228 PSN 0x11871a RKey 0x1c03ec VAddr 0x00ed2c303fd000
GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
remote address: LID 0000 QPN 0x0228 PSN 0x737353 RKey 0x1c03ec VAddr 0x00e6e81b10d000
GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
---------------------------------------------------------------------------------------
#bytes #iterations BW peak[Gb/sec] BW average[Gb/sec] MsgRate[Mpps]
65536 3323131 0.00 108.92 0.207739
---------------------------------------------------------------------------------------

vs on 6.17.0-1029-nvidia

benjamin@gx10-ed9e:~$ ib_write_bw -d rocep1s0f1 -i 1 -p 12000 -F --report_gbits -D 30 -s 65536 192.168.100.11
WARNING: BW peak won't be measured in this run.
---------------------------------------------------------------------------------------
RDMA_Write BW Test
Dual-port : OFF Device : rocep1s0f1
Number of qps : 1 Transport type : IB
Connection type : RC Using SRQ : OFF
PCIe relax order: ON
ibv_wr* API : ON
TX depth : 128
CQ Moderation : 1
Mtu : 1024[B]
Link type : Ethernet
GID index : 3
Max inline data : 0[B]
rdma_cm QPs : OFF
Data ex. method : Ethernet
---------------------------------------------------------------------------------------
local address: LID 0000 QPN 0x0228 PSN 0xe01321 RKey 0x1c03ed VAddr 0x00e3d3d756d000
GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
remote address: LID 0000 QPN 0x0228 PSN 0x68f259 RKey 0x1c01ed VAddr 0x00e6557e4ad000
GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
---------------------------------------------------------------------------------------
#bytes #iterations BW peak[Gb/sec] BW average[Gb/sec] MsgRate[Mpps]
65536 411083 0.00 13.47 0.025693
---------------------------------------------------------------------------------------

Thanks for finding that, I would have been disappointed with my new cable…

Well yeah, I ask the test to run for 30 seconds, so less speed → less iteration done in the allotted time.

@Claesbas it would be interesting to see if it only impact the GX10 or it’s only an issue if one of them uses the 1029 kernel? Can you try your benchmark the other way?

Thank you for flagging this. Can you share your firmware version? Please share with me the output of sudo dmidecode -t 45

Sure! I used “ib_write_bw” from perftest.

On the receiving GX10:

ib_write_bw
-d rocep1s0f1
-i 1
-x 3
-F
-q 8
–report_gbits

Then on the sending GX10:

ib_write_bw
-d rocep1s0f1
-i 1
-x 3
-F
-q 8
–report_gbits
<IP_OF_RECEIVING_GX10>

In my setup the RDMA interface is “rocep1s0f1”, GID index is “3”, and the direct-link IPs are “10.70.0.1” / “10.70.0.2”, so for example from my first machine to the second I use:

ib_write_bw -d rocep1s0f1 -i 1 -x 3 -F -q 8 --report_gbits 10.70.0.2

With kernel “6.17.0-1029-nvidia” on the receiving GX10 I was only getting around 13.2 Gbit/s. After booting that machine with “6.17.0-1026-nvidia”, the exact same test gives around 111.7 Gbit/s.

Would be very interesting to see what you get with two GX10s, especially which kernel versions you are running.

Ok, I updated again this morning everything, rebooted, and now I cannot reproduce…

On gx10-ed9e:

benjamin@gx10-ed9e:~$ uname -a
Linux gx10-ed9e 6.17.0-1029-nvidia #29-Ubuntu SMP PREEMPT_DYNAMIC Wed Jul  1 00:13:52 UTC 2026 aarch64 aarch64 aarch64 GNU/Linux
benjamin@gx10-ed9e:~$ ib_write_bw -d rocep1s0f1 -i 1 -x 3 -F -q 8 --report_gbits

************************************
* Waiting for client to connect... *
************************************
---------------------------------------------------------------------------------------
                    RDMA_Write BW Test
 Dual-port       : OFF		Device         : rocep1s0f1
 Number of qps   : 8		Transport type : IB
 Connection type : RC		Using SRQ      : OFF
 PCIe relax order: ON
 ibv_wr* API     : ON
 CQ Moderation   : 1
 Mtu             : 1024[B]
 Link type       : Ethernet
 GID index       : 3
 Max inline data : 0[B]
 rdma_cm QPs	 : OFF
 Data ex. method : Ethernet
---------------------------------------------------------------------------------------
 local address: LID 0000 QPN 0x0268 PSN 0x1ad04e RKey 0x1c0300 VAddr 0x00eb0b3611e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 local address: LID 0000 QPN 0x0269 PSN 0x402f20 RKey 0x1c0300 VAddr 0x00eb0b3612e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 local address: LID 0000 QPN 0x026a PSN 0x9c51ea RKey 0x1c0300 VAddr 0x00eb0b3613e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 local address: LID 0000 QPN 0x026b PSN 0x5bbf1 RKey 0x1c0300 VAddr 0x00eb0b3614e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 local address: LID 0000 QPN 0x026c PSN 0xe941b0 RKey 0x1c0300 VAddr 0x00eb0b3615e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 local address: LID 0000 QPN 0x026d PSN 0x2d6d52 RKey 0x1c0300 VAddr 0x00eb0b3616e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 local address: LID 0000 QPN 0x026e PSN 0x10f949 RKey 0x1c0300 VAddr 0x00eb0b3617e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 local address: LID 0000 QPN 0x026f PSN 0x42f60e RKey 0x1c0300 VAddr 0x00eb0b3618e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x0248 PSN 0x2ec82e RKey 0x1c0300 VAddr 0x00e5ac3b9ff000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 remote address: LID 0000 QPN 0x0249 PSN 0x6a6cb7 RKey 0x1c0300 VAddr 0x00e5ac3ba0f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 remote address: LID 0000 QPN 0x024a PSN 0xabc1ff RKey 0x1c0300 VAddr 0x00e5ac3ba1f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 remote address: LID 0000 QPN 0x024b PSN 0x30dfab RKey 0x1c0300 VAddr 0x00e5ac3ba2f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 remote address: LID 0000 QPN 0x024c PSN 0x4f0719 RKey 0x1c0300 VAddr 0x00e5ac3ba3f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 remote address: LID 0000 QPN 0x024d PSN 0x345dd1 RKey 0x1c0300 VAddr 0x00e5ac3ba4f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 remote address: LID 0000 QPN 0x024e PSN 0xb50626 RKey 0x1c0300 VAddr 0x00e5ac3ba5f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 remote address: LID 0000 QPN 0x024f PSN 0xf08af1 RKey 0x1c0300 VAddr 0x00e5ac3ba6f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
---------------------------------------------------------------------------------------
 #bytes     #iterations    BW peak[Gb/sec]    BW average[Gb/sec]   MsgRate[Mpps]
 65536      40000            111.74             111.72 		   0.213085
---------------------------------------------------------------------------------------
benjamin@gx10-ed9e:~$ ib_write_bw -d rocep1s0f1 -i 1 -x 3 -F -q 8 --report_gbits 192.168.100.11
---------------------------------------------------------------------------------------
                    RDMA_Write BW Test
 Dual-port       : OFF		Device         : rocep1s0f1
 Number of qps   : 8		Transport type : IB
 Connection type : RC		Using SRQ      : OFF
 PCIe relax order: ON
 ibv_wr* API     : ON
 TX depth        : 128
 CQ Moderation   : 1
 Mtu             : 1024[B]
 Link type       : Ethernet
 GID index       : 3
 Max inline data : 0[B]
 rdma_cm QPs	 : OFF
 Data ex. method : Ethernet
---------------------------------------------------------------------------------------
 local address: LID 0000 QPN 0x0270 PSN 0x16c070 RKey 0x1c0300 VAddr 0x00f145001bf000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 local address: LID 0000 QPN 0x0271 PSN 0x9bf99a RKey 0x1c0300 VAddr 0x00f145001cf000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 local address: LID 0000 QPN 0x0272 PSN 0x1323dc RKey 0x1c0300 VAddr 0x00f145001df000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 local address: LID 0000 QPN 0x0273 PSN 0x548bfb RKey 0x1c0300 VAddr 0x00f145001ef000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 local address: LID 0000 QPN 0x0274 PSN 0x98d1f2 RKey 0x1c0300 VAddr 0x00f145001ff000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 local address: LID 0000 QPN 0x0275 PSN 0x61256c RKey 0x1c0300 VAddr 0x00f1450020f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 local address: LID 0000 QPN 0x0276 PSN 0x75b85b RKey 0x1c0300 VAddr 0x00f1450021f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 local address: LID 0000 QPN 0x0277 PSN 0x6a7cb8 RKey 0x1c0300 VAddr 0x00f1450022f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x0250 PSN 0xe906ae RKey 0x1c0300 VAddr 0x00e9309eebe000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 remote address: LID 0000 QPN 0x0251 PSN 0x679600 RKey 0x1c0300 VAddr 0x00e9309eece000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 remote address: LID 0000 QPN 0x0252 PSN 0x505f4a RKey 0x1c0300 VAddr 0x00e9309eede000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 remote address: LID 0000 QPN 0x0253 PSN 0x33add1 RKey 0x1c0300 VAddr 0x00e9309eeee000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 remote address: LID 0000 QPN 0x0254 PSN 0x487e10 RKey 0x1c0300 VAddr 0x00e9309eefe000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 remote address: LID 0000 QPN 0x0255 PSN 0x786232 RKey 0x1c0300 VAddr 0x00e9309ef0e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 remote address: LID 0000 QPN 0x0256 PSN 0x7c7ca9 RKey 0x1c0300 VAddr 0x00e9309ef1e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 remote address: LID 0000 QPN 0x0257 PSN 0x9225ee RKey 0x1c0300 VAddr 0x00e9309ef2e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
---------------------------------------------------------------------------------------
 #bytes     #iterations    BW peak[Gb/sec]    BW average[Gb/sec]   MsgRate[Mpps]
 65536      40000            111.62             111.60 		   0.212870
---------------------------------------------------------------------------------------
benjamin@gx10-ed9e:~$ sudo dmidecode -t 45
[sudo] password for benjamin: 
# dmidecode 3.5
Getting SMBIOS data from sysfs.
SMBIOS 3.3.0 present.

Handle 0x0009, DMI type 45, 26 bytes
Firmware Inventory Information
	Firmware Component Name: BIOS Firmware
	Firmware Version: 5.36_GX10DGX
	Firmware ID: 011FDCCC-5E61-5186-99AD-2772D5F330A2
	Release Date: 05/05/2026
	Manufacturer: Default string
	Lowest Supported Firmware Version: 5.36_GX10DGX
	Image Size: 32 MB
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 1
		0x0000

Handle 0x0013, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SROOT-FMC
	Firmware Version: SROOT_FMC_BPT-0.1.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0014, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SROOT-FMC
	Firmware Version: SROOT_FMC-0.1.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0015, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SROOT-FMC
	Firmware Version: SROOT_FMC-0.1.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0016, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SROOT-FW
	Firmware Version: SROOT_FW_BPT-0.1.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0017, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SROOT-FW
	Firmware Version: SROOT_FW-0.1.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0018, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SROOT-FW
	Firmware Version: SROOT_FW-0.1.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0019, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: AP-PL1
	Firmware Version: APPL-NOGFH-EN
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x001A, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SoCFSVN
	Firmware Version: SoC_Flash_SVN-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x001B, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: ACC
	Firmware Version: ACC-ADSP-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x001C, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: ACC
	Firmware Version: ACC-APPL-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x001D, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: ACC
	Firmware Version: ACC-C2C-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x001E, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: ACC
	Firmware Version: ACC-DISP_SMMU-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x001F, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: ACC
	Firmware Version: ACC-DISP-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0020, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: ACC
	Firmware Version: ACC-HFRP-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0021, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: ACC
	Firmware Version: ACC-HSIO_SMMU-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0022, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: ACC
	Firmware Version: ACC-ISP-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0023, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: ACC
	Firmware Version: ACC-OSROOT-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0024, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: ACC
	Firmware Version: ACC-SCP-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0025, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: ACC
	Firmware Version: ACC-SVPP-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0026, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: ACC
	Firmware Version: ACC-VAD-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0027, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: PLL
	Firmware Version: PLL_CLK-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0028, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: DCC
	Firmware Version: DCC-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0029, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SSPM
	Firmware Version: SSPM_BPT-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x002A, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SSPM
	Firmware Version: SSPM_FMC-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x002B, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: HFRP
	Firmware Version: HFRP_BPT-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x002C, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: HFRP
	Firmware Version: HFRP_FMC-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x002D, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: CPUEB
	Firmware Version: CPUEB_BPT-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x002E, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: CPUEB
	Firmware Version: CPUEB_FMC-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x002F, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: CPUEB
	Firmware Version: CPUEB_FMC-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0030, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: CPUEB
	Firmware Version: CPUEB_FMC-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0031, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: DPM
	Firmware Version: DPM_BPT-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0032, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: DPM
	Firmware Version: DPM_FMC-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0033, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: DPM
	Firmware Version: DPM_FMC-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0034, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SPM
	Firmware Version: SPM_BPT-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0035, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SPM
	Firmware Version: SPM_FMC-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0036, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SPM
	Firmware Version: SPM_FMC-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0037, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SPBM
	Firmware Version: SPBM_BPT-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0038, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SPBM
	Firmware Version: SPBM_FMC-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0039, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: USB4
	Firmware Version: USB4_BPT-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x003A, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: USB4
	Firmware Version: USB4-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x003B, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: BL31
	Firmware Version: BL31
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x003C, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: BL32
	Firmware Version: BL32
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x003D, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: TPM
	Firmware Version: SOCTS
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x003E, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SoCDSVN
	Firmware Version: SoC_Driver_SVN-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x003F, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: GPU
	Firmware Version: GFW
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0040, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: OSR_FMC
	Firmware Version: OSROOT_FMC_BPT-0.1.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0041, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: OSR_FMC
	Firmware Version: OSROOT_FMC-0.1.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0042, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: OSR_FMC
	Firmware Version: OSROOT_FMC-0.1.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0043, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: OSR_DCT
	Firmware Version: OS_DCT
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0044, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: OSR_FW
	Firmware Version: FW-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0045, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: OSR_FW
	Firmware Version: FW-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0046, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: OEMFSVN
	Firmware Version: OEM_Flash_SVN-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0047, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: FLASH
	Firmware Version: SBP:R:2.152.15
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0048, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: ESPI
	Firmware Version: OEMTS_ESPI
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0049, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: STMM
	Firmware Version: ASUS_STMM_0105
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x004A, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SCP
	Firmware Version: SCP_BPT-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x004B, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SCP
	Firmware Version: SCP
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x004C, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: OEMDSVN
	Firmware Version: OEM_Driver_SVN-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x004D, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: UEFI
	Firmware Version: ASUS_UEFI_0105
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x004E, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: EC Firmware
	Firmware Version: 3.3.2
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x004F, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: PD Firmware
	Firmware Version: PD0 FW1: 5.22, FW2: 5.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0050, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: PD Firmware
	Firmware Version: PD1 FW1: 5.22, FW2: 5.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0051, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: GOP Driver
	Firmware Version: 9000C60
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

On gx10-c5b9:

benjamin@gx10-c5b9:~$ uname -a
Linux gx10-c5b9 6.17.0-1029-nvidia #29-Ubuntu SMP PREEMPT_DYNAMIC Wed Jul  1 00:13:52 UTC 2026 aarch64 aarch64 aarch64 GNU/Linux
benjamin@gx10-c5b9:~$ ib_write_bw -d rocep1s0f1 -i 1 -x 3 -F -q 8 --report_gbits 192.168.100.10
---------------------------------------------------------------------------------------
                    RDMA_Write BW Test
 Dual-port       : OFF		Device         : rocep1s0f1
 Number of qps   : 8		Transport type : IB
 Connection type : RC		Using SRQ      : OFF
 PCIe relax order: ON
 ibv_wr* API     : ON
 TX depth        : 128
 CQ Moderation   : 1
 Mtu             : 1024[B]
 Link type       : Ethernet
 GID index       : 3
 Max inline data : 0[B]
 rdma_cm QPs	 : OFF
 Data ex. method : Ethernet
---------------------------------------------------------------------------------------
 local address: LID 0000 QPN 0x0248 PSN 0x2ec82e RKey 0x1c0300 VAddr 0x00e5ac3b9ff000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x0249 PSN 0x6a6cb7 RKey 0x1c0300 VAddr 0x00e5ac3ba0f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x024a PSN 0xabc1ff RKey 0x1c0300 VAddr 0x00e5ac3ba1f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x024b PSN 0x30dfab RKey 0x1c0300 VAddr 0x00e5ac3ba2f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x024c PSN 0x4f0719 RKey 0x1c0300 VAddr 0x00e5ac3ba3f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x024d PSN 0x345dd1 RKey 0x1c0300 VAddr 0x00e5ac3ba4f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x024e PSN 0xb50626 RKey 0x1c0300 VAddr 0x00e5ac3ba5f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x024f PSN 0xf08af1 RKey 0x1c0300 VAddr 0x00e5ac3ba6f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 remote address: LID 0000 QPN 0x0268 PSN 0x1ad04e RKey 0x1c0300 VAddr 0x00eb0b3611e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x0269 PSN 0x402f20 RKey 0x1c0300 VAddr 0x00eb0b3612e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x026a PSN 0x9c51ea RKey 0x1c0300 VAddr 0x00eb0b3613e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x026b PSN 0x5bbf1 RKey 0x1c0300 VAddr 0x00eb0b3614e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x026c PSN 0xe941b0 RKey 0x1c0300 VAddr 0x00eb0b3615e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x026d PSN 0x2d6d52 RKey 0x1c0300 VAddr 0x00eb0b3616e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x026e PSN 0x10f949 RKey 0x1c0300 VAddr 0x00eb0b3617e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x026f PSN 0x42f60e RKey 0x1c0300 VAddr 0x00eb0b3618e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
---------------------------------------------------------------------------------------
 #bytes     #iterations    BW peak[Gb/sec]    BW average[Gb/sec]   MsgRate[Mpps]
 65536      40000            111.74             111.72 		   0.213085
---------------------------------------------------------------------------------------
benjamin@gx10-c5b9:~$ ib_write_bw -d rocep1s0f1 -i 1 -x 3 -F -q 8 --report_gbits

************************************
* Waiting for client to connect... *
************************************
---------------------------------------------------------------------------------------
                    RDMA_Write BW Test
 Dual-port       : OFF		Device         : rocep1s0f1
 Number of qps   : 8		Transport type : IB
 Connection type : RC		Using SRQ      : OFF
 PCIe relax order: ON
 ibv_wr* API     : ON
 CQ Moderation   : 1
 Mtu             : 1024[B]
 Link type       : Ethernet
 GID index       : 3
 Max inline data : 0[B]
 rdma_cm QPs	 : OFF
 Data ex. method : Ethernet
---------------------------------------------------------------------------------------
 local address: LID 0000 QPN 0x0250 PSN 0xe906ae RKey 0x1c0300 VAddr 0x00e9309eebe000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x0251 PSN 0x679600 RKey 0x1c0300 VAddr 0x00e9309eece000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x0252 PSN 0x505f4a RKey 0x1c0300 VAddr 0x00e9309eede000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x0253 PSN 0x33add1 RKey 0x1c0300 VAddr 0x00e9309eeee000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x0254 PSN 0x487e10 RKey 0x1c0300 VAddr 0x00e9309eefe000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x0255 PSN 0x786232 RKey 0x1c0300 VAddr 0x00e9309ef0e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x0256 PSN 0x7c7ca9 RKey 0x1c0300 VAddr 0x00e9309ef1e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x0257 PSN 0x9225ee RKey 0x1c0300 VAddr 0x00e9309ef2e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 remote address: LID 0000 QPN 0x0270 PSN 0x16c070 RKey 0x1c0300 VAddr 0x00f145001bf000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x0271 PSN 0x9bf99a RKey 0x1c0300 VAddr 0x00f145001cf000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x0272 PSN 0x1323dc RKey 0x1c0300 VAddr 0x00f145001df000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x0273 PSN 0x548bfb RKey 0x1c0300 VAddr 0x00f145001ef000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x0274 PSN 0x98d1f2 RKey 0x1c0300 VAddr 0x00f145001ff000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x0275 PSN 0x61256c RKey 0x1c0300 VAddr 0x00f1450020f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x0276 PSN 0x75b85b RKey 0x1c0300 VAddr 0x00f1450021f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x0277 PSN 0x6a7cb8 RKey 0x1c0300 VAddr 0x00f1450022f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
---------------------------------------------------------------------------------------
 #bytes     #iterations    BW peak[Gb/sec]    BW average[Gb/sec]   MsgRate[Mpps]
 65536      40000            111.62             111.60 		   0.212870
---------------------------------------------------------------------------------------
benjamin@gx10-c5b9:~$ sudo dmidecode -t 45
[sudo] password for benjamin: 
# dmidecode 3.5
Getting SMBIOS data from sysfs.
SMBIOS 3.3.0 present.

Handle 0x0009, DMI type 45, 26 bytes
Firmware Inventory Information
	Firmware Component Name: BIOS Firmware
	Firmware Version: 5.36_GX10DGX
	Firmware ID: 011FDCCC-5E61-5186-99AD-2772D5F330A2
	Release Date: 05/05/2026
	Manufacturer: Default string
	Lowest Supported Firmware Version: 5.36_GX10DGX
	Image Size: 32 MB
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 1
		0x0000

Handle 0x0013, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SROOT-FMC
	Firmware Version: SROOT_FMC_BPT-0.1.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0014, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SROOT-FMC
	Firmware Version: SROOT_FMC-0.1.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0015, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SROOT-FMC
	Firmware Version: SROOT_FMC-0.1.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0016, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SROOT-FW
	Firmware Version: SROOT_FW_BPT-0.1.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0017, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SROOT-FW
	Firmware Version: SROOT_FW-0.1.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0018, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SROOT-FW
	Firmware Version: SROOT_FW-0.1.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0019, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: AP-PL1
	Firmware Version: APPL-NOGFH-EN
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x001A, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SoCFSVN
	Firmware Version: SoC_Flash_SVN-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x001B, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: ACC
	Firmware Version: ACC-ADSP-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x001C, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: ACC
	Firmware Version: ACC-APPL-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x001D, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: ACC
	Firmware Version: ACC-C2C-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x001E, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: ACC
	Firmware Version: ACC-DISP_SMMU-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x001F, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: ACC
	Firmware Version: ACC-DISP-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0020, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: ACC
	Firmware Version: ACC-HFRP-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0021, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: ACC
	Firmware Version: ACC-HSIO_SMMU-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0022, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: ACC
	Firmware Version: ACC-ISP-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0023, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: ACC
	Firmware Version: ACC-OSROOT-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0024, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: ACC
	Firmware Version: ACC-SCP-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0025, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: ACC
	Firmware Version: ACC-SVPP-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0026, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: ACC
	Firmware Version: ACC-VAD-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0027, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: PLL
	Firmware Version: PLL_CLK-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0028, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: DCC
	Firmware Version: DCC-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0029, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SSPM
	Firmware Version: SSPM_BPT-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x002A, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SSPM
	Firmware Version: SSPM_FMC-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x002B, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: HFRP
	Firmware Version: HFRP_BPT-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x002C, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: HFRP
	Firmware Version: HFRP_FMC-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x002D, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: CPUEB
	Firmware Version: CPUEB_BPT-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x002E, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: CPUEB
	Firmware Version: CPUEB_FMC-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x002F, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: CPUEB
	Firmware Version: CPUEB_FMC-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0030, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: CPUEB
	Firmware Version: CPUEB_FMC-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0031, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: DPM
	Firmware Version: DPM_BPT-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0032, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: DPM
	Firmware Version: DPM_FMC-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0033, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: DPM
	Firmware Version: DPM_FMC-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0034, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SPM
	Firmware Version: SPM_BPT-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0035, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SPM
	Firmware Version: SPM_FMC-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0036, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SPM
	Firmware Version: SPM_FMC-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0037, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SPBM
	Firmware Version: SPBM_BPT-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0038, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SPBM
	Firmware Version: SPBM_FMC-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0039, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: USB4
	Firmware Version: USB4_BPT-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x003A, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: USB4
	Firmware Version: USB4-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x003B, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: BL31
	Firmware Version: BL31
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x003C, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: BL32
	Firmware Version: BL32
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x003D, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: TPM
	Firmware Version: SOCTS
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x003E, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SoCDSVN
	Firmware Version: SoC_Driver_SVN-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x003F, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: GPU
	Firmware Version: GFW
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0040, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: OSR_FMC
	Firmware Version: OSROOT_FMC_BPT-0.1.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0041, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: OSR_FMC
	Firmware Version: OSROOT_FMC-0.1.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0042, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: OSR_FMC
	Firmware Version: OSROOT_FMC-0.1.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0043, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: OSR_DCT
	Firmware Version: OS_DCT
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0044, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: OSR_FW
	Firmware Version: FW-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0045, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: OSR_FW
	Firmware Version: FW-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0046, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: OEMFSVN
	Firmware Version: OEM_Flash_SVN-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0047, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: FLASH
	Firmware Version: SBP:R:2.152.15
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0048, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: ESPI
	Firmware Version: OEMTS_ESPI
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0049, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: STMM
	Firmware Version: ASUS_STMM_0105
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x004A, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SCP
	Firmware Version: SCP_BPT-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x004B, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: SCP
	Firmware Version: SCP
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x004C, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: OEMDSVN
	Firmware Version: OEM_Driver_SVN-1.0.0
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x004D, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: UEFI
	Firmware Version: ASUS_UEFI_0105
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x004E, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: EC Firmware
	Firmware Version: 3.3.2
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x004F, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: PD Firmware
	Firmware Version: PD0 FW1: 5.22, FW2: 5.22
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0050, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: PD Firmware
	Firmware Version: PD1 FW1: 5.22, FW2: 5.22
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Handle 0x0051, DMI type 45, 24 bytes
Firmware Inventory Information
	Firmware Component Name: GOP Driver
	Firmware Version: 9000C60
	Firmware ID: Not Specified
	Release Date: Not Specified
	Manufacturer: Not Specified
	Lowest Supported Firmware Version: Not Specified
	Image Size: Unknown
	Characteristics:
		Updatable: Yes
		Write-Protect: No
	State: Enabled
	Associated Components: 0

Issue with the PD that resolved with another reboot?

# dmidecode 3.5
Getting SMBIOS data from sysfs.
SMBIOS 3.3.0 present.

Handle 0x0009, DMI type 45, 26 bytes
Firmware Inventory Information
        Firmware Component Name: BIOS Firmware
        Firmware Version: 5.36_GX10DGX
        Firmware ID: 011FDCCC-5E61-5186-99AD-2772D5F330A2
        Release Date: 03/26/2026
        Manufacturer: Default string
        Lowest Supported Firmware Version: 5.36_GX10DGX
        Image Size: 32 MB
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 1
                0x0000

Handle 0x0013, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: SROOT-FMC
        Firmware Version: SROOT_FMC_BPT-0.1.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0014, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: SROOT-FMC
        Firmware Version: SROOT_FMC-0.1.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0015, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: SROOT-FMC
        Firmware Version: SROOT_FMC-0.1.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0016, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: SROOT-FW
        Firmware Version: SROOT_FW_BPT-0.1.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0017, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: SROOT-FW
        Firmware Version: SROOT_FW-0.1.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0018, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: SROOT-FW
        Firmware Version: SROOT_FW-0.1.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0019, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: AP-PL1
        Firmware Version: APPL-NOGFH-EN
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x001A, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: SoCFSVN
        Firmware Version: SoC_Flash_SVN-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x001B, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: ACC
        Firmware Version: ACC-ADSP-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x001C, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: ACC
        Firmware Version: ACC-APPL-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x001D, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: ACC
        Firmware Version: ACC-C2C-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x001E, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: ACC
        Firmware Version: ACC-DISP_SMMU-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x001F, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: ACC
        Firmware Version: ACC-DISP-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0020, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: ACC
        Firmware Version: ACC-HFRP-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0021, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: ACC
        Firmware Version: ACC-HSIO_SMMU-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0022, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: ACC
        Firmware Version: ACC-ISP-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0023, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: ACC
        Firmware Version: ACC-OSROOT-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0024, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: ACC
        Firmware Version: ACC-SCP-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0025, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: ACC
        Firmware Version: ACC-SVPP-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0026, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: ACC
        Firmware Version: ACC-VAD-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0027, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: PLL
        Firmware Version: PLL_CLK-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0028, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: DCC
        Firmware Version: DCC-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0029, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: SSPM
        Firmware Version: SSPM_BPT-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x002A, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: SSPM
        Firmware Version: SSPM_FMC-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x002B, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: HFRP
        Firmware Version: HFRP_BPT-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x002C, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: HFRP
        Firmware Version: HFRP_FMC-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x002D, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: CPUEB
        Firmware Version: CPUEB_BPT-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x002E, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: CPUEB
        Firmware Version: CPUEB_FMC-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x002F, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: CPUEB
        Firmware Version: CPUEB_FMC-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0030, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: CPUEB
        Firmware Version: CPUEB_FMC-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0031, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: DPM
        Firmware Version: DPM_BPT-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0032, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: DPM
        Firmware Version: DPM_FMC-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0033, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: DPM
        Firmware Version: DPM_FMC-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0034, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: SPM
        Firmware Version: SPM_BPT-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0035, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: SPM
        Firmware Version: SPM_FMC-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0036, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: SPM
        Firmware Version: SPM_FMC-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0037, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: SPBM
        Firmware Version: SPBM_BPT-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0038, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: SPBM
        Firmware Version: SPBM_FMC-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0039, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: USB4
        Firmware Version: USB4_BPT-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x003A, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: USB4
        Firmware Version: USB4-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x003B, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: BL31
        Firmware Version: BL31
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x003C, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: BL32
        Firmware Version: BL32
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x003D, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: TPM
        Firmware Version: SOCTS
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x003E, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: SoCDSVN
        Firmware Version: SoC_Driver_SVN-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x003F, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: GPU
        Firmware Version: GFW
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0040, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: OSR_FMC
        Firmware Version: OSROOT_FMC_BPT-0.1.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0041, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: OSR_FMC
        Firmware Version: OSROOT_FMC-0.1.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0042, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: OSR_FMC
        Firmware Version: OSROOT_FMC-0.1.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0043, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: OSR_DCT
        Firmware Version: OS_DCT
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0044, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: OSR_FW
        Firmware Version: FW-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0045, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: OSR_FW
        Firmware Version: FW-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0046, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: OEMFSVN
        Firmware Version: OEM_Flash_SVN-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0047, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: FLASH
        Firmware Version: SBP:R:2.148.24
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0048, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: ESPI
        Firmware Version: OEMTS_ESPI
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0049, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: STMM
        Firmware Version: ASUS_STMM_0104
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x004A, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: SCP
        Firmware Version: SCP_BPT-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x004B, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: SCP
        Firmware Version: SCP
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x004C, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: OEMDSVN
        Firmware Version: OEM_Driver_SVN-1.0.0
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x004D, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: UEFI
        Firmware Version: ASUS_UEFI_0104
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x004E, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: EC Firmware
        Firmware Version: 2.78.24
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x004F, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: PD Firmware
        Firmware Version: PD0 FW1: 4.10, FW2: 4.10
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0050, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: PD Firmware
        Firmware Version: PD1 FW1: 4.10, FW2: 4.10
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

Handle 0x0051, DMI type 45, 24 bytes
Firmware Inventory Information
        Firmware Component Name: GOP Driver
        Firmware Version: 9000B90
        Firmware ID: Not Specified
        Release Date: Not Specified
        Manufacturer: Not Specified
        Lowest Supported Firmware Version: Not Specified
        Image Size: Unknown
        Characteristics:
                Updatable: Yes
                Write-Protect: No
        State: Enabled
        Associated Components: 0

You should definitely update the firmwares, it seems you are several versions behind.

I had an almost identical problem a couple of weeks back. Good news is the fix was relatively simple. Note my set up is going via a switch. Exactly as recorded by my AI … which also admitted it spent a lot of cycles hypothesizing and chasing dead-ends until I suggested the reboot.

The cause: spark-01 booted with no carrier on the CX7 (spark-02 was down at the time, so the link was dead), and the cable came live afterwards. The mlx5 driver initialises against a dead port and never fully recovers its transmit path on later link-up.

    │            condition            │  01 → 02  │ 02 → 01 │
    │ cable hot-plugged after boot    │ 13.3 Gb/s │ 97.98   │
    │ after reboot, link live at boot │ 97.98     │ 97.98   │

Inferred mechanism: DMA writes (receive) are posted and stay fast; DMA reads (transmit) are non-posted an latency-sensitive, so only the outbound direction suffers.

The fix was a reboot with the link already live

I hope that helps in some way!
Paul

I think you are on to something @wentbackward, I had to reboot both machines today and perf were awful:

benjamin@gx10-c5b9:~$ ib_write_bw -d rocep1s0f1 -i 1 -x 3 -F -q 8 --report_gbits 192.168.100.10
---------------------------------------------------------------------------------------
                    RDMA_Write BW Test
 Dual-port       : OFF		Device         : rocep1s0f1
 Number of qps   : 8		Transport type : IB
 Connection type : RC		Using SRQ      : OFF
 PCIe relax order: ON
 ibv_wr* API     : ON
 TX depth        : 128
 CQ Moderation   : 1
 Mtu             : 1024[B]
 Link type       : Ethernet
 GID index       : 3
 Max inline data : 0[B]
 rdma_cm QPs	 : OFF
 Data ex. method : Ethernet
---------------------------------------------------------------------------------------
 local address: LID 0000 QPN 0x04e0 PSN 0xae2a24 RKey 0x22a992 VAddr 0x00e732ff12f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x04e1 PSN 0x722675 RKey 0x22a992 VAddr 0x00e732ff13f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x04e2 PSN 0xfe8be5 RKey 0x22a992 VAddr 0x00e732ff14f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x04e3 PSN 0xdd7a99 RKey 0x22a992 VAddr 0x00e732ff15f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x04e4 PSN 0x66d26f RKey 0x22a992 VAddr 0x00e732ff16f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x04e5 PSN 0x4d356f RKey 0x22a992 VAddr 0x00e732ff17f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x04e6 PSN 0xa8c86c RKey 0x22a992 VAddr 0x00e732ff18f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x04e7 PSN 0xcd26bf RKey 0x22a992 VAddr 0x00e732ff19f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 remote address: LID 0000 QPN 0x04e0 PSN 0x258ddd RKey 0x22b69f VAddr 0x00f17f56ece000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x04e1 PSN 0xf55f03 RKey 0x22b69f VAddr 0x00f17f56ede000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x04e2 PSN 0xba791 RKey 0x22b69f VAddr 0x00f17f56eee000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x04e3 PSN 0x553e0c RKey 0x22b69f VAddr 0x00f17f56efe000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x04e4 PSN 0x8be92f RKey 0x22b69f VAddr 0x00f17f56f0e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x04e5 PSN 0xfed865 RKey 0x22b69f VAddr 0x00f17f56f1e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x04e6 PSN 0xf2a260 RKey 0x22b69f VAddr 0x00f17f56f2e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x04e7 PSN 0x769ed9 RKey 0x22b69f VAddr 0x00f17f56f3e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
---------------------------------------------------------------------------------------
 #bytes     #iterations    BW peak[Gb/sec]    BW average[Gb/sec]   MsgRate[Mpps]
 65536      40000            13.27              13.27  		   0.025312
---------------------------------------------------------------------------------------
benjamin@gx10-c5b9:~$ ib_write_bw -d rocep1s0f1 -i 1 -x 3 -F -q 8 --report_gbits

************************************
* Waiting for client to connect... *
************************************
---------------------------------------------------------------------------------------
                    RDMA_Write BW Test
 Dual-port       : OFF		Device         : rocep1s0f1
 Number of qps   : 8		Transport type : IB
 Connection type : RC		Using SRQ      : OFF
 PCIe relax order: ON
 ibv_wr* API     : ON
 CQ Moderation   : 1
 Mtu             : 1024[B]
 Link type       : Ethernet
 GID index       : 3
 Max inline data : 0[B]
 rdma_cm QPs	 : OFF
 Data ex. method : Ethernet
---------------------------------------------------------------------------------------
 local address: LID 0000 QPN 0x04e8 PSN 0xd10cea RKey 0x22a900 VAddr 0x00f18716c9e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x04e9 PSN 0x1c258c RKey 0x22a900 VAddr 0x00f18716cae000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x04ea PSN 0x3945e6 RKey 0x22a900 VAddr 0x00f18716cbe000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x04eb PSN 0x5e063d RKey 0x22a900 VAddr 0x00f18716cce000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x04ec PSN 0x512c0c RKey 0x22a900 VAddr 0x00f18716cde000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x04ed PSN 0xcade7e RKey 0x22a900 VAddr 0x00f18716cee000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x04ee PSN 0x57b105 RKey 0x22a900 VAddr 0x00f18716cfe000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x04ef PSN 0xc2191a RKey 0x22a900 VAddr 0x00f18716d0e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 remote address: LID 0000 QPN 0x04e8 PSN 0xd18546 RKey 0x22b6a0 VAddr 0x00f87a7b44f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x04e9 PSN 0x420cb8 RKey 0x22b6a0 VAddr 0x00f87a7b45f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x04ea PSN 0x9e3ba2 RKey 0x22b6a0 VAddr 0x00f87a7b46f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x04eb PSN 0x718f49 RKey 0x22b6a0 VAddr 0x00f87a7b47f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x04ec PSN 0xd34e28 RKey 0x22b6a0 VAddr 0x00f87a7b48f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x04ed PSN 0xa88c6a RKey 0x22b6a0 VAddr 0x00f87a7b49f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x04ee PSN 0x8cc681 RKey 0x22b6a0 VAddr 0x00f87a7b4af000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x04ef PSN 0xf9a6e6 RKey 0x22b6a0 VAddr 0x00f87a7b4bf000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
---------------------------------------------------------------------------------------
 #bytes     #iterations    BW peak[Gb/sec]    BW average[Gb/sec]   MsgRate[Mpps]
 65536      40000            13.25              13.25  		   0.025280
---------------------------------------------------------------------------------------

After rebooting gx10-c5b9, I get back the expected perf one way:

benjamin@gx10-c5b9:~$ ib_write_bw -d rocep1s0f1 -i 1 -x 3 -F -q 8 --report_gbits 192.168.100.10
---------------------------------------------------------------------------------------
                    RDMA_Write BW Test
 Dual-port       : OFF		Device         : rocep1s0f1
 Number of qps   : 8		Transport type : IB
 Connection type : RC		Using SRQ      : OFF
 PCIe relax order: ON
 ibv_wr* API     : ON
 TX depth        : 128
 CQ Moderation   : 1
 Mtu             : 1024[B]
 Link type       : Ethernet
 GID index       : 3
 Max inline data : 0[B]
 rdma_cm QPs	 : OFF
 Data ex. method : Ethernet
---------------------------------------------------------------------------------------
 local address: LID 0000 QPN 0x0228 PSN 0x848401 RKey 0x1c03ec VAddr 0x00f5ce6cc3f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x0229 PSN 0xb88457 RKey 0x1c03ec VAddr 0x00f5ce6cc4f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x022a PSN 0x1c0455 RKey 0x1c03ec VAddr 0x00f5ce6cc5f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x022b PSN 0x54d580 RKey 0x1c03ec VAddr 0x00f5ce6cc6f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x022c PSN 0x619d93 RKey 0x1c03ec VAddr 0x00f5ce6cc7f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x022d PSN 0x3e7ef9 RKey 0x1c03ec VAddr 0x00f5ce6cc8f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x022e PSN 0x258764 RKey 0x1c03ec VAddr 0x00f5ce6cc9f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x022f PSN 0x93b98d RKey 0x1c03ec VAddr 0x00f5ce6ccaf000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 remote address: LID 0000 QPN 0x04f0 PSN 0xfffd2f RKey 0x1c0400 VAddr 0x00f5d3c7b2e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x04f1 PSN 0x9270ed RKey 0x1c0400 VAddr 0x00f5d3c7b3e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x04f2 PSN 0xbc8433 RKey 0x1c0400 VAddr 0x00f5d3c7b4e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x04f3 PSN 0x34bb06 RKey 0x1c0400 VAddr 0x00f5d3c7b5e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x04f4 PSN 0x74bba1 RKey 0x1c0400 VAddr 0x00f5d3c7b6e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x04f5 PSN 0x4adeef RKey 0x1c0400 VAddr 0x00f5d3c7b7e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x04f6 PSN 0x696722 RKey 0x1c0400 VAddr 0x00f5d3c7b8e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x04f7 PSN 0xa6b173 RKey 0x1c0400 VAddr 0x00f5d3c7b9e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
---------------------------------------------------------------------------------------
 #bytes     #iterations    BW peak[Gb/sec]    BW average[Gb/sec]   MsgRate[Mpps]
 65536      40000            110.38             110.36 		   0.210494
---------------------------------------------------------------------------------------
benjamin@gx10-c5b9:~$ ib_write_bw -d rocep1s0f1 -i 1 -x 3 -F -q 8 --report_gbits

************************************
* Waiting for client to connect... *
************************************
---------------------------------------------------------------------------------------
                    RDMA_Write BW Test
 Dual-port       : OFF		Device         : rocep1s0f1
 Number of qps   : 8		Transport type : IB
 Connection type : RC		Using SRQ      : OFF
 PCIe relax order: ON
 ibv_wr* API     : ON
 CQ Moderation   : 1
 Mtu             : 1024[B]
 Link type       : Ethernet
 GID index       : 3
 Max inline data : 0[B]
 rdma_cm QPs	 : OFF
 Data ex. method : Ethernet
---------------------------------------------------------------------------------------
 local address: LID 0000 QPN 0x0230 PSN 0x32bd2c RKey 0x1c03ec VAddr 0x00fc8caecee000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x0231 PSN 0xe77da6 RKey 0x1c03ec VAddr 0x00fc8caecfe000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x0232 PSN 0xed24f8 RKey 0x1c03ec VAddr 0x00fc8caed0e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x0233 PSN 0xf62ce7 RKey 0x1c03ec VAddr 0x00fc8caed1e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x0234 PSN 0x8e5e6e RKey 0x1c03ec VAddr 0x00fc8caed2e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x0235 PSN 0x755e38 RKey 0x1c03ec VAddr 0x00fc8caed3e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x0236 PSN 0x292f37 RKey 0x1c03ec VAddr 0x00fc8caed4e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x0237 PSN 0x6dc064 RKey 0x1c03ec VAddr 0x00fc8caed5e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 remote address: LID 0000 QPN 0x04f8 PSN 0x6446ef RKey 0x1c0500 VAddr 0x00e06946f1f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x04f9 PSN 0xfecae4 RKey 0x1c0500 VAddr 0x00e06946f2f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x04fa PSN 0xf04928 RKey 0x1c0500 VAddr 0x00e06946f3f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x04fb PSN 0x994220 RKey 0x1c0500 VAddr 0x00e06946f4f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x04fc PSN 0x1210ea RKey 0x1c0500 VAddr 0x00e06946f5f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x04fd PSN 0xbd51ce RKey 0x1c0500 VAddr 0x00e06946f6f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x04fe PSN 0x7636df RKey 0x1c0500 VAddr 0x00e06946f7f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x04ff PSN 0x847fb6 RKey 0x1c0500 VAddr 0x00e06946f8f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
---------------------------------------------------------------------------------------
 #bytes     #iterations    BW peak[Gb/sec]    BW average[Gb/sec]   MsgRate[Mpps]
 65536      40000            13.25              13.25  		   0.025280
---------------------------------------------------------------------------------------

And then I rebooted the other gx10, back to full perf:

benjamin@gx10-c5b9:~$ ib_write_bw -d rocep1s0f1 -i 1 -x 3 -F -q 8 --report_gbits 192.168.100.10
---------------------------------------------------------------------------------------
                    RDMA_Write BW Test
 Dual-port       : OFF		Device         : rocep1s0f1
 Number of qps   : 8		Transport type : IB
 Connection type : RC		Using SRQ      : OFF
 PCIe relax order: ON
 ibv_wr* API     : ON
 TX depth        : 128
 CQ Moderation   : 1
 Mtu             : 1024[B]
 Link type       : Ethernet
 GID index       : 3
 Max inline data : 0[B]
 rdma_cm QPs	 : OFF
 Data ex. method : Ethernet
---------------------------------------------------------------------------------------
 local address: LID 0000 QPN 0x0238 PSN 0x8c958a RKey 0x1c0300 VAddr 0x00ee2691edf000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x0239 PSN 0x3511ac RKey 0x1c0300 VAddr 0x00ee2691eef000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x023a PSN 0x7a8f86 RKey 0x1c0300 VAddr 0x00ee2691eff000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x023b PSN 0xd01f5d RKey 0x1c0300 VAddr 0x00ee2691f0f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x023c PSN 0xf89eac RKey 0x1c0300 VAddr 0x00ee2691f1f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x023d PSN 0x926c9e RKey 0x1c0300 VAddr 0x00ee2691f2f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x023e PSN 0x7ff4a5 RKey 0x1c0300 VAddr 0x00ee2691f3f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x023f PSN 0x28a43a RKey 0x1c0300 VAddr 0x00ee2691f4f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 remote address: LID 0000 QPN 0x0228 PSN 0xcdbfc0 RKey 0x1c03ec VAddr 0x00ef579cb4e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x0229 PSN 0xa88eaa RKey 0x1c03ec VAddr 0x00ef579cb5e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x022a PSN 0x1afbac RKey 0x1c03ec VAddr 0x00ef579cb6e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x022b PSN 0x504f8b RKey 0x1c03ec VAddr 0x00ef579cb7e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x022c PSN 0x3e7642 RKey 0x1c03ec VAddr 0x00ef579cb8e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x022d PSN 0x47fb7c RKey 0x1c03ec VAddr 0x00ef579cb9e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x022e PSN 0xd13d2b RKey 0x1c03ec VAddr 0x00ef579cbae000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x022f PSN 0x74e948 RKey 0x1c03ec VAddr 0x00ef579cbbe000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
---------------------------------------------------------------------------------------
 #bytes     #iterations    BW peak[Gb/sec]    BW average[Gb/sec]   MsgRate[Mpps]
 65536      40000            111.62             111.60 		   0.212862
---------------------------------------------------------------------------------------
benjamin@gx10-c5b9:~$ ib_write_bw -d rocep1s0f1 -i 1 -x 3 -F -q 8 --report_gbits

************************************
* Waiting for client to connect... *
************************************
---------------------------------------------------------------------------------------
                    RDMA_Write BW Test
 Dual-port       : OFF		Device         : rocep1s0f1
 Number of qps   : 8		Transport type : IB
 Connection type : RC		Using SRQ      : OFF
 PCIe relax order: ON
 ibv_wr* API     : ON
 CQ Moderation   : 1
 Mtu             : 1024[B]
 Link type       : Ethernet
 GID index       : 3
 Max inline data : 0[B]
 rdma_cm QPs	 : OFF
 Data ex. method : Ethernet
---------------------------------------------------------------------------------------
 local address: LID 0000 QPN 0x0240 PSN 0x8ae9de RKey 0x1c0300 VAddr 0x00fd311e59e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x0241 PSN 0xb27170 RKey 0x1c0300 VAddr 0x00fd311e5ae000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x0242 PSN 0x966dfa RKey 0x1c0300 VAddr 0x00fd311e5be000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x0243 PSN 0x7a0ec1 RKey 0x1c0300 VAddr 0x00fd311e5ce000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x0244 PSN 0x976440 RKey 0x1c0300 VAddr 0x00fd311e5de000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x0245 PSN 0x1f84a2 RKey 0x1c0300 VAddr 0x00fd311e5ee000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x0246 PSN 0xd6c659 RKey 0x1c0300 VAddr 0x00fd311e5fe000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 local address: LID 0000 QPN 0x0247 PSN 0x77a5de RKey 0x1c0300 VAddr 0x00fd311e60e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:11
 remote address: LID 0000 QPN 0x0230 PSN 0xcf25e6 RKey 0x1c04ed VAddr 0x00e2e05705f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x0231 PSN 0x85a40f RKey 0x1c04ed VAddr 0x00e2e05706f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x0232 PSN 0x1b6277 RKey 0x1c04ed VAddr 0x00e2e05707f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x0233 PSN 0x8402c3 RKey 0x1c04ed VAddr 0x00e2e05708f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x0234 PSN 0x5c8851 RKey 0x1c04ed VAddr 0x00e2e05709f000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x0235 PSN 0xacb2a9 RKey 0x1c04ed VAddr 0x00e2e0570af000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x0236 PSN 0x4b361e RKey 0x1c04ed VAddr 0x00e2e0570bf000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
 remote address: LID 0000 QPN 0x0237 PSN 0x9bc789 RKey 0x1c04ed VAddr 0x00e2e0570cf000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:100:10
---------------------------------------------------------------------------------------
 #bytes     #iterations    BW peak[Gb/sec]    BW average[Gb/sec]   MsgRate[Mpps]
 65536      40000            111.08             108.05 		   0.206082
---------------------------------------------------------------------------------------

I have tried this exact scenario on an FE Spark and was not able to reproduce. @foogitiff Are you also running on an ASUS GX10?

Yes I have two GX10

Hi, @Claesbas what is your sparks’ connection, back to back or via a switch?

They are connected via a 0.5m https://www.fs.com/eu-en/products/115634.html - looking at the backs its the right one on both.

I really thing it is connected to the “rebooting”. I forgot to even try that.

So my guess is that its some “bug” when connecting the cable in some circumstances, it get stuck one way in slow mode - rebooting both devices fixes it with the cable attached.

Its just my hunch.

I had issues with fs com 0.5m cable. Switching to Amphenol resolved it.

so it seems for both back-to-back connection and connection via switch the issue may happen then can be fixed by a reboot in both Sparks. here some more questions may help to isolate whether it is hot-plug issue or not, can you help to recall?

  1. whether you plugged in the cable at the time one/two Spark were running?
  2. After you plugged before you ran test was there reboot?

Thanks.

I am afraid I cant remember in detail. I think my first spark was turned on. I put the new on top and connected the cable (top first the bottom), then turned the top one on.