QSFP Port validation on Thor Devkit

[jameskuo]

Hi Nvidia:
We have two Thor Devkit with Jetpack 7.0 GA (Clean build, just downloaded and flashed from the BSP published on site).
From the document we found, the default setting for QSFP port should be 10Gbps. However, when we connect the QSFP cable to the port on both Devkit, dmesg showed nothing and the setting page showed Cable unplugged on all of the mgbe ports.
In another post Here, we saw [Validation in progress], is it for 25G mode? or the whole port is still in validation?

Another thing we found is that after following the guide line about enable 25g Here, dmesg flooded with error meesages with Link Up for mgbe port. So, it seems like handshaking is happened in 25G mode while default 10G mode didn’t?

Please Help.

Many Thanks.

[sgursal]

Could you provide further details of your setup/use case? Are you connecting to an ethernet switch or 2x Thor DevKit back to back through MGBE? QSFP cable is optical or passive/active copper cable, cable length used? Suggest to test 4x10GbE first.

[jameskuo]

Hi Sgursal:
Thanks for the reply.

1. The use case: We have 2x Thor Devkit back to back through MGBE. IP config on Devkit A is set to Share to others wihile Devkit B is set to DHCP, so the IP can be through DHCP.
   Based on the situation, we tested 4x25GbE and 4x10GbE. 4x25GbE showed only 3 of 4 interfaces are connected, but it’s not functional. 4x10GbE showed 4 interfaces are cable unpluged.

2. The cable was bought from Here. We used this one to tested on IGX Orin loopback test, hence the quality should be OK.

Many Thanks.

[WayneWWW]

Hi James,

Currently the x4 interfaces are not fully validated yet. We only validate x1 so only single 25GbE or 10GbE are supported.

[jameskuo]

Hi Wayne:
Thanks for the reply.
Does that mean we should enable one port at a time in device tree then validate it? We can’t even connect any of them in 10GbE mode.

Many Thanks.

[WayneWWW]

Do you mean even a single 10GbE interface fails to work on your devkit?

[jameskuo]

Exactly. None of them is able to get IP.

[WayneWWW]

just a quick check. Does static IP work?

[jameskuo]

Please ignore last post. There are critical errors.
I’m doing another tests.

[WayneWWW]

We tried a test with static IP and it could work with 10GbE.

[jameskuo]

Hi Wayne:
Thanks for the reply.
We did another test with static IP. The speed can achieved to 8Gbps on each mgbe interface, besides mgbe3_0.
But I think that’s OK.
We will verify it again once the full function(4x10G & 4x25G) is released.

Thanks for the support.

[liu.jialu]

According the page : Enable 25 Gigabit Ethernet on QSFP Port — NVIDIA Jetson Linux Developer Guide

connect two Thor back-to-back.

It displays “Connected - 25,000 Mb/s“, and CPU is locked up by jetson_clocks.

But, the iperf3 test did not even reach 10Gbps, just like the previous configuration of 10G, the speed did not improve any more.

[WayneWWW]

25GbE has issue now which could not reach to expected result. We are still checking it.

[johnny_nv]

which cable did you buy?