I am designing a baseboard for a Jetson Xavier module. I would like to know following information related to Xavier PCIe lanes.
What are the different cards been tested at the x16 (J6) and x8 (J22) PCIe connector available on the Xavier development kit? I would like to know what are the different 3rd party PCIe devices are supported by Xavier.
Below is the PCIe lane mapping for the xavier baseboard I am designing. Please confirm the assignment is correct.
UPHY0: x1 mPCIe
UPHY1: USB3.1
UPHY[5:2]: M.2
UPHY6: USB3.1
UPHY7: x1 PCIe to PCIe device
UPHY8: x1 PCIe to PCIe device
UPHY9: NC
UPHY10:x1 UFS
UPHY11: NC
NVHS[3:0]: x4 PCIe to the switch
NVHS[7:4]: NC
Following cards have been verified
RCS_r2UG-A2E16-A PCIe Switch
Nvidiaāa dGPU
Intel82572EI NIC
NEC uPD720200 USB3.0 card
ASUS USB3.1 card
Moschip USB2.0 card
OCZ SSD
OCZ RVD400-22280-512G-A SSD
Silicon Image Corp. 3132 SATA Controller
Intel E10G42BT X520-T2 10Gigabit NIC card
StarTech 1G NIC Card
TP-Link TG-3468 1G NIC Card
ASUS ROG AREION 10G Express 10Gbps
ASUS XG-C100C 10G NIC card
Realtech RTL8111/8168 1G NIC card
Intel CT Desktop Ethernet NIC card
Tehuti 10G Network Card
Intel Ethernet I210 ā T1
Toshiba NVME card
Intel 750 Series SSDPEDMW400G4 NVMe SSD
Samsung NVME SSD
WD NVME WDS256G1X0C SSD
Plextor PX-128M8PeGN NVMe SSD
Intel SSDPEKKW512G7X1 NVME SSD
Kingston SKC1000/240G NVMe SSD
Realtek RTL8188CE NIC
Realtek RTL8822BE NIC
Broadcom 4356 WiFi Card
TPLINK N900 NIC card
Regarding the configuration, yes, that would work. (On a side note, you can have both Lane-8 and Lane-9 routed to an x2 slot and depending on your requirement, you can either use it to connect to x1 cards or x2 cards. Reason behind it is, both lane-8,9 are owned by the same controller
Nope. That is not possible. All lanes (i.e. total 8) of NVHS port can only be owned by one PCIe controller and that is C5 controller. So, either we use one lane, 4 lanes or 8 lanes, only one controller (C5) can own those lanes and we canāt use other lanes for any other purpose.
Although we didnāt test this particular card as such, but, I donāt see any reason why it canāt work. FWIW, we have tested other cards with the same Realtek chipset (i.e RTL8111G) and they all work fine.
Jetson AGX has only one x16 CEM formfactor slot to which one ASUS USB3.1 add-on card can be connected.
When you said, āa total of 2 more ASUS USB3.1 card (or some other 3.1 extension card) can be added to the Jetson Xavier AGX ?ā Iām not sure where do you want to connect the other ASUS USB3.1 card?
FWIW, AGX has got two more slots in the form of M.2 Key-M and M.2 Key-E and if you are planning to connect to those slot with the help of an adapter, then, sureā¦go ahead and it would work fine too
@vidyas: We notice you have the Supermicro RSC R2UG-A2E16-A PCIe switch on your supported list.
We tried this other PCIe switch HBA card.
On an x86_64 Linux host (x8 slot, no bifurcation config, to mimic the Jetson) it presents as four NVMe drives. On the Jetson Xavier, it only presents the first NVMe drive.
Can you you elaborate on the Jetson PCIe restrictions alluded to in this thread?
Is this expected behavior for this Syba card on the Jetson?
Should we expect different, better results with this or this?
What makes the RSC R2UG-A2E16-A reportedly supported; how should users pick additional PCIe switch chipsets that may be supported.
Would you expect the RSC R2UG-A2E16-A in Jetsonās x8, with two NVMe x4 drive adapters inserted, to present both drives to the Jetson?
Nope. This is not the expected behavior.I expect all 4 downstream ports of the switch (and NVMe devices as well if they are connected). Could you please share the ādmesgā and āsudo lspci -vvvvā output (if possible, lspci output on the x86 machine as well). If only one NVMe is showing up and not others, I may have to doubt the PCIe switch, as well as Tegra links up with only the upstream port of the PCIe switch, and what happens beneath the upstream port, is not controlled by Tegra.
Canāt really comment as the observation with Syba card itself is not expected. Having said that, I donāt expect to see any reduction in the number of devices that get enumerated.
Well, it just means that we happen to have this card and tested it. It doesnāt mean that other cards are not supported. They are just not connected and tested. Again, it doesnāt mean they donāt work as expected or something. All cards are expected to work with Tegra in the way they work with any other PCIe root port.
Tehuti 10G card that we have tested had a normal ethernet port and not SFP. But, I canāt think of any reason why an SFP card wonāt work with AGX though.