Hi
I use two xavier connected by pcie(x1, gen-1).
What I had done.
–1–
Follow https://devtalk.nvidia.com/default/topic/1048582/jetson-agx-xavier/the-problem-about-xavier-pcie-endpoint-mode/. set ep ODMDATA=0x9191000
–2–
swap tx and rx with a cable
tx <–> rx, prst <–> prst, wake <–> wake, clkreq <–> clkreq, clkref <–> clkref
–3–
ep log
uisee@uisee-xavier-02:~$ dmesg | grep -i pci
[ 0.000000] PCI I/O : 0xffffffbefee00000 - 0xffffffbeffe00000 ( 16 MB)
[ 0.958765] iommu: Adding device 141a0000.pcie_ep to group 0
[ 0.959822] iommu: Adding device 14180000.pcie to group 1
[ 0.961093] iommu: Adding device 14100000.pcie to group 2
[ 0.962101] iommu: Adding device 14140000.pcie to group 3
[ 1.037882] GPIO line 490 (pcie-reg-enable) hogged as output/high
[ 1.037989] GPIO line 289 (pcie-reg-enable) hogged as output/high
[ 1.337731] PCI: CLS 0 bytes, default 64
[ 4.344789] Intel(R) 10GbE PCI Express Linux Network Driver - version 4.6.4
[ 4.356394] ehci-pci: EHCI PCI platform driver
[ 4.356464] ohci-pci: OHCI PCI platform driver
[ 7.619977] tegra-pcie-dw 141a0000.pcie_ep: invalid max-speed (err=-22), set to Gen-1
[ 7.619981] tegra-pcie-dw 141a0000.pcie_ep: Setting init speed to max speed
[ 7.621325] tegra-pcie-dw 14180000.pcie: Setting init speed to max speed
[ 7.622166] OF: PCI: host bridge /pcie@14180000 ranges:
[ 7.622178] OF: PCI: IO 0x38100000..0x381fffff -> 0x38100000
[ 7.622184] OF: PCI: MEM 0x38200000..0x39ffffff -> 0x38200000
[ 7.622188] OF: PCI: MEM 0x1800000000..0x1bffffffff -> 0x1800000000
[ 8.131545] tegra-pcie-dw 14180000.pcie: link is down
[ 8.132925] tegra-pcie-dw 14180000.pcie: PCI host bridge to bus 0000:00
[ 8.134013] pci_bus 0000:00: root bus resource [bus 00-ff]
[ 8.135036] pci_bus 0000:00: root bus resource [io 0x0000-0xfffff] (bus address [0x38100000-0x381fffff])
[ 8.136151] pci_bus 0000:00: root bus resource [mem 0x38200000-0x39ffffff]
[ 8.137209] pci_bus 0000:00: root bus resource [mem 0x1800000000-0x1bffffffff pref]
[ 8.138306] pci 0000:00:00.0: [10de:1ad0] type 01 class 0x060400
[ 8.138471] pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
[ 8.140051] pci 0000:00:00.0: PCI bridge to [bus 01-ff]
[ 8.141123] pci 0000:00:00.0: Max Payload Size set to 256/ 256 (was 256), Max Read Rq 512
[ 8.142451] pcieport 0000:00:00.0: Signaling PME through PCIe PME interrupt
[ 8.143551] pcie_pme 0000:00:00.0:pcie001: service driver pcie_pme loaded
[ 8.143661] aer 0000:00:00.0:pcie002: service driver aer loaded
[ 8.143856] pcie_pme 0000:00:00.0:pcie001: unloading service driver pcie_pme
[ 8.143900] aer 0000:00:00.0:pcie002: unloading service driver aer
[ 8.144010] pci_bus 0000:01: busn_res: [bus 01-ff] is released
[ 8.145563] pci_bus 0000:00: busn_res: [bus 00-ff] is released
[ 8.145842] tegra-pcie-dw 14180000.pcie: PCIe link is not up...!
[ 8.152669] tegra-pcie-dw 14100000.pcie: Setting init speed to max speed
[ 8.159310] OF: PCI: host bridge /pcie@14100000 ranges:
[ 8.163632] OF: PCI: IO 0x30100000..0x301fffff -> 0x30100000
[ 8.169474] OF: PCI: MEM 0x30200000..0x31ffffff -> 0x30200000
[ 8.175294] OF: PCI: MEM 0x1200000000..0x123fffffff -> 0x1200000000
[ 8.288868] tegra-pcie-dw 14100000.pcie: link is up
[ 8.290217] tegra-pcie-dw 14100000.pcie: PCI host bridge to bus 0001:00
[ 8.291356] pci_bus 0001:00: root bus resource [bus 00-ff]
[ 8.292422] pci_bus 0001:00: root bus resource [io 0x100000-0x1fffff] (bus address [0x30100000-0x301fffff])
[ 8.293620] pci_bus 0001:00: root bus resource [mem 0x30200000-0x31ffffff]
[ 8.294732] pci_bus 0001:00: root bus resource [mem 0x1200000000-0x123fffffff pref]
[ 8.295961] pci 0001:00:00.0: [10de:1ad2] type 01 class 0x060400
[ 8.296155] pci 0001:00:00.0: PME# supported from D0 D3hot D3cold
[ 8.297904] pci 0001:01:00.0: [1b4b:9171] type 00 class 0x010601
[ 8.298012] pci 0001:01:00.0: reg 0x10: [io 0x8000-0x8007]
[ 8.298095] pci 0001:01:00.0: reg 0x14: [io 0x8040-0x8043]
[ 8.298157] pci 0001:01:00.0: reg 0x18: [io 0x8100-0x8107]
[ 8.298235] pci 0001:01:00.0: reg 0x1c: [io 0x8140-0x8143]
[ 8.298297] pci 0001:01:00.0: reg 0x20: [io 0x800000-0x80000f]
[ 8.298358] pci 0001:01:00.0: reg 0x24: [mem 0x00900000-0x009001ff]
[ 8.298419] pci 0001:01:00.0: reg 0x30: [mem 0xd0000000-0xd000ffff pref]
[ 8.298750] pci 0001:01:00.0: PME# supported from D3hot
[ 8.309600] pci 0001:00:00.0: BAR 14: assigned [mem 0x30200000-0x302fffff]
[ 8.310810] pci 0001:00:00.0: BAR 13: assigned [io 0x100000-0x100fff]
[ 8.311976] pci 0001:01:00.0: BAR 6: assigned [mem 0x30200000-0x3020ffff pref]
[ 8.313222] pci 0001:01:00.0: BAR 5: assigned [mem 0x30210000-0x302101ff]
[ 8.314465] pci 0001:01:00.0: BAR 4: assigned [io 0x100000-0x10000f]
[ 8.315710] pci 0001:01:00.0: BAR 0: assigned [io 0x100010-0x100017]
[ 8.316947] pci 0001:01:00.0: BAR 2: assigned [io 0x100018-0x10001f]
[ 8.318196] pci 0001:01:00.0: BAR 1: assigned [io 0x100020-0x100023]
[ 8.319435] pci 0001:01:00.0: BAR 3: assigned [io 0x100024-0x100027]
[ 8.320669] pci 0001:00:00.0: PCI bridge to [bus 01-ff]
[ 8.321909] pci 0001:00:00.0: bridge window [io 0x100000-0x100fff]
[ 8.323143] pci 0001:00:00.0: bridge window [mem 0x30200000-0x302fffff]
[ 8.329296] pci 0001:00:00.0: Max Payload Size set to 256/ 256 (was 256), Max Read Rq 512
[ 8.338016] pci 0001:01:00.0: Max Payload Size set to 256/ 512 (was 128), Max Read Rq 512
[ 8.346886] pcieport 0001:00:00.0: Signaling PME through PCIe PME interrupt
[ 8.353481] pci 0001:01:00.0: Signaling PME through PCIe PME interrupt
[ 8.360007] pcie_pme 0001:00:00.0:pcie001: service driver pcie_pme loaded
[ 8.360166] aer 0001:00:00.0:pcie002: service driver aer loaded
[ 8.386644] tegra-pcie-dw 14140000.pcie: Setting init speed to max speed
[ 8.394088] OF: PCI: host bridge /pcie@14140000 ranges:
[ 8.398493] OF: PCI: IO 0x34100000..0x341fffff -> 0x34100000
[ 8.404244] OF: PCI: MEM 0x34200000..0x35ffffff -> 0x34200000
[ 8.410355] OF: PCI: MEM 0x1280000000..0x12bfffffff -> 0x1280000000
[ 8.928143] tegra-pcie-dw 14140000.pcie: link is down
[ 8.929697] tegra-pcie-dw 14140000.pcie: PCI host bridge to bus 0003:00
[ 8.931450] pci_bus 0003:00: root bus resource [bus 00-ff]
[ 8.933391] pci_bus 0003:00: root bus resource [io 0x200000-0x2fffff] (bus address [0x34100000-0x341fffff])
[ 8.934763] pci_bus 0003:00: root bus resource [mem 0x34200000-0x35ffffff]
[ 8.936047] pci_bus 0003:00: root bus resource [mem 0x1280000000-0x12bfffffff pref]
[ 8.937386] pci 0003:00:00.0: [10de:1ad2] type 01 class 0x060400
[ 8.937606] pci 0003:00:00.0: PME# supported from D0 D3hot D3cold
[ 8.939471] pci 0003:00:00.0: PCI bridge to [bus 01-ff]
[ 8.940726] pci 0003:00:00.0: Max Payload Size set to 256/ 256 (was 256), Max Read Rq 512
[ 8.942339] pcieport 0003:00:00.0: Signaling PME through PCIe PME interrupt
[ 8.943630] pcie_pme 0003:00:00.0:pcie001: service driver pcie_pme loaded
[ 8.943753] aer 0003:00:00.0:pcie002: service driver aer loaded
[ 8.943942] pcie_pme 0003:00:00.0:pcie001: unloading service driver pcie_pme
[ 8.943987] aer 0003:00:00.0:pcie002: unloading service driver aer
[ 8.944079] pci_bus 0003:01: busn_res: [bus 01-ff] is released
[ 8.945540] pci_bus 0003:00: busn_res: [bus 00-ff] is released
[ 8.945813] tegra-pcie-dw 14140000.pcie: PCIe link is not up...!
uisee@uisee-xavier-02:~$
–4–
rc log
uisee@uisee-xavier-01:~$ dmesg | grep -i pci
[ 0.000000] PCI I/O : 0xffffffbefee00000 - 0xffffffbeffe00000 ( 16 MB)
[ 0.913131] iommu: Adding device 14180000.pcie to group 0
[ 0.914244] iommu: Adding device 14100000.pcie to group 1
[ 0.915275] iommu: Adding device 14140000.pcie to group 2
[ 0.916263] iommu: Adding device 141a0000.pcie to group 3
[ 0.991724] GPIO line 490 (pcie-reg-enable) hogged as output/high
[ 0.991820] GPIO line 289 (pcie-reg-enable) hogged as output/high
[ 1.318471] PCI: CLS 0 bytes, default 64
[ 4.322711] Intel(R) 10GbE PCI Express Linux Network Driver - version 4.6.4
[ 4.333785] ehci-pci: EHCI PCI platform driver
[ 4.333845] ohci-pci: OHCI PCI platform driver
[ 6.805965] tegra-pcie-dw 14180000.pcie: Setting init speed to max speed
[ 6.813333] OF: PCI: host bridge /pcie@14180000 ranges:
[ 6.817538] OF: PCI: IO 0x38100000..0x381fffff -> 0x38100000
[ 6.823306] OF: PCI: MEM 0x38200000..0x39ffffff -> 0x38200000
[ 6.829503] OF: PCI: MEM 0x1800000000..0x1bffffffff -> 0x1800000000
[ 7.346922] tegra-pcie-dw 14180000.pcie: link is down
[ 7.347303] tegra-pcie-dw 14180000.pcie: PCI host bridge to bus 0000:00
[ 7.347436] pci_bus 0000:00: root bus resource [bus 00-ff]
[ 7.347534] pci_bus 0000:00: root bus resource [io 0x0000-0xfffff] (bus address [0x38100000-0x381fffff])
[ 7.347693] pci_bus 0000:00: root bus resource [mem 0x38200000-0x39ffffff]
[ 7.347830] pci_bus 0000:00: root bus resource [mem 0x1800000000-0x1bffffffff pref]
[ 7.347985] pci 0000:00:00.0: [10de:1ad0] type 01 class 0x060400
[ 7.348151] pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
[ 7.348896] pci 0000:00:00.0: PCI bridge to [bus 01-ff]
[ 7.349003] pci 0000:00:00.0: Max Payload Size set to 256/ 256 (was 256), Max Read Rq 512
[ 7.349424] pcieport 0000:00:00.0: Signaling PME through PCIe PME interrupt
[ 7.349557] pcie_pme 0000:00:00.0:pcie001: service driver pcie_pme loaded
[ 7.349757] aer 0000:00:00.0:pcie002: service driver aer loaded
[ 7.349911] pcie_pme 0000:00:00.0:pcie001: unloading service driver pcie_pme
[ 7.350017] aer 0000:00:00.0:pcie002: unloading service driver aer
[ 7.350123] pci_bus 0000:01: busn_res: [bus 01-ff] is released
[ 7.350384] pci_bus 0000:00: busn_res: [bus 00-ff] is released
[ 7.350592] tegra-pcie-dw 14180000.pcie: PCIe link is not up...!
[ 7.351493] tegra-pcie-dw 14100000.pcie: Setting init speed to max speed
[ 7.352672] OF: PCI: host bridge /pcie@14100000 ranges:
[ 7.352784] OF: PCI: IO 0x30100000..0x301fffff -> 0x30100000
[ 7.352913] OF: PCI: MEM 0x30200000..0x31ffffff -> 0x30200000
[ 7.358960] OF: PCI: MEM 0x1200000000..0x123fffffff -> 0x1200000000
[ 7.473726] tegra-pcie-dw 14100000.pcie: link is up
[ 7.474119] tegra-pcie-dw 14100000.pcie: PCI host bridge to bus 0001:00
[ 7.474246] pci_bus 0001:00: root bus resource [bus 00-ff]
[ 7.474345] pci_bus 0001:00: root bus resource [io 0x100000-0x1fffff] (bus address [0x30100000-0x301fffff])
[ 7.474514] pci_bus 0001:00: root bus resource [mem 0x30200000-0x31ffffff]
[ 7.474633] pci_bus 0001:00: root bus resource [mem 0x1200000000-0x123fffffff pref]
[ 7.474799] pci 0001:00:00.0: [10de:1ad2] type 01 class 0x060400
[ 7.474946] pci 0001:00:00.0: PME# supported from D0 D3hot D3cold
[ 7.475734] pci 0001:01:00.0: [1b4b:9171] type 00 class 0x010601
[ 7.475840] pci 0001:01:00.0: reg 0x10: [io 0x8000-0x8007]
[ 7.475901] pci 0001:01:00.0: reg 0x14: [io 0x8040-0x8043]
[ 7.475962] pci 0001:01:00.0: reg 0x18: [io 0x8100-0x8107]
[ 7.476040] pci 0001:01:00.0: reg 0x1c: [io 0x8140-0x8143]
[ 7.476101] pci 0001:01:00.0: reg 0x20: [io 0x800000-0x80000f]
[ 7.476179] pci 0001:01:00.0: reg 0x24: [mem 0x00900000-0x009001ff]
[ 7.476240] pci 0001:01:00.0: reg 0x30: [mem 0xd0000000-0xd000ffff pref]
[ 7.476570] pci 0001:01:00.0: PME# supported from D3hot
[ 7.486419] pci 0001:00:00.0: BAR 14: assigned [mem 0x30200000-0x302fffff]
[ 7.486563] pci 0001:00:00.0: BAR 13: assigned [io 0x100000-0x100fff]
[ 7.486691] pci 0001:01:00.0: BAR 6: assigned [mem 0x30200000-0x3020ffff pref]
[ 7.486840] pci 0001:01:00.0: BAR 5: assigned [mem 0x30210000-0x302101ff]
[ 7.487012] pci 0001:01:00.0: BAR 4: assigned [io 0x100000-0x10000f]
[ 7.487206] pci 0001:01:00.0: BAR 0: assigned [io 0x100010-0x100017]
[ 7.487408] pci 0001:01:00.0: BAR 2: assigned [io 0x100018-0x10001f]
[ 7.487591] pci 0001:01:00.0: BAR 1: assigned [io 0x100020-0x100023]
[ 7.488474] pci 0001:01:00.0: BAR 3: assigned [io 0x100024-0x100027]
[ 7.494886] pci 0001:00:00.0: PCI bridge to [bus 01-ff]
[ 7.499994] pci 0001:00:00.0: bridge window [io 0x100000-0x100fff]
[ 7.506467] pci 0001:00:00.0: bridge window [mem 0x30200000-0x302fffff]
[ 7.513141] pci 0001:00:00.0: Max Payload Size set to 256/ 256 (was 256), Max Read Rq 512
[ 7.522000] pci 0001:01:00.0: Max Payload Size set to 256/ 512 (was 128), Max Read Rq 512
[ 7.530737] pcieport 0001:00:00.0: Signaling PME through PCIe PME interrupt
[ 7.537346] pci 0001:01:00.0: Signaling PME through PCIe PME interrupt
[ 7.543838] pcie_pme 0001:00:00.0:pcie001: service driver pcie_pme loaded
[ 7.543968] aer 0001:00:00.0:pcie002: service driver aer loaded
[ 7.570577] tegra-pcie-dw 14140000.pcie: Setting init speed to max speed
[ 7.578054] OF: PCI: host bridge /pcie@14140000 ranges:
[ 7.582358] OF: PCI: IO 0x34100000..0x341fffff -> 0x34100000
[ 7.588199] OF: PCI: MEM 0x34200000..0x35ffffff -> 0x34200000
[ 7.594022] OF: PCI: MEM 0x1280000000..0x12bfffffff -> 0x1280000000
[ 8.114591] tegra-pcie-dw 14140000.pcie: link is down
[ 8.114956] tegra-pcie-dw 14140000.pcie: PCI host bridge to bus 0003:00
[ 8.115098] pci_bus 0003:00: root bus resource [bus 00-ff]
[ 8.115195] pci_bus 0003:00: root bus resource [io 0x200000-0x2fffff] (bus address [0x34100000-0x341fffff])
[ 8.115379] pci_bus 0003:00: root bus resource [mem 0x34200000-0x35ffffff]
[ 8.115512] pci_bus 0003:00: root bus resource [mem 0x1280000000-0x12bfffffff pref]
[ 8.115683] pci 0003:00:00.0: [10de:1ad2] type 01 class 0x060400
[ 8.115833] pci 0003:00:00.0: PME# supported from D0 D3hot D3cold
[ 8.116527] pci 0003:00:00.0: PCI bridge to [bus 01-ff]
[ 8.116639] pci 0003:00:00.0: Max Payload Size set to 256/ 256 (was 256), Max Read Rq 512
[ 8.117072] pcieport 0003:00:00.0: Signaling PME through PCIe PME interrupt
[ 8.117196] pcie_pme 0003:00:00.0:pcie001: service driver pcie_pme loaded
[ 8.117305] aer 0003:00:00.0:pcie002: service driver aer loaded
[ 8.117453] pcie_pme 0003:00:00.0:pcie001: unloading service driver pcie_pme
[ 8.117497] aer 0003:00:00.0:pcie002: unloading service driver aer
[ 8.117571] pci_bus 0003:01: busn_res: [bus 01-ff] is released
[ 8.117839] pci_bus 0003:00: busn_res: [bus 00-ff] is released
[ 8.118081] tegra-pcie-dw 14140000.pcie: PCIe link is not up...!
[ 8.118727] tegra-pcie-dw 141a0000.pcie: Setting init speed to max speed
[ 8.119950] OF: PCI: host bridge /pcie@141a0000 ranges:
[ 8.120095] OF: PCI: IO 0x3a100000..0x3a1fffff -> 0x3a100000
[ 8.120978] OF: PCI: MEM 0x3a200000..0x3bffffff -> 0x3a200000
[ 8.126887] OF: PCI: MEM 0x1c00000000..0x1fffffffff -> 0x1c00000000
[ 8.646535] tegra-pcie-dw 141a0000.pcie: link is down
[ 8.646895] tegra-pcie-dw 141a0000.pcie: PCI host bridge to bus 0005:00
[ 8.647040] pci_bus 0005:00: root bus resource [bus 00-ff]
[ 8.647159] pci_bus 0005:00: root bus resource [io 0x300000-0x3fffff] (bus address [0x3a100000-0x3a1fffff])
[ 8.647324] pci_bus 0005:00: root bus resource [mem 0x3a200000-0x3bffffff]
[ 8.647456] pci_bus 0005:00: root bus resource [mem 0x1c00000000-0x1fffffffff pref]
[ 8.647809] pci 0005:00:00.0: [10de:1ad0] type 01 class 0x060400
[ 8.647975] pci 0005:00:00.0: PME# supported from D0 D3hot D3cold
[ 8.648664] pci 0005:00:00.0: PCI bridge to [bus 01-ff]
[ 8.648773] pci 0005:00:00.0: Max Payload Size set to 256/ 256 (was 256), Max Read Rq 512
[ 8.649202] pcieport 0005:00:00.0: Signaling PME through PCIe PME interrupt
[ 8.649331] pcie_pme 0005:00:00.0:pcie001: service driver pcie_pme loaded
[ 8.649434] aer 0005:00:00.0:pcie002: service driver aer loaded
[ 8.649572] pcie_pme 0005:00:00.0:pcie001: unloading service driver pcie_pme
[ 8.649610] aer 0005:00:00.0:pcie002: unloading service driver aer
[ 8.649711] pci_bus 0005:01: busn_res: [bus 01-ff] is released
[ 8.649934] pci_bus 0005:00: busn_res: [bus 00-ff] is released
[ 8.650138] tegra-pcie-dw 141a0000.pcie: PCIe link is not up...!
uisee@uisee-xavier-01:~$
Thanks