What else should I check?
Hi, if Jetson Orin is RP, no external clock source is neccessary.
I’m connecting two boards of the same type to operate them as EP/RP.
In this case, shouldn’t an external clock be applied to RP?
When I added “pci=noaer” to the kernel command line,
RP booted normally without any errors.
When I ran the lspci command, the device was recognized as follows.
root@eip:/home/eip# lspci
0000:00:00.0 PCI bridge: NVIDIA Corporation Device 229c (rev a1)
0000:01:00.0 Unassigned class [ff00]: Qualcomm Device 0306
0001:00:00.0 PCI bridge: NVIDIA Corporation Device 229e (rev a1)
0001:01:00.0 Ethernet controller: Marvell Technology Group Ltd. Device 2b43 (rev 03)
0001:01:00.1 Ethernet controller: Marvell Technology Group Ltd. Device 2b44 (rev 03)
0001:01:00.2 Bluetooth: Marvell Technology Group Ltd. Device 2b45 (rev 03)
0007:00:00.0 PCI bridge: NVIDIA Corporation Device 229a (rev a1)
0007:01:00.0 RAM memory: NVIDIA Corporation Device 229a
However, when I try to transfer using the command below on RP, the transfer does not seem to be completed.
echo 16777216 > /sys/kernel/debug/0007:01:00.0_pcie_dma_test/dma_size
echo 4 > /sys/kernel/debug/0007:01:00.0_pcie_dma_test/nents
echo 1000 > /sys/kernel/debug/0007:01:00.0_pcie_dma_test/stress_count
echo 0x11 > /sys/kernel/debug/0007:01:00.0_pcie_dma_test/edma_ch
cat /sys/kernel/debug/0007:01:00.0_pcie_dma_test/edmalib_test
[ 45.935322] pcie_dma_host 0007:01:00.0: edmalib_common_test: re-init edma lib prev_ch(0) != current chans(11)
[ 45.936101] tegra194-pcie 141e0000.pcie: tegra_pcie_edma_initialize: success
[ 46.164972] pcie_dma_host 0007:01:00.0: edmalib_common_test: EDMA LIB WR started for 1 chans, size 16777216 Bytes, iterations: 1000 of descriptors 4
[ 46.166907] pcie_dma_host 0007:01:00.0: edmalib_common_test: EDMA LIB submit done
What part should I check?
Your previous EP side log has LTSSM error log.
Is it still there or not?
There’s No LTSSM error log on EP
root@eip:/home/eip# [ 4875.789538] tegra194-pcie 141e0000.pcie-ep: iATU unroll: enabled
[ 4875.789551] tegra194-pcie 141e0000.pcie-ep: Detected iATU regions: 8 outbound, 2 inbound
[ 4875.789807] pcie_dma_epf tegra_pcie_dma_epf.0: BAR0 phy_addr: f0000000 size: 10000000
But if you don’t use “noaer” in RP side, then you still have it?
If I don’t use noaer on the RP side, an error like the one below will occur during booting.
…
[ 15.363244] pci 0007:00:00.0: ASPM: Could not configure common clock
[ 15.874781] pci 0007:01:00.0: BAR 2: error updating (high 0x000030 != 0xffffffff)
[ 16.032219] pci 0007:01:00.0: BAR 4: error updating (0x40000004 != 0x000000)
[ 16.163587] pcieport 0007:00:00.0: PCIe Bus Error: severity=Corrected, type=Physical Layer, (Transmitter ID)
[ 16.163592] pcieport 0007:00:00.0: device [10de:229a] error status/mask=00003001/0000e000
[ 16.163595] pcieport 0007:00:00.0: [ 0] RxErr (First)
[ 16.163598] pcieport 0007:00:00.0: [12] Timeout
[ 16.163615] pcieport 0007:00:00.0: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, (Requester ID)
[ 16.163618] pcieport 0007:00:00.0: device [10de:229a] error status/mask=00004000/00400000
[ 16.163621] pcieport 0007:00:00.0: [14] CmpltTO (First)
[ 17.644335] pcieport 0007:00:00.0: PCIe Bus Error: severity=Corrected, type=Physical Layer, (Transmitter ID)
[ 17.644341] pcieport 0007:00:00.0: device [10de:229a] error status/mask=00003041/0000e000
[ 17.644344] pcieport 0007:00:00.0: [ 0] RxErr
[ 17.644346] pcieport 0007:00:00.0: [ 6] BadTLP
[ 17.644348] pcieport 0007:00:00.0: [12] Timeout
[ 17.644367] pcieport 0007:00:00.0: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, (Requester ID)
[ 17.644369] pcieport 0007:00:00.0: device [10de:229a] error status/mask=00004000/00400000
[ 17.644372] pcieport 0007:00:00.0: [14] CmpltTO (First)
[ 17.753806] pcieport 0007:00:00.0: PCIe Bus Error: severity=Corrected, type=Physical Layer, (Transmitter ID)
[ 17.753808] pcieport 0007:00:00.0: device [10de:229a] error status/mask=00003041/0000e000
[ 17.753810] pcieport 0007:00:00.0: [ 0] RxErr
[ 17.753811] pcieport 0007:00:00.0: [ 6] BadTLP
[ 17.753813] pcieport 0007:00:00.0: [12] Timeout
[ 17.906649] pcieport 0007:00:00.0: PCIe Bus Error: severity=Corrected, type=Physical Layer, (Transmitter ID)
[ 17.906653] pcieport 0007:00:00.0: device [10de:229a] error status/mask=00003101/0000e000
[ 17.906655] pcieport 0007:00:00.0: [ 0] RxErr
[ 17.906656] pcieport 0007:00:00.0: [ 8] Rollover
[ 17.906657] pcieport 0007:00:00.0: [12] Timeout
[ 17.917581] pcie_dma_host 0007:01:00.0: PCIe Bus Error: severity=Corrected, type=Physical Layer, (Transmitter ID)
[ 17.917583] pcie_dma_host 0007:01:00.0: device [10de:229a] error status/mask=00001041/0000e000
[ 17.917593] pcie_dma_host 0007:01:00.0: [ 0] RxErr
[ 17.917594] pcie_dma_host 0007:01:00.0: [ 6] BadTLP
[ 17.917600] pcie_dma_host 0007:01:00.0: [12] Timeout
[ 17.962940] pcieport 0007:00:00.0: PCIe Bus Error: severity=Corrected, type=Physical Layer, (Transmitter ID)
[ 17.962942] pcieport 0007:00:00.0: device [10de:229a] error status/mask=00001041/0000e000
[ 17.962943] pcieport 0007:00:00.0: [ 0] RxErr
[ 17.962945] pcieport 0007:00:00.0: [ 6] BadTLP
[ 17.962946] pcieport 0007:00:00.0: [12] Timeout
[ 17.967227] pcie_dma_host 0007:01:00.0: PCIe Bus Error: severity=Corrected, type=Physical Layer, (Receiver ID)
[ 17.967229] pcie_dma_host 0007:01:00.0: device [10de:229a] error status/mask=00000001/0000e000
[ 17.967231] pcie_dma_host 0007:01:00.0: [ 0] RxErr
[ 18.054235] pcieport 0007:00:00.0: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, (Requester ID)
[ 18.054237] pcieport 0007:00:00.0: device [10de:229a] error status/mask=00004000/00400000
[ 18.054238] pcieport 0007:00:00.0: [14] CmpltTO (First)
[ 18.139815] pcieport 0007:00:00.0: PCIe Bus Error: severity=Corrected, type=Physical Layer, (Transmitter ID)
[ 18.139823] pcieport 0007:00:00.0: device [10de:229a] error status/mask=00003001/0000e000
[ 18.139830] pcieport 0007:00:00.0: [ 0] RxErr
[ 18.139837] pcieport 0007:00:00.0: [12] Timeout
[ 18.139872] pcieport 0007:00:00.0: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, (Requester ID)
[ 18.139874] pcieport 0007:00:00.0: device [10de:229a] error status/mask=00004000/00400000
[ 18.139875] pcieport 0007:00:00.0: [14] CmpltTO (First)
[ 18.161963] pcieport 0007:00:00.0: PCIe Bus Error: severity=Corrected, type=Physical Layer, (Transmitter ID)
[ 18.161964] pcieport 0007:00:00.0: device [10de:229a] error status/mask=00003001/0000e000
[ 18.161966] pcieport 0007:00:00.0: [ 0] RxErr
[ 18.161967] pcieport 0007:00:00.0: [12] Timeout
[ 18.273540] pcie_dma_host 0007:01:00.0: PCIe Bus Error: severity=Corrected, type=Physical Layer, (Transmitter ID)
[ 18.273543] pcie_dma_host 0007:01:00.0: device [10de:229a] error status/mask=ffffffff/00000041
[ 18.273552] pcie_dma_host 0007:01:00.0: [ 1] Unknown Error Bit
[ 18.273553] pcie_dma_host 0007:01:00.0: [ 2] Unknown Error Bit
[ 18.273554] pcie_dma_host 0007:01:00.0: [ 3] Unknown Error Bit
[ 18.273555] pcie_dma_host 0007:01:00.0: [ 4] Unknown Error Bit
[ 18.273558] pcie_dma_host 0007:01:00.0: [ 5] Unknown Error Bit
[ 18.273560] pcie_dma_host 0007:01:00.0: [ 7] BadDLLP
[ 18.273566] pcie_dma_host 0007:01:00.0: [ 8] Rollover
[ 18.273567] pcie_dma_host 0007:01:00.0: [ 9] Unknown Error Bit
[ 18.273568] pcie_dma_host 0007:01:00.0: [10] Unknown Error Bit
[ 18.273570] pcie_dma_host 0007:01:00.0: [11] Unknown Error Bit
[ 18.273571] pcie_dma_host 0007:01:00.0: [12] Timeout
[ 18.273572] pcie_dma_host 0007:01:00.0: [13] NonFatalErr
[ 18.273586] pcie_dma_host 0007:01:00.0: [14] CorrIntErr (First)
[ 18.273587] pcie_dma_host 0007:01:00.0: [15] HeaderOF
[ 18.273588] pcie_dma_host 0007:01:00.0: [16] Unknown Error Bit
[ 18.273589] pcie_dma_host 0007:01:00.0: [17] Unknown Error Bit
[ 18.273590] pcie_dma_host 0007:01:00.0: [18] Unknown Error Bit
[ 18.273596] pcie_dma_host 0007:01:00.0: [19] Unknown Error Bit
[ 18.273598] pcie_dma_host 0007:01:00.0: [20] Unknown Error Bit
[ 18.273599] pcie_dma_host 0007:01:00.0: [21] Unknown Error Bit
[ 18.273600] pcie_dma_host 0007:01:00.0: [22] Unknown Error Bit
[ 18.273601] pcie_dma_host 0007:01:00.0: [23] Unknown Error Bit
[ 18.273602] pcie_dma_host 0007:01:00.0: [24] Unknown Error Bit
[ 18.273603] pcie_dma_host 0007:01:00.0: [25] Unknown Error Bit
[ 18.273604] pcie_dma_host 0007:01:00.0: [26] Unknown Error Bit
[ 18.273605] pcie_dma_host 0007:01:00.0: [27] Unknown Error Bit
[ 18.273606] pcie_dma_host 0007:01:00.0: [28] Unknown Error Bit
[ 18.273620] pcie_dma_host 0007:01:00.0: [29] Unknown Error Bit
[ 18.273621] pcie_dma_host 0007:01:00.0: [30] Unknown Error Bit
[ 18.273628] pcie_dma_host 0007:01:00.0: [31] Unknown Error Bit
[ 18.395404] pcieport 0007:00:00.0: PCIe Bus Error: severity=Corrected, type=Physical Layer, (Transmitter ID)
[ 18.395411] pcieport 0007:00:00.0: device [10de:229a] error status/mask=00003041/0000e000
[ 18.395413] pcieport 0007:00:00.0: [ 0] RxErr
[ 18.395414] pcieport 0007:00:00.0: [ 6] BadTLP
[ 18.395415] pcieport 0007:00:00.0: [12] Timeout
[ 18.421321] pcie_dma_host 0007:01:00.0: PCIe Bus Error: severity=Corrected, type=Physical Layer, (Transmitter ID)
[ 18.421330] pcie_dma_host 0007:01:00.0: device [10de:229a] error status/mask=00001001/0000e000
[ 18.421348] pcie_dma_host 0007:01:00.0: [ 0] RxErr
[ 18.421349] pcie_dma_host 0007:01:00.0: [12] Timeout
[ 18.494980] pcieport 0007:00:00.0: PCIe Bus Error: severity=Corrected, type=Physical Layer, (Transmitter ID)
[ 18.494983] pcieport 0007:00:00.0: device [10de:229a] error status/mask=00001001/0000e000
[ 18.494994] pcieport 0007:00:00.0: [ 0] RxErr
[ 18.494996] pcieport 0007:00:00.0: [12] Timeout
[ 18.497145] pcie_dma_host 0007:01:00.0: PCIe Bus Error: severity=Corrected, type=Physical Layer, (Receiver ID)
[ 18.497153] pcie_dma_host 0007:01:00.0: device [10de:229a] error status/mask=00000001/0000e000
[ 18.497159] pcie_dma_host 0007:01:00.0: [ 0] RxErr
[ 18.595256] pcieport 0007:00:00.0: PCIe Bus Error: severity=Corrected, type=Physical Layer, (Transmitter ID)
[ 18.595258] pcieport 0007:00:00.0: device [10de:229a] error status/mask=00003041/0000e000
[ 18.595260] pcieport 0007:00:00.0: [ 0] RxErr
[ 18.595261] pcieport 0007:00:00.0: [ 6] BadTLP
[ 18.595262] pcieport 0007:00:00.0: [12] Timeout
[ 18.625395] pcie_dma_host 0007:01:00.0: PCIe Bus Error: severity=Corrected, type=Physical Layer, (Receiver ID)
[ 18.625397] pcie_dma_host 0007:01:00.0: device [10de:229a] error status/mask=00000041/0000e000
[ 18.625405] pcie_dma_host 0007:01:00.0: [ 0] RxErr
[ 18.625406] pcie_dma_host 0007:01:00.0: [ 6] BadTLP
[ 18.718753] pcieport 0007:00:00.0: PCIe Bus Error: severity=Corrected, type=Physical Layer, (Transmitter ID)
[ 18.718754] pcieport 0007:00:00.0: device [10de:229a] error status/mask=00001001/0000e000
[ 18.718756] pcieport 0007:00:00.0: [ 0] RxErr
[ 18.718757] pcieport 0007:00:00.0: [12] Timeout
[ 18.734337] pcieport 0007:00:00.0: PCIe Bus Error: severity=Corrected, type=Physical Layer, (Receiver ID)
[ 18.734339] pcieport 0007:00:00.0: device [10de:229a] error status/mask=00002001/0000e000
[ 18.734340] pcieport 0007:00:00.0: [ 0] RxErr
…
This one should be fixed first. Our PCIe RP will use internal clk. You should not use external one for it.
Are you saying to remove the external clock on RP?
I removed external clock on RP, but there’s same error(“PCIe Bus Error: severity=Corrected, type=Physical Layer, (Transmitter ID)”)
What is your software configuration on RP side?
SW configuration is the same as EP/RP except for ODMDATA
*RP setting ODMDATA="gbe-uphy-config-0,hsstp-lane-map-3,hsio-uphy-config-16,nvhs-uphy-config-0 ”;
*EP setting ODMDATA=“gbe-uphy-config-1,hsstp-lane-map-3,hsio-uphy-config-16,nvhs-uphy-config-0”;
I mean more than these things… Default software does not enable C7 either…
Did you change anything else or you don’t know what I am talking about?
I added below things.
tegra234-p3737-0000+p3701-0000.dts
pcie@141e0000 {
status = “okay”;vddio-pex-ctl-supply = <&vdd_1v8_ls>; vpcie3v3-supply = <&vdd_3v3_pcie>; vpcie12v-supply = <&vdd_12v_pcie>; phys = <&p2u_gbe_0>, <&p2u_gbe_1>, <&p2u_gbe_2>, <&p2u_gbe_3>, <&p2u_gbe_4>, <&p2u_gbe_5>, <&p2u_gbe_6>, <&p2u_gbe_7>; phy-names = "p2u-0", "p2u-1", "p2u-2", "p2u-3", "p2u-4", "p2u-5", "p2u-6", "p2u-7"; };
*tegra234-p3737-0000+p3701-0000-dynamic.dts
/* PCIe C7 endpoint */
fragment-t234-p3737-0000-p3701-0000-pcie-c7-ep@0 {
target-path = "/bus@0";
board_config {
odm-data = "gbe-uphy-config-1";
};
__overlay__ {
pcie@141e0000 {
status = "disabled";
};
pcie-ep@141e0000 {
status = "okay";
};
};
};
Did you change the pinmux?
May I check the pinmux dtsi file directly?
Here’s my pinmux settings.
tegra234-mb1-bct-gpio-p3701-0000-a04.dtsi.txt (4.3 KB)
tegra234-mb1-bct-pinmux-p3701-0000-a04.dtsi.txt (63.5 KB)
