Jetson AGX Xavier, R3521.
When enable PCIe Controller C3, we meet some problem.Logs are as follow:
[ 6.060573] tegra194-pcie 14140000.pcie: Adding to iommu group 9
[ 6.150906] CPU:0, Error: cbb-noc@2300000, irq=15
[ 6.151130] **************************************
[ 6.151301] CPU:0, Error:cbb-noc
[ 6.151389] Error Logger : 0
[ 6.151478] ErrLog0 : 0x80030000
[ 6.151597] Transaction Type : RD - Read, Incrementing
[ 6.151728] Error Code : SLV
[ 6.151853] Error Source : Target
[ 6.151947] Error Description : Target error detected by CBB slave
[ 6.152103] AXI2APB_2 bridge error: SFIFONE - Status FIFO Not Empty interrupt
[ 6.152311] AXI2APB_2 bridge error: TIM - Timer(Timeout) interrupt
[ 6.152471] Packet header Lock : 0
[ 6.152557] Packet header Len1 : 3
[ 6.152645] NOC protocol version : version >= 2.7
[ 6.152763] ErrLog1 : 0x32002c
[ 6.152898] ErrLog2 : 0x0
[ 6.152971] RouteId : 0x32002c
[ 6.153054] InitFlow : ccroc_p2ps/I/ccroc_p2ps
[ 6.153170] Targflow : axis_satellite_grout/T/axis_satellite_grout
[ 6.153330] TargSubRange : 0
[ 6.153426] SeqId : 0
[ 6.155470] ErrLog3 : 0x3e20078
[ 6.158962] ErrLog4 : 0x0
[ 6.161597] Address accessed : 0x3e20078
[ 6.166054] ErrLog5 : 0xb09f851
[ 6.169118] Non-Modify : 0x1
[ 6.172791] AXI ID : 0x16
[ 6.175765] Master ID : CCPLEX
[ 6.179174] Security Group(GRPSEC): 0x7e
[ 6.183289] Cache : 0x1 -- Bufferable
[ 6.187234] Protection : 0x2 -- Unprivileged, Non-Secure, Data Access
[ 6.194317] FALCONSEC : 0x0
[ 6.197210] Virtual Queuing Channel(VQC): 0x0
[ 6.201849] **************************************
[ 6.206942] ------------[ cut here ]------------
[ 6.211385] kernel BUG at drivers/soc/tegra/cbb/tegra194-cbb.c:2057!
[ 6.218259] Internal error: Oops - BUG: 0 [#1] PREEMPT SMP
[ 6.223117] Modules linked in:
[ 6.226538] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 5.10.104-tegra #1
[ 6.233340] Hardware name: Unknown Jetson-AGX/Jetson-AGX, BIOS 2.1-32413640 01/24/2023
[ 6.241070] pstate: 60400089 (nZCv daIf +PAN -UAO -TCO BTYPE=--)
[ 6.247206] pc : tegra194_cbb_err_isr+0x19c/0x1b0
[ 6.251638] lr : tegra194_cbb_err_isr+0x11c/0x1b0
[ 6.256360] sp : ffff800010003b40
[ 6.260031] x29: ffff800010003b40 x28: 0000000000000001
[ 6.265283] x27: 0000000000000080 x26: ffffcc0f42e4c138
[ 6.270722] x25: ffffcc0f437def60 x24: 0000000000000001
[ 6.276133] x23: ffffcc0f43166000 x22: ffffcc0f435ff030
[ 6.281812] x21: 000000000000000f x20: 0000000000000005
[ 6.287164] x19: ffffcc0f435ff020 x18: 0000000000000010
[ 6.292416] x17: ffffcc0f4370b9cc x16: 000000007047e8a5
[ 6.298100] x15: ffff4de00013dc70 x14: 0720072007200720
[ 6.303432] x13: 0720072007200720 x12: 0720072007200720
[ 6.308510] x11: 0720072007200720 x10: 0720072007200720
[ 6.314294] x9 : 0720072007200720 x8 : 07200720072a072a
[ 6.319534] x7 : 072a072a072a072a x6 : c0000000ffffefff
[ 6.325046] x5 : 0000000000057fa8 x4 : ffffcc0f43487968
[ 6.330484] x3 : 00000000ffffffff x2 : ffffcc0f4179e170
[ 6.335810] x1 : ffff4de00013d700 x0 : 0000000100010100
[ 6.341411] Call trace:
[ 6.343884] tegra194_cbb_err_isr+0x19c/0x1b0
[ 6.348162] __handle_irq_event_percpu+0x68/0x2a0
[ 6.352630] handle_irq_event_percpu+0x40/0xa0
[ 6.356898] handle_irq_event+0x50/0xf0
[ 6.360918] handle_fasteoi_irq+0xc0/0x170
[ 6.364940] generic_handle_irq+0x40/0x60
[ 6.368977] __handle_domain_irq+0x70/0xd0
[ 6.373174] efi_header_end+0xb0/0xf0
[ 6.376411] el1_irq+0xd0/0x180
[ 6.379392] __do_softirq+0xb4/0x3e8
[ 6.383073] irq_exit+0xc0/0xe0
[ 6.386036] __handle_domain_irq+0x74/0xd0
[ 6.390061] efi_header_end+0xb0/0xf0
[ 6.393734] el1_irq+0xd0/0x180
[ 6.396983] tegra_p2u_power_on+0x34/0x150
[ 6.400993] phy_power_on+0x98/0x110
[ 6.404689] tegra_pcie_enable_phy+0x68/0xf0
[ 6.408783] tegra_pcie_config_controller+0x138/0x450
[ 6.413938] tegra_pcie_config_rp+0x4c/0x250
[ 6.418149] tegra_pcie_dw_probe+0xae8/0x1150
[ 6.422894] platform_drv_probe+0x5c/0xb0
[ 6.426979] really_probe+0xf8/0x3d0
[ 6.430312] driver_probe_device+0x60/0xc0
[ 6.434337] device_driver_attach+0x78/0x80
[ 6.438709] __driver_attach+0x68/0xf0
[ 6.442392] bus_for_each_dev+0x84/0xe0
[ 6.446576] driver_attach+0x34/0x40
[ 6.449909] bus_add_driver+0x150/0x1f0
[ 6.453848] driver_register+0x68/0x120
[ 6.457714] __platform_driver_register+0x64/0x70
[ 6.462701] tegra_pcie_rp_init+0x24/0x2c
[ 6.466794] do_one_initcall+0x50/0x2f0
[ 6.470659] kernel_init_freeable+0x254/0x2d4
[ 6.474694] kernel_init+0x1c/0x118
[ 6.478354] ret_from_fork+0x10/0x24
[ 6.481866] Code: a9446bf9 a94573fb a8c67bfd d65f03c0 (d4210000)
[ 6.488014] ---[ end trace 42211aa9325362e0 ]---
[ 6.492696] Kernel panic - not syncing: Oops - BUG: Fatal exception in interrupt
[ 6.500132] SMP: stopping secondary CPUs
[ 6.503951] Kernel Offset: 0x4c0f315e0000 from 0xffff800010000000
[ 6.510187] PHYS_OFFSET: 0xffffb22100000000
[ 6.514306] CPU features: 0x8240002,03802a30
[ 6.518679] Memory Limit: none
[ 6.521760] ---[ end Kernel panic - not syncing: Oops - BUG: Fatal exception in interrupt ]---
The dts for C3:
pcie@14140000 {
status = "okay";
num-lanes = <1>;
// nvidia,max-speed = <1>;
// max-link-speed = <1>;
nvidia,disable-power-down;
/delete-property/ nvidia,pex-wake;
/delete-property/ nvidia,enable-power-down;
#if TEGRA_PCIE_VERSION >= DT_VERSION_2
phys = <&p2u_hsio_1>;
phy-names = "p2u-0";
#else
phys = <&p2u_1>;
phy-names = "pcie-p2u-0";
#endif
};
When we comment out the C3 node, the system can boot normally.
What might be the cause of this phenomenon?