L4T 35.1 Orin AGX kernel panic tegra_qspi_isr_thread

L4T 35.1 Orin AGX target.
Kernel built using tegra_defcong for 5.10.104 kernel, no changes. Simple recompiled from source to set a going forward benchmark for product development.
No changes to Orin p3737 device tree.
Flashed emmc using flash.sh
Kernel panic in tegra_qspi_isr_thread
Unsure how to reproduce this kernel panic.

[   14.492152] EXT4-fs (mmcblk0p1): re-mounted. Opts: (null)
[   14.498781] systemd[1]: Starting udev Coldplug all Devices...
[   14.506270] systemd[1]: Started Journal Service.
[   14.538476] systemd-journald[314]: Received client request to flush runtime j
ournal.
[   14.550743] systemd-journald[314]: File /var/log/journal/6b0b968df0625e0ab6c0
2ed46345ab72/system.journal corrupted or uncleanly shut down, renaming and replacing.
[   14.877185] using random self ethernet address
[   14.881886] using random host ethernet address
[   17.027911] tegra23x-qspi 3270000.spi: QSPI get spurious interrupt, Status = 
0x00400005
[   17.036286] Unable to handle kernel NULL pointer dereference at virtual address 0000000000000010
[   17.045378] Mem abort info:
[   17.048246]   ESR = 0x96000004
[   17.051393]   EC = 0x25: DABT (current EL), IL = 32 bits
[   17.056855]   SET = 0, FnV = 0
[   17.060001]   EA = 0, S1PTW = 0
[   17.063222] Data abort info:
[   17.066178]   ISV = 0, ISS = 0x00000004
[   17.070121]   CM = 0, WnR = 0
[   17.073181] user pgtable: 4k pages, 48-bit VAs, pgdp=000000010b354000
[   17.079803] [0000000000000010] pgd=0000000000000000, p4d=0000000000000000
[   17.086800] Internal error: Oops: 96000004 [#1] PREEMPT SMP
[   17.092531] Modules linked in:
[   17.095681] CPU: 0 PID: 197 Comm: irq/72-3270000. Not tainted 5.10.104.0-FLIR
 #1
[   17.103304] Hardware name:  /, BIOS 1.0-d7fb19b 08/10/2022
[   17.108939] pstate: 40c00089 (nZcv daIf +PAN +UAO -TCO BTYPE=--)
[   17.115132] pc : tegra_qspi_isr_thread+0x15c/0x330
[   17.120054] lr : tegra_qspi_isr_thread+0x12c/0x330
[   17.124986] sp : ffff80001276bd30
[   17.128387] x29: ffff80001276bd30 x28: ffff1321c6675700 
[   17.133847] x27: ffff1321c6675700 x26: ffffc686b5d1f480 
[   17.139314] x25: 0000000000000001 x24: ffffc686b5d1f558 
[   17.144773] x23: 0000000000000000 x22: ffff1321c6964690 
[   17.150234] x21: 0000000000000000 x20: 0000000000000000 
[   17.155697] x19: ffff1321c6964680 x18: 0000000000000000 
[   17.161158] x17: 0000000000000000 x16: 0000000000000000 
[   17.166619] x15: 000000000000014a x14: 0000000000000a98 
[   17.172080] x13: 0000000000000a98 x12: 0000000000000018 
[   17.177541] x11: ffff1328ec4c0f40 x10: 0000000000000a80 
[   17.183002] x9 : ffff80001276bce0 x8 : ffff1321c66761e0 
[   17.188466] x7 : 0000000000000020 x6 : 0000000000000000 
[   17.193928] x5 : 00000000410fd420 x4 : 0000000000f0000f 
[   17.199390] x3 : 0000000000000000 x2 : 0000000000000001 
[   17.204853] x1 : 0000000000000000 x0 : 0000000000000000 
[   17.210319] Call trace:
[   17.212830]  tegra_qspi_isr_thread+0x15c/0x330
[   17.217402]  irq_thread_fn+0x34/0xa0
[   17.221080]  irq_thread+0x158/0x250
[   17.224673]  kthread+0x148/0x168
[   17.227999]  ret_from_fork+0x10/0x1c
[   17.231681] Code: b9407660 f240003f 1a941000 b9005a60 (b94012a2) 
[   17.237963] ---[ end trace 4c40a45366b8047c ]---
[   17.242717] Kernel panic - not syncing: Oops: Fatal exception
[   17.248621] SMP: stopping secondary CPUs
[   17.252659] Kernel Offset: 0x4686a5c10000 from 0xffff800010000000
[   17.258923] PHYS_OFFSET: 0xffffecdf40000000
[   17.263227] CPU features: 0x0040006,4a80aa38
[   17.267624] Memory Limit: none
[   17.270761] ---[ end Kernel panic - not syncing: Oops: Fatal exception ]---

Here is the entire console log prior to the kernel panic:
orin-tegra_qspi_isr_thread_kernel_panic_log.txt (60.4 KB)

Does this always happen or need to run some applications to trigger?

I’ve seen this kernel crash twice, both times on the last system reboot after running flash.sh. I haven’t found any means to reproduce it.

Again, kernel built from 5.10 as-shipped source using the tegra_defconfig – no local changes. Stock device tree.

I reviewed the relevant tegra_qspi_isr_thread source code and found nothing obvious.