Boot AGX Xavier

I am trying to bring up a custom board and I keep getting a Kernel oops!

Specifically this message before a stack/register dump:

kernel BUG at /dvs/git/dirty/git-master_linux/kernel/nvidia/drivers/platform/tegra/tegra_cbb.c:839!

I am using the standard image from the Jetson AGX on my custom board and have tried to build other images using my pinmux config (without success of flashing it). I do not have U501 present and am working on getting that resolved, however the design guide says that this is not needed.

I woul dlike a list of what all these panic modes are (eg please publish tegra_vbb.c) so that we can diagnose our own hardware.

What would be useful is a very basic ‘kernel’ image that has no peripherals and just uses UART as the terminal. This way we can see if the CPU and other system stuff is running.

Thanks,

Here is a snipped of the log if this helps. I’m at the stage of hardware bring up and I need to know the root cause of this kernel oops. Thanks.

[ 0.000000] Booting Linux on physical CPU 0x0
[ 0.000000] Linux version 4.9.253-tegra (buildbrain@mobile-u64-5497-d3000) (gcc version 7.3.1 20180425 [linaro-7.3-2018.05 revision d29120a424ecfbc167ef90065c0eeb7f91977701] (Linaro GCC 7.3-2018.05) ) #1 SMP PREEMPT Mon Jul 26 12:19:28 PDT 2021
[ 0.000000] Boot CPU: AArch64 Processor [4e0f0040]
[ 0.000000] OF: fdt:memory scan node memory, reg size 48,
[ 0.000000] OF: fdt: - 80000000 , 2c000000
[ 0.000000] OF: fdt: - ac200000 , 44800000
[ 0.000000] OF: fdt: - 100000000 , 780000000
[ 0.000000] earlycon: tegra_comb_uart0 at MMIO32 0x000000000c168000 (options ‘’)
[ 0.000000] bootconsole [tegra_comb_uart0] enabled
[ 0.000000] Found tegra_fbmem: 00800000@a06aa000
[ 0.000000] Found lut_mem: 00002008@a06a4000
[ 11.867534] tegra-i2c 31c0000.i2c: rx dma timeout txlen:28 rxlen:128
[ 11.867568] tegra-i2c 31c0000.i2c: — register dump for debugging ----
[ 11.867625] tegra-i2c 31c0000.i2c: I2C_CNFG - 0x22c00
[ 11.867647] tegra-i2c 31c0000.i2c: I2C_PACKET_TRANSFER_STATUS - 0x10001
[ 11.867691] tegra-i2c 31c0000.i2c: I2C_FIFO_CONTROL - 0x0
[ 11.867714] tegra-i2c 31c0000.i2c: I2C_FIFO_STATUS - 0x800080
[ 11.867736] tegra-i2c 31c0000.i2c: I2C_MST_FIFO_CONTROL - 0x70
[ 11.867782] tegra-i2c 31c0000.i2c: I2C_MST_FIFO_STATUS - 0x7c0000
[ 11.867805] tegra-i2c 31c0000.i2c: I2C_MST_PACKET_TRANSFER_CNT - 0x0
[ 11.867829] tegra-i2c 31c0000.i2c: I2C_INT_MASK - 0x6c
[ 11.867870] tegra-i2c 31c0000.i2c: I2C_INT_STATUS - 0x2
[ 11.867903] tegra-i2c 31c0000.i2c: i2c transfer timed out addr: 0x50
[ 11.977921] ucsi_ccg 1-0008: read version failed
[ 11.978045] ucsi_ccg 1-0008: get_fw_info fail, err=-121
[ 12.035769] ufs_tegra 2450000.ufshci: dme-link-startup: error code 1
[ 12.147751] ufs_tegra 2450000.ufshci: dme-link-startup: error code 1
[ 12.263733] ufs_tegra 2450000.ufshci: dme-link-startup: error code 1
[ 12.375568] ufs_tegra 2450000.ufshci: dme-link-startup: error code 1
[ 12.387587] ufs_tegra 2450000.ufshci: link startup failed 1
ÿâsafereg_poll_timer_cb: poll interval 127 above target 100
ÿá[ 12.564159] CPU:0, Error:CBB-NOC@0x2300000,irq=488
[ 12.728758] **************************************
[ 12.728841] * For more Internal Decode Help
[ 12.728911] * http://nv/cbberr
[ 12.728969] * NVIDIA userID is required to access
[ 12.729047] **************************************
[ 12.729128] CPU:0, Error:CBB-NOC
[ 12.729188] Error Logger : 0
[ 12.729246] ErrLog0 : 0x80030000
[ 12.729308] Transaction Type : RD - Read, Incrementing
[ 12.729398] Error Code : SLV
[ 12.729456] Error Source : Target
[ 12.729517] Error Description : Target error detected by CBB slave
ÿâsafÿá[ 12.810957] AXI2APB_1 bridge error: SFIFONE - Status FIFO Not Empty interrupt[ 12.811103] AXI2APB_1 bridge error: TIM - Timer(Timeout) interrupt
[ 12.811214] Packet header Lock : 0
[ 12.811276] Packet header Len1 : 3
[ 12.811342] NOC protocol version : version >= 2.7
[ 12.811425] ErrLog1 : 0x320022
[ 12.811484] ErrLog2 : 0x0
[ 12.811534] RouteId : 0x320022
[ 12.811594] InitFlow : ccroc_p2ps/I/ccroc_p2ps
[ 12.811676] Targflow : axis_satellite_grout/T/axis_satellite_grout
[ 12.811781] TargSubRange : 0
[ 12.811839] SeqId : 0
[ 12.811892] ErrLog3 : 0x2470088
[ 12.811949] ErrLog4 : 0x0
[ 12.812025] Address : 0x2470088 (unknown device)
[ 12.812107] ErrLog5 : 0x889f851
[ 12.812164] Non-Modify : 0x1
[ 12.812405] AXI ID : 0x11
[ 12.812648] Master ID : CCPLEX
[ 12.812897] Security Group(GRPSEC): 0x7e
[ 12.813233] Cache : 0x1 – Device
[ 12.813523] Protection : 0x2 – Unprivileged, Non-Secure, Data Access
[ 12.814065] FALCONSEC : 0x0
[ 12.815460] Virtual Queuing Channel(VQC): 0x0
[ 12.820098] **************************************
[ 12.825128] kernel BUG at /dvs/git/dirty/git-master_linux/kernel/nvidia/drivers/platform/tegra/tegra_cbb.c:839!
[ 12.835152] Internal error: Oops - BUG: 0 [#1] PREEMPT SMP
[ 12.840313] Modules linked in:
[ 12.843461] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 4.9.253-tegra #1
[ 12.849766] Hardware name: Jetson-AGX (DT)
[ 12.854224] task: ffffff8009e913c0 task.stack: ffffff8009e80000
[ 12.860092] PC is at tegra_cbb_error_isr+0x1a0/0x1a8
[ 12.864641] LR is at tegra_cbb_error_isr+0xc8/0x1a8
[ 12.869893] pc : [] lr : [] pstate: 604001c5
[ 12.877325] sp : ffffffc7ffc4de50
[ 12.880741] x29: ffffffc7ffc4de50 x28: 0000000000000005
[ 12.886421] x27: 00000000000001c0 x26: 0000000000000001
[ 12.891856] x25: ffffff800a1ef000 x24: ffffff8009836018
[ 12.897631] x23: ffffff8009516950 x22: 0000000000000001
[ 12.903572] x21: 00000000000001e8 x20: ffffff800a03b720
[ 12.909346] x19: ffffff800a03b720 x18: 0000000000000010
[ 12.915034] x17: 0000000000001400 x16: 0000000000000000
[ 12.920469] x15: ffffffffffffffff x14: ffffff808a16e5b7
[ 12.926244] x13: ffffff800a16e5c5 x12: 0000000000000000
[ 12.931930] x11: 0000000005f5e0ff x10: 00000000000002a6
[ 12.937872] x9 : 00000000ffffffd0 x8 : ffffff80083d6cf0
[ 12.943646] x7 : ffffff8009ed4468 x6 : 0000000000000000
[ 12.949160] x5 : 0000000000000000 x4 : 0000000000000000
[ 12.954497] x3 : ffffffffffffffff x2 : ffffff8009ea4220
[ 12.959835] x1 : ffffff8009e913c0 x0 : 0000000000010001
[ 12.964917]
[ 12.966573] Process swapper/0 (pid: 0, stack limit = 0xffffff8009e80000)
[ 12.972705] Call trace:
[ 12.975325] [] tegra_cbb_error_isr+0x1a0/0x1a8
[ 12.980926] [] __handle_irq_event_percpu+0x68/0x288
[ 12.987049] [] handle_irq_event_percpu+0x28/0x60
[ 12.992912] [] handle_irq_event+0x50/0x80
[ 12.998250] [] handle_fasteoi_irq+0xd4/0x1c0
[ 13.003592] [] generic_handle_irq+0x34/0x50
[ 13.008928] [] __handle_domain_irq+0x68/0xc0
[ 13.014355] [] gic_handle_irq+0x5c/0xb0
[ 13.019603] [] el1_irq+0xe8/0x194
[ 13.024156] [] cpuidle_enter_state+0xb8/0x380
[ 13.029666] [] cpuidle_enter+0x34/0x48
[ 13.035351] [] call_cpuidle+0x44/0x70
[ 13.040166] [] cpu_startup_entry+0x1b0/0x200
[ 13.046205] [] rest_init+0x84/0x90
[ 13.051364] [] start_kernel+0x374/0x38c
[ 13.056788] [] __primary_switched+0x80/0x94
[ 13.140077] —[ end trace 019645931a7cc854 ]—
[ 13.145422] Kernel panic - not syncing: Fatal exception in interrupt
[ 13.145565] SMP: stopping secondary CPUs
[ 13.222251] Kernel Offset: disabled
[ 13.222342] Memory Limit: none
[ 13.222399] trusty-log panic notifier - trusty version Built: 12:20:34 Jul 26 2021 [ 13.227813] Rebooting in 5 seconds…

I’m welsh too !
I’m going to move this post to a different category, the team there will be in a better position to help you.

Thanks. Diolch yn fawr !! (I don’t speak Welsh but grew up there).

Remove “quiet” in your /boot/extlinux/extlinux.conf and flash your board again to enable full logs.

And I think this is still related to hardware design. You may clarify what is added on your board in comparison with our developer kit.

Or you can just test this module on developer kit first to make sure it is working fine.

This is basically a cut down version of your carrier board. The module works fine in your carrier board. I am trying to get it to boot in our custom board and I can’t find out what it’s failing on. If I could find out what is causing a spurious interrupt or incorrect state I might be able to isolate the problem.

The only thing that has changed on out custom board is the PCIe interfaces. All other peripherals are removed. USB, HDMI, Etc removed. I have kept the M2/M interface and SD interface. Also none of these devices are populated: U513 is not present. U501 is now present and has a clone of the contents of your Carrier board. I still see the same error whether booting from EMMC or SD. I’m pretty sure it’s related to the hardware design but I don’t know what to look at since the error is cryptic! - I will try as you suggest. The module has power. I am looking at the UART3 debug terminal for the status. I see that I2C 0x50 times out and this is apparently internal to the module. I don’t understand why this is as I don’t have anything on that I2C bus. I have an EEPROM at 0x56 as per your original schematics.

Thanks. Log of SD boot up below.

[ 11.866193] tegra-i2c 31c0000.i2c: rx dma timeout txlen:28 rxlen:128
[ 11.866251] tegra-i2c 31c0000.i2c: — register dump for debugging ----
[ 11.866280] tegra-i2c 31c0000.i2c: I2C_CNFG - 0x22c00
[ 11.866302] tegra-i2c 31c0000.i2c: I2C_PACKET_TRANSFER_STATUS - 0x10001
[ 11.866348] tegra-i2c 31c0000.i2c: I2C_FIFO_CONTROL - 0x0
[ 11.866372] tegra-i2c 31c0000.i2c: I2C_FIFO_STATUS - 0x800080
[ 11.866394] tegra-i2c 31c0000.i2c: I2C_MST_FIFO_CONTROL - 0x70
[ 11.866436] tegra-i2c 31c0000.i2c: I2C_MST_FIFO_STATUS - 0x7c0000
[ 11.866458] tegra-i2c 31c0000.i2c: I2C_MST_PACKET_TRANSFER_CNT - 0x0
[ 11.866489] tegra-i2c 31c0000.i2c: I2C_INT_MASK - 0x6c
[ 11.866510] tegra-i2c 31c0000.i2c: I2C_INT_STATUS - 0x2
[ 11.866541] tegra-i2c 31c0000.i2c: i2c transfer timed out addr: 0x50
[ 11.972842] ucsi_ccg 1-0008: read version failed
[ 11.972974] ucsi_ccg 1-0008: get_fw_info fail, err=-121
[ 12.034366] ufs_tegra 2450000.ufshci: dme-link-startup: error code 1
[ 12.146386] ufs_tegra 2450000.ufshci: dme-link-startup: error code 1
[ 12.258806] ufs_tegra 2450000.ufshci: dme-link-startup: error code 1
[ 12.370318] ufs_tegra 2450000.ufshci: dme-link-startup: error code 1
[ 12.382483] ufs_tegra 2450000.ufshci: link startup failed 1
[ 12.476528] CPU:0, Error:CBB-NOC@0x2300000,irq=488
[ 12.723407] **************************************
[ 12.723487] * For more Internal Decode Help
[ 12.723559] * http://nv/cbberr
[ 12.723617] * NVIDIA userID is required to access
[ 12.723696] **************************************
[ 12.723776] CPU:0, Error:CBB-NOC
[ 12.723832] Error Logger : 0
[ 12.723889] ErrLog0 : 0x80030000
[ 12.723949] Transaction Type : RD - Read, Incrementing
[ 12.724037] Error Code : SLV
[ 12.724094] Error Source : Target
[ 12.724153] Error Description : Target error detected by CBB slave
[ 12.805615] AXI2APB_1 bridge error: SFIFONE - Status FIFO Not Empty interrupt[ 12.805760] AXI2APB_1 bridge error: TIM - Timer(Timeout) interrupt
[ 12.805869] Packet header Lock : 0
[ 12.805931] Packet header Len1 : 3
[ 12.805992] NOC protocol version : version >= 2.7
[ 12.806074] ErrLog1 : 0x320024
[ 12.806131] ErrLog2 : 0x0
[ 12.806180] RouteId : 0x320024
[ 12.806237] InitFlow : ccroc_p2ps/I/ccroc_p2ps
[ 12.806318] Targflow : axis_satellite_grout/T/axis_satellite_grout
[ 12.806421] TargSubRange : 0
[ 12.806477] SeqId : 0
[ 12.806525] ErrLog3 : 0x2470088
[ 12.806581] ErrLog4 : 0x0
[ 12.806649] Address : 0x2470088 (unknown device)
[ 12.806736] ErrLog5 : 0x909f851
[ 12.806793] Non-Modify : 0x1
[ 12.807052] AXI ID : 0x12
[ 12.807295] Master ID : CCPLEX
[ 12.807554] Security Group(GRPSEC): 0x7e
[ 12.807871] Cache : 0x1 – Device
[ 12.808174] Protection : 0x2 – Unprivileged, Non-Secure, Data Access
[ 12.808699] FALCONSEC : 0x0
[ 12.810027] Virtual Queuing Channel(VQC): 0x0
[ 12.814666] **************************************
[ 12.819694] kernel BUG at /dvs/git/dirty/git-master_linux/kernel/nvidia/drivers/platform/tegra/tegra_cbb.c:839!
[ 12.829458] Internal error: Oops - BUG: 0 [#1] PREEMPT SMP
[ 12.834877] Modules linked in:
[ 12.837787] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 4.9.253-tegra #1
[ 12.844589] Hardware name: Jetson-AGX (DT)
[ 12.848793] task: ffffff8009e913c0 task.stack: ffffff8009e80000
[ 12.854663] PC is at tegra_cbb_error_isr+0x1a0/0x1a8
[ 12.859211] LR is at tegra_cbb_error_isr+0xc8/0x1a8
[ 12.864460] pc : [] lr : [] pstate: 604001c5
[ 12.871893] sp : ffffffc7ffc4de50
[ 12.875308] x29: ffffffc7ffc4de50 x28: 0000000000000005
[ 12.880993] x27: 00000000000001c0 x26: 0000000000000001
[ 12.886429] x25: ffffff800a1ef000 x24: ffffff8009836018
[ 12.892456] x23: ffffff8009516950 x22: 0000000000000001
[ 12.897890] x21: 00000000000001e8 x20: ffffff800a03b720
[ 12.903918] x19: ffffff800a03b720 x18: 0000000000000010
[ 12.909606] x17: 0000000000000000 x16: 000000000000000e
[ 12.915039] x15: ffffffffffffffff x14: ffffff808a16e5b7
[ 12.920996] x13: ffffff800a16e5c5 x12: 0000000000000000
[ 12.926753] x11: 0000000005f5e0ff x10: 00000000000002a6
[ 12.932440] x9 : 00000000ffffffd0 x8 : ffffff80083d6cf0
[ 12.938214] x7 : ffffff8009ed4468 x6 : 0000000000000000
[ 12.943727] x5 : 0000000000000000 x4 : 0000000000000000
[ 12.948812] x3 : ffffffffffffffff x2 : ffffff8009ea4220
[ 12.954401] x1 : ffffff8009e913c0 x0 : 0000000000010001
[ 12.959486]
[ 12.960882] Process swapper/0 (pid: 0, stack limit = 0xffffff8009e80000)
[ 12.967528] Call trace:
[ 12.969896] [] tegra_cbb_error_isr+0x1a0/0x1a8
[ 12.975502] [] __handle_irq_event_percpu+0x68/0x288
[ 12.981619] [] handle_irq_event_percpu+0x28/0x60
[ 12.987486] [] handle_irq_event+0x50/0x80
[ 12.992564] [] handle_fasteoi_irq+0xd4/0x1c0
[ 12.998249] [] generic_handle_irq+0x34/0x50
[ 13.003586] [] __handle_domain_irq+0x68/0xc0
[ 13.009186] [] gic_handle_irq+0x5c/0xb0
[ 13.014261] [] el1_irq+0xe8/0x194
[ 13.018988] [] cpuidle_enter_state+0xb8/0x380
[ 13.024497] [] cpuidle_enter+0x34/0x48
[ 13.029922] [] call_cpuidle+0x44/0x70
[ 13.034996] [] cpu_startup_entry+0x1b0/0x200
[ 13.041036] [] rest_init+0x84/0x90
[ 13.045679] [] start_kernel+0x374/0x38c
[ 13.051358] [] __primary_switched+0x80/0x94
[ 13.134754] —[ end trace b2d1f508420451ec ]—
[ 13.140284] Kernel panic - not syncing: Fatal exception in interrupt
[ 13.140423] SMP: stopping secondary CPUs
[ 13.216926] Kernel Offset: disabled
[ 13.217016] Memory Limit: none
[ 13.217070] trusty-log panic notifier - trusty version Built: 12:20:34 Jul 26 2021 [ 13.222658] Rebooting in 5 seconds…

After removing the ‘quiet’ option I see this log (booting from SD):

[0017.262] I> node /plugin-manager/fragement-tegra-wdt-en matches
[0017.269] I> node /plugin-manager/fragement-soft-wdt matches
[0017.276] I> node /plugin-manager/fragment-pcie-c5-rp matches
[0017.281] I> node /plugin-manager/fragment-tegra-ufs-lane10 matches
[0017.293] I> Disable plugin-manager status in FDT
[0017.293] I> Plugin-manager override finished successfully
[0017.295] I> tegrabl_load_kernel_and_dtb: Done
[0017.317] I> Kernel EP: 0x80080000, DTB: 0x90000000
[ 0.000000] Booting Linux on physical CPU 0x0
[ 0.000000] Linux version 4.9.253-tegra (buildbrain@mobile-u64-5497-d3000) (gcc version 7.3.1 20180425 [linaro-7.3-2018.05 revision d29120a424ecfbc167ef90065c0eeb7f91977701] (Linaro GCC 7.3-2018.05) ) #1 SMP PREEMPT Mon Jul 26 12:19:28 PDT 2021
[ 0.000000] Boot CPU: AArch64 Processor [4e0f0040]
[ 0.000000] OF: fdt:memory scan node memory, reg size 48,
[ 0.000000] OF: fdt: - 80000000 , 2c000000
[ 0.000000] OF: fdt: - ac200000 , 44800000
[ 0.000000] OF: fdt: - 100000000 , 780000000
[ 0.000000] earlycon: tegra_comb_uart0 at MMIO32 0x000000000c168000 (options ‘’)
[ 0.000000] bootconsole [tegra_comb_uart0] enabled
[ 0.000000] Found tegra_fbmem: 00800000@a06aa000
[ 0.000000] Found lut_mem: 00002008@a06a4000
[ 11.867724] tegra-i2c 31c0000.i2c: rx dma timeout txlen:28 rxlen:128
[ 11.867784] tegra-i2c 31c0000.i2c: — register dump for debugging ----
[ 11.867813] tegra-i2c 31c0000.i2c: I2C_CNFG - 0x22c00
[ 11.867858] tegra-i2c 31c0000.i2c: I2C_PACKET_TRANSFER_STATUS - 0x10001
[ 11.867883] tegra-i2c 31c0000.i2c: I2C_FIFO_CONTROL - 0x0
[ 11.867906] tegra-i2c 31c0000.i2c: I2C_FIFO_STATUS - 0x800080
[ 11.867949] tegra-i2c 31c0000.i2c: I2C_MST_FIFO_CONTROL - 0x70
[ 11.867976] tegra-i2c 31c0000.i2c: I2C_MST_FIFO_STATUS - 0x7c0000
[ 11.867999] tegra-i2c 31c0000.i2c: I2C_MST_PACKET_TRANSFER_CNT - 0x0
[ 11.868047] tegra-i2c 31c0000.i2c: I2C_INT_MASK - 0x6c
[ 11.868069] tegra-i2c 31c0000.i2c: I2C_INT_STATUS - 0x2
[ 11.868102] tegra-i2c 31c0000.i2c: i2c transfer timed out addr: 0x50
[ 11.976336] ucsi_ccg 1-0008: read version failed
[ 11.976469] ucsi_ccg 1-0008: get_fw_info fail, err=-121
[ 12.036287] ufs_tegra 2450000.ufshci: dme-link-startup: error code 1
[ 12.147949] ufs_tegra 2450000.ufshci: dme-link-startup: error code 1
[ 12.260069] ufs_tegra 2450000.ufshci: dme-link-startup: error code 1
[ 12.372035] ufs_tegra 2450000.ufshci: dme-link-startup: error code 1
[ 12.383896] ufs_tegra 2450000.ufshci: link startup failed 1
[ 12.478186] CPU:0, Error:CBB-NOC@0x2300000,irq=488
[ 12.725053] **************************************
[ 12.725135] * For more Internal Decode Help
[ 12.725205] * http://nv/cbberr
[ 12.725263] * NVIDIA userID is required to access
[ 12.725341] **************************************
[ 12.725423] CPU:0, Error:CBB-NOC
[ 12.725483] Error Logger : 0
[ 12.725543] ErrLog0 : 0x80030000
[ 12.725605] Transaction Type : RD - Read, Incrementing
[ 12.725695] Error Code : SLV
[ 12.725754] Error Source : Target
[ 12.725816] Error Description : Target error detected by CBB slave
[ 12.807235] AXI2APB_1 bridge error: SFIFONE - Status FIFO Not Empty interrupt[ 12.807385] AXI2APB_1 bridge error: TIM - Timer(Timeout) interrupt
[ 12.807501] Packet header Lock : 0
[ 12.807564] Packet header Len1 : 3
[ 12.807627] NOC protocol version : version >= 2.7
[ 12.807715] ErrLog1 : 0x320024
[ 12.807773] ErrLog2 : 0x0
[ 12.807825] RouteId : 0x320024
[ 12.807883] InitFlow : ccroc_p2ps/I/ccroc_p2ps
[ 12.807966] Targflow : axis_satellite_grout/T/axis_satellite_grout
[ 12.808072] TargSubRange : 0
[ 12.808130] SeqId : 0
[ 12.808179] ErrLog3 : 0x2470088
[ 12.808240] ErrLog4 : 0x0
[ 12.808310] Address : 0x2470088 (unknown device)
[ 12.808395] ErrLog5 : 0x909f851
[ 12.808453] Non-Modify : 0x1
[ 12.808671] AXI ID : 0x12
[ 12.808898] Master ID : CCPLEX
[ 12.809175] Security Group(GRPSEC): 0x7e
[ 12.809495] Cache : 0x1 – Device
[ 12.809801] Protection : 0x2 – Unprivileged, Non-Secure, Data Access
[ 12.810314] FALCONSEC : 0x0
[ 12.811554] Virtual Queuing Channel(VQC): 0x0
[ 12.815934] **************************************
[ 12.820962] kernel BUG at /dvs/git/dirty/git-master_linux/kernel/nvidia/drivers/platform/tegra/tegra_cbb.c:839!
[ 12.830985] Internal error: Oops - BUG: 0 [#1] PREEMPT SMP
[ 12.836146] Modules linked in:
[ 12.839555] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 4.9.253-tegra #1
[ 12.845858] Hardware name: Jetson-AGX (DT)
[ 12.850317] task: ffffff8009e913c0 task.stack: ffffff8009e80000
[ 12.856185] PC is at tegra_cbb_error_isr+0x1a0/0x1a8
[ 12.860735] LR is at tegra_cbb_error_isr+0xc8/0x1a8
[ 12.865722] pc : [] lr : [] pstate: 604001c5
[ 12.873417] sp : ffffffc7ffc4de50
[ 12.876834] x29: ffffffc7ffc4de50 x28: 0000000000000005
[ 12.882267] x27: 00000000000001c0 x26: 0000000000000001
[ 12.888203] x25: ffffff800a1ef000 x24: ffffff8009836018
[ 12.893978] x23: ffffff8009516950 x22: 0000000000000001
[ 12.899413] x21: 00000000000001e8 x20: ffffff800a03b720
[ 12.905441] x19: ffffff800a03b720 x18: 0000000000000010
[ 12.910876] x17: 0000000000000000 x16: 000000000000000e
[ 12.916563] x15: ffffffffffffffff x14: ffffff808a16e5b7
[ 12.922503] x13: ffffff800a16e5c5 x12: 0000000000000000
[ 12.928278] x11: 0000000005f5e0ff x10: 00000000000002a6
[ 12.933966] x9 : 00000000ffffffd0 x8 : ffffff80083d6cf0
[ 12.939490] x7 : ffffff8009ed4468 x6 : 0000000000000000
[ 12.945253] x5 : 0000000000000000 x4 : 0000000000000000
[ 12.950590] x3 : ffffffffffffffff x2 : ffffff8009ea4220
[ 12.955675] x1 : ffffff8009e913c0 x0 : 0000000000010001
[ 12.961264]
[ 12.962667] Process swapper/0 (pid: 0, stack limit = 0xffffff8009e80000)
[ 12.969055] Call trace:
[ 12.971423] [] tegra_cbb_error_isr+0x1a0/0x1a8
[ 12.977022] [] __handle_irq_event_percpu+0x68/0x288
[ 12.983147] [] handle_irq_event_percpu+0x28/0x60
[ 12.989005] [] handle_irq_event+0x50/0x80
[ 12.994344] [] handle_fasteoi_irq+0xd4/0x1c0
[ 12.999686] [] generic_handle_irq+0x34/0x50
[ 13.005022] [] __handle_domain_irq+0x68/0xc0
[ 13.010707] [] gic_handle_irq+0x5c/0xb0
[ 13.015781] [] el1_irq+0xe8/0x194
[ 13.020509] [] cpuidle_enter_state+0xb8/0x380
[ 13.026020] [] cpuidle_enter+0x34/0x48
[ 13.031274] [] call_cpuidle+0x44/0x70
[ 13.036519] [] cpu_startup_entry+0x1b0/0x200
[ 13.042300] [] rest_init+0x84/0x90
[ 13.047203] [] start_kernel+0x374/0x38c
[ 13.052881] [] __primary_switched+0x80/0x94
[ 13.136333] —[ end trace d68b7494e3d3b4c1 ]—
[ 13.141984] Kernel panic - not syncing: Fatal exception in interrupt
[ 13.142126] SMP: stopping secondary CPUs
[ 13.218517] Kernel Offset: disabled
[ 13.218614] Memory Limit: none
[ 13.218677] trusty-log panic notifier - trusty version Built: 12:20:34 Jul 26 2021 [ 13.225047]

  1. Just let you know, it would be better to attach your log as text file here. Otherwise if you keep pasting more and more logs directly, it will be hard to read this post or using search function.

  2. It seems that every time the system gots cpu error, the last driver is ufs tegra. Do you have ufs on your board design? If not, how about disabling it from device tree first?

Thanks Wayne.

So in all reality I’m not that familiar with the whole device tree build process for custom hardware. I’m the hardware guy and I’m kind of running blind as I have no software support currently (maybe you can suggest a consultant ?). If there is a detailed step by step process on how to map IO’s correctly in the config tree and build an image + flash that would be very helpful. I have built the *.dtsi files and have basically been mucking around trying to figure out how to build things. However there’s a lot of stuff in there that I don’t know or understand.

What would be helpful would be a command line step-by-step guide for myself and people like me who are bringing up new hardware.

Cheers.

Just to add to this my process is: build, try and program on an AGX carrier board and them move the module to our custom hardware.

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.