# nvbootctrl dump-slots-info Current bootloader slot: A Active bootloader slot: A magic:0x43424e00, version: 5 features: 0 num_slots: 2 slot: 0, priority: 15, suffix: _a, retry_count: 6, boot_successful: 0 slot: 1, priority: 14, suffix: _b, retry_count: 7, boot_successful: 0 .... [ 136.153968] tegra194-vi5 15c10000.vi: no reply from camera processor [ 136.154858] tegra194-vi5 15c10000.vi: uncorr_err: request timed out after 2500 ms [ 136.155537] tegra194-vi5 15c10000.vi: err_rec: attempting to reset the capture channel [ 136.164818] Unable to handle kernel NULL pointer dereference at virtual address 00000010 [ 136.165329] Mem abort info: [ 136.165808] ESR = 0x96000005 [ 136.166175] Exception class = DABT (current EL), IL = 32 bits [ 136.166835] SET = 0, FnV = 0 [ 136.167139] EA = 0, S1PTW = 0 [ 136.167336] Data abort info: [ 136.167527] ISV = 0, ISS = 0x00000005 [ 136.167742] CM = 0, WnR = 0 [ 136.167949] user pgtable: 4k pages, 39-bit VAs, pgd = ffffffc7d4db6000 [ 136.168291] [0000000000000010] *pgd=0000000000000000, *pud=0000000000000000 [ 136.168816] Internal error: Oops: 96000005 [#3] PREEMPT SMP [ 136.169095] Modules linked in: nvgpu ath10k_pci ath10k_core ath mac80211 pps_gpio ppsya_gen_gpio mttcan can_dev btusb btrtl btbcm btintel option usb_wwan cfg80211 ip_tables x_tables [ 136.171953] CPU: 1 PID: 3913 Comm: vi-output, gw5_ Tainted: G D W 4.9.253-yasdc-32.6.1-2022-01-12-b0 #3 [ 136.172328] Hardware name: Yandex Xavier (DT) [ 136.172603] task: ffffffc7d611f000 task.stack: ffffffc7d35ec000 [ 136.177735] PC is at _raw_write_lock+0x30/0x58 [ 136.182482] LR is at destroy_buffer_table+0x40/0xd8 [ 136.186922] pc : [] lr : [] pstate: 20c00045 [ 136.194776] sp : ffffffc7d35efc70 [ 136.197918] x29: ffffffc7d35efc70 x28: 0000000000000000 [ 136.203435] x27: 0000000000000000 x26: 0000000000000000 [ 136.209006] x25: 0000000000000010 x24: 0000000000000098 [ 136.214570] x23: 0000000000000018 x22: ffffff8009189598 [ 136.219796] x21: 0000000000000000 x20: ffffffc7d8ec5580 [ 136.225287] x19: 0000000000000010 x18: 0000000000000400 [ 136.231089] x17: 0000000000000002 x16: 0000000000000003 [ 136.236750] x15: ffffffc7dac70e28 x14: 00070000000bfed8 [ 136.242449] x13: 0007000000000000 x12: ffffff800c000064 [ 136.248126] x11: 000000000000000b x10: 0101010101010101 [ 136.253818] x9 : ffffffc7d35efa80 x8 : 0000000000000000 [ 136.259670] x7 : ffffffc7d36052c0 x6 : ffffffc7ca610441 [ 136.265106] x5 : ffffff80086a0b6c x4 : ffffffbf1f298410 [ 136.270456] x3 : 0000000000000000 x2 : ffffffc7ca610440 [ 136.275771] x1 : 0000000000000000 x0 : 0000000080000000 [ 136.281125] [ 136.282453] Process vi-output, gw5_ (pid: 3913, stack limit = 0xffffffc7d35ec000) [ 136.289674] Call trace: [ 136.292274] [] _raw_write_lock+0x30/0x58 [ 136.297093] [] destroy_buffer_table+0x40/0xd8 [ 136.302947] [] vi_capture_shutdown+0xd4/0x130 [ 136.308276] [] vi_channel_close_ex+0x34/0x88 [ 136.314133] [] vi5_channel_error_recover+0x48/0x1c8 [ 136.319842] [] tegra_channel_error_recover+0x58/0x90 [ 136.326225] [] tegra_channel_kthread_capture_dequeue+0xf8/0x1c0 [ 136.332866] [] kthread+0xec/0xf0 [ 136.337748] [] ret_from_fork+0x10/0x30 [ 136.342833] ---[ end trace 3e47d24084e613bd ]--- [ 136.497110] note: vi-output, gw5_[3913] exited with preempt_count 1 [ 136.499250] ------------[ cut here ]------------ [ 136.500405] WARNING: CPU: 1 PID: 3910 at /kernel/kernel-4.9/drivers/media/v4l2-core/videobuf2-core.c:1367 vb2_start_streaming+0xe8/0x1c8 [ 136.501325] Modules linked in: nvgpu ath10k_pci ath10k_core ath mac80211 pps_gpio ppsya_gen_gpio mttcan can_dev btusb btrtl btbcm btintel option usb_wwan cfg80211 ip_tables x_tables [ 136.504169] [ 136.504969] CPU: 1 PID: 3910 Comm: v4l2-ctl Tainted: G D W 4.9.253-yasdc-32.6.1-2022-01-12-b0 #3 [ 136.506005] Hardware name: Yandex Xavier (DT) [ 136.506591] task: ffffffc7d6c5aa00 task.stack: ffffffc7ccc7c000 [ 136.507108] PC is at vb2_start_streaming+0xe8/0x1c8 [ 136.507526] LR is at vb2_start_streaming+0x7c/0x1c8 [ 136.507998] pc : [] lr : [] pstate: 80400045 [ 136.508569] sp : ffffffc7ccc7fb30 [ 136.508903] x29: ffffffc7ccc7fb30 x28: 0000000000000000 [ 136.509528] x27: ffffffc7d58aa000 x26: 0000000000000001 [ 136.510114] x25: ffffff800a1bfe50 x24: 0000000000000012 [ 136.510714] x23: 0000000000000000 x22: ffffffc7ccc7fd10 [ 136.514787] x21: ffffff800a3af000 x20: ffffffc7d6103780 [ 136.520373] x19: 00000000ffffffea x18: 0000000000000000 [ 136.526187] x17: 0000000000000000 x16: 0000000000000008 [ 136.531663] x15: 0000000000000071 x14: 00000000000000b3 [ 136.537101] x13: 0000000000000107 x12: 0000000000000400 [ 136.542954] x11: 0000000000000400 x10: 0000000000000a30 [ 136.548641] x9 : ffffffc7ccc7f850 x8 : 0000000000000000 [ 136.554417] x7 : 0000000000000400 x6 : 0000000000000400 [ 136.559677] x5 : ffffff8008c2da54 x4 : ffffffbf1f634410 [ 136.565266] x3 : ffffffc7d6103850 x2 : ffffffc7d6103850 [ 136.570604] x1 : 0000000000000000 x0 : ffffffc7d8d125b8 [ 136.575961] [ 136.577342] ---[ end trace 3e47d24084e613be ]--- [ 136.581805] Call trace: [ 136.584262] [] vb2_start_streaming+0xe8/0x1c8 [ 136.589600] [] vb2_core_streamon+0x16c/0x1a0 [ 136.595026] [] vb2_streamon+0x54/0x88 [ 136.600270] [] vb2_ioctl_streamon+0x54/0x60 [ 136.605352] [] v4l_streamon+0x3c/0x50 [ 136.610455] [] __video_do_ioctl+0x204/0x2c8 [ 136.615770] [] video_usercopy+0x2a0/0x6a0 [ 136.620845] [] video_ioctl2+0x3c/0x50 [ 136.625658] [] v4l2_ioctl+0x88/0x118 [ 136.630728] [] do_vfs_ioctl+0xb0/0x8d8 [ 136.635830] [] SyS_ioctl+0x8c/0xa8 [ 136.640451] [] el0_svc_naked+0x34/0x38 ... [ 140.857437] tegra194-vi5 15c10000.vi: no reply from camera processor [ 140.857686] tegra194-vi5 15c10000.vi: uncorr_err: request timed out after 2500 ms [ 140.858034] tegra194-vi5 15c10000.vi: err_rec: attempting to reset the capture channel [ 140.912159] CPU:0, Error:RCE-NOC@0xbe00000,irq=483 [ 140.912266] ************************************** [ 140.912348] * For more Internal Decode Help [ 140.912416] * http://nv/cbberr [ 140.912472] * NVIDIA userID is required to access [ 140.912545] ************************************** [ 140.912629] CPU:0, Error:RCE-NOC [ 140.912684] Error Logger : 1 [ 140.912746] ErrLog0 : 0x80030600 [ 140.912805] Transaction Type : RD - Read, Incrementing [ 140.912891] Error Code : TMO [ 140.912946] Error Source : Target NIU [ 140.913013] Error Description : Target time-out error [ 140.913102] Packet header Lock : 0 [ 140.913159] Packet header Len1 : 3 [ 140.913217] NOC protocol version : version >= 2.7 [ 140.913294] ErrLog1 : 0x157600 [ 140.913590] ErrLog2 : 0x0 [ 140.913807] RouteId : 0x157600 [ 140.914064] InitFlow : cpu_p_i/I/0 [ 140.914362] Targflow : cbb_t/T/0 [ 140.914645] TargSubRange : 27 [ 140.914888] SeqId : 0 [ 140.915126] ErrLog3 : 0x5e48000 [ 140.915368] ErrLog4 : 0x0 [ 140.917840] Address : 0x15e48000 (unknown device) [ 140.922971] ErrLog5 : 0x387e31 [ 140.926210] Master ID : RCE [ 140.929359] Security Group(GRPSEC): 0x3f [ 140.933383] Cache : 0x1 -- Device [ 140.937147] Protection : 0x3 -- Privileged, Non-Secure, Data Access [ 140.943538] FALCONSEC : 0x0 [ 140.946947] Virtual Queuing Channel(VQC): 0x0 [ 140.951672] ************************************** [ 140.957196] [ 140.957196] [ 140.957196] ###################### RTCPU EXCEPTION ###################### [ 140.957196] [RCE] Data abort [ 140.957196] R0: 00000000 R1: 0bcb3e4c R2: 0bca0294 R3: 15c00000 [ 140.957196] R4: 00000001 R5: 0bca24e8 R6: 00092000 R7: 00000023 [ 140.957196] R8: 00248000 R9: bfedf270 R10: 00000b10 R11: 0bca24e8 [ 140.957196] R12: 0001e3fa SP: 0bcdf800 LR: 0bc8a01c PC: 0bc80308 [ 140.957196] SP: 0bcb49c0 LR: 0bc83610 [ 140.957196] CPSR: 60000197 SPSR: 6000001f [ 140.957196] DFSR: 00001008 DFAR: 15e48000 ADFSR: 00000000 [ 140.957196] IFSR: 00000000 IFAR: 00000000 AIFSR: 00000000 [ 140.957196] Callstack [ 140.957196] [0bcb49b0]: 0bc83610 [ 140.957196] [0bcb49b4]: 0bc8364c [ 140.957196] [0bcb49bc]: 0bc8a08c [ 140.957196] [0bcb49e4]: 0bc8a2e8 [ 140.957196] [0bcb4a2c]: 0bc8a870 [ 140.957196] [0bcb4ad0]: 0bc8a5f0 [ 140.957196] [0bcb4c34]: 0bc9fb95 [ 140.957196] [0bcb57b8]: 0bc83610 [ 140.957196] [0bcb57bc]: 0bc848c8 [ 140.986238] CPU:0, Error:CBB-NOC@0x2300000,irq=477 [ 140.986246] ************************************** [ 140.986249] * For more Internal Decode Help [ 140.986253] * http://nv/cbberr [ 140.986255] * NVIDIA userID is required to access [ 140.986257] ************************************** [ 140.986259] CPU:0, Error:CBB-NOC [ 140.986261] Error Logger : 1 [ 140.986268] ErrLog0 : 0x80030600 [ 140.986270] Transaction Type : RD - Read, Incrementing [ 140.986272] Error Code : TMO [ 140.986274] Error Source : Target NIU [ 140.986275] Error Description : Target time-out error [ 140.986279] Packet header Lock : 0 [ 140.986281] Packet header Len1 : 3 [ 140.986282] NOC protocol version : version >= 2.7 [ 140.986284] ErrLog1 : 0x9528aa [ 140.986286] ErrLog2 : 0x0 [ 140.986287] RouteId : 0x9528aa [ 140.986290] InitFlow : rce_p2ps/I/rce_p2ps [ 140.986291] Targflow : host1x_p2pm/T/host1x_p2pm [ 140.986293] TargSubRange : 20 [ 140.986295] SeqId : 0 [ 140.986297] ErrLog3 : 0x248000 [ 140.986298] ErrLog4 : 0x0 [ 140.986324] Address : 0x15e48000 (unknown device) [ 140.986326] ErrLog5 : 0x2af0fc71 [ 140.986328] Non-Modify : 0x1 [ 140.986329] AXI ID : 0x55 [ 140.986331] Master ID : RCE [ 140.986333] Security Group(GRPSEC): 0x3f [ 140.986335] Cache : 0x1 -- Device [ 140.986337] Protection : 0x3 -- Privileged, Non-Secure, Data Access [ 140.986339] FALCONSEC : 0x0 [ 140.986341] Virtual Queuing Channel(VQC): 0x0 [ 140.986343] ************************************** [ 141.297788] tegra186-cam-rtcpu bc00000.rtcpu: Alert: Camera RTCPU gone bad! restoring it immediately!! [ 141.297965] tegra-ivc-cdev ivc-bc00000.rtcpu:echo@0: tegra_ivc_bus_ready_child is_ready 0 [ 141.298097] tegra-ivc-cdev ivc-bc00000.rtcpu:echo@0: tegra_ivc_bus_ready_child is_ready updated 0 [ 141.298233] tegra-ivc-cdev ivc-bc00000.rtcpu:dbg@1: tegra_ivc_bus_ready_child is_ready 0 [ 141.298367] tegra-ivc-cdev ivc-bc00000.rtcpu:dbg@1: tegra_ivc_bus_ready_child is_ready updated 0 [ 141.298503] tegra-camera-rtcpu-debugfs ivc-bc00000.rtcpu:dbg@2: tegra_ivc_bus_ready_child is_ready 0 [ 141.298644] tegra-camera-rtcpu-debugfs ivc-bc00000.rtcpu:dbg@2: tegra_ivc_bus_ready_child is_ready updated 0 [ 141.298796] tegra-capture-ivc ivc-bc00000.rtcpu:ivccontrol@3: tegra_ivc_bus_ready_child is_ready 0 [ 141.299224] tegra-capture-ivc ivc-bc00000.rtcpu:ivccontrol@3: tegra_ivc_bus_ready_child is_ready updated 0 [ 141.299980] tegra-capture-ivc ivc-bc00000.rtcpu:ivccapture@4: tegra_ivc_bus_ready_child is_ready 0 [ 141.300678] tegra-capture-ivc ivc-bc00000.rtcpu:ivccapture@4: tegra_ivc_bus_ready_child is_ready updated 0 ��data abort, halting Synchronous external abort (dfsr=0x00001808), AXI slave error on write to 0x13e0c008 r0 0x500ca9dc r1 0x50097aa8 r2 0x00000300 r3 0x13e0c000 r4 0x500ca9dc r5 0x500ca9dc r6 0x00000000 r7 0x500ca4cc r8 0x500d2bc0 r9 0x000019a2 r10 0x00000000 r11 0x5013e044 r12 0x00000000 usp 0x5001d0c8 ulr 0x52003bcb pc 0x50016d44 spsr 0x60000153 fiq r13 0x5001cfc8 r14 0x00000000 irq r13 0x5001cfa8 r14 0x5002ca6c *svc r13 0x5013e038 r14 0x50016054 und r13 0x5001d0c8 r14 0x5002bd54 sys r13 0x5001d0c8 r14 0x52003bcb bottom of stack at 0x5013e038: 0x5013e038: 00000024 500ca9dc 5013e05c 50016054 |.......P...PT..P| 0x5013e048: 00000003 00000000 500ca9dc 00000024 |...........P....| 013e078: 5001ce98 00000000 5013e0a4 50005a78 |...P.......PxZ.P| 0x5013e088: 00000000 00000000 00000000 00000000 |................| 0x5013e098: 00000000 00000000 5013e0ac 50000b08 |...........P...P| 0x5013e0a8: 00000000 50000ad0 d53571bf 48454150 |.......P.q..PAEH| call stack: 0x50016d44 0x50016054 0x50016194 0x50005a78 0x50000b08 0x50000ad0 HALT: spinning forever... ��[ 141.881091] tegra194-vi5 15c10000.vi: no reply from camera processor [ 141.881221] tegra194-vi5 15c10000.vi: vi_capture_ivc_send_control: pending chan_id 0 msg_id 19 [ 141.881357] tegra194-vi5 15c10000.vi: vi_capture_reset:IVC vi_capture_ivc_send_control -110 [ 141.881537] ------------[ cut here ]------------ [ 141.881621] WARNING: CPU: 3 PID: 3875 at /kernel/nvidia/drivers/platform/tegra/rtcpu/capture-ivc.c:96 tegra_capture_ivc_tx+0x11c/0x150 [ 141.881863] Modules linked in: nvgpu ath10k_pci ath10k_core ath mac80211 pps_gpio ppsya_gen_gpio mttcan can_dev btusb btrtl btbcm btintel option usb_wwan cfg80211 ip_tables x_tables [ 141.882198] [ 141.882243] CPU: 3 PID: 3875 Comm: vi-output, gw5_ Tainted: G D W 4.9.253-yasdc-32.6.1-2022-01-12-b0 #3 [ 141.882682] Hardware name: Yandex Xavier (DT) [ 141.883010] task: ffffffc7d611b800 task.stack: ffffffc7d5bc0000 [ 141.883485] PC is at tegra_capture_ivc_tx+0x11c/0x150 [ 141.883873] LR is at tegra_capture_ivc_control_submit+0x34/0x58 [ 141.884460] pc : [] lr : [] pstate: 40c00045 [ 141.892073] sp : ffffffc7d5bc3a90 [ 141.895742] x29: ffffffc7d5bc3a90 x28: 0000000000000000 [ 141.901088] x27: 0000000000000000 x26: 0000000000000000 [ 141.906853] x25: 0000000000000108 x24: ffffffc7d5bc3bd8 [ 141.912366] x23: 0000000000000015 x22: ffffffc7ca6bbe80 [ 141.917616] x21: ffffffc7d58f4c00 x20: ffffffc7d593a018 [ 141.923304] x19: ffffffc7d5bc3bd8 x18: 0000000000000010 [ 141.928991] x17: 0000007f9a3c3688 x16: ffffff800827f280 [ 141.934678] x15: ffffffffffffffff x14: 2d206c6f72746e6f [ 141.940112] x13: 635f646e65735f63 x12: 76695f6572757470 [ 141.945966] x11: 61635f6976204356 x10: 0000000000000cdf [ 141.951400] x9 : 0000000000000000 x8 : ffffffc7d5bc3ce0 [ 141.957428] x7 : 0000000000000000 x6 : 000000000000003f [ 141.962687] x5 : 0000000000000040 x4 : 0000000000000015 [ 141.968279] x3 : 0000000000000108 x2 : 0000000000000108 [ 141.973616] x1 : ffffffc7d5bc3bd8 x0 : 0000000000000000 [ 141.978953] [ 141.980354] ---[ end trace 3e47d24084e613bf ]--- [ 141.984818] Call trace: [ 141.987270] [] tegra_capture_ivc_tx+0x11c/0x150 [ 141.992700] [] tegra_capture_ivc_control_submit+0x34/0x58 [ 141.999262] [] vi_capture_ivc_send_control.isra.3+0x58/0x1f0 [ 142.006433] [] vi_capture_release+0x78/0x2b8 [ 142.012033] [] vi_capture_shutdown+0x94/0x130 [ 142.017375] [] vi_channel_close_ex+0x34/0x88 [ 142.023058] [] vi5_channel_error_recover+0x48/0x1c8 [ 142.028926] [] tegra_channel_error_recover+0x58/0x90 [ 142.035050] [] tegra_channel_kthread_capture_dequeue+0xf8/0x1c0 [ 142.042221] [] kthread+0xec/0xf0 [ 142.047035] [] ret_from_fork+0x10/0x30 [ 142.052404] tegra194-vi5 15c10000.vi: IVC control submit failed -5 [ 142.058510] CPU: 3 PID: 3875 Comm: vi-output, gw5_ Tainted: G D W 4.9.253-yasdc-32.6.1-2022-01-12-b0 #3 [ 142.068646] Hardware name: Yandex Xavier (DT) [ 142.073022] Call trace: [ 142.075733] [] dump_backtrace+0x0/0x198 [ 142.081244] [] show_stack+0x24/0x30 [ 142.086408] [] dump_stack+0xa0/0xc4 [ 142.091482] [] vi_capture_ivc_send_control.isra.3+0x1ec/0x1f0 [ 142.098743] [] vi_capture_release+0x78/0x2b8 [ 142.104781] [] vi_capture_shutdown+0x94/0x130 [ 142.110732] [] vi_channel_close_ex+0x34/0x88 [ 142.116336] [] vi5_channel_error_recover+0x48/0x1c8 [ 142.122724] [] tegra_channel_error_recover+0x58/0x90 [ 142.129199] [] tegra_channel_kthread_capture_dequeue+0xf8/0x1c0 [ 142.136722] [] kthread+0xec/0xf0 [ 142.141706] [] ret_from_fork+0x10/0x30 [ 142.147186] tegra194-vi5 15c10000.vi: vi_capture_release: release channel IVC failed -5 [ 142.155147] ------------[ cut here ]------------ [ 142.159648] WARNING: CPU: 4 PID: 3875 at /kernel/nvidia/drivers/media/platform/tegra/camera/vi/capture.c:784 vi_capture_release+0x250/0x2b8 [ 142.176006] Modules linked in: nvgpu ath10k_pci ath10k_core ath mac80211 pps_gpio ppsya_gen_gpio mttcan can_dev btusb btrtl btbcm btintel option usb_wwan cfg80211 ip_tables x_tables [ 142.192978] [ 142.194312] CPU: 4 PID: 3875 Comm: vi-output, gw5_ Tainted: G D W 4.9.253-yasdc-32.6.1-2022-01-12-b0 #3 [ 142.204709] Hardware name: Yandex Xavier (DT) [ 142.209255] task: ffffffc7d611b800 task.stack: ffffffc7d5bc0000 [ 142.214861] PC is at vi_capture_release+0x250/0x2b8 [ 142.219847] LR is at vi_capture_release+0x250/0x2b8 [ 142.224748] pc : [] lr : [] pstate: 40c00045 [ 142.232530] sp : ffffffc7d5bc3b80 [ 142.235942] x29: ffffffc7d5bc3b80 x28: 0000000000000000 [ 142.241715] x27: 0000000000000000 x26: 0000000000000000 [ 142.247404] x25: 0000000000000000 x24: 0000000000000000 [ 142.252740] x23: 00000000fffffffb x22: ffffffc7ca6bbe80 [ 142.257823] x21: 000000000000ffff x20: 0000000000000001 [ 142.263423] x19: ffffffc7d8d17400 x18: 0000000000000010 [ 142.269199] x17: 0000007f9a3c3688 x16: ffffff800827f280 [ 142.274798] x15: ffffffffffffffff x14: ffffff808a34d637 [ 142.280573] x13: ffffff800a34d645 x12: 0000000000000000 [ 142.286428] x11: 0000000005f5e0ff x10: 0000000000000d18 [ 142.292116] x9 : 00000000ffffffd0 x8 : ffffff8008542ec0 [ 142.297636] x7 : ffffff800a0a7a20 x6 : ffffffc7ffd21bf0 [ 142.303149] x5 : ffffffc7ffd21bf0 x4 : 0000000000000000 [ 142.308741] x3 : ffffffc7ffd277f8 x2 : ffffffc7ffd21bf0 [ 142.313824] x1 : ffffffc7d611b800 x0 : 000000000000004b [ 142.319414] [ 142.320817] ---[ end trace 3e47d24084e613c0 ]--- [ 142.325279] Call trace: [ 142.327733] [] vi_capture_release+0x250/0x2b8 [ 142.333156] [] vi_capture_shutdown+0x94/0x130 [ 142.338669] [] vi_channel_close_ex+0x34/0x88 [ 142.344270] [] vi5_channel_error_recover+0x48/0x1c8 [ 142.350137] [] tegra_channel_error_recover+0x58/0x90 [ 142.356519] [] tegra_channel_kthread_capture_dequeue+0xf8/0x1c0 [ 142.363521] [] kthread+0xec/0xf0 [ 142.368245] [] ret_from_fork+0x10/0x30 [ 142.373414] Unable to handle kernel NULL pointer dereference at virtual address 00000010 [ 142.380851] Mem abort info: [ 142.383388] ESR = 0x96000005 [ 142.386539] Exception class = DABT (current EL), IL = 32 bits [ 142.392055] SET = 0, FnV = 0 [ 142.395220] EA = 0, S1PTW = 0 [ 142.398525] Data abort info: [ 142.401159] ISV = 0, ISS = 0x00000005 [ 142.405262] CM = 0, WnR = 0 [ 142.407972] user pgtable: 4k pages, 39-bit VAs, pgd = ffffffc7d708a000 [ 142.414457] [0000000000000010] *pgd=0000000000000000, *pud=0000000000000000 [ 142.422056] Internal error: Oops: 96000005 [#4] PREEMPT SMP [ 142.427833] Modules linked in: nvgpu ath10k_pci ath10k_core ath mac80211 pps_gpio ppsya_gen_gpio mttcan can_dev btusb btrtl btbcm btintel option usb_wwan cfg80211 ip_tables x_tables [ 142.444472] CPU: 4 PID: 3875 Comm: vi-output, gw5_ Tainted: G D W 4.9.253-yasdc-32.6.1-2022-01-12-b0 #3 [ 142.455043] Hardware name: Yandex Xavier (DT) [ 142.459159] task: ffffffc7d611b800 task.stack: ffffffc7d5bc0000 [ 142.465371] PC is at _raw_write_lock+0x30/0x58 [ 142.469832] LR is at destroy_buffer_table+0x40/0xd8 [ 142.474297] pc : [] lr : [] pstate: 20c00045 [ 142.481909] sp : ffffffc7d5bc3c70 [ 142.485322] x29: ffffffc7d5bc3c70 x28: 0000000000000000 [ 142.491004] x27: 0000000000000000 x26: 0000000000000000 [ 142.496349] x25: 0000000000000010 x24: 0000000000000098 [ 142.501861] x23: 0000000000000018 x22: ffffff8009189598 [ 142.507365] x21: 0000000000000000 x20: ffffffc7ca6bbe80 [ 142.512878] x19: 0000000000000010 x18: 000000000000ba7e [ 142.518399] x17: 0000000000000002 x16: 0000000000000003 [ 142.524087] x15: 000000000000012a x14: 0000000000000000 [ 142.530030] x13: 0000000000000000 x12: 0000000000000400 [ 142.535716] x11: 0000000000000400 x10: 0000000000000a30 [ 142.541149] x9 : ffffffc7d5bc3a80 x8 : 0000000000000000 [ 142.547177] x7 : ffffffc7d378df40 x6 : ffffffc7d36054c1 [ 142.552692] x5 : ffffff80086a0b6c x4 : ffffffbf1f4d8150 [ 142.557773] x3 : 0000000000000000 x2 : ffffffc7d36054c0 [ 142.563365] x1 : 0000000000000000 x0 : 0000000080000000 [ 142.568448] [ 142.570110] Process vi-output, gw5_ (pid: 3875, stack limit = 0xffffffc7d5bc0000) [ 142.577022] Call trace: [ 142.579385] [] _raw_write_lock+0x30/0x58 [ 142.584461] [] destroy_buffer_table+0x40/0xd8 [ 142.590319] [] vi_capture_shutdown+0xd4/0x130 [ 142.595660] [] vi_channel_close_ex+0x34/0x88 [ 142.601260] [] vi5_channel_error_recover+0x48/0x1c8 [ 142.607211] [] tegra_channel_error_recover+0x58/0x90 [ 142.613595] [] tegra_channel_kthread_capture_dequeue+0xf8/0x1c0 [ 142.620506] [] kthread+0xec/0xf0 [ 142.625062] [] ret_from_fork+0x10/0x30 [ 142.630138] ---[ end trace 3e47d24084e613c1 ]--- [ 142.642650] note: vi-output, gw5_[3875] exited with preempt_count 1 [ 145.307577] bpmp_wait_ack() returned -110 (ch 22 mrq 3 data <0x25 0x01 0x00 0x06>) [ 145.307754] ------------[ cut here ]------------ [ 145.307842] WARNING: CPU: 0 PID: 0 at /kernel/nvidia/drivers/firmware/tegra/mail.c:323 bpmp_send_receive_atomic+0x248/0x268 [ 145.308071] Modules linked in: nvgpu ath10k_pci ath10k_core ath mac80211 pps_gpio ppsya_gen_gpio mttcan can_dev btusb btrtl btbcm btintel option usb_wwan cfg80211 ip_tables x_tables [ 145.308436] [ 145.308475] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G D W 4.9.253-yasdc-32.6.1-2022-01-12-b0 #3 [ 145.308629] Hardware name: Yandex Xavier (DT) [ 145.308700] task: ffffff800a041580 task.stack: ffffff800a030000 [ 145.308796] PC is at bpmp_send_receive_atomic+0x248/0x268 [ 145.309024] LR is at bpmp_send_receive_atomic+0x248/0x268 [ 145.309445] pc : [] lr : [] pstate: 404001c5 [ 145.310020] sp : ffffffc7ffcc0ad0 [ 145.310282] x29: ffffffc7ffcc0ad0 x28: 0000000000000004 [ 145.310725] x27: ffffffc7ffcc0e18 x26: 0000000000000016 [ 145.315467] x25: ffffffc7ffcc0e1c x24: 00000000000f4240 [ 145.320551] x23: 00000020c288ac11 x22: ffffff800a3b34e0 [ 145.325891] x21: ffffff800a1ce0d0 x20: 20c49ba5e353f7cf [ 145.331742] x19: 0000000000000003 x18: 0000000000000010 [ 145.337265] x17: 0000000000000002 x16: 0000000000000000 [ 145.342866] x15: ffffffffffffffff x14: 3630783020303078 [ 145.348552] x13: 3020313078302035 x12: 3278303c20617461 [ 145.354492] x11: 6420332071726d20 x10: 0000000000000d6f [ 145.359929] x9 : 31312d2064656e72 x8 : ffffff8008542ec0 [ 145.365954] x7 : ffffff800a0a7a20 x6 : 0000000000000000 [ 145.371467] x5 : 0000000000000000 x4 : ffffffc7ffcc1be8 [ 145.376551] x3 : ffffffc7ffcc1be8 x2 : 0000000000000007 [ 145.381890] x1 : ffffff800a041580 x0 : 0000000000000046 [ 145.387226] [ 145.388881] ---[ end trace 3e47d24084e613c2 ]--- [ 145.393086] Call trace: [ 145.395796] [] bpmp_send_receive_atomic+0x248/0x268 [ 145.401659] [] tegra_bpmp_send_receive_atomic+0xc4/0x170 [ 145.408310] [] clk_bpmp_is_enabled+0x44/0x68 [ 145.413909] [] __clk_is_enabled+0x38/0x60 [ 145.418988] [] is_nvcvnas_clk_enabled+0x34/0x40 [ 145.425108] [] tegra_cbb_error_isr+0x80/0x1a8 [ 145.430709] [] __handle_irq_event_percpu+0x68/0x288 [ 145.436657] [] handle_irq_event_percpu+0x28/0x60 [ 145.442520] [] handle_irq_event+0x50/0x80 [ 145.447599] [] handle_fasteoi_irq+0xd4/0x1c0 [ 145.453546] [] generic_handle_irq+0x34/0x50 [ 145.459058] [] __handle_domain_irq+0x68/0xc0 [ 145.464888] bpmp_trywait() timed out (ch 1 mrq 22 data <0xed 0x00 0x00 0x07>) [ 145.464921] ------------[ cut here ]------------ [ 145.464928] WARNING: CPU: 1 PID: 1988 at /kernel/nvidia/drivers/firmware/tegra/mail.c:400 bpmp_trywait+0x1a4/0x1b0 [ 145.464955] Modules linked in: nvgpu ath10k_pci ath10k_core ath mac80211 pps_gpio ppsya_gen_gpio mttcan can_dev btusb btrtl btbcm btintel option usb_wwan cfg80211 ip_tables x_tables [ 145.464957] [ 145.464974] CPU: 1 PID: 1988 Comm: mmc_cmdq_d/0 Tainted: G D W 4.9.253-yasdc-32.6.1-2022-01-12-b0 #3 [ 145.464975] Hardware name: Yandex Xavier (DT) [ 145.464978] task: ffffffc7d6c9e200 task.stack: ffffffc7d6990000 [ 145.464980] PC is at bpmp_trywait+0x1a4/0x1b0 [ 145.464983] LR is at bpmp_trywait+0x1a4/0x1b0 [ 145.464985] pc : [] lr : [] pstate: 20c00045 [ 145.464987] sp : ffffffc7d69936e0 [ 145.464991] x29: ffffffc7d69936e0 x28: ffffff800a3b34e0 [ 145.464996] x27: 0000000000000000 x26: 0000000000000040 [ 145.465000] x25: ffffff800a3b35d8 x24: 0000000000000004 [ 145.465004] x23: ffffffc7d6993a6c x22: 0000000000000016 [ 145.465011] x21: ffffff800919a000 x20: 0000000000000001 [ 145.465015] x19: ffffff800a3b34e0 x18: 0000000000000001 [ 145.465019] x17: 0000007f883b7f50 x16: 000000000000d0df [ 145.465023] x15: ffffffffffffffff x14: ffffff800a34de58 [ 145.465027] x13: ffffff800a34da9f x12: ffffff800a054000 [ 145.465031] x11: 000000000000ede8 x10: ffffff800a34d0d0 [ 145.465035] x9 : 0000000000000001 x8 : ffffffc7ffc8bac7 [ 145.465039] x7 : 0000000000000000 x6 : 000000002e2ce00d [ 145.465043] x5 : 0000000000000000 x4 : 0000000000000000 [ 145.465047] x3 : ffffffffffffffff x2 : 00000047f633e000 [ 145.465051] x1 : ffffffc7d6c9e200 x0 : 0000000000000041 [ 145.465052] [ 145.465054] ---[ end trace 3e47d24084e613c3 ]--- [ 145.465055] Call trace: [ 145.465059] [] bpmp_trywait+0x1a4/0x1b0 [ 145.465062] [] tegra_bpmp_send_receive+0x154/0x2b8 [ 145.465066] [] bpmp_send_clk_message+0x40/0xb0 [ 145.465069] [] clk_bpmp_enable+0x38/0x48 [ 145.465072] [] clk_core_prepare+0x6c/0x1e0 [ 145.465075] [] clk_core_prepare+0x4c/0x1e0 [ 145.465079] [] clk_prepare+0x2c/0x58 [ 145.465084] [] tegra_sdhci_set_clock+0x78/0x478 [ 145.465087] [] tegra_sdhci_runtime_resume+0x30/0x60 [ 145.465091] [] sdhci_pltfm_runtime_resume+0x30/0x50 [ 145.465097] [] pm_generic_runtime_resume+0x3c/0x58 [ 145.465100] [] __rpm_callback+0x74/0xa0 [ 145.465102] [] rpm_callback+0x70/0x98 [ 145.465105] [] rpm_resume+0x470/0x710 [ 145.465108] [] __pm_runtime_resume+0x4c/0x70 [ 145.465112] [] __mmc_claim_host+0x148/0x1b8 [ 145.465115] [] mmc_blk_cmdq_issue_rq+0x40/0x598 [ 145.465118] [] mmc_cmdq_thread+0x104/0x1f0 [ 145.465122] [] kthread+0xec/0xf0 [ 145.465126] [] ret_from_fork+0x10/0x30 [ 145.465176] sdhci-tegra 3460000.sdhci: clk enable failed -110 [ 145.465191] sdhci-tegra 3460000.sdhci: Reg 0x28 being accessed without clock [ 145.465217] ------------[ cut here ]------------ [ 145.465221] WARNING: CPU: 1 PID: 1988 at /kernel/kernel-4.9/drivers/mmc/host/sdhci-tegra.c:281 tegra_sdhci_is_clk_enabled.isra.1+0x48/0x60 [ 145.465244] Modules linked in: nvgpu ath10k_pci ath10k_core ath mac80211 pps_gpio ppsya_gen_gpio mttcan can_dev btusb btrtl btbcm btintel option usb_wwan cfg80211 ip_tables x_tables [ 145.465245] [ 145.465260] CPU: 1 PID: 1988 Comm: mmc_cmdq_d/0 Tainted: G D W 4.9.253-yasdc-32.6.1-2022-01-12-b0 #3 [ 145.465261] Hardware name: Yandex Xavier (DT) [ 145.465263] task: ffffffc7d6c9e200 task.stack: ffffffc7d6990000 [ 145.465266] PC is at tegra_sdhci_is_clk_enabled.isra.1+0x48/0x60 [ 145.465268] LR is at tegra_sdhci_is_clk_enabled.isra.1+0x48/0x60 [ 145.465270] pc : [] lr : [] pstate: 20c000c5 [ 145.465272] sp : ffffffc7d6993c00 [ 145.465277] x29: ffffffc7d6993c00 x28: 0000000000000000 [ 145.465281] x27: ffffffc7d69a0000 x26: ffffffc7d7732800 [ 145.465285] x25: ffffffc7d7732800 x24: 0000000000000000 [ 145.465289] x23: 00000000000000ff x22: 0000000000000040 [ 145.465293] x21: ffffffc7d71957c0 x20: 0000000000000028 [ 145.465297] x19: ffffffc7d7195000 x18: 0000000000000020 [ 145.465301] x17: 0000007f883b7f50 x16: 000000000000d0df [ 145.465305] x15: ffffffffffffffff x14: ffffff800a34de58 [ 145.465309] x13: ffffff800a34da9b x12: ffffff800a054000 [ 145.465313] x11: 000000000000fb48 x10: ffffff800a34d0d0 [ 145.465317] x9 : 0000000000000001 x8 : ffffffc7ffc8c843 [ 145.465321] x7 : 0000000000000000 x6 : 000000002e2ce00d [ 145.465325] x5 : 0000000000000000 x4 : 0000000000000000 [ 145.465329] x3 : ffffffffffffffff x2 : 00000047f633e000 [ 145.465333] x1 : ffffffc7d6c9e200 x0 : 0000000000000040 [ 145.465334] [ 145.465336] ---[ end trace 3e47d24084e613c4 ]--- [ 145.465337] Call trace: [ 145.465340] [] tegra_sdhci_is_clk_enabled.isra.1+0x48/0x60 [ 145.465342] [] tegra_sdhci_readb+0x28/0x60 [ 145.465346] [] sdhci_led_control+0xe8/0x108 [ 145.465351] [] led_set_brightness_nopm+0x30/0x58 [ 145.465355] [] led_set_brightness+0x5c/0x90 [ 145.465358] [] led_trigger_event+0x54/0x80 [ 145.465361] [] mmc_start_cmdq_request+0x88/0x128 [ 145.465363] [] mmc_cmdq_start_req+0x3c/0x60 [ 145.465366] [] mmc_blk_cmdq_issue_rq+0x304/0x598 [ 145.465369] [] mmc_cmdq_thread+0x104/0x1f0 [ 145.465372] [] kthread+0xec/0xf0 [ 145.465374] [] ret_from_fork+0x10/0x30 [ 145.465379] sdhci-tegra 3460000.sdhci: Reg 0x28 being accessed without clock [ 145.465404] ------------[ cut here ]------------ [ 145.465408] WARNING: CPU: 1 PID: 1988 at /kernel/kernel-4.9/drivers/mmc/host/sdhci-tegra.c:281 tegra_sdhci_is_clk_enabled.isra.1+0x48/0x60 [ 145.465433] Modules linked in: nvgpu ath10k_pci ath10k_core ath mac80211 pps_gpio ppsya_gen_gpio mttcan can_dev btusb btrtl btbcm btintel option usb_wwan cfg80211 ip_tables x_tables [ 145.465434] [ 145.465448] CPU: 1 PID: 1988 Comm: mmc_cmdq_d/0 Tainted: G D W 4.9.253-yasdc-32.6.1-2022-01-12-b0 #3 [ 145.465450] Hardware name: Yandex Xavier (DT) [ 145.465452] task: ffffffc7d6c9e200 task.stack: ffffffc7d6990000 [ 145.465454] PC is at tegra_sdhci_is_clk_enabled.isra.1+0x48/0x60 [ 145.465456] LR is at tegra_sdhci_is_clk_enabled.isra.1+0x48/0x60 [ 145.465458] pc : [] lr : [] pstate: 20c000c5 [ 145.465460] sp : ffffffc7d6993bf0 [ 145.465464] x29: ffffffc7d6993bf0 x28: 0000000000000000 [ 145.465468] x27: ffffffc7d69a0000 x26: ffffffc7d7732800 [ 145.465472] x25: ffffffc7d7732800 x24: 0000000000000000 [ 145.465476] x23: 00000000000000ff x22: 0000000000000001 [ 145.465480] x21: ffffff8009197770 x20: 0000000000000028 [ 145.465484] x19: ffffffc7d7195000 x18: 0000000000000020 [ 145.465487] x17: 0000007f883b7f50 x16: 000000000000d0df [ 145.465491] x15: ffffffffffffffff x14: ffffff800a34de58 [ 145.465495] x13: ffffff800a34da9b x12: ffffff800a054000 [ 145.465499] x11: 000000000001066c x10: ffffff800a34d0d0 [ 145.465503] x9 : 0000000000000001 x8 : ffffffc7ffc8d37f [ 145.465508] x7 : 0000000000000000 x6 : 000000002e2ce00d [ 145.465511] x5 : 0000000000000000 x4 : 0000000000000000 [ 145.465516] x3 : ffffffffffffffff x2 : 00000047f633e000 [ 145.465519] x1 : ffffffc7d6c9e200 x0 : 0000000000000040 [ 145.465521] [ 145.465522] ---[ end trace 3e47d24084e613c5 ]--- [ 145.465524] Call trace: [ 145.465527] [] tegra_sdhci_is_clk_enabled.isra.1+0x48/0x60 [ 145.465529] [] tegra_sdhci_writeb+0x34/0x70 [ 145.465532] [] sdhci_led_control+0xd8/0x108 [ 145.465536] [] led_set_brightness_nopm+0x30/0x58 [ 145.465539] [] led_set_brightness+0x5c/0x90 [ 145.465542] [] led_trigger_event+0x54/0x80 [ 145.465544] [] mmc_start_cmdq_request+0x88/0x128 [ 145.465547] [] mmc_cmdq_start_req+0x3c/0x60 [ 145.465550] [] mmc_blk_cmdq_issue_rq+0x304/0x598 [ 145.465553] [] mmc_cmdq_thread+0x104/0x1f0 [ 145.465555] [] kthread+0xec/0xf0 [ 145.465558] [] ret_from_fork+0x10/0x30 [ 145.465572] mmc0: Reg 0x28 being accessed without clock [ 145.465596] ------------[ cut here ]------------ [ 145.465599] WARNING: CPU: 1 PID: 1988 at /kernel/kernel-4.9/drivers/mmc/host/cmdq_hci.c:49 is_host_clk_enabled.part.1+0x34/0x50 [ 145.465622] Modules linked in: nvgpu ath10k_pci ath10k_core ath mac80211 pps_gpio ppsya_gen_gpio mttcan can_dev btusb btrtl btbcm btintel option usb_wwan cfg80211 ip_tables x_tables [ 145.465623] [ 145.465634] CPU: 1 PID: 1988 Comm: mmc_cmdq_d/0 Tainted: G D W 4.9.253-yasdc-32.6.1-2022-01-12-b0 #3 [ 145.465636] Hardware name: Yandex Xavier (DT) [ 145.465638] task: ffffffc7d6c9e200 task.stack: ffffffc7d6990000 [ 145.465640] PC is at is_host_clk_enabled.part.1+0x34/0x50 [ 145.465642] LR is at is_host_clk_enabled.part.1+0x34/0x50 [ 145.465644] pc : [] lr : [] pstate: 20c000c5 [ 145.465645] sp : ffffffc7d6993c20 [ 145.465650] x29: ffffffc7d6993c20 x28: ffffffc7d6a30010 [ 145.465654] x27: 0000000000000001 x26: 0000000000000021 [ 145.465657] x25: 0000000000000001 x24: 0000000000000001 [ 145.465661] x23: ffffffc7d7195000 x22: ffffffc7d69a02e0 [ 145.465665] x21: 0000000000000023 x20: 0000000000000028 [ 145.465669] x19: ffffffc7d7195000 x18: 0000000000000020 [ 145.465673] x17: 0000007f883b7f50 x16: 000000000000d0df [ 145.465677] x15: ffffffffffffffff x14: ffffff800a34de58 [ 145.465681] x13: ffffff800a34da88 x12: ffffff800a054000 [ 145.465685] x11: 00000000000111c4 x10: ffffff800a34d0d0 [ 145.465689] x9 : 0000000000000001 x8 : ffffffc7ffc8de77 [ 145.465693] x7 : 0000000000000000 x6 : 000000002e2ce00d [ 145.465697] x5 : 0000000000000000 x4 : 0000000000000000 [ 145.465701] x3 : ffffffffffffffff x2 : 00000047f633e000 [ 145.465705] x1 : ffffffc7d6c9e200 x0 : 000000000000002b [ 145.465706] [ 145.465707] ---[ end trace 3e47d24084e613c6 ]--- [ 145.465708] Call trace: [ 145.465711] [] is_host_clk_enabled.part.1+0x34/0x50 [ 145.465714] [] cmdq_reg_readl+0x58/0x80 [ 145.465717] [] cmdq_request+0x2a8/0x508 [ 145.465719] [] mmc_start_cmdq_request+0x9c/0x128 [ 145.465722] [] mmc_cmdq_start_req+0x3c/0x60 [ 145.465725] [] mmc_blk_cmdq_issue_rq+0x304/0x598 [ 145.465728] [] mmc_cmdq_thread+0x104/0x1f0 [ 145.465730] [] kthread+0xec/0xf0 [ 145.465733] [] ret_from_fork+0x10/0x30 [ 145.465737] sdhci-tegra 3460000.sdhci: Reg 0x2e being accessed without clock [ 145.465761] ------------[ cut here ]------------ [ 145.465765] WARNING: CPU: 1 PID: 1988 at /kernel/kernel-4.9/drivers/mmc/host/sdhci-tegra.c:281 tegra_sdhci_is_clk_enabled.isra.1+0x48/0x60 [ 145.465786] Modules linked in: nvgpu ath10k_pci ath10k_core ath mac80211 pps_gpio ppsya_gen_gpio mttcan can_dev btusb btrtl btbcm btintel option usb_wwan cfg80211 ip_tables x_tables [ 145.465787] [ 145.465798] CPU: 1 PID: 1988 Comm: mmc_cmdq_d/0 Tainted: G D W 4.9.253-yasdc-32.6.1-2022-01-12-b0 #3 [ 145.465800] Hardware name: Yandex Xavier (DT) [ 145.465802] task: ffffffc7d6c9e200 task.stack: ffffffc7d6990000 [ 145.465804] PC is at tegra_sdhci_is_clk_enabled.isra.1+0x48/0x60 [ 145.465805] LR is at tegra_sdhci_is_clk_enabled.isra.1+0x48/0x60 [ 145.465808] pc : [] lr : [] pstate: 20c000c5 [ 145.465809] sp : ffffffc7d6993bf0 [ 145.465813] x29: ffffffc7d6993bf0 x28: ffffffc7d6a30010 [ 145.465817] x27: 0000000000000001 x26: 0000000000000021 [ 145.465821] x25: 0000000000000001 x24: 0000000000000001 [ 145.465825] x23: ffffffc7d7195000 x22: 000000000000000e [ 145.465829] x21: ffffff8009197770 x20: 000000000000002e [ 145.465832] x19: ffffffc7d7195000 x18: 0000000000000020 [ 145.465836] x17: 0000007f883b7f50 x16: 000000000000d0df [ 145.465840] x15: ffffffffffffffff x14: ffffff800a34de58 [ 145.465844] x13: ffffff800a34da9b x12: ffffff800a054000 [ 145.465848] x11: 0000000000011bbc x10: ffffff800a34d0d0 [ 145.465852] x9 : 0000000000000001 x8 : ffffffc7ffc8e8cb [ 145.465856] x7 : 0000000000000000 x6 : 000000002e2ce00d [ 145.465860] x5 : 0000000000000000 x4 : 0000000000000000 [ 145.465864] x3 : ffffffffffffffff x2 : 00000047f633e000 [ 145.465868] x1 : ffffffc7d6c9e200 x0 : 0000000000000040 [ 145.465869] [ 145.465871] ---[ end trace 3e47d24084e613c7 ]--- [ 145.465872] Call trace: [ 145.465875] [] tegra_sdhci_is_clk_enabled.isra.1+0x48/0x60 [ 145.465877] [] tegra_sdhci_writeb+0x34/0x70 [ 145.465881] [] sdhci_cmdq_set_data_timeout+0x58/0x68 [ 145.465883] [] cmdq_request+0x2f4/0x508 [ 145.465886] [] mmc_start_cmdq_request+0x9c/0x128 [ 145.465888] [] mmc_cmdq_start_req+0x3c/0x60 [ 145.465891] [] mmc_blk_cmdq_issue_rq+0x304/0x598 [ 145.465894] [] mmc_cmdq_thread+0x104/0x1f0 [ 145.465897] [] kthread+0xec/0xf0 [ 145.465899] [] ret_from_fork+0x10/0x30 [ 145.465902] mmc0: Reg 0x28 being accessed without clock [ 145.465926] ------------[ cut here ]------------ [ 145.465929] WARNING: CPU: 1 PID: 1988 at /kernel/kernel-4.9/drivers/mmc/host/cmdq_hci.c:49 is_host_clk_enabled.part.1+0x34/0x50 [ 145.465950] Modules linked in: nvgpu ath10k_pci ath10k_core ath mac80211 pps_gpio ppsya_gen_gpio mttcan can_dev btusb btrtl btbcm btintel option usb_wwan cfg80211 ip_tables x_tables [ 145.465951] [ 145.465958] CPU: 1 PID: 1988 Comm: mmc_cmdq_d/0 Tainted: G D W 4.9.253-yasdc-32.6.1-2022-01-12-b0 #3 [ 145.465959] Hardware name: Yandex Xavier (DT) [ 145.465961] task: ffffffc7d6c9e200 task.stack: ffffffc7d6990000 [ 145.465963] PC is at is_host_clk_enabled.part.1+0x34/0x50 [ 145.465966] LR is at is_host_clk_enabled.part.1+0x34/0x50 [ 145.465968] pc : [] lr : [] pstate: 20c000c5 [ 145.465970] sp : ffffffc7d6993c10 [ 145.465974] x29: ffffffc7d6993c10 x28: ffffffc7d6a30010 [ 145.465978] x27: 0000000000000001 x26: 0000000000000021 [ 145.465982] x25: 0000000000000001 x24: 0000000000000001 [ 145.465985] x23: ffffffc7d7195000 x22: ffffffc7d69a02e0 [ 145.465989] x21: 0000000000000001 x20: 0000000000000028 [ 145.465993] x19: ffffffc7d7195000 x18: 0000000000000020 [ 145.465997] x17: 0000007f883b7f50 x16: 000000000000d0df [ 145.466001] x15: ffffffffffffffff x14: ffffff800a34de58 [ 145.466005] x13: ffffff800a34da88 x12: ffffff800a054000 [ 145.466009] x11: 0000000000012620 x10: ffffff800a34d0d0 [ 145.466013] x9 : 0000000000000001 x8 : ffffffc7ffc8f33f [ 145.466017] x7 : 0000000000000000 x6 : 000000002e2ce00d [ 145.466021] x5 : 0000000000000000 x4 : 0000000000000000 [ 145.466024] x3 : ffffffffffffffff x2 : 00000047f633e000 [ 145.466028] x1 : ffffffc7d6c9e200 x0 : 000000000000002b [ 145.466030] [ 145.466031] ---[ end trace 3e47d24084e613c8 ]--- [ 145.466032] Call trace: [ 145.466035] [] is_host_clk_enabled.part.1+0x34/0x50 [ 145.466038] [] cmdq_reg_writel+0x64/0x90 [ 145.466041] [] cmdq_request+0x304/0x508 [ 145.466043] [] mmc_start_cmdq_request+0x9c/0x128 [ 145.466046] [] mmc_cmdq_start_req+0x3c/0x60 [ 145.466049] [] mmc_blk_cmdq_issue_rq+0x304/0x598 [ 145.466051] [] mmc_cmdq_thread+0x104/0x1f0 [ 145.466054] [] kthread+0xec/0xf0 [ 145.466057] [] ret_from_fork+0x10/0x30 [ 146.488956] sdhci-tegra 3460000.sdhci: Reg 0x28 being accessed without clock [ 146.488985] ------------[ cut here ]------------ [ 146.488993] WARNING: CPU: 7 PID: 1988 at /kernel/kernel-4.9/drivers/mmc/host/sdhci-tegra.c:281 tegra_sdhci_is_clk_enabled.isra.1+0x48/0x60 [ 146.489023] Modules linked in: nvgpu ath10k_pci ath10k_core ath mac80211 pps_gpio ppsya_gen_gpio mttcan can_dev btusb btrtl btbcm btintel option usb_wwan cfg80211 ip_tables x_tables [ 146.489024] [ 146.489040] CPU: 7 PID: 1988 Comm: mmc_cmdq_d/0 Tainted: G D W 4.9.253-yasdc-32.6.1-2022-01-12-b0 #3 [ 146.489042] Hardware name: Yandex Xavier (DT) [ 146.489044] task: ffffffc7d6c9e200 task.stack: ffffffc7d6990000 [ 146.489047] PC is at tegra_sdhci_is_clk_enabled.isra.1+0x48/0x60 [ 146.489049] LR is at tegra_sdhci_is_clk_enabled.isra.1+0x48/0x60 [ 146.489052] pc : [] lr : [] pstate: 20c000c5 [ 146.489053] sp : ffffffc7d6993c00 [ 146.489059] x29: ffffffc7d6993c00 x28: 0000000000000002 [ 146.489063] x27: ffffffc7d69a0000 x26: ffffffc7d7732800 [ 146.489067] x25: ffffffc7d7732800 x24: 0000000000000378 [ 146.489070] x23: 00000000000000ff x22: 0000000000000040 [ 146.489074] x21: ffffffc7d71957c0 x20: 0000000000000028 [ 146.489078] x19: ffffffc7d7195000 x18: 0000000000000020 [ 146.489081] x17: 0000000000001400 x16: 0000000000000000 [ 146.489085] x15: ffffffffffffffff x14: ffffff800a34de58 [ 146.489089] x13: ffffff800a34da9b x12: ffffff800a054000 [ 146.489093] x11: 0000000000013098 x10: ffffff800a34d0d0 [ 146.489097] x9 : 0000000000000001 x8 : ffffffc7ffc8fd93 [ 146.489100] x7 : 0000000000000000 x6 : 000000002e2ce00d [ 146.489104] x5 : 0000000000000000 x4 : 0000000000000000 [ 146.489108] x3 : ffffffffffffffff x2 : 00000047f63ce000 [ 146.489112] x1 : ffffffc7d6c9e200 x0 : 0000000000000040 [ 146.489113] [ 146.489114] ---[ end trace 3e47d24084e613c9 ]--- [ 146.489116] Call trace: [ 146.489119] [] tegra_sdhci_is_clk_enabled.isra.1+0x48/0x60 [ 146.489122] [] tegra_sdhci_readb+0x28/0x60 [ 146.489125] [] sdhci_led_control+0xe8/0x108 [ 146.489129] [] led_set_brightness_nopm+0x30/0x58 [ 146.489132] [] led_set_brightness+0x5c/0x90 [ 146.489136] [] led_trigger_event+0x54/0x80 [ 146.489139] [] mmc_start_cmdq_request+0x88/0x128 [ 146.489141] [] mmc_cmdq_start_req+0x3c/0x60 [ 146.489144] [] mmc_blk_cmdq_issue_rq+0x304/0x598 [ 146.489147] [] mmc_cmdq_thread+0x104/0x1f0 [ 146.489150] [] kthread+0xec/0xf0 [ 146.489154] [] ret_from_fork+0x10/0x30 [ 146.489159] sdhci-tegra 3460000.sdhci: Reg 0x28 being accessed without clock [ 146.489183] ------------[ cut here ]------------ [ 146.489186] WARNING: CPU: 7 PID: 1988 at /kernel/kernel-4.9/drivers/mmc/host/sdhci-tegra.c:281 tegra_sdhci_is_clk_enabled.isra.1+0x48/0x60 [ 146.489206] Modules linked in: nvgpu ath10k_pci ath10k_core ath mac80211 pps_gpio ppsya_gen_gpio mttcan can_dev btusb btrtl btbcm btintel option usb_wwan cfg80211 ip_tables x_tables [ 146.489207] [ 146.489217] CPU: 7 PID: 1988 Comm: mmc_cmdq_d/0 Tainted: G D W 4.9.253-yasdc-32.6.1-2022-01-12-b0 #3 [ 146.489219] Hardware name: Yandex Xavier (DT) [ 146.489221] task: ffffffc7d6c9e200 task.stack: ffffffc7d6990000 [ 146.489223] PC is at tegra_sdhci_is_clk_enabled.isra.1+0x48/0x60 [ 146.489225] LR is at tegra_sdhci_is_clk_enabled.isra.1+0x48/0x60 [ 146.489227] pc : [] lr : [] pstate: 20c000c5 [ 146.489228] sp : ffffffc7d6993bf0 [ 146.489232] x29: ffffffc7d6993bf0 x28: 0000000000000002 [ 146.489236] x27: ffffffc7d69a0000 x26: ffffffc7d7732800 [ 146.489239] x25: ffffffc7d7732800 x24: 0000000000000378 [ 146.489243] x23: 00000000000000ff x22: 0000000000000001 [ 146.489247] x21: ffffff8009197770 x20: 0000000000000028 [ 146.489250] x19: ffffffc7d7195000 x18: 0000000000000020 [ 146.489254] x17: 0000000000001400 x16: 0000000000000000 [ 146.489257] x15: ffffffffffffffff x14: ffffff800a34de58 [ 146.489261] x13: ffffff800a34da9b x12: ffffff800a054000 [ 146.489265] x11: 0000000000013bc4 x10: ffffff800a34d0d0 [ 146.489269] x9 : 0000000000000001 x8 : ffffffc7ffc908cf [ 146.489272] x7 : 0000000000000000 x6 : 000000002e2ce00d [ 146.489276] x5 : 0000000000000000 x4 : 0000000000000000 [ 146.489280] x3 : ffffffffffffffff x2 : 00000047f63ce000 [ 146.489283] x1 : ffffffc7d6c9e200 x0 : 0000000000000040 [ 146.489284] [ 146.489286] ---[ end trace 3e47d24084e613ca ]--- [ 146.489287] Call trace: [ 146.489290] [] tegra_sdhci_is_clk_enabled.isra.1+0x48/0x60 [ 146.489292] [] tegra_sdhci_writeb+0x34/0x70 [ 146.489295] [] sdhci_led_control+0xd8/0x108 [ 146.489298] [] led_set_brightness_nopm+0x30/0x58 [ 146.489302] [] led_set_brightness+0x5c/0x90 [ 146.489305] [] led_trigger_event+0x54/0x80 [ 146.489307] [] mmc_start_cmdq_request+0x88/0x128 [ 146.489310] [] mmc_cmdq_start_req+0x3c/0x60 [ 146.489313] [] mmc_blk_cmdq_issue_rq+0x304/0x598 [ 146.489315] [] mmc_cmdq_thread+0x104/0x1f0 [ 146.489318] [] kthread+0xec/0xf0 [ 146.489320] [] ret_from_fork+0x10/0x30 [ 146.489334] mmc0: Reg 0x28 being accessed without clock [ 146.489358] ------------[ cut here ]------------ [ 146.489361] WARNING: CPU: 7 PID: 1988 at /kernel/kernel-4.9/drivers/mmc/host/cmdq_hci.c:49 is_host_clk_enabled.part.1+0x34/0x50 [ 146.489382] Modules linked in: nvgpu ath10k_pci ath10k_core ath mac80211 pps_gpio ppsya_gen_gpio mttcan can_dev btusb btrtl btbcm btintel option usb_wwan cfg80211 ip_tables x_tables [ 146.489383] [ 146.489393] CPU: 7 PID: 1988 Comm: mmc_cmdq_d/0 Tainted: G D W 4.9.253-yasdc-32.6.1-2022-01-12-b0 #3 [ 146.489395] Hardware name: Yandex Xavier (DT) [ 146.489397] task: ffffffc7d6c9e200 task.stack: ffffffc7d6990000 [ 146.489399] PC is at is_host_clk_enabled.part.1+0x34/0x50 [ 146.489401] LR is at is_host_clk_enabled.part.1+0x34/0x50 [ 146.489403] pc : [] lr : [] pstate: 20c000c5 [ 146.489404] sp : ffffffc7d6993c20 [ 146.489408] x29: ffffffc7d6993c20 x28: ffffffc7d6a30810 [ 146.489412] x27: 0000000000000001 x26: 0000000000000021 [ 146.489415] x25: 0000000000000001 x24: 0000000000000001 [ 146.489419] x23: ffffffc7d7195000 x22: ffffffc7d69a0658 [ 146.489422] x21: 0000000000000023 x20: 0000000000000028 [ 146.489426] x19: ffffffc7d7195000 x18: 0000000000000020 [ 146.489429] x17: 0000000000001400 x16: 0000000000000000 [ 146.489433] x15: ffffffffffffffff x14: ffffff800a34de58 [ 146.489437] x13: ffffff800a34da88 x12: ffffff800a054000 [ 146.489440] x11: 00000000000146b4 x10: ffffff800a34d000 [ 146.489444] x9 : 0000000000000000 x8 : ffffffc7ffc913c7 [ 146.489448] x7 : 0000000000000000 x6 : 000000002e2ce00d [ 146.489451] x5 : 0000000000000000 x4 : 0000000000000000 [ 146.489455] x3 : ffffffffffffffff x2 : 00000047f63ce000 [ 146.489459] x1 : ffffffc7d6c9e200 x0 : 000000000000002b [ 146.489460] [ 146.489461] ---[ end trace 3e47d24084e613cb ]--- [ 146.489462] Call trace: [ 146.489465] [] is_host_clk_enabled.part.1+0x34/0x50 [ 146.489468] [] cmdq_reg_readl+0x58/0x80 [ 146.489470] [] cmdq_request+0x2a8/0x508 [ 146.489473] [] mmc_start_cmdq_request+0x9c/0x128 [ 146.489475] [] mmc_cmdq_start_req+0x3c/0x60 [ 146.489478] [] mmc_blk_cmdq_issue_rq+0x304/0x598 [ 146.489481] [] mmc_cmdq_thread+0x104/0x1f0 [ 146.489483] [] kthread+0xec/0xf0 [ 146.489486] [] ret_from_fork+0x10/0x30 [ 146.489489] sdhci-tegra 3460000.sdhci: Reg 0x2e being accessed without clock [ 146.489512] ------------[ cut here ]------------ [ 146.489515] WARNING: CPU: 7 PID: 1988 at /kernel/kernel-4.9/drivers/mmc/host/sdhci-tegra.c:281 tegra_sdhci_is_clk_enabled.isra.1+0x48/0x60 [ 146.489534] Modules linked in: nvgpu ath10k_pci ath10k_core ath mac80211 pps_gpio ppsya_gen_gpio mttcan can_dev btusb btrtl btbcm btintel option usb_wwan cfg80211 ip_tables x_tables [ 146.489535] [ 146.489545] CPU: 7 PID: 1988 Comm: mmc_cmdq_d/0 Tainted: G D W 4.9.253-yasdc-32.6.1-2022-01-12-b0 #3 [ 146.489546] Hardware name: Yandex Xavier (DT) [ 146.489548] task: ffffffc7d6c9e200 task.stack: ffffffc7d6990000 [ 146.489550] PC is at tegra_sdhci_is_clk_enabled.isra.1+0x48/0x60 [ 146.489551] LR is at tegra_sdhci_is_clk_enabled.isra.1+0x48/0x60 [ 146.489554] pc : [] lr : [] pstate: 20c000c5 [ 146.489555] sp : ffffffc7d6993bf0 [ 146.489559] x29: ffffffc7d6993bf0 x28: ffffffc7d6a30810 [ 146.489562] x27: 0000000000000001 x26: 0000000000000021 [ 146.489566] x25: 0000000000000001 x24: 0000000000000001 [ 146.489569] x23: ffffffc7d7195000 x22: 000000000000000e [ 146.489573] x21: ffffff8009197770 x20: 000000000000002e [ 146.489577] x19: ffffffc7d7195000 x18: 0000000000000020 [ 146.489580] x17: 0000000000001400 x16: 0000000000000000 [ 146.489584] x15: ffffffffffffffff x14: ffffff800a34de58 [ 146.489587] x13: ffffff800a34da9b x12: ffffff800a054000 [ 146.489591] x11: 0000000000015124 x10: ffffff800a34d0d0 [ 146.489594] x9 : 0000000000000001 x8 : ffffffc7ffc91e1b [ 146.489598] x7 : 0000000000000000 x6 : 000000002e2ce00d [ 146.489602] x5 : 0000000000000000 x4 : 0000000000000000 [ 146.489606] x3 : ffffffffffffffff x2 : 00000047f63ce000 [ 146.489609] x1 : ffffffc7d6c9e200 x0 : 0000000000000040 [ 146.489610] [ 146.489612] ---[ end trace 3e47d24084e613cc ]--- [ 146.489613] Call trace: [ 146.489615] [] tegra_sdhci_is_clk_enabled.isra.1+0x48/0x60 [ 146.489618] [] tegra_sdhci_writeb+0x34/0x70 [ 146.489621] [] sdhci_cmdq_set_data_timeout+0x58/0x68 [ 146.489624] [] cmdq_request+0x2f4/0x508 [ 146.489626] [] mmc_start_cmdq_request+0x9c/0x128 [ 146.489629] [] mmc_cmdq_start_req+0x3c/0x60 [ 146.489631] [] mmc_blk_cmdq_issue_rq+0x304/0x598 [ 146.489634] [] mmc_cmdq_thread+0x104/0x1f0 [ 146.489636] [] kthread+0xec/0xf0 [ 146.489639] [] ret_from_fork+0x10/0x30 [ 146.489641] mmc0: Reg 0x28 being accessed without clock [ 146.489664] ------------[ cut here ]------------ [ 146.489668] WARNING: CPU: 7 PID: 1988 at /kernel/kernel-4.9/drivers/mmc/host/cmdq_hci.c:49 is_host_clk_enabled.part.1+0x34/0x50 [ 146.489687] Modules linked in: nvgpu ath10k_pci ath10k_core ath mac80211 pps_gpio ppsya_gen_gpio mttcan can_dev btusb btrtl btbcm btintel option usb_wwan cfg80211 ip_tables x_tables [ 146.489689] [ 146.489696] CPU: 7 PID: 1988 Comm: mmc_cmdq_d/0 Tainted: G D W 4.9.253-yasdc-32.6.1-2022-01-12-b0 #3 [ 146.489699] Hardware name: Yandex Xavier (DT) [ 146.489701] task: ffffffc7d6c9e200 task.stack: ffffffc7d6990000 [ 146.489704] PC is at is_host_clk_enabled.part.1+0x34/0x50 [ 146.489706] LR is at is_host_clk_enabled.part.1+0x34/0x50 [ 146.489708] pc : [] lr : [] pstate: 20c000c5 [ 146.489709] sp : ffffffc7d6993c10 [ 146.489713] x29: ffffffc7d6993c10 x28: ffffffc7d6a30810 [ 146.489717] x27: 0000000000000001 x26: 0000000000000021 [ 146.489721] x25: 0000000000000001 x24: 0000000000000001 [ 146.489724] x23: ffffffc7d7195000 x22: ffffffc7d69a0658 [ 146.489728] x21: 0000000000000002 x20: 0000000000000028 [ 146.489732] x19: ffffffc7d7195000 x18: 0000000000000020 [ 146.489735] x17: 0000000000001400 x16: 0000000000000000 [ 146.489739] x15: ffffffffffffffff x14: ffffff800a34de58 [ 146.489742] x13: ffffff800a34da88 x12: ffffff800a054000 [ 146.489746] x11: 0000000000015b94 x10: ffffff800a34d000 [ 146.489750] x9 : 0000000000000000 x8 : ffffffc7ffc9288f [ 146.489754] x7 : 0000000000000000 x6 : 000000002e2ce00d [ 146.489757] x5 : 0000000000000000 x4 : 0000000000000000 [ 146.489761] x3 : ffffffffffffffff x2 : 00000047f63ce000 [ 146.489765] x1 : ffffffc7d6c9e200 x0 : 000000000000002b [ 146.489766] [ 146.489767] ---[ end trace 3e47d24084e613cd ]--- [ 146.489768] Call trace: [ 146.489771] [] is_host_clk_enabled.part.1+0x34/0x50 [ 146.489774] [] cmdq_reg_writel+0x64/0x90 [ 146.489777] [] cmdq_request+0x304/0x508 [ 146.489779] [] mmc_start_cmdq_request+0x9c/0x128 [ 146.489782] [] mmc_cmdq_start_req+0x3c/0x60 [ 146.489785] [] mmc_blk_cmdq_issue_rq+0x304/0x598 [ 146.489787] [] mmc_cmdq_thread+0x104/0x1f0 [ 146.489790] [] kthread+0xec/0xf0 [ 146.489792] [] ret_from_fork+0x10/0x30 [ 148.125371] [] gic_handle_irq+0x5c/0xb0 [ 148.130960] [] el1_irq+0xe8/0x194 [ 148.135428] [] cpuidle_enter_state+0xb8/0x380 [ 148.141459] [] cpuidle_enter+0x34/0x48 [ 148.146884] [] call_cpuidle+0x44/0x70 [ 148.152134] [] cpu_startup_entry+0x1b0/0x200 [ 148.158088] [] rest_init+0x84/0x90 [ 148.163075] [] start_kernel+0x374/0x38c [ 148.168496] [] __primary_switched+0x80/0x94 [ 148.421025] CPU:0, Error:BPMP-NOC@0xd600000,irq=482 [ 148.421120] ************************************** [ 148.421197] * For more Internal Decode Help [ 148.421262] * http://nv/cbberr [ 148.421316] * NVIDIA userID is required to access [ 148.421390] ************************************** [ 148.421466] CPU:0, Error:BPMP-NOC [ 148.421522] Error Logger : 0 [ 148.421584] ErrLog0 : 0x80030008 [ 148.421644] Transaction Type : WR - Write, Incrementing [ 148.421734] Error Code : SLV [ 148.421788] Error Source : Target [ 148.421849] Error Description : Target error detected by CBB slave [ 148.421953] AXI2APB_0 bridge error: SFIFONE - Status FIFO Not Empty interrupt[ 148.422071] AXI2APB_0 bridge error: TIM - Timer(Timeout) interrupt [ 148.422369] Packet header Lock : 0 [ 148.422646] Packet header Len1 : 3 [ 148.422921] NOC protocol version : version >= 2.7 [ 148.423301] ErrLog1 : 0xbba01 [ 148.423563] ErrLog2 : 0x0 [ 148.423786] RouteId : 0xbba01 [ 148.424031] InitFlow : cpu_p_i/I/0 [ 148.425465] Targflow : cbb_t/T/0 [ 148.429054] TargSubRange : 13 [ 148.432377] SeqId : 0 [ 148.435089] ErrLog3 : 0x3e0c008 [ 148.438502] ErrLog4 : 0x0 [ 148.441238] Address : 0x13e0c008 -- hypervisor + 0xc008 [ 148.446815] ErrLog5 : 0xcfa30 [ 148.450230] Master ID : BPMP [ 148.453553] Security Group(GRPSEC): 0x7d [ 148.457494] Cache : 0x0 -- Non-cacheable/Non-Bufferable) [ 148.463441] Protection : 0x3 -- Privileged, Non-Secure, Data Access [ 148.470177] FALCONSEC : 0x0 [ 148.473327] Virtual Queuing Channel(VQC): 0x0 [ 148.477797] ************************************** [ 149.560672] bpmp_trywait() timed out (ch 2 mrq 22 data <0xa6 0x00 0x00 0x08>) [ 149.560832] ------------[ cut here ]------------ [ 149.560920] WARNING: CPU: 1 PID: 759 at /kernel/nvidia/drivers/firmware/tegra/mail.c:400 bpmp_trywait+0x1a4/0x1b0 [ 149.561140] Modules linked in: nvgpu ath10k_pci ath10k_core ath mac80211 pps_gpio ppsya_gen_gpio mttcan can_dev btusb btrtl btbcm btintel option usb_wwan cfg80211 ip_tables x_tables [ 149.561496] [ 149.561538] CPU: 1 PID: 759 Comm: kworker/1:1 Tainted: G D W 4.9.253-yasdc-32.6.1-2022-01-12-b0 #3 [ 149.561688] Hardware name: Yandex Xavier (DT) [ 149.561765] Workqueue: pm pm_runtime_work [ 149.561836] task: ffffffc7dac85400 task.stack: ffffffc7daccc000 [ 149.561931] PC is at bpmp_trywait+0x1a4/0x1b0 [ 149.562290] LR is at bpmp_trywait+0x1a4/0x1b0 [ 149.562633] pc : [] lr : [] pstate: 40c00045 [ 149.563214] sp : ffffffc7daccf7c0 [ 149.563455] x29: ffffffc7daccf7c0 x28: ffffff800a3b34e0 [ 149.563908] x27: 0000000000000000 x26: 0000000000000040 [ 149.569427] x25: ffffff800a3b35d8 x24: 0000000000000004 [ 149.574598] x23: ffffffc7daccfb4c x22: 0000000000000016 [ 149.579849] x21: ffffff800919a000 x20: 0000000000000002 [ 149.585876] x19: ffffff800a3b34e0 x18: 0000000000000010 [ 149.591651] x17: 0000007f883b7f50 x16: 00000000000012fd [ 149.597097] x15: ffffffffffffffff x14: ffffff808a34d637 [ 149.602686] x13: ffffff800a34d645 x12: 0000000000000000 [ 149.608539] x11: 0000000005f5e0ff x10: 0000000000000f8d [ 149.614227] x9 : 00000000ffffffd0 x8 : ffffff8008542ec0 [ 149.619750] x7 : ffffff800a0a7a20 x6 : ffffffc7ffcd9bf0 [ 149.625514] x5 : ffffffc7ffcd9bf0 x4 : 0000000000000000 [ 149.630852] x3 : ffffffc7ffcdf7f8 x2 : ffffffc7ffcd9bf0 [ 149.636189] x1 : ffffffc7dac85400 x0 : 0000000000000041 [ 149.641274] [ 149.642928] ---[ end trace 3e47d24084e613ce ]--- [ 149.647390] Call trace: [ 149.649845] [] bpmp_trywait+0x1a4/0x1b0 [ 149.654660] [] tegra_bpmp_send_receive+0x154/0x2b8 [ 149.660782] [] bpmp_send_clk_message+0x40/0xb0 [ 149.666381] [] clk_bpmp_disable+0x38/0x48 [ 149.671719] [] clk_core_unprepare+0x7c/0x1f8 [ 149.677317] [] clk_unprepare+0x34/0x48 [ 149.682141] [] nvhost_module_disable_clk+0x68/0x180 [ 149.688518] [] nvhost_module_runtime_suspend+0xc8/0x160 [ 149.694649] [] pm_generic_runtime_suspend+0x3c/0x58 [ 149.700772] [] genpd_runtime_suspend+0x98/0x230 [ 149.706805] [] __rpm_callback+0x74/0xa0 [ 149.712055] [] rpm_callback+0x34/0x98 [ 149.717047] [] rpm_suspend+0x100/0x5f0 [ 149.722729] [] pm_runtime_work+0x80/0xb8 [ 149.727812] [] process_one_work+0x1e4/0x4b0 [ 149.733842] [] worker_thread+0x50/0x4c8 [ 149.739180] [] kthread+0xec/0xf0 [ 149.743735] [] ret_from_fork+0x10/0x30 [ 152.729510] CPU:0, Error:CBB-NOC@0x2300000,irq=477 [ 152.729615] ************************************** [ 152.729694] * For more Internal Decode Help [ 152.729764] * http://nv/cbberr [ 152.729819] * NVIDIA userID is required to access [ 152.729893] ************************************** [ 152.729970] CPU:0, Error:CBB-NOC [ 152.730025] Error Logger : 1 [ 152.730082] ErrLog0 : 0x80030608 [ 152.730143] Transaction Type : WR - Write, Incrementing [ 152.730233] Error Code : TMO [ 152.730287] Error Source : Target NIU [ 152.730356] Error Description : Target time-out error [ 152.730442] Packet header Lock : 0 [ 152.730500] Packet header Len1 : 3 [ 152.730562] NOC protocol version : version >= 2.7 [ 152.730640] ErrLog1 : 0x251b59 [ 152.730954] ErrLog2 : 0x0 [ 152.731175] RouteId : 0x251b59 [ 152.731434] InitFlow : bpmp_p2ps/I/bpmp_p2ps [ 152.731780] Targflow : host1x_p2pm/T/host1x_p2pm [ 152.732185] TargSubRange : 13 [ 152.732447] SeqId : 0 [ 152.732662] ErrLog3 : 0xc008 [ 152.734297] ErrLog4 : 0x0 [ 152.737284] Address : 0x13e0c008 -- hypervisor + 0xc008 [ 152.742781] ErrLog5 : 0x5619f470 [ 152.746197] Non-Modify : 0x1 [ 152.749692] AXI ID : 0xac [ 152.752668] Master ID : BPMP [ 152.755906] Security Group(GRPSEC): 0x7d [ 152.759672] Cache : 0x0 -- Non-cacheable/Non-Bufferable) [ 152.765706] Protection : 0x3 -- Privileged, Non-Secure, Data Access [ 152.772274] FALCONSEC : 0x0 [ 152.775594] Virtual Queuing Channel(VQC): 0x0 [ 152.780062] ************************************** [ 153.912451] tegra_bpmp_send_receive() down_timeout return -62 [ 153.912565] tch_free 0x0 to_complete 0x7 [ 157.031657] CPU:0, Error:CBB-NOC@0x2300000,irq=477 [ 157.031760] ************************************** [ 157.031839] * For more Internal Decode Help [ 157.031908] * http://nv/cbberr [ 157.031963] * NVIDIA userID is required to access [ 157.032038] ************************************** [ 157.032121] CPU:0, Error:CBB-NOC [ 157.032176] Error Logger : 1 [ 157.032232] ErrLog0 : 0x80030608 [ 157.032290] Transaction Type : WR - Write, Incrementing [ 157.032379] Error Code : TMO [ 157.032433] Error Source : Target NIU [ 157.032501] Error Description : Target time-out error [ 157.032586] Packet header Lock : 0 [ 157.032644] Packet header Len1 : 3 [ 157.032707] NOC protocol version : version >= 2.7 [ 157.032786] ErrLog1 : 0x351a01 [ 157.033090] ErrLog2 : 0x0 [ 157.033306] RouteId : 0x351a01 [ 157.033579] InitFlow : ccroc_p2ps/I/ccroc_p2ps [ 157.033960] Targflow : host1x_p2pm/T/host1x_p2pm [ 157.034341] TargSubRange : 13 [ 157.034604] SeqId : 0 [ 157.034820] ErrLog3 : 0x18088 [ 157.037043] ErrLog4 : 0x0 [ 157.039859] Address : 0x13e18088 -- guest + 0x8088 [ 157.044658] ErrLog5 : 0x9f851 [ 157.048071] Non-Modify : 0x1 [ 157.051306] AXI ID : 0x0 [ 157.054021] Master ID : CCPLEX [ 157.057258] Security Group(GRPSEC): 0x7e [ 157.061540] Cache : 0x1 -- Device [ 157.065220] Protection : 0x2 -- Unprivileged, Non-Secure, Data Access [ 157.072304] FALCONSEC : 0x0 [ 157.075459] Virtual Queuing Channel(VQC): 0x0 [ 157.079834] ************************************** [ 157.085107] ------------[ cut here ]------------ [ 157.089370] kernel BUG at /kernel/nvidia/drivers/platform/tegra/tegra_cbb.c:839! [ 157.100919] Internal error: Oops - BUG: 0 [#5] PREEMPT SMP [ 157.106255] Modules linked in: nvgpu ath10k_pci ath10k_core ath mac80211 pps_gpio ppsya_gen_gpio mttcan can_dev btusb btrtl btbcm btintel option usb_wwan cfg80211 ip_tables x_tables [ 157.123160] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G D W 4.9.253-yasdc-32.6.1-2022-01-12-b0 #3 [ 157.132679] Hardware name: Yandex Xavier (DT) [ 157.137141] task: ffffff800a041580 task.stack: ffffff800a030000 [ 157.142927] PC is at tegra_cbb_error_isr+0x1a0/0x1a8 [ 157.148082] LR is at tegra_cbb_error_isr+0xc8/0x1a8 [ 157.152980] pc : [] lr : [] pstate: 604001c5 [ 157.160245] sp : ffffffc7ffcc0bf0 [ 157.163657] x29: ffffffc7ffcc0bf0 x28: 0000000000000006 [ 157.169514] x27: 00000000000001c0 x26: 0000000000000001 [ 157.175289] x25: ffffff800a3d1000 x24: ffffff8009997018 [ 157.180548] x23: ffffff8009656278 x22: 0000000000000001 [ 157.186054] x21: 00000000000001dd x20: ffffff800a207438 [ 157.191311] x19: ffffff800a207438 x18: 0000000000000010 [ 157.197087] x17: 0000000000340000 x16: 000000000000000e [ 157.202940] x15: ffffffffffffffff x14: ffffff808a34d637 [ 157.208461] x13: ffffff800a34d645 x12: 0000000000000000 [ 157.214402] x11: 0000000005f5e0ff x10: 0000000000001007 [ 157.220089] x9 : 00000000ffffffd0 x8 : ffffff8008542ec0 [ 157.225611] x7 : ffffff800a0a7a20 x6 : 0000000000000000 [ 157.231376] x5 : 0000000000000000 x4 : ffffffc7ffcc1be8 [ 157.236714] x3 : ffffffc7ffcc1be8 x2 : 0000000000000007 [ 157.242053] x1 : ffffff800a041580 x0 : 0000000000010101 [ 157.247389] [ 157.248798] Process swapper/0 (pid: 0, stack limit = 0xffffff800a030000) [ 157.255179] Call trace: [ 157.257545] [] tegra_cbb_error_isr+0x1a0/0x1a8 [ 157.262887] [] __handle_irq_event_percpu+0x68/0x288 [ 157.269011] [] handle_irq_event_percpu+0x28/0x60 [ 157.274872] [] handle_irq_event+0x50/0x80 [ 157.280210] [] handle_fasteoi_irq+0xd4/0x1c0 [ 157.285893] [] generic_handle_irq+0x34/0x50 [ 157.291230] [] __handle_domain_irq+0x68/0xc0 [ 157.296573] [] gic_handle_irq+0x5c/0xb0 [ 157.301822] [] el1_irq+0xe8/0x194 [ 157.306373] [] irq_exit+0xd0/0x118 [ 157.310834] [] __handle_domain_irq+0x6c/0xc0 [ 157.317130] [] gic_handle_irq+0x5c/0xb0 [ 157.322380] [] el1_irq+0xe8/0x194 [ 157.327370] [] cpuidle_enter_state+0xb8/0x380 [ 157.333318] [] cpuidle_enter+0x34/0x48 [ 157.338743] [] call_cpuidle+0x44/0x70 [ 157.343734] [] cpu_startup_entry+0x1b0/0x200 [ 157.349859] [] rest_init+0x84/0x90 [ 157.354672] [] start_kernel+0x374/0x38c [ 157.360181] [] __primary_switched+0x80/0x94 [ 157.365789] ---[ end trace 3e47d24084e613cf ]--- [ 157.379049] Kernel panic - not syncing: Fatal exception in interrupt [ 157.379168] SMP: stopping secondary CPUs [ 157.380834] Kernel Offset: disabled [ 157.384072] Memory Limit: none [ 157.387479] trusty-log panic notifier - trusty version Built: 18:08:23 Apr 8 2020 [ 157.403524] Rebooting in 5 seconds.. ���� [0000.055] W> RATCHET: MB1 binary ratchet value 4 is too large than ratchet level 2 from HW fuses. [0000.063] I> MB1 (prd-version: 1.5.1.6-t194-41334769-1740dd39) [0000.069] I> Boot-mode: Coldboot [0000.071] I> Chip revision : A02P [0000.075] I> Bootrom patch version : 15 (correctly patched) ... [0004.271] I> ########## Fixed storage boot ########## [0004.282] I> Already published: 00010003 [0004.282] I> Look for boot partition [0004.283] I> Fallback: assuming 0th partition is boot partition [0004.289] I> Detect filesystem [0004.316] I> Loading extlinux.conf ... [0004.316] I> rootfs path: /sdmmc_user/boot/extlinux/extlinux.conf [0004.347] I> L4T boot options [0004.347] I> [1]: "primary kernel" [0004.347] I> Enter choice: [0007.348] I> Continuing with default option: 1 [0007.348] I> Loading kernel sig file from rootfs ... [0007.348] I> rootfs path: /sdmmc_user/boot/Image.sig [0013.573] I> lookup_linear_dir:447: Invalid file block num [0013.574] I> ext2_walk:142: 'Image.sig' lookup failed [0013.574] I> ext4_open_file:666: '/boot/Image.sig' lookup failed [0013.575] E> file /sdmmc_user/boot/Image.sig open failed!! [0013.575] W> Failed to load kernel sig file (err=202113041) [0013.575] I> Loading kernel binary from rootfs ... [0013.580] I> rootfs path: /sdmmc_user/boot/Image [0019.788] I> lookup_linear_dir:447: Invalid file block num [0019.789] I> ext2_walk:142: 'Image' lookup failed [0019.789] I> ext4_open_file:666: '/boot/Image' lookup failed [0019.789] E> file /sdmmc_user/boot/Image open failed!! [0019.790] W> Failed to load kernel binary from rootfs (err=202113041) [0019.790] I> A/B: bin_type (37) slot 1 [0019.793] I> Loading kernel_b from partition [0019.798] I> Loading partition kernel_b at 0xa4ad0000 from device(0x1) [0020.293] I> Validate kernel ... [0020.293] I> T19x: Authenticate kernel (bin_type: 37), max size 0x5000000 [0020.705] I> Encryption fuse is not ON [0020.739] I> Checking boot.img header magic ... [0020.739] I> [OK] [0020.739] I> No kernel-dtb binary path [0020.740] I> A/B: bin_type (38) slot 1 [0020.740] I> Loading kernel-dtb_b from partition [0020.740] I> Loading partition kernel-dtb_b at 0x91000000 from device(0x1) [0020.749] I> Validate kernel-dtb ... [0020.749] I> T19x: Authenticate kernel-dtb (bin_type: 38), max size 0x400000 [0020.752] I> Encryption fuse is not ON [0020.753] I> Loading ramdisk from rootfs ... [0020.756] I> Loading initrd sig file from rootfs ... [0020.761] I> rootfs path: /sdmmc_user/boot/initrd.sig [0020.790] I> Loading initrd binary from rootfs ... [0020.791] I> rootfs path: /sdmmc_user/boot/initrd [0020.859] I> overload load_size to 8983758 (from 8983760) [0020.862] I> Validate initrd ... [0020.863] I> T19x: Authenticate initrd (bin_type: 49), max size 0x4000000 [0020.945] I> Encryption fuse is not ON [0020.958] I> Kernel hdr @0xa4ad0000 [0020.959] I> Kernel dtb @0x90000000 [0020.959] I> decompressor handler not found [0020.959] I> Copying kernel image (36302856 bytes) from 0xa4ad0800 to 0x80080000 ... [0020.968] I> Done [0020.968] I> Move ramdisk (len: 8980698) from 0xa6d70000 to 0x96000000 [0020.972] I> Updated bpmp info to DTB [0020.973] I> Ramdisk: Base: 0x96000000; Size: 0x8908da [0020.973] I> Updated initrd info to DTB [0020.974] W> WARN: Fail to override "console=none" in commandline [0020.978] I> Active rootfs suffix: [0020.981] E> tegrabl_linuxboot_add_disp_param, du 1 failed to get display params [0020.988] E> tegrabl_linuxboot_add_disp_param, du 1 failed to get display params [0020.996] I> Active slot suffix: _b [0020.999] I> add_boot_slot_suffix: slot_suffix = _b ... # nvbootctrl dump-slots-info Current bootloader slot: B Active bootloader slot: B magic:0x43424e00, version: 5 features: 0 num_slots: 2 slot: 0, priority: 15, suffix: _a, retry_count: 0, boot_successful: 0 slot: 1, priority: 14, suffix: _b, retry_count: 6, boot_successful: 0