AGX orin kernel reported error

Hi:

JP: 39.2 super

HW: AGX orin 32GB

We found kernel reported some errors , please help us to check it and the log is below:

2026-11-02T09:59:52.566027+08:00 localhost kernel: [TS:46399844120] “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.

2026-11-02T09:59:52.566029+08:00 localhost kernel: [TS:46399844164] task:kworker/u18:0 state:D stack:0 pid:81 tgid:81 ppid:2 flags:0x00000008

2026-11-02T09:59:52.566034+08:00 localhost kernel: [TS:46399844358] Workqueue: events_freezable_power_ thermal_zone_device_check

2026-11-02T09:59:52.566035+08:00 localhost kernel: [TS:46399844641] Call trace:

2026-11-02T09:59:52.566037+08:00 localhost kernel: [TS:46399844690] __switch_to+0xe0/0x110

2026-11-02T09:59:52.566040+08:00 localhost kernel: [TS:46399844874] __schedule+0x37c/0x9a8

2026-11-02T09:59:52.566042+08:00 localhost kernel: [TS:46399844933] schedule+0x38/0xd0

2026-11-02T09:59:52.566043+08:00 localhost kernel: [TS:46399844992] schedule_timeout+0xa8/0x1c0

2026-11-02T09:59:52.566044+08:00 localhost kernel: [TS:46399845085] wait_for_completion_timeout+0x80/0x160

2026-11-02T09:59:52.566044+08:00 localhost kernel: [TS:46399845149] tegra_bpmp_transfer+0x1b4/0x3d8

2026-11-02T09:59:52.566045+08:00 localhost kernel: [TS:46399845296] __tegra_bpmp_thermal_get_temp+0x90/0xf8 [tegra_bpmp_thermal]

2026-11-02T09:59:52.566046+08:00 localhost kernel: [TS:46399845550] tegra_bpmp_thermal_get_temp+0x28/0x40 [tegra_bpmp_thermal]

2026-11-02T09:59:52.566047+08:00 localhost kernel: [TS:46399845617] __thermal_zone_get_temp+0x30/0x118

2026-11-02T09:59:52.566049+08:00 localhost kernel: [TS:46399845694] __thermal_zone_device_update.part.0+0x44/0x3e0

2026-11-02T09:59:52.566050+08:00 localhost kernel: [TS:46399845753] thermal_zone_device_check+0x78/0xa0

2026-11-02T09:59:52.566051+08:00 localhost kernel: [TS:46399845815] process_one_work+0x178/0x410

2026-11-02T09:59:52.566052+08:00 localhost kernel: [TS:46399845969] worker_thread+0x320/0x450

2026-11-02T09:59:52.566053+08:00 localhost kernel: [TS:46399846063] kthread+0x104/0x118

2026-11-02T09:59:52.566055+08:00 localhost kernel: [TS:46399846144] ret_from_fork+0x10/0x20

2026-11-02T09:59:52.566056+08:00 localhost kernel: [TS:46399846412] INFO: task kworker/u17:2:121 blocked for more than 122 seconds.

2026-11-02T09:59:52.566057+08:00 localhost kernel: [TS:46399846490] Tainted: G O 6.8.12-1021-rt-tegra #1

2026-11-02T09:59:52.566058+08:00 localhost kernel: [TS:46399846528] “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.

2026-11-02T09:59:52.566059+08:00 localhost kernel: [TS:46399846568] task:kworker/u17:2 state:D stack:0 pid:121 tgid:121 ppid:2 flags:0x00000008

2026-11-02T09:59:52.566061+08:00 localhost kernel: [TS:46399846684] Workqueue: events_freezable_power_ thermal_zone_device_check

2026-11-02T09:59:52.566062+08:00 localhost kernel: [TS:46399846768] Call trace:

2026-11-02T09:59:52.566063+08:00 localhost kernel: [TS:46399846808] __switch_to+0xe0/0x110

2026-11-02T09:59:52.566064+08:00 localhost kernel: [TS:46399846885] __schedule+0x37c/0x9a8

2026-11-02T09:59:52.566065+08:00 localhost kernel: [TS:46399846936] schedule+0x38/0xd0

2026-11-02T09:59:52.566066+08:00 localhost kernel: [TS:46399846992] schedule_timeout+0xa8/0x1c0

2026-11-02T09:59:52.566076+08:00 localhost kernel: [TS:46399847067] __down_common+0x104/0x220

2026-11-02T09:59:52.566077+08:00 localhost kernel: [TS:46399847128] __down_timeout+0x20/0x38

2026-11-02T09:59:52.566078+08:00 localhost kernel: [TS:46399847188] down_timeout+0x70/0x88

2026-11-02T09:59:52.566095+08:00 localhost kernel: [TS:46399847247] tegra_bpmp_transfer+0xc0/0x3d8

2026-11-02T09:59:52.566096+08:00 localhost kernel: [TS:46399847337] __tegra_bpmp_thermal_get_temp+0x90/0xf8 [tegra_bpmp_thermal]

2026-11-02T09:59:52.566097+08:00 localhost kernel: [TS:46399847408] tegra_bpmp_thermal_get_temp+0x28/0x40 [tegra_bpmp_thermal]

2026-11-02T09:59:52.566098+08:00 localhost kernel: [TS:46399847461] __thermal_zone_get_temp+0x30/0x118

2026-11-02T09:59:52.566100+08:00 localhost kernel: [TS:46399847537] __thermal_zone_device_update.part.0+0x44/0x3e0

2026-11-02T09:59:52.566101+08:00 localhost kernel: [TS:46399847591] thermal_zone_device_check+0x78/0xa0

2026-11-02T09:59:52.566102+08:00 localhost kernel: [TS:46399847645] process_one_work+0x178/0x410

2026-11-02T09:59:52.566103+08:00 localhost kernel: [TS:46399847743] worker_thread+0x320/0x450

2026-11-02T09:59:52.566104+08:00 localhost kernel: [TS:46399847834] kthread+0x104/0x118

2026-11-02T09:59:52.566105+08:00 localhost kernel: [TS:46399847908] ret_from_fork+0x10/0x20

2026-11-02T09:59:52.566107+08:00 localhost kernel: [TS:46399848007] INFO: task kworker/u17:6:125 blocked for more than 122 seconds.

2026-11-02T09:59:52.566108+08:00 localhost kernel: [TS:46399848057] Tainted: G O 6.8.12-1021-rt-tegra #1

2026-11-02T09:59:52.566109+08:00 localhost kernel: [TS:46399848093] “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.

2026-11-02T09:59:52.566110+08:00 localhost kernel: [TS:46399848128] task:kworker/u17:6 state:D stack:0 pid:125 tgid:125 ppid:2 flags:0x00000008

2026-11-02T09:59:52.566111+08:00 localhost kernel: [TS:46399848233] Workqueue: events_freezable_power_ thermal_zone_device_check

2026-11-02T09:59:52.566112+08:00 localhost kernel: [TS:46399848308] Call trace:

2026-11-02T09:59:52.566113+08:00 localhost kernel: [TS:46399848340] __switch_to+0xe0/0x110

2026-11-02T09:59:52.566114+08:00 localhost kernel: [TS:46399848407] __schedule+0x37c/0x9a8

2026-11-02T09:59:52.566115+08:00 localhost kernel: [TS:46399848456] rt_mutex_schedule+0x2c/0x58

2026-11-02T09:59:52.566116+08:00 localhost kernel: [TS:46399848585] rt_mutex_slowlock_block.constprop.0+0xb0/0x188

2026-11-02T09:59:52.566117+08:00 localhost kernel: [TS:46399848658] __rt_mutex_slowlock_locked.constprop.0+0xec/0x268

2026-11-02T09:59:52.566118+08:00 localhost kernel: [TS:46399848750] mutex_lock+0x84/0xb0

2026-11-02T09:59:52.566119+08:00 localhost kernel: [TS:46399848815] thermal_zone_device_check+0x30/0xa0

2026-11-02T09:59:52.566120+08:00 localhost kernel: [TS:46399848868] process_one_work+0x178/0x410

2026-11-02T09:59:52.566121+08:00 localhost kernel: [TS:46399848959] worker_thread+0x320/0x450

2026-11-02T09:59:52.566122+08:00 localhost kernel: [TS:46399849049] kthread+0x104/0x118

2026-11-02T09:59:52.566123+08:00 localhost kernel: [TS:46399849121] ret_from_fork+0x10/0x20

2026-11-02T09:59:52.566124+08:00 localhost kernel: [TS:46399849208] INFO: task kworker/u17:8:127 blocked for more than 122 seconds.

2026-11-02T09:59:52.566125+08:00 localhost kernel: [TS:46399849254] Tainted: G O 6.8.12-1021-rt-tegra #1

2026-11-02T09:59:52.566126+08:00 localhost kernel: [TS:46399849290] “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.

2026-11-02T09:59:52.566127+08:00 localhost kernel: [TS:46399849325] task:kworker/u17:8 state:D stack:0 pid:127 tgid:127 ppid:2 flags:0x00000008

2026-11-02T09:59:52.566128+08:00 localhost kernel: [TS:46399849418] Workqueue: events_freezable_power_ thermal_zone_device_check

2026-11-02T09:59:52.566129+08:00 localhost kernel: [TS:46399849496] Call trace:

2026-11-02T09:59:52.566130+08:00 localhost kernel: [TS:46399849527] __switch_to+0xe0/0x110

2026-11-02T09:59:52.566131+08:00 localhost kernel: [TS:46399849589] __schedule+0x37c/0x9a8

2026-11-02T09:59:52.566132+08:00 localhost kernel: [TS:46399849642] schedule+0x38/0xd0

2026-11-02T09:59:52.566133+08:00 localhost kernel: [TS:46399849699] schedule_timeout+0xa8/0x1c0

2026-11-02T09:59:52.566134+08:00 localhost kernel: [TS:46399849772] __down_common+0x104/0x220

2026-11-02T09:59:52.566153+08:00 localhost kernel: [TS:46399849829] __down_timeout+0x20/0x38

2026-11-02T09:59:52.566154+08:00 localhost kernel: [TS:46399849885] down_timeout+0x70/0x88

2026-11-02T09:59:52.566155+08:00 localhost kernel: [TS:46399849944] tegra_bpmp_transfer+0xc0/0x3d8

2026-11-02T09:59:52.566156+08:00 localhost kernel: [TS:46399850032] __tegra_bpmp_thermal_get_temp+0x90/0xf8 [tegra_bpmp_thermal]

2026-11-02T09:59:52.566157+08:00 localhost kernel: [TS:46399850106] tegra_bpmp_thermal_get_temp+0x28/0x40 [tegra_bpmp_thermal]

2026-11-02T09:59:52.566157+08:00 localhost kernel: [TS:46399850158] __thermal_zone_get_temp+0x30/0x118

2026-11-02T09:59:52.566158+08:00 localhost kernel: [TS:46399850228] __thermal_zone_device_update.part.0+0x44/0x3e0

2026-11-02T09:59:52.566159+08:00 localhost kernel: [TS:46399850281] thermal_zone_device_check+0x78/0xa0

2026-11-02T09:59:52.566161+08:00 localhost kernel: [TS:46399850333] process_one_work+0x178/0x410

2026-11-02T09:59:52.566161+08:00 localhost kernel: [TS:46399850422] worker_thread+0x320/0x450

2026-11-02T09:59:52.566162+08:00 localhost kernel: [TS:46399850511] kthread+0x104/0x118

2026-11-02T09:59:52.566163+08:00 localhost kernel: [TS:46399850583] ret_from_fork+0x10/0x20

2026-11-02T09:59:52.566164+08:00 localhost kernel: [TS:46399851300] INFO: task kworker/u18:1:318 blocked for more than 122 seconds.

2026-11-02T09:59:52.566165+08:00 localhost kernel: [TS:46399851345] Tainted: G O 6.8.12-1021-rt-tegra #1

2026-11-02T09:59:52.566166+08:00 localhost kernel: [TS:46399851377] “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.

2026-11-02T09:59:52.566167+08:00 localhost kernel: [TS:46399851409] task:kworker/u18:1 state:D stack:0 pid:318 tgid:318 ppid:2 flags:0x00000008

2026-11-02T09:59:52.566168+08:00 localhost kernel: [TS:46399851510] Workqueue: events_freezable_power_ thermal_zone_device_check

2026-11-02T09:59:52.566169+08:00 localhost kernel: [TS:46399851583] Call trace:

2026-11-02T09:59:52.566170+08:00 localhost kernel: [TS:46399851615] __switch_to+0xe0/0x110

2026-11-02T09:59:52.566171+08:00 localhost kernel: [TS:46399851687] __schedule+0x37c/0x9a8

2026-11-02T09:59:52.566172+08:00 localhost kernel: [TS:46399851733] schedule+0x38/0xd0

2026-11-02T09:59:52.566173+08:00 localhost kernel: [TS:46399851792] schedule_timeout+0xa8/0x1c0

2026-11-02T09:59:52.566173+08:00 localhost kernel: [TS:46399851865] __down_common+0x104/0x220

2026-11-02T09:59:52.566174+08:00 localhost kernel: [TS:46399851921] __down_timeout+0x20/0x38

2026-11-02T09:59:52.566175+08:00 localhost kernel: [TS:46399851976] down_timeout+0x70/0x88

2026-11-02T09:59:52.566176+08:00 localhost kernel: [TS:46399852033] tegra_bpmp_transfer+0xc0/0x3d8

2026-11-02T09:59:52.566177+08:00 localhost kernel: [TS:46399852118] __tegra_bpmp_thermal_get_temp+0x90/0xf8 [tegra_bpmp_thermal]

2026-11-02T09:59:52.566178+08:00 localhost kernel: [TS:46399852176] tegra_bpmp_thermal_get_temp+0x28/0x40 [tegra_bpmp_thermal]

2026-11-02T09:59:52.566179+08:00 localhost kernel: [TS:46399852227] __thermal_zone_get_temp+0x30/0x118

2026-11-02T09:59:52.566179+08:00 localhost kernel: [TS:46399852307] __thermal_zone_device_update.part.0+0x44/0x3e0

2026-11-02T09:59:52.566181+08:00 localhost kernel: [TS:46399852361] thermal_zone_device_check+0x78/0xa0

2026-11-02T09:59:52.566182+08:00 localhost kernel: [TS:46399852414] process_one_work+0x178/0x410

2026-11-02T09:59:52.566182+08:00 localhost kernel: [TS:46399852510] worker_thread+0x320/0x450

2026-11-02T09:59:52.566183+08:00 localhost kernel: [TS:46399852599] kthread+0x104/0x118

2026-11-02T09:59:52.566184+08:00 localhost kernel: [TS:46399852673] ret_from_fork+0x10/0x20

2026-11-02T09:59:52.566230+08:00 localhost kernel: [TS:46399852779] INFO: task kworker/u18:4:368 blocked for more than 122 seconds.

2026-11-02T09:59:52.566231+08:00 localhost kernel: [TS:46399852820] Tainted: G O 6.8.12-1021-rt-tegra #1

2026-11-02T09:59:52.566232+08:00 localhost kernel: [TS:46399852857] “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.

2026-11-02T09:59:52.566233+08:00 localhost kernel: [TS:46399852894] task:kworker/u18:4 state:D stack:0 pid:368 tgid:368 ppid:2 flags:0x00000008

2026-11-02T09:59:52.566234+08:00 localhost kernel: [TS:46399852988] Workqueue: events_freezable_power_ thermal_zone_device_check

2026-11-02T09:59:52.566235+08:00 localhost kernel: [TS:46399853057] Call trace:

2026-11-02T09:59:52.566236+08:00 localhost kernel: [TS:46399853094] __switch_to+0xe0/0x110

2026-11-02T09:59:52.566236+08:00 localhost kernel: [TS:46399853155] __schedule+0x37c/0x9a8

2026-11-02T09:59:52.566237+08:00 localhost kernel: [TS:46399853202] schedule+0x38/0xd0

2026-11-02T09:59:52.566274+08:00 localhost kernel: [TS:46399853256] schedule_timeout+0xa8/0x1c0

2026-11-02T09:59:52.566277+08:00 localhost kernel: [TS:46399853335] __down_common+0x104/0x220

2026-11-02T09:59:52.566279+08:00 localhost kernel: [TS:46399853390] __down_timeout+0x20/0x38

2026-11-02T09:59:52.566284+08:00 localhost kernel: [TS:46399853444] down_timeout+0x70/0x88

2026-11-02T09:59:52.566285+08:00 localhost kernel: [TS:46399853502] tegra_bpmp_transfer+0xc0/0x3d8

2026-11-02T09:59:52.566286+08:00 localhost kernel: [TS:46399853588] __tegra_bpmp_thermal_get_temp+0x90/0xf8 [tegra_bpmp_thermal]

2026-11-02T09:59:52.566288+08:00 localhost kernel: [TS:46399853645] tegra_bpmp_thermal_get_temp+0x28/0x40 [tegra_bpmp_thermal]

2026-11-02T09:59:52.566289+08:00 localhost kernel: [TS:46399853696] __thermal_zone_get_temp+0x30/0x118

2026-11-02T09:59:52.566291+08:00 localhost kernel: [TS:46399853767] __thermal_zone_device_update.part.0+0x44/0x3e0

2026-11-02T09:59:52.566292+08:00 localhost kernel: [TS:46399853819] thermal_zone_device_check+0x78/0xa0

2026-11-02T09:59:52.566292+08:00 localhost kernel: [TS:46399853870] process_one_work+0x178/0x410

2026-11-02T09:59:52.566293+08:00 localhost kernel: [TS:46399853960] worker_thread+0x320/0x450

2026-11-02T09:59:52.566294+08:00 localhost kernel: [TS:46399854051] kthread+0x104/0x118

2026-11-02T09:59:52.566295+08:00 localhost kernel: [TS:46399854125] ret_from_fork+0x10/0x20

2026-11-02T09:59:52.566296+08:00 localhost kernel: [TS:46399854898] INFO: task wk2xxx:770 blocked for more than 122 seconds.

2026-11-02T09:59:52.566307+08:00 localhost kernel: [TS:46399854938] Tainted: G O 6.8.12-1021-rt-tegra #1

2026-11-02T09:59:52.566309+08:00 localhost kernel: [TS:46399854974] “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.

2026-11-02T09:59:52.566310+08:00 localhost kernel: [TS:46399855010] task:wk2xxx state:D stack:0 pid:770 tgid:770 ppid:2 flags:0x00000008

2026-11-02T09:59:52.566311+08:00 localhost kernel: [TS:46399855090] Call trace:

2026-11-02T09:59:52.566319+08:00 localhost kernel: [TS:46399855121] __switch_to+0xe0/0x110

2026-11-02T09:59:52.566320+08:00 localhost kernel: [TS:46399855186] __schedule+0x37c/0x9a8

2026-11-02T09:59:52.566321+08:00 localhost kernel: [TS:46399855238] schedule+0x38/0xd0

2026-11-02T09:59:52.566330+08:00 localhost kernel: [TS:46399855298] schedule_timeout+0xa8/0x1c0

2026-11-02T09:59:52.566331+08:00 localhost kernel: [TS:46399855382] wait_for_completion_timeout+0x80/0x160

2026-11-02T09:59:52.566333+08:00 localhost kernel: [TS:46399855451] tegra_bpmp_transfer+0x1b4/0x3d8

2026-11-02T09:59:52.566341+08:00 localhost kernel: [TS:46399855545] tegra_bpmp_clk_transfer+0xac/0x108

2026-11-02T09:59:52.566342+08:00 localhost kernel: [TS:46399855688] tegra_bpmp_clk_prepare+0x50/0x88

2026-11-02T09:59:52.566342+08:00 localhost kernel: [TS:46399855745] clk_core_prepare+0x84/0x300

2026-11-02T09:59:52.566350+08:00 localhost kernel: [TS:46399855843] clk_prepare+0x30/0x58

2026-11-02T09:59:52.566351+08:00 localhost kernel: [TS:46399855902] tegra_spi_runtime_resume+0x30/0xa8 [spi_tegra114]

2026-11-02T09:59:52.566351+08:00 localhost kernel: [TS:46399856122] pm_generic_runtime_resume+0x34/0x58

2026-11-02T09:59:52.566354+08:00 localhost kernel: [TS:46399856297] __rpm_callback+0x50/0x1c0

2026-11-02T09:59:52.566355+08:00 localhost kernel: [TS:46399856361] rpm_callback+0x74/0x88

2026-11-02T09:59:52.566356+08:00 localhost kernel: [TS:46399856417] rpm_resume+0x53c/0x768

2026-11-02T09:59:52.566357+08:00 localhost kernel: [TS:46399856479] __pm_runtime_resume+0x50/0x98

2026-11-02T09:59:52.566358+08:00 localhost kernel: [TS:46399856540] __spi_pump_transfer_message+0x25c/0x688

2026-11-02T09:59:52.566358+08:00 localhost kernel: [TS:46399856664] __spi_sync+0x258/0x418

2026-11-02T09:59:52.566359+08:00 localhost kernel: [TS:46399856711] spi_sync+0x38/0x68

2026-11-02T09:59:52.566360+08:00 localhost kernel: [TS:46399856758] wk2xxx_read_global_reg.isra.0+0xf8/0x158 [wk2xxx_spi]

2026-11-02T09:59:52.566361+08:00 localhost kernel: [TS:46399856974] wk2xxx_ist+0x5c/0x1f0 [wk2xxx_spi]

2026-11-02T09:59:52.566362+08:00 localhost kernel: [TS:46399857039] kthread_worker_fn+0xe4/0x268

2026-11-02T09:59:52.566362+08:00 localhost kernel: [TS:46399857133] kthread+0x104/0x118

2026-11-02T09:59:52.566363+08:00 localhost kernel: [TS:46399857212] ret_from_fork+0x10/0x20

2026-11-02T09:59:52.566364+08:00 localhost kernel: [TS:46399857507] INFO: task nvfancontrol:1281 blocked for more than 122 seconds.

2026-11-02T09:59:52.566365+08:00 localhost kernel: [TS:46399857556] Tainted: G O 6.8.12-1021-rt-tegra #1

2026-11-02T09:59:52.566366+08:00 localhost kernel: [TS:46399857589] “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.

2026-11-02T09:59:52.566374+08:00 localhost kernel: [TS:46399857620] task:nvfancontrol state:D stack:0 pid:1281 tgid:1281 ppid:1 flags:0x00000004

2026-11-02T09:59:52.566375+08:00 localhost kernel: [TS:46399857699] Call trace:

2026-11-02T09:59:52.566376+08:00 localhost kernel: [TS:46399857731] __switch_to+0xe0/0x110

2026-11-02T09:59:52.566377+08:00 localhost kernel: [TS:46399857792] __schedule+0x37c/0x9a8

2026-11-02T09:59:52.566378+08:00 localhost kernel: [TS:46399857851] schedule+0x38/0xd0

2026-11-02T09:59:52.566379+08:00 localhost kernel: [TS:46399857905] schedule_timeout+0xa8/0x1c0

2026-11-02T09:59:52.566380+08:00 localhost kernel: [TS:46399857986] wait_for_completion_timeout+0x80/0x160

2026-11-02T09:59:52.566381+08:00 localhost kernel: [TS:46399858042] tegra_bpmp_transfer+0x1b4/0x3d8

2026-11-02T09:59:52.566382+08:00 localhost kernel: [TS:46399858139] __tegra_bpmp_thermal_get_temp+0x90/0xf8 [tegra_bpmp_thermal]

2026-11-02T09:59:52.566382+08:00 localhost kernel: [TS:46399858200] tegra_bpmp_thermal_get_temp+0x28/0x40 [tegra_bpmp_thermal]

2026-11-02T09:59:52.566383+08:00 localhost kernel: [TS:46399858253] __thermal_zone_get_temp+0x30/0x118

2026-11-02T09:59:52.566384+08:00 localhost kernel: [TS:46399858330] thermal_zone_get_temp+0x58/0xa0

2026-11-02T09:59:52.566385+08:00 localhost kernel: [TS:46399858400] temp_show+0x40/0xb0

2026-11-02T09:59:52.566386+08:00 localhost kernel: [TS:46399858461] dev_attr_show+0x28/0x80

2026-11-02T09:59:52.566387+08:00 localhost kernel: [TS:46399858589] sysfs_kf_seq_show+0x94/0x120

2026-11-02T09:59:52.566387+08:00 localhost kernel: [TS:46399858748] kernfs_seq_show+0x34/0x48

2026-11-02T09:59:52.566388+08:00 localhost kernel: [TS:46399858846] seq_read_iter+0xe4/0x490

2026-11-02T09:59:52.566398+08:00 localhost kernel: [TS:46399859017] kernfs_fop_read_iter+0x168/0x1e0

2026-11-02T09:59:52.566399+08:00 localhost kernel: [TS:46399859106] vfs_read+0x22c/0x320

2026-11-02T09:59:52.566400+08:00 localhost kernel: [TS:46399859261] ksys_read+0x7c/0x120

2026-11-02T09:59:52.566401+08:00 localhost kernel: [TS:46399859342] __arm64_sys_read+0x24/0x38

2026-11-02T09:59:52.566402+08:00 localhost kernel: [TS:46399859427] invoke_syscall+0x50/0x128

2026-11-02T09:59:52.566402+08:00 localhost kernel: [TS:46399859553] el0_svc_common.constprop.0+0x48/0xf0

2026-11-02T09:59:52.566403+08:00 localhost kernel: [TS:46399859653] do_el0_svc+0x24/0x38

2026-11-02T09:59:52.566404+08:00 localhost kernel: [TS:46399859746] el0_svc+0x40/0x160

2026-11-02T09:59:52.566405+08:00 localhost kernel: [TS:46399859880] el0t_64_sync_handler+0x120/0x130

2026-11-02T09:59:52.566406+08:00 localhost kernel: [TS:46399859966] el0t_64_sync+0x194/0x198

2026-11-02T09:59:52.566407+08:00 localhost kernel: [TS:46399860672] INFO: task spi_rx:2794 blocked for more than 122 seconds.

2026-11-02T09:59:52.566407+08:00 localhost kernel: [TS:46399860715] Tainted: G O 6.8.12-1021-rt-tegra #1

2026-11-02T09:59:52.566408+08:00 localhost kernel: [TS:46399860747] “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.

2026-11-02T09:59:52.566409+08:00 localhost kernel: [TS:46399860779] task:spi_rx state:D stack:0 pid:2794 tgid:2794 ppid:2780 flags:0x00000004

2026-11-02T09:59:52.566420+08:00 localhost kernel: [TS:46399860857] Call trace:

2026-11-02T09:59:52.566421+08:00 localhost kernel: [TS:46399860893] __switch_to+0xe0/0x110

2026-11-02T09:59:52.566422+08:00 localhost kernel: [TS:46399860963] __schedule+0x37c/0x9a8

2026-11-02T09:59:52.566423+08:00 localhost kernel: [TS:46399861017] schedule+0x38/0xd0

2026-11-02T09:59:52.566423+08:00 localhost kernel: [TS:46399861073] rpm_resume+0x18c/0x768

2026-11-02T09:59:52.566425+08:00 localhost kernel: [TS:46399861141] __pm_runtime_resume+0x50/0x98

2026-11-02T09:59:52.566425+08:00 localhost kernel: [TS:46399861201] tegra_spi_transfer_one_message+0x5c/0x1b70 [spi_tegra124_slave]

2026-11-02T09:59:52.566426+08:00 localhost kernel: [TS:46399861337] __spi_pump_transfer_message+0x21c/0x688

2026-11-02T09:59:52.566427+08:00 localhost kernel: [TS:46399861392] __spi_sync+0x258/0x418

2026-11-02T09:59:52.566428+08:00 localhost kernel: [TS:46399861441] spi_sync+0x38/0x68

2026-11-02T09:59:52.566429+08:00 localhost kernel: [TS:46399861493] spidev_message+0x380/0x520 [spidev]

2026-11-02T09:59:52.566430+08:00 localhost kernel: [TS:46399861620] spidev_ioctl+0x410/0xb98 [spidev]

2026-11-02T09:59:52.566431+08:00 localhost kernel: [TS:46399861681] __arm64_sys_ioctl+0xb4/0x100

2026-11-02T09:59:52.566431+08:00 localhost kernel: [TS:46399861772] invoke_syscall+0x50/0x128

2026-11-02T09:59:52.566432+08:00 localhost kernel: [TS:46399861865] el0_svc_common.constprop.0+0x48/0xf0

2026-11-02T09:59:52.566433+08:00 localhost kernel: [TS:46399861956] do_el0_svc+0x24/0x38

2026-11-02T09:59:52.566434+08:00 localhost kernel: [TS:46399862042] el0_svc+0x40/0x160

2026-11-02T09:59:52.566435+08:00 localhost kernel: [TS:46399862137] el0t_64_sync_handler+0x120/0x130

2026-11-02T09:59:52.566436+08:00 localhost kernel: [TS:46399862222] el0t_64_sync+0x194/0x198

2026-11-02T09:59:52.566436+08:00 localhost kernel: [TS:46399863203] INFO: task gpsd:3511 blocked for more than 122 seconds.

2026-11-02T09:59:52.566437+08:00 localhost kernel: [TS:46399863248] Tainted: G O 6.8.12-1021-rt-tegra #1

2026-11-02T09:59:52.566438+08:00 localhost kernel: [TS:46399863281] “echo 0 > /proc/sys/kernel/hung_task_timeout_secs” disables this message.

2026-11-02T09:59:52.566448+08:00 localhost kernel: [TS:46399863313] task:gpsd state:D stack:0 pid:3511 tgid:3511 ppid:1 flags:0x00000004

2026-11-02T09:59:52.566450+08:00 localhost kernel: [TS:46399863387] Call trace:

2026-11-02T09:59:52.566451+08:00 localhost kernel: [TS:46399863417] __switch_to+0xe0/0x110

2026-11-02T09:59:52.566474+08:00 localhost kernel: [TS:46399863479] __schedule+0x37c/0x9a8

2026-11-02T09:59:52.566482+08:00 localhost kernel: [TS:46399863532] rt_mutex_schedule+0x2c/0x58

2026-11-02T09:59:52.566483+08:00 localhost kernel: [TS:46399863652] rt_mutex_slowlock_block.constprop.0+0xb0/0x188

2026-11-02T09:59:52.566484+08:00 localhost kernel: [TS:46399863721] __rt_mutex_slowlock_locked.constprop.0+0xec/0x268

2026-11-02T09:59:52.566485+08:00 localhost kernel: [TS:46399863804] mutex_lock+0x84/0xb0

2026-11-02T09:59:52.566486+08:00 localhost kernel: [TS:46399863869] wk2xxx_read_slave_reg.isra.0+0xa8/0x168 [wk2xxx_spi]

2026-11-02T09:59:52.566487+08:00 localhost kernel: [TS:46399863958] wk2xxx_termios+0x1a0/0x330 [wk2xxx_spi]

2026-11-02T09:59:52.566488+08:00 localhost kernel: [TS:46399864023] uart_change_line_settings+0x48/0x1d0

2026-11-02T09:59:52.566489+08:00 localhost kernel: [TS:46399864156] uart_set_termios+0x80/0x170

2026-11-02T09:59:52.566490+08:00 localhost kernel: [TS:46399864257] tty_set_termios+0x198/0x248

2026-11-02T09:59:52.566491+08:00 localhost kernel: [TS:46399864396] set_termios+0x210/0x2d0

2026-11-02T09:59:52.566492+08:00 localhost kernel: [TS:46399864489] tty_mode_ioctl+0x534/0x680

2026-11-02T09:59:52.566492+08:00 localhost kernel: [TS:46399864589] n_tty_ioctl_helper+0x40/0x170

2026-11-02T09:59:52.566493+08:00 localhost kernel: [TS:46399864691] n_tty_ioctl+0x128/0x2c0

2026-11-02T09:59:52.566494+08:00 localhost kernel: [TS:46399864788] tty_ioctl+0x110/0xf68

2026-11-02T09:59:52.566495+08:00 localhost kernel: [TS:46399864876] __arm64_sys_ioctl+0xb4/0x100

2026-11-02T09:59:52.566496+08:00 localhost kernel: [TS:46399864962] invoke_syscall+0x50/0x128

2026-11-02T09:59:52.566496+08:00 localhost kernel: [TS:46399865053] el0_svc_common.constprop.0+0x48/0xf0

2026-11-02T09:59:52.566497+08:00 localhost kernel: [TS:46399865150] do_el0_svc+0x24/0x38

2026-11-02T09:59:52.566506+08:00 localhost kernel: [TS:46399865235] el0_svc+0x40/0x160

2026-11-02T09:59:52.566507+08:00 localhost kernel: [TS:46399865324] el0t_64_sync_handler+0x120/0x130

2026-11-02T09:59:52.566508+08:00 localhost kernel: [TS:46399865408] el0t_64_sync+0x194/0x198

2026-11-02T09:59:52.566509+08:00 localhost kernel: [TS:46399865459] Future hung task reports are suppressed, see sysctl kernel.hung_task_warnings

2026-11-02T10:07:35.413986+08:00 localhost kernel: [TS:60863844131] thermal thermal_zone7: failed to read out thermal zone (-62)

2026-11-02T10:07:35.414006+08:00 localhost kernel: [TS:60863844124] spi-tegra114 c260000.spi: clk_prepare failed: -110

2026-11-02T10:07:35.414009+08:00 localhost kernel: [TS:60863844186] thermal thermal_zone3: failed to read out thermal zone (-62)

2026-11-02T10:07:35.414013+08:00 localhost kernel: [TS:60863844385] thermal thermal_zone8: failed to read out thermal zone (-62)

2026-11-02T10:07:35.414033+08:00 localhost kernel: [TS:60863844577] spi_master spi1: Failed to power device: -110

2026-11-02T10:07:35.414036+08:00 localhost kernel: [TS:60863844703] spi_master spi1: noqueue transfer failed

2026-11-02T10:07:35.414038+08:00 localhost kernel: [TS:60863844757] spi-tegra114 c260000.spi: Runtime PM usage count underflow!

2026-11-02T10:07:35.414040+08:00 localhost kernel: [TS:60863845042] thermal thermal_zone4: failed to read out thermal zone (-62)

2026-11-02T10:07:35.414041+08:00 localhost kernel: [TS:60863845158] spi_master spi1: Failed to power device: -22

2026-11-02T10:07:35.414043+08:00 localhost kernel: [TS:60863845235] spi_master spi1: noqueue transfer failed

2026-11-02T10:07:35.414044+08:00 localhost kernel: [TS:60863845287] spi-tegra114 c260000.spi: Runtime PM usage count underflow!

2026-11-02T10:07:35.414047+08:00 localhost kernel: [TS:60863845469] thermal thermal_zone1: failed to read out thermal zone (-62)

2026-11-02T10:07:35.414048+08:00 localhost kernel: [TS:60863845499] spi_master spi1: Failed to power device: -22

2026-11-02T10:07:35.414049+08:00 localhost kernel: [TS:60863845551] thermal thermal_zone6: failed to read out thermal zone (-62)

2026-11-02T10:07:35.414049+08:00 localhost kernel: [TS:60863845706] spi_master spi1: noqueue transfer failed

2026-11-02T10:07:35.414050+08:00 localhost kernel: [TS:60863845813] spi-tegra114 c260000.spi: Runtime PM usage count underflow!

2026-11-02T10:07:35.414051+08:00 localhost kernel: [TS:60863845951] spi_master spi1: Failed to power device: -22

2026-11-02T10:07:35.414052+08:00 localhost kernel: [TS:60863846080] spi_master spi1: noqueue transfer failed

2026-11-02T10:07:35.414054+08:00 localhost kernel: [TS:60863846163] spi-tegra114 c260000.spi: Runtime PM usage count underflow!

2026-11-02T10:07:35.414055+08:00 localhost kernel: [TS:60863846275] spi_master spi1: Failed to power device: -22

2026-11-02T10:07:35.414056+08:00 localhost kernel: [TS:60863846397] spi_master spi1: noqueue transfer failed

2026-11-02T10:07:35.414057+08:00 localhost kernel: [TS:60863846478] spi-tegra114 c260000.spi: Runtime PM usage count underflow!

2026-11-02T10:07:35.414059+08:00 localhost kernel: [TS:60863846580] spi_master spi1: Failed to power device: -22

2026-11-02T10:07:35.414059+08:00 localhost kernel: [TS:60863846701] spi_master spi1: noqueue transfer failed

2026-11-02T10:07:35.414061+08:00 localhost kernel: [TS:60863846780] spi-tegra114 c260000.spi: Runtime PM usage count underflow!

2026-11-02T10:07:35.414062+08:00 localhost kernel: [TS:60863846880] spi_master spi1: Failed to power device: -22

2026-11-02T10:07:35.414062+08:00 localhost kernel: [TS:60863846955] spi_master spi1: noqueue transfer failed

2026-11-02T10:07:35.414063+08:00 localhost kernel: [TS:60863846996] spi-tegra114 c260000.spi: Runtime PM usage count underflow!

2026-11-02T10:07:35.414064+08:00 localhost kernel: [TS:60863847046] spi_master spi1: Failed to power device: -22

2026-11-02T10:07:35.414065+08:00 localhost kernel: [TS:60863847090] spi_master spi1: noqueue transfer failed

2026-11-02T10:07:35.414066+08:00 localhost kernel: [TS:60863847123] spi-tegra114 c260000.spi: Runtime PM usage count underflow!

2026-11-02T10:07:35.414067+08:00 localhost kernel: [TS:60863847165] spi_master spi1: Failed to power device: -22

2026-11-02T10:07:35.414068+08:00 localhost kernel: [TS:60863847208] spi_master spi1: noqueue transfer failed

2026-11-02T10:07:35.414069+08:00 localhost kernel: [TS:60863847242] spi-tegra114 c260000.spi: Runtime PM usage count underflow!

2026-11-02T10:07:35.414070+08:00 localhost kernel: [TS:60863847281] spi_master spi1: Failed to power device: -22

2026-11-02T10:07:35.414071+08:00 localhost kernel: [TS:60863847324] spi_master spi1: noqueue transfer failed

2026-11-02T10:07:35.414072+08:00 localhost kernel: [TS:60863847362] spi-tegra114 c260000.spi: Runtime PM usage count underflow!

2026-11-02T10:07:35.414073+08:00 localhost kernel: [TS:60863847402] spi_master spi1: Failed to power device: -22

2026-11-02T10:07:35.414075+08:00 localhost kernel: [TS:60863847445] spi_master spi1: noqueue transfer failed

2026-11-02T10:07:35.414076+08:00 localhost kernel: [TS:60863

The detail is:

Our product powered off due to low battery and then we charged it and it power on , then kernel started to boot up, but it failed.

By the side, we have applied the RT-patch. Maybe that related to this issue.
If we find else something about this issue, we will update here immediately

Hi,

Please provide the serial console log for us to review.
Also could you observe the issue when not enabled rt kernel?

Thanks

kern.log (10.0 MB)

syslog.txt (46.6 MB)

Hi

We have been reproducing this problem for two days, but we have not been able to reproduce it

hi,
Another of our machines reproduced the issue and the similarity was the batteries of the two machines were very low

kern_2_1106.log (18.5 MB)

Hi,

Could you please confirm the error come from custom board or develoepr kit?

Thanks

Thank you for your reply.

it came from custom board.

We have checked the kern_2_1106.log and find the issue happened in SC7 @DavidDDD

hello, are there some advices for us?