Serial port not worked, kernel report : serial-tegra 3140000.serial: Not able to get desc for Rx

Hardware:our designed carrier board,Orin module(disassembled from NV Orin Devkit)
Software:Jetpack 5.0.2
Question:Serial Port could not receive data for a moment when working, and kernel report error “serial-tegra 3140000.serial: Not able to get desc for Rx” and “page allocation failure” at the same time.

So what could cause serial port failure and how to solve it?
kernel-1.log (869.1 KB)
nvidia-bug-report-tegra.log (5.7 MB)

Hi user121818,

What device do you connect on 3140000.serial?
Is it working as normal, or lost some data?

Could you help to provide the “uarte: serial@3140000 {” configuration from device tree?

We connect an IMU on 3140000.serial.
It works normally at the beginning, but only keeps for a while. When error happened, 3140000.serial could not get data. It looks like this serial closed for a moment.
The device tree is just shown below.
img_v2_64ee8a33-ce1b-49e1-b39f-6bc27436dfcg

Could you help to check if there’s other driver using this UART node?

Does this issue happen 100% after boot up?
Or Have you tried to reduce the speed of this serial?

Please also capture dmesg for further check.

Yes, Only one driver uses this UART node.
Not 100%. But frequency is a little high.
dmesg were shown as “nvidia-bug-report-tegra.log”

There’s no other serial related error messages in kernel log.

Have you tried to reduce the speed of this UART with your IMU?

serial related error message is only " serial-tegra 3140000.serial: Not able to get desc for Rx "
But, everytime once this happened, kernel would report something “page allocation failure” almost at the same time of serial related error(only a few ms before serial error), just shown as below. So does this failure cause serial error?or anything other?

Feb 13 15:13:57 xxk kernel: [14641.955774] cpufreq: cpu4,cur:2318000,set:2201600,set ndiv:172
Feb 13 15:16:47 xxk kernel: [14811.873581] cpufreq: cpu4,cur:2080000,set:2201600,set ndiv:172
Feb 13 15:18:41 xxk kernel: [14925.322018] swapper/0: page allocation failure: order:0, mode:0x40800(GFP_NOWAIT|__GFP_COMP), nodemask=(null),cpuset=/,mems_allowed=0
Feb 13 15:18:41 xxk kernel: [14925.334392] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G OE 5.10.104-tegra #19
Feb 13 15:18:41 xxk kernel: [14925.334394] Hardware name: /, BIOS 1.0-d7fb19b 08/10/2022
Feb 13 15:18:41 xxk kernel: [14925.334396] Call trace:
Feb 13 15:18:41 xxk kernel: [14925.334403] dump_backtrace+0x0/0x1d0
Feb 13 15:18:41 xxk kernel: [14925.334406] show_stack+0x2c/0x40
Feb 13 15:18:41 xxk kernel: [14925.334411] dump_stack+0xd8/0x138
Feb 13 15:18:41 xxk kernel: [14925.334414] warn_alloc+0x108/0x180
Feb 13 15:18:41 xxk kernel: [14925.334415] __alloc_pages_slowpath.constprop.0+0xb74/0xba0
Feb 13 15:18:41 xxk kernel: [14925.334417] __alloc_pages_nodemask+0x29c/0x320
Feb 13 15:18:41 xxk kernel: [14925.334420] allocate_slab+0x2ac/0x510
Feb 13 15:18:41 xxk kernel: [14925.334422] ___slab_alloc.constprop.0+0x1d4/0x750
Feb 13 15:18:41 xxk kernel: [14925.334424] __slab_alloc.isra.0.constprop.0+0x4c/0x90
Feb 13 15:18:41 xxk kernel: [14925.334425] __kmalloc+0x420/0x450
Feb 13 15:18:41 xxk kernel: [14925.334429] tegra_dma_prep_slave_sg+0x12c/0x340
Feb 13 15:18:41 xxk kernel: [14925.334432] tegra_uart_start_rx_dma+0xb0/0x130
Feb 13 15:18:41 xxk kernel: [14925.334434] tegra_uart_isr+0x300/0x490
Feb 13 15:18:41 xxk kernel: [14925.334437] __handle_irq_event_percpu+0x60/0x2a0
Feb 13 15:18:41 xxk kernel: [14925.334438] handle_irq_event_percpu+0x3c/0xa0
Feb 13 15:18:41 xxk kernel: [14925.334440] handle_irq_event+0x4c/0xf0
Feb 13 15:18:41 xxk kernel: [14925.334442] handle_fasteoi_irq+0xbc/0x170
Feb 13 15:18:41 xxk kernel: [14925.334443] generic_handle_irq+0x3c/0x60
Feb 13 15:18:41 xxk kernel: [14925.334445] __handle_domain_irq+0x6c/0xc0
Feb 13 15:18:41 xxk kernel: [14925.334446] gic_handle_irq+0x64/0x130
Feb 13 15:18:41 xxk kernel: [14925.334447] el1_irq+0xd0/0x180
Feb 13 15:18:41 xxk kernel: [14925.334451] cpuidle_enter_state+0xb4/0x400
Feb 13 15:18:41 xxk kernel: [14925.334453] cpuidle_enter+0x3c/0x50
Feb 13 15:18:41 xxk kernel: [14925.334454] call_cpuidle+0x40/0x70
Feb 13 15:18:41 xxk kernel: [14925.334456] do_idle+0x1fc/0x260
Feb 13 15:18:41 xxk kernel: [14925.334457] cpu_startup_entry+0x2c/0x70
Feb 13 15:18:41 xxk kernel: [14925.334459] rest_init+0xd8/0xe4
Feb 13 15:18:41 xxk kernel: [14925.334463] arch_call_rest_init+0x14/0x1c
Feb 13 15:18:41 xxk kernel: [14925.334465] start_kernel+0x50c/0x540
Feb 13 15:18:41 xxk kernel: [14925.334466] Mem-Info:
Feb 13 15:18:41 xxk kernel: [14925.334471] active_anon:739241 inactive_anon:2290086 isolated_anon:1549
Feb 13 15:18:41 xxk kernel: [14925.334471] active_file:215958 inactive_file:2944373 isolated_file:0
Feb 13 15:18:41 xxk kernel: [14925.334471] unevictable:4603 dirty:27740 writeback:0
Feb 13 15:18:41 xxk kernel: [14925.334471] slab_reclaimable:179064 slab_unreclaimable:152839
Feb 13 15:18:41 xxk kernel: [14925.334471] mapped:208463 shmem:52482 pagetables:16367 bounce:0
Feb 13 15:18:41 xxk kernel: [14925.334471] free:52952 free_pcp:6284 free_cma:57
Feb 13 15:18:41 xxk kernel: [14925.334474] Node 0 active_anon:2956964kB inactive_anon:9160344kB active_file:863832kB inactive_file:11777492kB unevictable:18412kB isolated(anon):6196kB isolated(file):0kB mapped:833852kB dirty:110960kB writeback:0kB shmem:209928kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 8278016kB writeback_tmp:0kB kernel_stack:23648kB all_unreclaimable? no
Feb 13 15:18:41 xxk kernel: [14925.334477] DMA free:117340kB min:2644kB low:4476kB high:6308kB reserved_highatomic:0KB active_anon:6636kB inactive_anon:799292kB active_file:5548kB inactive_file:397976kB unevictable:0kB writepending:288kB present:2097152kB managed:1834880kB mlocked:0kB pagetables:3596kB bounce:0kB free_pcp:11356kB local_pcp:704kB free_cma:0kB
Feb 13 15:18:41 xxk kernel: [14925.334478] lowmem_reserve: 0 0 28732 28732
Feb 13 15:18:41 xxk kernel: [14925.334484] Normal free:94468kB min:85416kB low:114836kB high:144256kB reserved_highatomic:2048KB active_anon:2950328kB inactive_anon:8361000kB active_file:858284kB inactive_file:11379516kB unevictable:18412kB writepending:110956kB present:30108352kB managed:29434328kB mlocked:32kB pagetables:61872kB bounce:0kB free_pcp:13760kB local_pcp:428kB free_cma:228kB
Feb 13 15:18:41 xxk kernel: [14925.334484] lowmem_reserve: 0 0 0 0
Feb 13 15:18:41 xxk kernel: [14925.334488] DMA: 9854kB (UE) 5378kB (UE) 21916kB (UME) 20832kB (UE) 35664kB (UME) 47128kB (UM) 86256kB (UME) 50512kB (UM) 161024kB (ME) 32048kB (M) 04096kB = 117340kB
Feb 13 15:18:41 xxk kernel: [14925.334502] Normal: 3196
4kB (UME) 13428kB (UME) 13716kB (UM) 76832kB (UM) 53664kB (UMH) 40128kB (UM) 3256kB (M) 6512kB (MH) 01024kB 02048kB 04096kB = 93552kB
Feb 13 15:18:41 xxk kernel: [14925.334516] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Feb 13 15:18:41 xxk kernel: [14925.334518] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=32768kB
Feb 13 15:18:41 xxk kernel: [14925.334519] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Feb 13 15:18:41 xxk kernel: [14925.334520] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=64kB
Feb 13 15:18:41 xxk kernel: [14925.334521] 3217232 total pagecache pages
Feb 13 15:18:41 xxk kernel: [14925.334528] 28 pages in swap cache
Feb 13 15:18:41 xxk kernel: [14925.334529] Swap cache stats: add 813619, delete 804721, find 44340/45320
Feb 13 15:18:41 xxk kernel: [14925.334530] Free swap = 12358784kB
Feb 13 15:18:41 xxk kernel: [14925.334531] Total swap = 15634560kB
Feb 13 15:18:41 xxk kernel: [14925.334532] 8051376 pages RAM
Feb 13 15:18:41 xxk kernel: [14925.334532] 0 pages HighMem/MovableOnly
Feb 13 15:18:41 xxk kernel: [14925.334533] 234074 pages reserved
Feb 13 15:18:41 xxk kernel: [14925.334534] 65536 pages cma reserved
Feb 13 15:18:41 xxk kernel: [14925.334535] 0 pages hwpoisoned
Feb 13 15:18:41 xxk kernel: [14925.334538] SLUB: Unable to allocate memory on node -1, gfp=0x900(GFP_NOWAIT|__GFP_ZERO)
Feb 13 15:18:41 xxk kernel: [14925.342869] cache: kmalloc-256, object size: 256, buffer size: 256, default order: 1, min order: 0
Feb 13 15:18:41 xxk kernel: [14925.352268] node 0: slabs: 53267, objs: 1704512, free: 0
Feb 13 15:18:41 xxk kernel: [14925.357910] serial-tegra 3140000.serial: Not able to get desc for Rx
Feb 13 15:20:42 xxk kernel: [15046.800084] cpufreq: cpu8,cur:2382000,set:2201600,set ndiv:172
Feb 13 15:21:06 xxk kernel: [15071.234396] cpufreq: cpu8,cur:2359000,set:2201600,set ndiv:172
Feb 13 15:21:12 xxk kernel: [15076.588554] cpufreq: cpu4,cur:2057000,set:2201600,set ndiv:172
Feb 13 15:21:14 xxk kernel: [15079.223100] cpufreq: cpu4,cur:2070000,set:2201600,set ndiv:172
Feb 13 15:21:16 xxk kernel: [15080.628327] cpufreq: cpu4,cur:2070000,set:2201600,set ndiv:172
Feb 13 15:21:25 xxk kernel: [15089.809300] tegra-xusb 3610000.xhci: Firmware timestamp: 2021-12-01 05:27:10 UTC, Version: 80.03 release
Feb 13 15:21:28 xxk kernel: [15092.447069] tegra-xusb 3610000.xhci: entering ELPG done
Feb 13 15:21:30 xxk kernel: [15094.578319] cpufreq: cpu8,cur:2355000,set:2201600,set ndiv:172

It is the same as testing on JP5.1.And the results was the same when reducing speed of UART

Nobody answered me?

It’s a memory problem. Try to raise the min_free_kbytes value.

I have tried to raise min_free_kbytes value to 135168 , but it is not helpful. The Error message is still reporting.

I’m closing this topic due to there is no update from you for a period, assuming this issue was resolved.
If still need the support, please open a new topic. Thanks

Could you help to verify with latest JP5.1.1?

Could this issue be reproduced on the AGX Orin devkit?