Xavier: reboot error

HI ,all:

the machine will reboot, the kernel log as follow:


Jun  1 09:45:23 : [   34.440685] imx185: module is already loaded
Jun  1 09:45:23 : [   34.456752] igb 0001:01:00.3 enP1p1s0f3: renamed from eth4
Jun  1 09:45:23 : [   34.473613] ixgbe 0005:01:00.0 enP5p1s0f0: renamed from eth5
Jun  1 09:45:23 : [   34.488648] Could not create tracefs 'imx185_s_stream' directory
Jun  1 09:45:23 : [   34.488706] imx185: module is already loaded
Jun  1 09:45:23 : [   34.496825] ixgbe 0005:01:00.1 enP5p1s0f1: renamed from eth6
Jun  1 09:45:23 : [   34.528800] Could not create tracefs 'imx185_s_stream' directory
Jun  1 09:45:23 : [   34.528861] imx185: module is already loaded
Jun  1 09:45:23 : [   34.529233] can_dev: exports duplicate symbol alloc_can_err_skb (owned by kernel)
Jun  1 09:45:23 : [   34.590813] usbcore: registered new interface driver option
Jun  1 09:45:23 : [   34.590850] usbserial: USB Serial support registered for GSM modem (1-port)
Jun  1 09:45:23 : [   34.591588] option 1-4:1.0: GSM modem (1-port) converter detected
Jun  1 09:45:23 : [   34.592492] usb 1-4: GSM modem (1-port) converter now attached to ttyUSB0
Jun  1 09:45:23 : [   34.593148] option 1-4:1.1: GSM modem (1-port) converter detected
Jun  1 09:45:23 : [   34.593374] usb 1-4: GSM modem (1-port) converter now attached to ttyUSB1
Jun  1 09:45:23 : [   34.593450] option 1-4:1.2: GSM modem (1-port) converter detected
Jun  1 09:45:23 : [   34.595024] usb 1-4: GSM modem (1-port) converter now attached to ttyUSB2
Jun  1 09:45:23 : [   34.596928] option 1-4:1.3: GSM modem (1-port) converter detected
Jun  1 09:45:23 : [   34.597139] usb 1-4: GSM modem (1-port) converter now attached to ttyUSB3
Jun  1 09:45:23 : [   34.660368] FAN rising trip_level:1 cur_temp:52750 trip_temps[2]:63000
Jun  1 09:45:23 : [   34.741155] EXT4-fs (nvme0n1): mounted filesystem with ordered data mode. Opts: (null)
Jun  1 09:45:23 : [   35.520929] using random self ethernet address
Jun  1 09:45:23 : [   35.520962] using random host ethernet address
Jun  1 09:45:23 : [   35.734721] random: crng init done
Jun  1 09:45:23 : [   35.734764] random: 7 urandom warning(s) missed due to ratelimiting
Jun  1 09:45:23 : [   36.062935] Mass Storage Function, version: 2009/09/11
Jun  1 09:45:23 : [   36.062947] LUN: removable file: (no medium)
Jun  1 09:45:23 : [   36.068871] using random self ethernet address
Jun  1 09:45:23 : [   36.068905] using random host ethernet address
Jun  1 09:45:23 : [   36.178781] rndis0: HOST MAC 36:7b:30:95:a4:10
Jun  1 09:45:23 : [   36.179109] rndis0: MAC 36:7b:30:95:a4:11
Jun  1 09:45:23 : [   36.179652] usb0: HOST MAC 36:7b:30:95:a4:12
Jun  1 09:45:23 : [   36.179686] usb0: MAC 36:7b:30:95:a4:13
Jun  1 09:45:23 : [   36.179704] tegra-xudc-new 3550000.xudc: exiting ELPG
Jun  1 09:45:23 : [   36.180206] tegra-xudc-new 3550000.xudc: exiting ELPG done
Jun  1 09:45:23 : [   36.180219] tegra-xudc-new 3550000.xudc: ep 0 (type: 0, dir: out) enabled
Jun  1 09:45:23 : [   36.180497] tegra-xudc-new 3550000.xudc: entering ELPG
Jun  1 09:45:23 : [   36.180697] tegra-xudc-new 3550000.xudc: entering ELPG done
Jun  1 09:45:23 : [   36.180713] tegra-xudc-new 3550000.xudc: exiting ELPG
Jun  1 09:45:23 : [   36.181160] tegra-xudc-new 3550000.xudc: exiting ELPG done
Jun  1 09:45:23 : [   36.181180] tegra-xudc-new 3550000.xudc: entering ELPG
Jun  1 09:45:23 : [   36.181372] tegra-xudc-new 3550000.xudc: entering ELPG done
Jun  1 09:45:23 : [   36.185317] l4tbr0: port 1(rndis0) entered blocking state
Jun  1 09:45:23 : [   36.185328] l4tbr0: port 1(rndis0) entered disabled state
Jun  1 09:45:23 : [   36.185493] device rndis0 entered promiscuous mode
Jun  1 09:45:23 : [   36.193892] IPv6: ADDRCONF(NETDEV_UP): rndis0: link is not ready
Jun  1 09:45:23 : [   36.198235] l4tbr0: port 2(usb0) entered blocking state
Jun  1 09:45:23 : [   36.198245] l4tbr0: port 2(usb0) entered disabled state
Jun  1 09:45:23 : [   36.200267] device usb0 entered promiscuous mode
Jun  1 09:45:23 : [   36.205074] IPv6: ADDRCONF(NETDEV_UP): usb0: link is not ready
Jun  1 09:45:23 : [   36.207678] nvgpu: 17000000.gv11b                 tpc_pg_mask_store:843  [INFO]  no value change, same mask already set
Jun  1 09:45:23 : [   36.345570] IPv6: ADDRCONF(NETDEV_UP): enP1p1s0f0: link is not ready
Jun  1 09:45:23 : [   36.465099] IPv6: ADDRCONF(NETDEV_UP): enP1p1s0f0: link is not ready
Jun  1 09:45:23 : [   36.481301] IPv6: ADDRCONF(NETDEV_UP): enP1p1s0f1: link is not ready
Jun  1 09:45:24 : [   36.603890] IPv6: ADDRCONF(NETDEV_UP): enP1p1s0f1: link is not ready
Jun  1 09:45:24 : [   36.614505] IPv6: ADDRCONF(NETDEV_UP): enP1p1s0f2: link is not ready
Jun  1 09:45:24 : [   36.737923] IPv6: ADDRCONF(NETDEV_UP): enP1p1s0f2: link is not ready
Jun  1 09:45:24 : [   36.747578] IPv6: ADDRCONF(NETDEV_UP): enP1p1s0f3: link is not ready
Jun  1 09:45:24 : [   36.873914] IPv6: ADDRCONF(NETDEV_UP): enP1p1s0f3: link is not ready
Jun  1 09:45:24 : [   36.889761] IPv6: ADDRCONF(NETDEV_UP): enP5p1s0f0: link is not ready
Jun  1 09:45:24 : [   36.900791] zram: Added device: zram0
Jun  1 09:45:24 : [   36.901519] zram: Added device: zram1
Jun  1 09:45:24 : [   36.901964] zram: Added device: zram2
Jun  1 09:45:24 : [   36.902454] zram: Added device: zram3
Jun  1 09:45:24 : [   36.903158] zram: Added device: zram4
Jun  1 09:45:24 : [   36.903529] zram: Added device: zram5
Jun  1 09:45:24 : [   36.903963] zram: Added device: zram6
Jun  1 09:45:24 : [   36.904585] zram: Added device: zram7
Jun  1 09:45:24 : [   36.922699] zram0: detected capacity change from 0 to 1036939264
Jun  1 09:45:24 : [   36.931086] ixgbe 0005:01:00.0: registered PHC device on enP5p1s0f0
Jun  1 09:45:24 : [   36.951335] Adding 1012632k swap on /dev/zram0.  Priority:5 extents:1 across:1012632k SS
Jun  1 09:45:24 : [   36.953956] zram1: detected capacity change from 0 to 1036939264
Jun  1 09:45:24 : [   36.964603] Adding 1012632k swap on /dev/zram1.  Priority:5 extents:1 across:1012632k SS
Jun  1 09:45:24 : [   36.967531] zram2: detected capacity change from 0 to 1036939264
Jun  1 09:45:24 : [   36.977560] Adding 1012632k swap on /dev/zram2.  Priority:5 extents:1 across:1012632k SS
Jun  1 09:45:24 : [   36.979881] zram3: detected capacity change from 0 to 1036939264
Jun  1 09:45:24 : [   36.991666] Adding 1012632k swap on /dev/zram3.  Priority:5 extents:1 across:1012632k SS
Jun  1 09:45:24 : [   36.995623] zram4: detected capacity change from 0 to 1036939264
Jun  1 09:45:24 : [   37.006183] Adding 1012632k swap on /dev/zram4.  Priority:5 extents:1 across:1012632k SS
Jun  1 09:45:24 : [   37.009003] zram5: detected capacity change from 0 to 1036939264
Jun  1 09:45:24 : [   37.019000] Adding 1012632k swap on /dev/zram5.  Priority:5 extents:1 across:1012632k SS
Jun  1 09:45:24 : [   37.021736] zram6: detected capacity change from 0 to 1036939264
Jun  1 09:45:24 : [   37.032423] Adding 1012632k swap on /dev/zram6.  Priority:5 extents:1 across:1012632k SS
Jun  1 09:45:24 : [   37.034849] zram7: detected capacity change from 0 to 1036939264
Jun  1 09:45:24 : [   37.038288] IPv6: ADDRCONF(NETDEV_UP): enP5p1s0f0: link is not ready
Jun  1 09:45:24 : [   37.045178] Adding 1012632k swap on /dev/zram7.  Priority:5 extents:1 across:1012632k SS
Jun  1 09:45:24 : [   37.054328] IPv6: ADDRCONF(NETDEV_UP): enP5p1s0f1: link is not ready
Jun  1 09:45:24 : [   37.098466] ixgbe 0005:01:00.1: registered PHC device on enP5p1s0f1
Jun  1 09:45:24 : [   37.100905] ixgbe 0005:01:00.0 enP5p1s0f0: detected SFP+: 5
Jun  1 09:45:24 : [   37.205975] IPv6: ADDRCONF(NETDEV_UP): enP5p1s0f1: link is not ready
Jun  1 09:45:24 : [   37.218765] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
Jun  1 09:45:24 : [   37.305095] gpio tegra-gpio wake20 for gpio=52(G:4)
Jun  1 09:45:24 : [   37.312328] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
Jun  1 09:45:25 : [   37.757290] tegradc 15200000.nvdisplay: blank - powerdown
Jun  1 09:45:27 : [   40.497189] igb 0001:01:00.3 enP1p1s0f3: igb: enP1p1s0f3 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
Jun  1 09:45:27 : [   40.499342] IPv6: ADDRCONF(NETDEV_CHANGE): enP1p1s0f3: link becomes ready
Jun  1 09:45:31 : [   43.616352] FAN rising trip_level:1 cur_temp:51550 trip_temps[2]:63000
Jun  1 10:10:17 : [ 1530.636067] [RCE] vi5_hwinit: firmware CL2018101701 protocol version 2.2
Jun  1 10:29:23 : [ 2676.506319] [RCE] vi5_hwinit: firmware CL2018101701 protocol version 2.2
Jun  1 10:46:40 : [ 3712.874901] [RCE] vi5_hwinit: firmware CL2018101701 protocol version 2.2
Jun  1 20:40:05 : [39316.422501] [RCE] vi5_hwinit: firmware CL2018101701 protocol version 2.2
Jun  1 20:44:00 : [39551.702191] [RCE] vi5_hwinit: firmware CL2018101701 protocol version 2.2
Jun  2 15:43:38 : [107926.233534] [RCE] vi5_hwinit: firmware CL2018101701 protocol version 2.2
Jun  2 16:05:38 : [109246.008100] [RCE] vi5_hwinit: firmware CL2018101701 protocol version 2.2
Jun  2 16:12:33 : [109660.862089] [RCE] vi5_hwinit: firmware CL2018101701 protocol version 2.2
Jun  2 16:17:15 : [109942.363415] FAN rising trip_level:2 cur_temp:63200 trip_temps[3]:72000
Jun  2 16:20:42 : [110150.109984] nvgpu: 17000000.gv11b gk20a_fifo_tsg_unbind_channel_verify_status:2200 [ERR]  Channel 504 to be removed from TSG 4 has NEXT set!
Jun  2 16:20:42 : [110150.110013] nvgpu: 17000000.gv11b          gk20a_tsg_unbind_channel:164  [ERR]  Channel 504 unbind failed, tearing down TSG 4
Jun  2 16:20:42 : [110150.110776] nvgpu: 17000000.gv11b gk20a_fifo_tsg_unbind_channel_verify_status:2200 [ERR]  Channel 507 to be removed from TSG 3 has NEXT set!
Jun  2 16:20:42 : [110150.110806] nvgpu: 17000000.gv11b          gk20a_tsg_unbind_channel:164  [ERR]  Channel 507 unbind failed, tearing down TSG 3
Jun  2 16:20:51 : [110158.512264] FAN cooling trip_level:1 cur_temp:54950 trip_temps[2]:63000
Jun  2 16:23:02 : [110289.268710] [RCE] vi5_hwinit: firmware CL2018101701 protocol version 2.2
Jun  2 16:23:03 : [110291.077682] ai_ctrl: page allocation failure: order:10, mode:0x240c0c0(GFP_KERNEL|__GFP_COMP|__GFP_ZERO)
Jun  2 16:23:03 : [110291.077760] CPU: 0 PID: 16745 Comm: ai_ctrl Not tainted 4.9.140-tegra #108
Jun  2 16:23:03 : [110291.077763] Hardware name: Jetson-AGX (DT)
Jun  2 16:23:03 : [110291.077767] Call trace:
Jun  2 16:23:03 : [110291.077785] [<ffffff800808bdb8>] dump_backtrace+0x0/0x198
Jun  2 16:23:03 : [110291.077798] [<ffffff800808c37c>] show_stack+0x24/0x30
Jun  2 16:23:03 : [110291.077809] [<ffffff800845d820>] dump_stack+0x98/0xc0
Jun  2 16:23:03 : [110291.077818] [<ffffff80081cf49c>] warn_alloc+0x104/0x130
Jun  2 16:23:03 : [110291.077828] [<ffffff80081cf9bc>] __alloc_pages_nodemask+0x474/0xd38
Jun  2 16:23:03 : [110291.077836] [<ffffff80081f3f44>] kmalloc_order+0x3c/0x78
Jun  2 16:23:03 : [110291.077851] [<ffffff80081f3fbc>] kmalloc_order_trace+0x3c/0x138
Jun  2 16:23:03 : [110291.077860] [<ffffff8008233564>] __kmalloc+0x2f4/0x360
Jun  2 16:23:03 : [110291.077872] [<ffffff8008579080>] nvdla_queue_alloc+0x208/0x340
Jun  2 16:23:03 : [110291.077880] [<ffffff8008575190>] nvdla_open+0xc0/0x1c8
Jun  2 16:23:03 : [110291.077887] [<ffffff8008263344>] chrdev_open+0x94/0x198
Jun  2 16:23:03 : [110291.077895] [<ffffff8008259e10>] do_dentry_open+0x1b8/0x318
Jun  2 16:23:03 : [110291.077902] [<ffffff800825b3b8>] vfs_open+0x58/0x88
Jun  2 16:23:03 : [110291.077910] [<ffffff800826e674>] do_last+0x454/0xe60
Jun  2 16:23:03 : [110291.077917] [<ffffff800826f110>] path_openat+0x90/0x378
Jun  2 16:23:03 : [110291.077925] [<ffffff8008270680>] do_filp_open+0x70/0xe8
Jun  2 16:23:03 : [110291.077944] [<ffffff800825b87c>] do_sys_open+0x174/0x258
Jun  2 16:23:03 : [110291.077949] [<ffffff800825b9e4>] SyS_openat+0x3c/0x50
Jun  2 16:23:03 : [110291.077966] [<ffffff80080838c0>] el0_svc_naked+0x34/0x38
Jun  2 16:23:03 : [110291.077969] Mem-Info:
Jun  2 16:23:03 : [110291.077979] active_anon:987121 inactive_anon:179800 isolated_anon:0
Jun  2 16:23:03 : [110291.077979]  active_file:663634 inactive_file:1401273 isolated_file:0
Jun  2 16:23:03 : [110291.077979]  unevictable:3038 dirty:13 writeback:7 unstable:0
Jun  2 16:23:03 : [110291.077979]  slab_reclaimable:127440 slab_unreclaimable:30839
Jun  2 16:23:03 : [110291.077979]  mapped:187389 shmem:176372 pagetables:5467 bounce:0
Jun  2 16:23:03 : [110291.077979]  free:208187 free_pcp:549 free_cma:171536
Jun  2 16:23:03 : [110291.077990] Node 0 active_anon:3948484kB inactive_anon:719200kB active_file:2654536kB inactive_file:5605092kB unevictable:12152kB isolated(anon):0kB isolated(file):0kB mapped:749556kB dirty:52kB writeback:28kB shmem:705488kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 1959936kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
Jun  2 16:23:03 : [110291.077996] DMA free:744120kB min:5004kB low:6800kB high:8596kB active_anon:13864kB inactive_anon:24kB active_file:7808kB inactive_file:959072kB unevictable:0kB writepending:0kB present:1839104kB managed:1812920kB mlocked:0kB slab_reclaimable:17836kB slab_unreclaimable:792kB kernel_stack:16kB pagetables:44kB bounce:0kB free_pcp:444kB local_pcp:444kB free_cma:686144kB
Jun  2 16:23:03 : lowmem_reserve[]: 0 14051 14051 14051
Jun  2 16:23:03 : [110291.078048] Normal free:88628kB min:40048kB low:54436kB high:68824kB active_anon:3934536kB inactive_anon:719176kB active_file:2646728kB inactive_file:4646020kB unevictable:12152kB writepending:80kB present:14680064kB managed:14389244kB mlocked:0kB slab_reclaimable:491924kB slab_unreclaimable:122564kB kernel_stack:8864kB pagetables:21824kB bounce:0kB free_pcp:1748kB local_pcp:680kB free_cma:0kB
Jun  2 16:23:03 : lowmem_reserve[]: 0 0 0 0
Jun  2 16:23:03 : [110291.078076] DMA: 36*4kB (UE) 39*8kB (UE) 38*16kB (UE) 37*32kB (UE) 94*64kB (UME) 54*128kB (UME) 14*256kB (UME) 3*512kB (ME) 3*1024kB (UME) 2*2048kB (UC) 175*4096kB (UMC) = 744264kB
Jun  2 16:23:03 : Normal: 138*4kB (UE) 98*8kB (UME) 316*16kB (UME) 115*32kB (UMEH) 894*64kB (UME) 24*128kB (UMH) 11*256kB (MH) 8*512kB (MH) 5*1024kB (MH) 3*2048kB (M) 0*4096kB = 88536kB
Jun  2 16:23:03 : [110291.078200] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Jun  2 16:23:03 : [110291.078203] 2244345 total pagecache pages
Jun  2 16:23:03 : [110291.078206] 0 pages in swap cache
Jun  2 16:23:03 : [110291.078209] Swap cache stats: add 10378, delete 10378, find 0/0
Jun  2 16:23:03 : [110291.078212] Free swap  = 8059544kB
Jun  2 16:23:03 : [110291.078215] Total swap = 8101056kB
Jun  2 16:23:03 : [110291.078218] 4129792 pages RAM
Jun  2 16:23:03 : [110291.078220] 0 pages HighMem/MovableOnly
Jun  2 16:23:03 : [110291.078223] 79251 pages reserved
Jun  2 16:23:03 : [110291.078242] 188416 pages cma reserved
Jun  2 16:23:03 : [110291.078251] nvdla 15880000.nvdla0: nvdla_queue_task_pool_alloc: failed to allocate task_pool->kmem_addr
Jun  2 16:23:03 : [110291.198102] ai_ctrl: page allocation failure: order:10, mode:0x240c0c0(GFP_KERNEL|__GFP_COMP|__GFP_ZERO)
Jun  2 16:23:03 : [110291.198168] CPU: 1 PID: 16745 Comm: ai_ctrl Not tainted 4.9.140-tegra #108
Jun  2 16:23:03 : [110291.198176] Hardware name: Jetson-AGX (DT)
Jun  2 16:23:03 : [110291.198180] Call trace:
Jun  2 16:23:03 : [110291.198196] [<ffffff800808bdb8>] dump_backtrace+0x0/0x198
Jun  2 16:23:03 : [110291.198203] [<ffffff800808c37c>] show_stack+0x24/0x30
Jun  2 16:23:03 : [110291.198211] [<ffffff800845d820>] dump_stack+0x98/0xc0
Jun  2 16:23:03 : [110291.198222] [<ffffff80081cf49c>] warn_alloc+0x104/0x130
Jun  2 16:23:03 : [110291.198230] [<ffffff80081cf9bc>] __alloc_pages_nodemask+0x474/0xd38
Jun  2 16:23:03 : [110291.198235] [<ffffff80081f3f44>] kmalloc_order+0x3c/0x78
Jun  2 16:23:03 : [110291.198239] [<ffffff80081f3fbc>] kmalloc_order_trace+0x3c/0x138
Jun  2 16:23:03 : [110291.198267] [<ffffff8008233564>] __kmalloc+0x2f4/0x360
Jun  2 16:23:03 : [110291.198286] [<ffffff8008579080>] nvdla_queue_alloc+0x208/0x340
Jun  2 16:23:03 : [110291.198312] [<ffffff8008575190>] nvdla_open+0xc0/0x1c8
Jun  2 16:23:03 : [110291.198318] [<ffffff8008263344>] chrdev_open+0x94/0x198
Jun  2 16:23:03 : [110291.198324] [<ffffff8008259e10>] do_dentry_open+0x1b8/0x318
Jun  2 16:23:03 : [110291.198330] [<ffffff800825b3b8>] vfs_open+0x58/0x88
Jun  2 16:23:03 : [110291.198336] [<ffffff800826e674>] do_last+0x454/0xe60
Jun  2 16:23:03 : [110291.198341] [<ffffff800826f110>] path_openat+0x90/0x378
Jun  2 16:23:03 : [110291.198346] [<ffffff8008270680>] do_filp_open+0x70/0xe8
Jun  2 16:23:03 : [110291.198353] [<ffffff800825b87c>] do_sys_open+0x174/0x258
Jun  2 16:23:03 : [110291.198358] [<ffffff800825b9e4>] SyS_openat+0x3c/0x50
Jun  2 16:23:03 : [110291.198363] [<ffffff80080838c0>] el0_svc_naked+0x34/0x38
Jun  2 16:23:03 : [110291.198366] Mem-Info:
Jun  2 16:23:03 : [110291.198376] active_anon:988975 inactive_anon:180135 isolated_anon:0
Jun  2 16:23:03 : [110291.198376]  active_file:663576 inactive_file:1397363 isolated_file:0
Jun  2 16:23:03 : [110291.198376]  unevictable:3038 dirty:13 writeback:8 unstable:0
Jun  2 16:23:03 : [110291.198376]  slab_reclaimable:127281 slab_unreclaimable:30839
Jun  2 16:23:03 : [110291.198376]  mapped:187396 shmem:176339 pagetables:5467 bounce:0
Jun  2 16:23:03 : [110291.198376]  free:210968 free_pcp:239 free_cma:171536
Jun  2 16:23:03 : [110291.198404] Node 0 active_anon:3955900kB inactive_anon:720540kB active_file:2654304kB inactive_file:5589452kB unevictable:12152kB isolated(anon):0kB isolated(file):0kB mapped:749584kB dirty:52kB writeback:32kB shmem:705356kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 1959936kB writeback_tmp:0kB unstable:0kB pages_scanned:113 all_unreclaimable? no
Jun  2 16:23:03 : [110291.198411] DMA free:744516kB min:5004kB low:6800kB high:8596kB active_anon:13864kB inactive_anon:24kB active_file:7808kB inactive_file:959072kB unevictable:0kB writepending:0kB present:1839104kB managed:1812920kB mlocked:0kB slab_reclaimable:17836kB slab_unreclaimable:792kB kernel_stack:16kB pagetables:44kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:686144kB
Jun  2 16:23:03 : lowmem_reserve[]: 0 14051 14051 14051
Jun  2 16:23:03 : [110291.198434] Normal free:99356kB min:40048kB low:54436kB high:68824kB active_anon:3941952kB inactive_anon:720516kB active_file:2646496kB inactive_file:4630380kB unevictable:12152kB writepending:84kB present:14680064kB managed:14389244kB mlocked:0kB slab_reclaimable:491288kB slab_unreclaimable:122564kB kernel_stack:8864kB pagetables:21824kB bounce:0kB free_pcp:952kB local_pcp:188kB free_cma:0kB
Jun  2 16:23:03 : lowmem_reserve[]: 0 0 0 0
Jun  2 16:23:03 : [110291.198476] DMA: 37*4kB (UME) 40*8kB (UME) 39*16kB (UME) 38*32kB (UME) 94*64kB (UME) 55*128kB (UME) 15*256kB (UME) 3*512kB (ME) 3*1024kB (UME) 2*2048kB (UC) 175*4096kB (UMC) = 744708kB
Jun  2 16:23:03 : Normal: 171*4kB (UME) 134*8kB (UME) 277*16kB (UME) 128*32kB (UMEH) 937*64kB (UME) 38*128kB (UMH) 19*256kB (MH) 12*512kB (MH) 9*1024kB (MH) 2*2048kB (M) 0*4096kB = 99436kB
Jun  2 16:23:03 : [110291.198577] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Jun  2 16:23:03 : [110291.198579] 2240290 total pagecache pages
Jun  2 16:23:03 : [110291.198583] 0 pages in swap cache
Jun  2 16:23:03 : [110291.198586] Swap cache stats: add 10431, delete 10431, find 0/0
Jun  2 16:23:03 : [110291.198589] Free swap  = 8059332kB
Jun  2 16:23:03 : [110291.198591] Total swap = 8101056kB
Jun  2 16:23:03 : [110291.198594] 4129792 pages RAM
Jun  2 16:23:03 : [110291.198597] 0 pages HighMem/MovableOnly
Jun  2 16:23:03 : [110291.198599] 79251 pages reserved
Jun  2 16:23:03 : [110291.198602] 188416 pages cma reserved
Jun  2 16:23:03 : [110291.198608] nvdla 158c0000.nvdla1: nvdla_queue_task_pool_alloc: failed to allocate task_pool->kmem_addr
Jun  2 16:25:34 : [110442.136610] [RCE] vi5_hwinit: firmware CL2018101701 protocol version 2.2
Jun  2 16:32:53 : [110881.133259] [RCE] vi5_hwinit: firmware CL2018101701 protocol version 2.2
Jun  2 16:46:32 : [    0.000000] Booting Linux on physical CPU 0x0
Jun  2 16:46:32 : [    0.000000] Linux version 4.9.140-tegra (tztek@build) (gcc version 7.3.1 20180425 [linaro-7.3-2018.05 revision d29120a424ecfbc167ef90065c0eeb7f91977701] (Linaro GCC 7.3-2018.05) ) #108 SMP PREEMPT Fri May 15 14:06:44 CST 2020 tztek_version:v0.0.2_debug
Jun  2 16:46:32 : [    0.000000] Boot CPU: AArch64 Processor [4e0f0040]
Jun  2 16:46:32 : [    0.000000] OF: fdt:memory scan node memory, reg size 48,
Jun  2 16:46:32 : [    0.000000] OF: fdt: - 80000000 ,  2c000000
Jun  2 16:46:32 : [    0.000000] OF: fdt: - ac200000 ,  44600000
Jun  2 16:46:32 : [    0.000000] OF: fdt: - 100000000 ,  380000000
Jun  2 16:46:32 : [    0.000000] OF: fdt:Reserved memory: failed to reserve memory for node 'fb0_carveout': base 0x0000000000000000, size 0 MiB
Jun  2 16:46:32 : [    0.000000] OF: fdt:Reserved memory: failed to reserve memory for node 'fb0_carveout': base 0x0000000000000000, size 0 MiB
Jun  2 16:46:32 : [    0.000000] OF: fdt:Reserved memory: failed to reserve memory for node 'fb1_carveout': base 0x0000000000000000, size 0 MiB
Jun  2 16:46:32 : [    0.000000] OF: fdt:Reserved memory: failed to reserve memory for node 'fb1_carveout': base 0x0000000000000000, size 0 MiB
Jun  2 16:46:32 : [    0.000000] OF: fdt:Reserved memory: failed to reserve memory for node 'fb2_carveout': base 0x0000000000000000, size 0 MiB
Jun  2 16:46:32 : [    0.000000] OF: fdt:Reserved memory: failed to reserve memory for node 'fb2_carveout': base 0x0000000000000000, size 0 MiB
Jun  2 16:46:32 : [    0.000000] OF: fdt:Reserved memory: failed to reserve memory for node 'fb3_carveout': base 0x0000000000000000, size 0 MiB
Jun  2 16:46:32 : [    0.000000] OF: fdt:Reserved memory: failed to reserve memory for node 'fb3_carveout': base 0x0000000000000000, size 0 MiB
Jun  2 16:46:32 : [    0.000000] OF: reserved mem: initialized node ramoops_carveout, compatible id nvidia,ramoops
Jun  2 16:46:32 : [    0.000000] OF: reserved mem: initialized node vpr-carveout, compatible id nvidia,vpr-carveout
Jun  2 16:46:32 : [    0.000000] OF: reserved mem: initialized node grid-of-semaphores, compatible id nvidia,gosmem
Jun  2 16:46:32 : [    0.000000] cma: Reserved 64 MiB at 0x00000000c2000000
Jun  2 16:46:32 : [    0.000000] On node 0 totalpages: 4129792
Jun  2 16:46:32 : [    0.000000]   DMA zone: 7184 pages used for memmap
Jun  2 16:46:32 : [    0.000000]   DMA zone: 0 pages reserved
Jun  2 16:46:32 : [    0.000000]   DMA zone: 459776 pages, LIFO batch:31
Jun  2 16:46:32 : [    0.000000]   Normal zone: 57344 pages used for memmap
Jun  2 16:46:32 : [    0.000000]   Normal zone: 3670016 pages, LIFO batch:31
Jun  2 16:46:32 : [    0.000000] psci: probing for conduit method from DT.
Jun  2 16:46:32 : [    0.000000] psci: PSCIv1.0 detected in firmware.
Jun  2 16:46:32 : [    0.000000] psci: Using standard PSCI v0.2 function IDs
Jun  2 16:46:32 : [    0.000000] psci: MIGRATE_INFO_TYPE not supported.
Jun  2 16:46:32 : [    0.000000] psci: SMC Calling Convention v1.1
Jun  2 16:46:32 : [    0.000000] percpu: Embedded 25 pages/cpu @ffffffc3ffc47000 s61592 r8192 d32616 u102400
Jun  2 16:46:32 : [    0.000000] pcpu-alloc: s61592 r8192 d32616 u102400 alloc=25*4096

Thanks.

I won’t be able to complete the debugging, but I see the Intel IGB network driver before the issue shows up. I know there have been some changes needed for IGB at times, and I am wondering what peripherals are added to this, and if you added IGB firmware or any modifications to use the IGB device? I’m thinking that whoever can answer this will need more information about that NIC or anything else on the board which is custom.