Hi,guys,
I encountered a problem. Tx2 running for about 2 days.It appears that load is too high and the soft interrupt cost high cpu times. I found amount of irq/62-host_syn appeared.I wonder what this interruption is used for. Could anyone help me? please!! Thank you very much!!
I’m not positive, but I think that would be for V4L2…possibly a camera, but maybe video. What is connected to the board?
nothing is connected to the board.no camera,no usb devices ,just connected one twisted-pair。
cat /proc/interrupts
CPU0 CPU1 CPU2 CPU3 CPU4 CPU5
3: 0 0 0 0 0 0 GICv2 30 Edge arch_timer
6: 486644583 0 0 0 0 0 GICv2 32 Level tegra186_timer0
7: 0 319560640 0 0 0 0 GICv2 33 Level tegra186_timer1
8: 0 0 308615863 0 0 0 GICv2 34 Level tegra186_timer2
9: 0 0 0 511052895 0 0 GICv2 35 Level tegra186_timer3
10: 0 0 0 0 504242797 0 GICv2 36 Level tegra186_timer4
11: 0 0 0 0 0 513295563 GICv2 37 Level tegra186_timer5
12: 133915801 0 0 0 0 0 GICv2 208 Level hsp
13: 0 0 0 0 0 0 GICv2 202 Level arm-smmu global fault
14: 0 0 0 0 0 0 GICv2 203 Level arm-smmu global fault
22: 20313228 0 0 0 0 0 GICv2 97 Level 3460000.sdhci
23: 10328134 0 0 0 0 0 GICv2 96 Level 3440000.sdhci
24: 0 0 0 0 0 0 GICv2 94 Level 3400000.sdhci
25: 0 0 0 0 0 0 GICv2 229 Level 3507000.ahci-sata
26: 43 0 0 0 0 0 GICv2 57 Level 3160000.i2c
27: 0 0 0 0 0 0 GICv2 58 Level c240000.i2c
28: 0 0 0 0 0 0 GICv2 59 Level 3180000.i2c
29: 68 0 0 0 0 0 GICv2 60 Level 3190000.i2c
30: 0 0 0 0 0 0 GICv2 62 Level 31b0000.i2c
31: 0 0 0 0 0 0 GICv2 63 Level 31c0000.i2c
32: 38 0 0 0 0 0 GICv2 64 Level c250000.i2c
33: 0 0 0 0 0 0 GICv2 65 Level 31e0000.i2c
34: 0 0 0 0 0 0 GICv2 68 Level 3210000.spi
35: 0 0 0 0 0 0 GICv2 69 Level c260000.spi
36: 0 0 0 0 0 0 GICv2 71 Level 3240000.spi
37: 42 0 0 0 0 0 GICv2 144 Level serial
42: 473966 0 0 0 0 0 GICv2 226 Level ether_qos.common_irq
44: 514013 0 0 0 0 0 GICv2 222 Level 2490000.ether_qos.rx0
45: 759891 0 0 0 0 0 GICv2 218 Level 2490000.ether_qos.tx0
52: 0 0 0 0 0 0 GICv2 48 Level b000000.rtcpu
53: 701112 0 0 0 0 0 GICv2 242 Level d230000.actmon
54: 0 0 0 0 0 0 PM 42 Level tegra_rtc
55: 0 0 0 0 0 0 GICv2 255 Level mc_status
57: 3 0 0 0 0 0 GICv2 196 Level 3538000.mailbox
59: 1412 0 0 0 0 0 PM 195 Level xhci-hcd:usb1
60: 0 0 0 0 0 0 PM 199 Level 3530000.xhci, xotg
61: 0 0 0 0 0 0 GICv2 198 Level 3550000.xudc
62: 60699784 0 0 0 0 0 GICv2 297 Level host_syncpt
63: 0 0 0 0 0 0 GICv2 295 Level host_status
64: 0 0 0 0 0 0 GICv2 151 Level 150c0000.nvcsi
65: 0 0 0 0 0 0 GICv2 233 Level 15700000.vi
68: 0 0 0 0 0 0 GICv2 237 Level tegra-isp-isr
69: 10804 0 0 0 0 0 GICv2 186 Level 15210000.nvdisplay
73: 5750557 0 0 0 0 0 GICv2 102 Level gk20a_stall
74: 0 0 0 0 0 0 GICv2 103 Level gk20a_nonstall
76: 0 0 0 0 0 0 GICv2 315 Level 3ad0000.se_elp
77: 54 0 0 0 0 0 GICv2 173 Level b150000.tegra-hsp
78: 53 0 0 0 0 0 GICv2 174 Level b150000.tegra-hsp, b150000.tegra-hsp
81: 0 0 0 0 0 0 GICv2 165 Level c150000.tegra-hsp
92: 2 0 0 0 0 0 GICv2 107 Level gpcdma.0
93: 2 0 0 0 0 0 GICv2 108 Level gpcdma.1
94: 0 0 0 0 0 0 GICv2 109 Level gpcdma.2
95: 0 0 0 0 0 0 GICv2 110 Level gpcdma.3
96: 0 0 0 0 0 0 GICv2 111 Level gpcdma.4
97: 0 0 0 0 0 0 GICv2 112 Level gpcdma.5
98: 0 0 0 0 0 0 GICv2 113 Level gpcdma.6
99: 0 0 0 0 0 0 GICv2 114 Level gpcdma.7
100: 0 0 0 0 0 0 GICv2 115 Level gpcdma.8
101: 0 0 0 0 0 0 GICv2 116 Level gpcdma.9
102: 0 0 0 0 0 0 GICv2 117 Level gpcdma.10
103: 0 0 0 0 0 0 GICv2 118 Level gpcdma.11
104: 0 0 0 0 0 0 GICv2 119 Level gpcdma.12
105: 0 0 0 0 0 0 GICv2 120 Level gpcdma.13
106: 0 0 0 0 0 0 GICv2 121 Level gpcdma.14
107: 0 0 0 0 0 0 GICv2 122 Level gpcdma.15
108: 0 0 0 0 0 0 GICv2 123 Level gpcdma.16
109: 0 0 0 0 0 0 GICv2 124 Level gpcdma.17
110: 0 0 0 0 0 0 GICv2 125 Level gpcdma.18
111: 0 0 0 0 0 0 GICv2 126 Level gpcdma.19
112: 0 0 0 0 0 0 GICv2 127 Level gpcdma.20
113: 0 0 0 0 0 0 GICv2 128 Level gpcdma.21
114: 0 0 0 0 0 0 GICv2 129 Level gpcdma.22
115: 0 0 0 0 0 0 GICv2 130 Level gpcdma.23
116: 0 0 0 0 0 0 GICv2 131 Level gpcdma.24
117: 0 0 0 0 0 0 GICv2 132 Level gpcdma.25
118: 0 0 0 0 0 0 GICv2 133 Level gpcdma.26
119: 0 0 0 0 0 0 GICv2 134 Level gpcdma.27
120: 0 0 0 0 0 0 GICv2 135 Level gpcdma.28
121: 0 0 0 0 0 0 GICv2 136 Level gpcdma.29
122: 0 0 0 0 0 0 GICv2 137 Level gpcdma.30
123: 0 0 0 0 0 0 GICv2 138 Level gpcdma.31
232: 8 0 0 0 0 0 tegra-gpio 101 Level phy_interrupt
252: 1 0 0 0 0 0 tegra-gpio 121 Edge 15210000.nvdisplay
256: 0 0 0 0 0 0 tegra-gpio 125 Edge 3400000.sdhci cd
290: 0 0 0 0 0 0 tegra-gpio 159 Edge external-connection:extcon@1
340: 0 0 0 0 0 0 tegra-gpio-aon 16 Level tmp451
380: 0 0 0 0 0 0 tegra-gpio-aon 56 Edge Power
381: 0 0 0 0 0 0 tegra-gpio-aon 57 Edge Volume Up
382: 0 0 0 0 0 0 tegra-gpio-aon 58 Edge Volume Down
383: 1256917 0 0 0 0 0 tegra-gpio-aon 59 Level bcmsdh_sdmmc
384: 1 0 0 0 0 0 tegra-gpio-aon 60 Edge bluetooth hostwake
390: 56 0 0 0 0 0 GIC 32 Level adma.0
391: 55 0 0 0 0 0 GIC 33 Level adma.1
392: 0 0 0 0 0 0 GIC 34 Level adma.2
393: 0 0 0 0 0 0 GIC 35 Level adma.3
394: 0 0 0 0 0 0 GIC 36 Level adma.4
395: 0 0 0 0 0 0 GIC 37 Level adma.5
396: 0 0 0 0 0 0 GIC 38 Level adma.6
397: 0 0 0 0 0 0 GIC 39 Level adma.7
398: 0 0 0 0 0 0 GIC 40 Level adma.8
399: 0 0 0 0 0 0 GIC 41 Level adma.9
400: 714 0 0 0 0 0 GICv2 193 Level snd_hda_tegra
411: 0 0 0 0 0 0 GIC 73 Edge hwmbox1_send_empty
412: 0 0 0 0 0 0 GIC 64 Edge hwmbox0_recv_full
413: 0 0 0 0 0 0 GIC 115 Edge adsp watchdog
414: 0 0 0 0 0 0 GIC 94 Edge adsp wfi
415: 0 0 0 0 0 0 GIC 89 Level AMC error int
424: 56823 0 0 0 0 0 GICv2 39 Level 30c0000.watchdog
431: 0 0 0 0 0 0 PM 241 Edge max77620-top
435: 0 0 0 0 0 0 max77620-top 3 Edge max77620-gpio
436: 0 0 0 0 0 0 max77620-top 4 Edge max77686-rtc
440: 0 0 0 0 0 0 max77620-top 8 Edge max77620-thermal
441: 0 0 0 0 0 0 max77620-top 9 Edge max77620-thermal
442: 0 0 0 0 0 0 max77620-gpio 0 Edge external-connection:extcon@1
450: 0 0 0 0 0 0 max77686-rtc 1 Edge rtc-alarm1
IPI0: 110277736 81628499 56348257 157303632 150039924 140813007 Rescheduling interrupts
IPI1: 14724 162 196 11617 3330 342 Function call interrupts
IPI2: 0 0 0 0 0 0 CPU stop interrupts
IPI3: 0 0 0 0 0 0 Timer broadcast interrupts
IPI4: 9878692 22849687 21429279 9650401 9676497 9580177 IRQ work interrupts
Err: 0
this is top command show,the si% is so high
top - 10:28:14 up 19 days, 17:41, 2 users, load average: 11.02, 11.42, 11.43
Tasks: 325 total, 7 running, 318 sleeping, 0 stopped, 0 zombie
%Cpu(s): 1.8 us, 22.5 sy, 0.0 ni, 0.5 id, 0.0 wa, 0.0 hi, 75.2 si, 0.0 st
KiB Mem : 8042792 total, 769880 free, 2839724 used, 4433188 buff/cache
KiB Swap: 0 total, 0 free, 0 used. 3002756 avail Mem
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
14 root 20 0 0 0 0 R 43.1 0.0 7395:32 ksoftirqd/1
19 root 20 0 0 0 0 R 37.2 0.0 7000:06 ksoftirqd/2
29 root 20 0 0 0 0 R 31.6 0.0 5899:41 ksoftirqd/4
24 root 20 0 0 0 0 R 29.9 0.0 5733:15 ksoftirqd/3
517 message+ 20 0 8636 5196 2660 R 28.0 0.1 4475:07 dbus-daemon
3 root 20 0 0 0 0 S 26.6 0.0 5898:23 ksoftirqd/0
34 root 20 0 0 0 0 S 26.6 0.0 5762:13 ksoftirqd/5
4987 root 20 0 3678312 20580 15904 S 26.3 0.3 0:48.17 starops-core
1 root 20 0 125252 38068 3468 S 16.4 0.5 2416:53 systemd
5816 root 20 0 15152 13144 2196 R 13.5 0.2 0:04.93 systemd-logind
3961 root 20 0 1008960 9176 6784 S 10.5 0.1 5193:27 edgepaxos
826 root 20 0 560544 43264 30956 S 7.6 0.5 1433:43 dockerd
919 root 20 0 48.140g 50564 34132 S 7.6 0.6 4121:54 Xorg
4988 root 20 0 856572 18584 15344 S 6.9 0.2 0:17.51 starops-ppf
943 root 20 0 527540 12116 8080 S 5.6 0.2 805:32.90 containerd
5518 root 20 0 0 0 0 S 3.3 0.0 0:01.08 kworker/u12:1
2539 nvidia 20 0 948304 160600 66544 S 2.6 2.0 1423:39 compiz
3610 root 20 0 0 0 0 S 2.6 0.0 0:06.14 kworker/u12:0
4220 root 20 0 6645404 128308 13728 S 2.6 1.6 2038:03 java
3755 root 20 0 6095544 120072 13928 S 2.3 1.5 2382:48 java
4203 root 20 0 6593212 115784 14360 S 2.3 1.4 1359:35 java
5820 root 20 0 4620408 40476 13208 S 2.0 0.5 0:02.79 java
117 root -51 0 0 0 0 S 1.3 0.0 175:41.28 irq/73-gk20a_st
2328 root 20 0 17.128g 977996 350616 S 1.3 12.2 548:30.07 sap_algo_server
4692 root 20 0 6430572 107064 14260 S 1.3 1.3 918:21.30 java
7 root 20 0 0 0 0 S 1.0 0.0 607:43.65 rcu_preempt
821 root 0 -20 0 0 0 S 1.0 0.0 0:03.06 kworker/1:1H
959 root 20 0 0 0 0 D 1.0 0.0 783:16.29 nvgpu_channel_p
6005 root 20 0 9016 3416 2628 R 1.0 0.0 0:00.11 top
30084 root 0 -20 0 0 0 S 1.0 0.0 0:09.92 kworker/2:0H
177 root -2 0 0 0 0 S 0.7 0.0 492:45.56 mmcqd/0
before is the bad device /proc/softirqs in 5minutes
HI: 0 0 0 0 0 0 avag:0
TIMER: 59150 65634 65530 62009 59413 63201 avag:74987.4
NET_TX: 0 0 0 0 0 0 avag:0
NET_RX: 601 207 215 341 298 397 avag:411.8
BLOCK: 0 0 0 0 0 0 avag:0
BLOCK_IOPOLL: 0 0 0 0 0 0 avag:0
TASKLET: 4217 0 0 0 0 0 avag:843.4
SCHED: 34740 46645 46981 36897 35489 37250 avag:47600.4
HRTIMER: 0 0 0 0 0 0 avag:0
RCU: 59817 21528 26422 11127 9290 9363 avag:27509.4
this is the normal device /proc/softirqs in 5minutes
HI: 0 0 0 0 0 0 avag:0
TIMER: 22417 6101 5393 21836 22476 25624 avag:20769.4
NET_TX: 0 0 0 0 0 0 avag:0
NET_RX: 1017 2 0 422 483 454 avag:475.6
BLOCK: 0 0 0 0 0 0 avag:0
BLOCK_IOPOLL: 0 0 0 0 0 0 avag:0
TASKLET: 4426 0 0 0 0 0 avag:885.2
SCHED: 16776 11888 3915 15693 15569 18750 avag:16518.2
HRTIMER: 0 0 0 0 0 0 avag:0
RCU: 15957 7442 5356 24624 25245 17293 avag:19183.4
This is related XUSB, but I couldn’t say how. What USB devices are connected? Is there a HUB with multiple devices, and if so, is the HUB powered?
Can you check the output of “lsusb” prior to this starting, and again after?
Hi,
What is the ‘twisted pair’ connected to TX2?
Does the issue happen without connecting the twisted pair?
Maybe I am not clear about it.The ‘twisted pair’ just mean a wired network connected。I found the timer softirq is so high。
before is the bad device /proc/softirqs in 5minutes
HI: 0 0 0 0 0 0 avag:0
TIMER: 59150 65634 65530 62009 59413 63201 avag:74987.4
NET_TX: 0 0 0 0 0 0 avag:0
NET_RX: 601 207 215 341 298 397 avag:411.8
BLOCK: 0 0 0 0 0 0 avag:0
BLOCK_IOPOLL: 0 0 0 0 0 0 avag:0
TASKLET: 4217 0 0 0 0 0 avag:843.4
SCHED: 34740 46645 46981 36897 35489 37250 avag:47600.4
HRTIMER: 0 0 0 0 0 0 avag:0
RCU: 59817 21528 26422 11127 9290 9363 avag:27509.4
this is the normal device /proc/softirqs in 5minutes
HI: 0 0 0 0 0 0 avag:0
TIMER: 22417 6101 5393 21836 22476 25624 avag:20769.4
NET_TX: 0 0 0 0 0 0 avag:0
NET_RX: 1017 2 0 422 483 454 avag:475.6
BLOCK: 0 0 0 0 0 0 avag:0
BLOCK_IOPOLL: 0 0 0 0 0 0 avag:0
TASKLET: 4426 0 0 0 0 0 avag:885.2
SCHED: 16776 11888 3915 15693 15569 18750 avag:16518.2
HRTIMER: 0 0 0 0 0 0 avag:0
RCU: 15957 7442 5356 24624 25245 17293 avag:19183.4
Hi,
Could you disable WIFI and ethernet for a trial? It probably is from ethernet transmission or searching for WIFI AP?
Hi tcwdwjj,
Have you tested with our suggestions or this is not an issue now?
Thanks