kernel panic with ethernet bridging

I’m trying to load the ethernet bridge module into my kernel, but am getting a kernel panic shortly after loading the module with modprobe. Wanted to see if this rings a bell with anyone else, maybe I missed something.

I followed the very helpful kernel compilation procedures in the docs and elsewhere in this forum. I have compiled and loaded other modules successfully with the linaro 5.2 toolchain.

For bridging I compiled and loaded bridge.ko, stp.ko and llc.ko as described here. “modprobe bridge” loads stp and llc as dependencies.
https://forum.openwrt.org/viewtopic.php?pid=207125#p207125

All seems fine at first, but 5-10 seconds after loading the module, a kernel panic occurs that hangs the system. I think it’s trigged by the very next network activity that occurs after the module load.

“Unable to handle kernel paging request at virtual address xxxxxx” … followed by memory dumps

Narrowed it down to the “llc” module - if I load just llc by itself, the panic occurs.

I can’t remember exactly what it was, but this does sound familiar from quite some time back. What are you using for the second NIC?

My aim is to set up a wifi access point and bridge to the onboard ethernet port.

The TK1 Grinch kernel runs the bridge module, so there is some tegra configuration where it works. Perhaps with a hidden dependency on some other module included in that kernel.

Ahh…this may in fact be the known corrupt WiFi firmware issue, and bridging just makes it show up. Have you seen this thread?
https://devtalk.nvidia.com/default/topic/901180/jetson-tx1/my-jetson-tx1-is-not-able-to-connect-to-wifi/

If only it were that easy :) Check tool reports my wifi is ok and haven’t seen any issues using it as a client.

I saw something to do with kernel OOPS quite some time back (while working with bridging). I don’t remember what it was…if you get a chance could you post a copy of the OOPS? Serial console should be able to log it without too much pain. Also, could you experiment with the WiFi as well, just to see if there is any ability to trigger using WiFi but without bridging?

Thanks for taking a look. Panic is below.

I’m now certain it’s triggered by network activity, probably the next packet received after loading. If I disable all network devices and then load the module, the panic doesn’t happen.

I’ll poke at wifi bit, but have been using it since receiving the board.

root@tegra-ubuntu:/home/ubuntu# modprobe llc
root@tegra-ubuntu:/home/ubuntu# lsmod
Module                  Size  Used by
llc                     5446  0 
rfcomm                 65526  0 
bnep                   14792  2 
bcmdhd               7445623  0 
cfg80211              451262  1 bcmdhd
cp210x                 18029  0 
nvhost_vi               5087  0 
bluedroid_pm           11252  0 
root@tegra-ubuntu:/home/ubuntu#
[   61.989227] Unable to handle kernel paging request at virtual address 1000002c2
[   61.997559] pgd = ffffffc00007d000
[   62.001471] [1000002c2] *pgd=0000000000000000
[   62.006550] Internal error: Oops: 96000005 [#1] PREEMPT SMP
[   62.012873] Enter nvdumper_crash_setup_regs
[   62.017913] nvdumper: all registers are saved.
[   62.017937] nvdumper: all registers are saved.
[   62.017961] nvdumper: all registers are saved.
[   62.033137] nvdumper: all registers are saved.
[   62.038199] Modules linked in: llc rfcomm bnep bcmdhd cfg80211 cp210x nvhost_vi bluedroid_pm
[   62.048691] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.10.67-gcdddc52 #1
[   62.056383] task: ffffffc001109870 ti: ffffffc0010fc000 task.ti: ffffffc0010fc000
[   62.064883] PC is at llc_rcv+0xac/0x35c [llc]
[   62.069903] LR is at llc_rcv+0x60/0x35c [llc]
[   62.074867] pc : [<ffffffbffcfde340>] lr : [<ffffffbffcfde2f4>] pstate: 20000105
[   62.083209] sp : ffffffc0010ffa80
[   62.087005] x29: ffffffc0010ffa80 x28: 0000000000000020 
[   62.093238] x27: 0000000000000000 x26: ffffffc0fd153000 
[   62.099461] x25: 0000000000000020 x24: 0000000000000000 
[   62.105677] x23: ffffffc0fcec2000 x22: ffffffbffcfde968 
[   62.111895] x21: ffffffc0fcec2000 x20: ffffffc0fd153700 
[   62.118108] x19: ffffffc0fd153700 x18: 6a044401871f4fdc 
[   62.124318] x17: 14e830061744ac61 x16: 0000000000000000 
[   62.130538] x15: 0000000000000000 x14: 0000000000000000 
[   62.136746] x13: 0000000000000000 x12: 0000000000000000 
[   62.142960] x11: 0000000000000000 x10: 0000000000000000 
[   62.149177] x9 : 0000000000000000 x8 : 0000000000000004 
[   62.155401] x7 : ffffffc0002f7708 x6 : 0006194a0be4fe80 
[   62.161625] x5 : 4000000000000080 x4 : 0000000000025da0 
[   62.167837] x3 : 0000000000000100 x2 : 000000003edd4000 
[   62.174057] x1 : 000000000000002e x0 : 00000001000002c0 
[   62.180271] 
[   62.180271] SP: 0xffffffc0010ffa00:
[   62.185900] fa00  fd153700 ffffffc0 fcec2000 ffffffc0 fcfde968 ffffffbf fcec2000 ffffffc0
[   62.196007] fa20  00000000 00000000 00000020 00000000 fd153000 ffffffc0 00000000 00000000
[   62.206118] fa40  00000020 00000000 010ffa80 ffffffc0 fcfde2f4 ffffffbf 010ffa80 ffffffc0
[   62.216225] fa60  fcfde340 ffffffbf 20000105 00000000 fd153000 ffffffc0 fd153700 ffffffc0
[   62.226328] fa80  010ffad0 ffffffc0 0090f850 ffffffc0 013546e8 ffffffc0 fcfde968 ffffffbf
[   62.236425] faa0  00000400 00000000 01354710 ffffffc0 fcec2000 ffffffc0 00000000 00000000
[   62.246535] fac0  00000020 00000000 00000020 00000000 010ffb50 ffffffc0 0090f960 ffffffc0
[   62.256680] fae0  fd153000 ffffffc0 f56e0040 ffffffc0 fd153000 ffffffc0 fcec2000 ffffffc0
[   62.266830] 
[   62.266830] X7: 0xffffffc0002f7688:
[   62.272467] 7688  39000069 3900046a 3900086b 39000c6c 3900106d 3900146e 3900186f 39001c70
[   62.282576] 76a8  91002021 91002063 f100205f 54fffd8a b50001a2 d65f03c0 f100205f 5400014d
[   62.292702] 76c8  d1002042 f9400029 f9000069 91002021 91002063 f100205f 54ffff4a b5000042
[   62.302815] 76e8  d65f03c0 b40002e2 92400c46 100000a7 d2800108 cb060108 8b080ce6 d61f00c0
[   62.312911] 7708  38401429 38001469 3840142a 3800146a 3840142b 3800146b 3840142c 3800146c
[   62.323009] 7728  3840142d 3800146d 3840142e 3800146e 3840142f 3800146f 38401430 38001470
[   62.333118] 7748  d65f03c0 cb0103e6 f24008c6 54000100 cb060042 38401429 38001469 f10004c6
[   62.343242] 7768  54ffffac f101005f 54fff76b f2400866 54000561 f102005f 540001ea d1010042
[   62.353399] 
[   62.353399] X19: 0xffffffc0fd153680:
[   62.359134] 3680  00000017 00000018 0100002a 757514c8 00000001 ffffffff 00000017 00000018
[   62.369247] 36a0  0100002a a74d3cc8 00000001 ffffffff 00000017 00000018 0100002a 87299568
[   62.379352] 36c0  00000001 ffffffff 00000001 00000000 00000001 ffffffff 00000500 00000001
[   62.389464] 36e0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[   62.399571] 3700  00000000 00000000 00000000 00000000 fe5010ea 1420907e 00000000 00000000
[   62.409693] 3720  fcec2000 ffffffc0 00000000 00000000 00000000 00000000 00000000 00000000
[   62.419798] 3740  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[   62.429926] 3760  00000000 00000000 0000002e 00000000 0000000e 00000000 00000000 04000102
[   62.440038] 
[   62.440038] X20: 0xffffffc0fd153680:
[   62.445765] 3680  00000017 00000018 0100002a 757514c8 00000001 ffffffff 00000017 00000018
[   62.455888] 36a0  0100002a a74d3cc8 00000001 ffffffff 00000017 00000018 0100002a 87299568
[   62.465997] 36c0  00000001 ffffffff 00000001 00000000 00000001 ffffffff 00000500 00000001
[   62.476108] 36e0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[   62.486209] 3700  00000000 00000000 00000000 00000000 fe5010ea 1420907e 00000000 00000000
[   62.496325] 3720  fcec2000 ffffffc0 00000000 00000000 00000000 00000000 00000000 00000000
[   62.506441] 3740  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[   62.516543] 3760  00000000 00000000 0000002e 00000000 0000000e 00000000 00000000 04000102
[   62.526669] 
[   62.526669] X21: 0xffffffc0fcec1f80:
[   62.532397] 1f80  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[   62.542507] 1fa0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[   62.552596] 1fc0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[   62.562708] 1fe0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[   62.572822] 2000  30687465 00000000 00000000 00000000 00000000 00000000 ff3e39b0 ffffffc0
[   62.582931] 2020  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[   62.593035] 2040  00000000 00000000 00000003 00000000 fcec7050 ffffffc0 fe7f3850 ffffffc0
[   62.603139] 2060  fcec2060 ffffffc0 fcec2060 ffffffc0 fcec2070 ffffffc0 fcec2070 ffffffc0
[   62.613247] 
[   62.613247] X23: 0xffffffc0fcec1f80:
[   62.618974] 1f80  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[   62.629070] 1fa0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[   62.639166] 1fc0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[   62.649267] 1fe0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[   62.721655] 2000  30687465 00000000 00000000 00000000 00000000 00000000 ff3e39b0 ffffffc0
[   62.794019] 2020  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[   62.866289] 2040  00000000 00000000 00000003 00000000 fcec7050 ffffffc0 fe7f3850 ffffffc0
[   62.938653] 2060  fcec2060 ffffffc0 fcec2060 ffffffc0 fcec2070 ffffffc0 fcec2070 ffffffc0
[   63.011329] 
[   63.011329] X26: 0xffffffc0fd152f80:
[   63.142366] 2f80  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[   63.215066] 2fa0  00000000 00000000 00000000 00000000 00000000 ffffffff 00000000 ffffffff
[   63.287609] 2fc0  00000040 00007ec0 f4910000 ffffffc0 f4910040 ffffffc0 00008100 00000001
[   63.360248] 2fe0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[   63.433002] 3000  00000000 00000000 00000000 00000000 fe5010ea 1420907e 00000000 00000000
[   63.505766] 3020  fcec2000 ffffffc0 00000000 00000000 00000000 00000000 00000000 00000000
[   63.578502] 3040  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[   63.651152] 3060  00000000 00000000 0000002e 00000000 0000000e 00000000 00000000 04000102
[   63.723639] 
[   63.723639] X29: 0xffffffc0010ffa00:
[   63.854322] fa00  fd153700 ffffffc0 fcec2000 ffffffc0 fcfde968 ffffffbf fcec2000 ffffffc0
[   63.926853] fa20  00000000 00000000 00000020 00000000 fd153000 ffffffc0 00000000 00000000
[   63.999466] fa40  00000020 00000000 010ffa80 ffffffc0 fcfde2f4 ffffffbf 010ffa80 ffffffc0
[   64.072109] fa60  fcfde340 ffffffbf 20000105 00000000 fd153000 ffffffc0 fd153700 ffffffc0
[   64.145136] fa80  010ffad0 ffffffc0 0090f850 ffffffc0 013546e8 ffffffc0 fcfde968 ffffffbf
[   64.218191] faa0  00000400 00000000 01354710 ffffffc0 fcec2000 ffffffc0 00000000 00000000
[   64.291310] fac0  00000020 00000000 00000020 00000000 010ffb50 ffffffc0 0090f960 ffffffc0
[   64.364463] fae0  fd153000 ffffffc0 f56e0040 ffffffc0 fd153000 ffffffc0 fcec2000 ffffffc0
[   64.437618] 
[   64.502813] Process swapper/0 (pid: 0, stack limit = 0xffffffc0010fc060)
[   64.573950] Stack: (0xffffffc0010ffa80 to 0xffffffc001100000)
[   64.644591] fa80: 010ffad0 ffffffc0 0090f850 ffffffc0 013546e8 ffffffc0 fcfde968 ffffffbf
[   64.718186] faa0: 00000400 00000000 01354710 ffffffc0 fcec2000 ffffffc0 00000000 00000000
[   64.791970] fac0: 00000020 00000000 00000020 00000000 010ffb50 ffffffc0 0090f960 ffffffc0
[   64.865813] fae0: fd153000 ffffffc0 f56e0040 ffffffc0 fd153000 ffffffc0 fcec2000 ffffffc0
[   64.940208] fb00: f56e0058 ffffffc0 fcec2968 ffffffc0 fd78db00 ffffffc0 fb9f5180 ffffffc0
[   65.014273] fb20: fcec27c0 ffffffc0 00000020 00000000 f56e0058 ffffffc0 fd153000 ffffffc0
[   65.088489] fb40: 010ffb50 ffffffc0 01354710 ffffffc0 010ffb70 ffffffc0 0090f9ac ffffffc0
[   65.162774] fb60: fd153000 ffffffc0 f56e0040 ffffffc0 010ffb90 ffffffc0 005ed93c ffffffc0
[   65.236860] fb80: 0000003c 00000000 005ed90c ffffffc0 010ffc10 ffffffc0 005ee4f8 ffffffc0
[   65.311223] fba0: fcec27c0 ffffffc0 fcec27d8 ffffffc0 00000000 00000000 010e1bc0 ffffffc0
[   65.399041] fbc0: 0130f000 ffffffc0 00000102 00000000 01103080 ffffffc0 010e1e28 ffffffc0
[   65.470848] fbe0: 00000000 00000000 012c1580 ffffffc0 010ffc00 ffffffc0 000af9bc 00000000
[   65.545430] fc00: 010ffc00 ffffffc0 010ffc00 ffffffc0 010ffc30 ffffffc0 000afa3c ffffffc0
[   65.620377] fc20: fcec27d0 ffffffc0 00000102 00000000 010ffc70 ffffffc0 000aec9c ffffffc0
[   65.694708] fc40: 010fc000 ffffffc0 00000006 00000000 00000001 00000000 011030b0 ffffffc0
[   65.768868] fc60: 00000006 00000000 00002010 ffffff80 010ffcf0 ffffffc0 000aeecc ffffffc0
[   65.843119] fc80: 00000180 00000000 00000000 00000000 0000200c ffffff80 01317678 ffffffc0
[   65.917616] fca0: 010ffda0 ffffffc0 00002010 ffffff80 01268000 ffffffc0 01268000 ffffffc0
[   65.992107] fcc0: 000803f8 ffffffc0 010fc000 ffffffc0 010ffcf0 ffffffc0 00f02c48 ffffffc0
[   66.066502] fce0: ffffa306 00000000 00200000 0000000a 010ffd10 ffffffc0 000af1b4 ffffffc0
[   66.141052] fd00: 010fc000 ffffffc0 00000000 00000000 010ffd30 ffffffc0 000859fc ffffffc0
[   66.215011] fd20: 00000047 00000000 000813c8 ffffffc0 010ffd50 ffffffc0 000813d0 ffffffc0
[   66.288447] fd40: 00000047 00000000 00000047 00000000 010ffec0 ffffffc0 00084e04 ffffffc0
[   66.361813] fd60: 3feb82f0 ffffffc0 00000003 00000000 010ffec0 ffffffc0 00743a4c ffffffc0
[   66.410412] fd80: 80000345 00000000 00000001 00000000 8007b000 00000000 8007d000 00000000
[   66.424283] fda0: 00000000 00000000 00743a48 ffffffc0 73dfec08 000727b0 00053114 00000000

and here’s a panic that occurred a different time that included a call trace:

[  209.325394] Call trace:
[  209.395666] [<ffffffbffcfde340>] llc_rcv+0xac/0x35c [llc]
[  209.469667] [<ffffffc00090f84c>] __netif_receive_skb_core+0x61c/0x6c4
[  209.545191] [<ffffffc00090f95c>] __netif_receive_skb+0x68/0x78
[  209.619934] [<ffffffc00090f9a8>] netif_receive_skb+0x3c/0x4c
[  209.694513] [<ffffffc0005ed938>] rx_bottom+0x1c8/0x31c
[  209.768694] [<ffffffc0005ee4f4>] bottom_half+0x44/0x5c
[  209.842954] [<ffffffc0000afa38>] tasklet_action+0xe8/0x170
[  209.917516] [<ffffffc0000aec98>] __do_softirq+0x184/0x2fc
[  209.992091] [<ffffffc0000aeec8>] do_softirq+0x44/0x6c
[  210.065864] [<ffffffc0000af1b0>] irq_exit+0x80/0xc8
[  210.139183] [<ffffffc0000859f8>] handle_IRQ+0x90/0xc4
[  210.212592] [<ffffffc0000813cc>] gic_handle_irq+0x70/0x184
[  210.286288] Exception stack(0xffffffc0010ffd60 to 0xffffffc0010ffe80)
[  210.361182] fd60: 3feb82f0 ffffffc0 00000003 00000000 010ffec0 ffffffc0 00743a4c ffffffc0
[  210.438206] fd80: 80000345 00000000 00000001 00000000 8007b000 00000000 8007d000 00000000
[  210.515278] fda0: 00000000 00000000 00743a48 ffffffc0 ba89cf5c 00321d6c 0004140d 00000000
[  210.592378] fdc0: baf3c200 0000002f 341540fa 00000000 3b9aca00 00000000 17937295 00000000
[  210.669278] fde0: 00000018 00000000 00084000 ffffffc0 5342b9b9 09d90814 8006412a 358ceb02
[  210.746610] fe00: 00000000 00000000 388ad497 230382b2 c2255d74 40007202 dc5ea1e1 0147a067
[  210.823741] fe20: a6062802 4bc43e0d 94442c61 14e83006 871fcfdd 6a044401 3feb82f0 ffffffc0
[  210.900977] fe40: 00000003 00000000 04a4a14f 00000030 03cd8101 00000030 3feb8608 ffffffc0
[  210.978151] fe60: 00000000 00000000 8007b000 00000000 8007d000 00000000 000803f8 ffffffc0
[  211.051081] [<ffffffc000084e00>] el1_irq+0x80/0xf0
[  211.093774] [<ffffffc000743c30>] cpuidle_idle_call+0x178/0x278
[  211.168317] [<ffffffc00008670c>] arch_cpu_idle+0x8/0x24
[  211.241959] [<ffffffc0000f57c4>] cpu_idle_loop+0x20c/0x278
[  211.315567] [<ffffffc0000f584c>] cpu_startup_entry+0x1c/0x20
[  211.388919] [<ffffffc000a9f694>] rest_init+0x84/0x94
[  211.461681] [<ffffffc00107a850>] start_kernel+0x26c/0x27c
[  211.534505] Code: aa1303e0 94e49a0d b4001300 f9406e60 (39400800) 
[  211.609970] ---[ end trace cbd7a359c34daef7 ]---
[  211.712353] Kernel panic - not syncing: Fatal exception in interrupt
[  211.787042] CPU1: stopping
[  211.857391] CPU: 1 PID: 0 Comm: swapper/1 Tainted: G      D      3.10.67-gcdddc52 #1
[  211.933484] Call trace:
[  212.004139] [<ffffffc000089ca0>] dump_backtrace+0x0/0xf4
[  212.078342] [<ffffffc000089f98>] show_stack+0x10/0x1c
[  212.151814] [<ffffffc0002f82a0>] dump_stack+0x1c/0x28
[  212.225295] [<ffffffc000090804>] ipi_cpu_stop+0x44/0x6c
[  212.298518] [<ffffffc000090c90>] handle_IPI+0xc0/0x11c
[  212.371626] [<ffffffc00008145c>] gic_handle_irq+0x100/0x184
[  212.445021] Exception stack(0xffffffc0fff5fd90 to 0xffffffc0fff5feb0)
[  212.519500] fd80:                                     3fec52f0 ffffffc0 00000003 00000000
[  212.596469] fda0: fff5fef0 ffffffc0 00743a4c ffffffc0 80000345 00000000 00000001 00000000
[  212.673658] fdc0: 8007b000 00000000 8007d000 00000000 00000000 00000000 00743a48 ffffffc0
[  212.751256] fde0: 894d4b16 00166055 0002833f 00000000 20947e00 00000031 341540fa 00000000
[  212.829181] fe00: 3b9aca00 00000000 17937295 00000000 00000018 00000000 00084000 ffffffc0
[  212.906915] fe20: c1020672 3614d05b 603c2c14 15410a03 00000001 00000000 062c6c38 f86a0099
[  212.984988] fe40: 4e2808a7 5d8f0162 6616e4a6 8c444b7a 114b8c7f 121d0a03 3ce31004 95f013c0
[  213.063005] fe60: 14032ea1 8e9d7a86 3fec52f0 ffffffc0 00000003 00000000 4e88461e 00000031
[  213.141681] fe80: 4e807f29 00000031 3fec5608 ffffffc0 00000001 00000000 8007b000 00000000
[  213.220675] fea0: 8007d000 00000000 000801f0 ffffffc0
[  213.296724] [<ffffffc000084e00>] el1_irq+0x80/0xf0
[  213.372607] [<ffffffc000743c30>] cpuidle_idle_call+0x178/0x278
[  213.449771] [<ffffffc00008670c>] arch_cpu_idle+0x8/0x24
[  213.526281] [<ffffffc0000f57c4>] cpu_idle_loop+0x20c/0x278
[  213.558376] SMP: failed to stop secondary CPUs

This looks to be fixed in the R23.2 kernel update.