[LEDE-DEV] Crash on D-Link DIR-869-A1 (ar71xx) with ath10k / Coova-Chilli

James Wood james.wood at purplewifi.com
Mon Nov 14 05:29:33 PST 2016


Hi John

Please find below with KALLSYMS enabled. To be honest it doesn't appear to
add anything extra? To enable it, I set CONFIG_KERNEL_KALLSYMS=y and
performed a make target/linux/clean - then re-compiled and used sysupgrade
to flash. Did I miss something, and how can I check whether KALLSYMS was
compiled in?

Wed Nov  9 14:13:23 2016 local6.info coova-chilli[1585]:
CoovaChilli(ChilliSpot) 1.3.0. Copyright 2002-2005 Mondru AB. Licensed under
GPL. Copyright 2006-2012 David Bird (Coova Technologies)
<support at coova.com>. Licensed under GPL. See http://www.coova.org/ for
details.
Wed Nov  9 14:13:23 2016 local6.notice coova-chilli[1585]: tun.c: 605: TX
queue length set to 100
Wed Nov  9 14:13:24 2016 kern.warn kernel: hostapd invoked oom-killer:
gfp_mask=0x24201ca, order=0, oom_score_adj=0
Wed Nov  9 14:13:24 2016 kern.warn kernel: CPU: 0 PID: 1548 Comm: hostapd
Not tainted 4.4.30 #0
Wed Nov  9 14:13:24 2016 kern.warn kernel: Stack : 803898c4 00000000
00000001 803e0000 83961b80 803ce083 8036b284 0000060c
Wed Nov  9 14:13:24 2016 kern.warn kernel:        8043379c 82081d1c 00000000
00000003 00003b43 800a60c4 00000006 80373ab0
Wed Nov  9 14:13:24 2016 kern.warn kernel:        00000000 00000000 8036ec10
82081bbc 80436542 800a4044 803cd710 00000000
Wed Nov  9 14:13:24 2016 kern.warn kernel:        00000001 801ee500 00000000
00000000 00000000 00000000 00000000 00000000
Wed Nov  9 14:13:24 2016 kern.warn kernel:        00000000 00000000 00000000
00000000 00000000 00000000 00000000 00000000
Wed Nov  9 14:13:24 2016 kern.warn kernel:        ...
Wed Nov  9 14:13:24 2016 kern.warn kernel: Call Trace:
Wed Nov  9 14:13:24 2016 kern.warn kernel: [<800715a8>] show_stack+0x50/0x84
Wed Nov  9 14:13:24 2016 kern.warn kernel: [<800d2400>]
dump_header.isra.4+0x48/0x130
Wed Nov  9 14:13:24 2016 kern.warn kernel: [<800d27e4>]
oom_kill_process+0x98/0x43c
Wed Nov  9 14:13:24 2016 kern.warn kernel: [<800d2eec>]
out_of_memory+0x2e0/0x324
Wed Nov  9 14:13:24 2016 kern.warn kernel: [<800d67e0>]
__alloc_pages_nodemask+0x684/0x6f0
Wed Nov  9 14:13:24 2016 kern.warn kernel: [<800d17e4>]
filemap_fault+0x258/0x458
Wed Nov  9 14:13:24 2016 kern.warn kernel: [<800ec3cc>] __do_fault+0x3c/0xa8
Wed Nov  9 14:13:24 2016 kern.warn kernel: [<800ef66c>]
handle_mm_fault+0x4e4/0xb84
Wed Nov  9 14:13:24 2016 kern.warn kernel: [<800761d4>]
__do_page_fault+0x134/0x470
Wed Nov  9 14:13:24 2016 kern.warn kernel: [<80060820>]
ret_from_exception+0x0/0x10
Wed Nov  9 14:13:24 2016 kern.warn kernel:
Wed Nov  9 14:13:24 2016 kern.warn kernel: Mem-Info:
Wed Nov  9 14:13:24 2016 kern.warn kernel: active_anon:381 inactive_anon:7
isolated_anon:0
Wed Nov  9 14:13:24 2016 kern.warn kernel:  active_file:25 inactive_file:30
isolated_file:0
Wed Nov  9 14:13:24 2016 kern.warn kernel:  unevictable:0 dirty:0
writeback:0 unstable:0
Wed Nov  9 14:13:24 2016 kern.warn kernel:  slab_reclaimable:140
slab_unreclaimable:1354
Wed Nov  9 14:13:24 2016 kern.warn kernel:  mapped:2 shmem:31 pagetables:64
bounce:0
Wed Nov  9 14:13:24 2016 kern.warn kernel:  free:2048 free_pcp:0 free_cma:0
Wed Nov  9 14:13:24 2016 kern.warn kernel: Normal free:8192kB min:8192kB
low:10240kB high:12288kB active_anon:1524kB inactive_anon:28kB
active_file:100kB inactive_file:120kB unevictable:0kB isolated(anon):0kB
isolated(file):0kB present:65536kB managed:60684kB mlocked:0kB dirty:0kB
writeback:0kB mapped:8kB shmem:124kB slab_reclaimable:560kB
slab_unreclaimable:5416kB kernel_stack:384kB pagetables:256kB unstable:0kB
bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB
pages_scanned:0 all_unrecWed Nov  9 14:13:24 2016 kern.warn kernel:
lowmem_reserve[]: 0 0
Wed Nov  9 14:13:24 2016 kern.warn kernel: Normal: 258*4kB (UM) 205*8kB (UM)
117*16kB (UM) 52*32kB (UM) 13*64kB (UM) 5*128kB (U) 2*256kB (U) 0*512kB
0*1024kB 0*2048kB 0*4096kB = 8192kB
Wed Nov  9 14:13:24 2016 kern.warn kernel: 86 total pagecache pages
Wed Nov  9 14:13:24 2016 kern.warn kernel: 0 pages in swap cache
Wed Nov  9 14:13:24 2016 kern.warn kernel: Swap cache stats: add 0, delete
0, find 0/0
Wed Nov  9 14:13:24 2016 kern.warn kernel: Free swap  = 0kB
Wed Nov  9 14:13:24 2016 kern.warn kernel: Total swap = 0kB
Wed Nov  9 14:13:24 2016 kern.warn kernel: 16384 pages RAM
Wed Nov  9 14:13:24 2016 kern.warn kernel: 0 pages HighMem/MovableOnly
Wed Nov  9 14:13:24 2016 kern.warn kernel: 1213 pages reserved
Wed Nov  9 14:13:24 2016 kern.info kernel: [ pid ]   uid  tgid total_vm
rss nr_ptes nr_pmds swapents oom_score_adj name
Wed Nov  9 14:13:24 2016 kern.info kernel: [  420]     0   420      295
15       4       0        0             0 ubusd
Wed Nov  9 14:13:24 2016 kern.info kernel: [  421]     0   421      224
10       3       0        0             0 askfirst
Wed Nov  9 14:13:24 2016 kern.info kernel: [  707]     0   707      307
34       4       0        0             0 logd
Wed Nov  9 14:13:24 2016 kern.info kernel: [  716]     0   716      361
23       4       0        0             0 rpcd
Wed Nov  9 14:13:24 2016 kern.info kernel: [  762]     0   762      414
40       5       0        0             0 netifd
Wed Nov  9 14:13:24 2016 kern.info kernel: [  801]     0   801      297
10       3       0        0             0 crond
Wed Nov  9 14:13:24 2016 kern.info kernel: [  827]     0   827      265
11       3       0        0             0 dropbear
Wed Nov  9 14:13:24 2016 kern.info kernel: [  849]     0   849      322
19       3       0        0             0 uhttpd
Wed Nov  9 14:13:24 2016 kern.info kernel: [  991]     0   991      296
10       3       0        0             0 ntpd
Wed Nov  9 14:13:24 2016 kern.info kernel: [ 1109]     0  1109      296
9       3       0        0             0 udhcpc
Wed Nov  9 14:13:24 2016 kern.info kernel: [ 1341]     0  1341      486
34       3       0        0             0 hostapd
Wed Nov  9 14:13:24 2016 kern.info kernel: [ 1376]   453  1376      261
17       4       0        0             0 dnsmasq
Wed Nov  9 14:13:24 2016 kern.info kernel: [ 1548]     0  1548      485
30       4       0        0             0 hostapd
Wed Nov  9 14:13:24 2016 kern.info kernel: [ 1571]     0  1571      282
25       3       0        0             0 dropbear
Wed Nov  9 14:13:24 2016 kern.info kernel: [ 1573]     0  1573      297
10       4       0        0             0 ash
Wed Nov  9 14:13:24 2016 kern.info kernel: [ 1585]     0  1585      776
43       4       0        0             0 chilli
Wed Nov  9 14:13:24 2016 kern.info kernel: [ 1586]     0  1586      260
3       3       0        0             0 hotplug-call
Wed Nov  9 14:13:24 2016 kern.err kernel: Out of memory: Kill process 1585
(chilli) score 3 or sacrifice child
Wed Nov  9 14:13:24 2016 kern.err kernel: Killed process 1585 (chilli)
total-vm:3104kB, anon-rss:168kB, file-rss:4kB
Wed Nov  9 14:13:24 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA
overrun on vdev 0, skipped old beacon
Wed Nov  9 14:13:24 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA
overrun on vdev 1, skipped old beacon
Wed Nov  9 14:13:24 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA
overrun on vdev 0, skipped old beacon
Wed Nov  9 14:13:24 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA
overrun on vdev 1, skipped old beacon
Wed Nov  9 14:13:25 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA
overrun on vdev 0, skipped old beacon

This is a 64MB RAM unit though and has over half of its memory free before
starting Coova-Chilli. We have the same software running on 32MB units for
many years with 20MB free still.

Why does it only get OOM and crash when attaching it to the 5GHz WiFi and
not 2.4GHz or the LAN bridge etc. Seems something between ath10k and
Coova-Chilli on this particular board/revision?

Anything else I can try to find out why it goes OOM or crashes?

Thanks

James

-----Original Message-----
From: Lede-dev [mailto:lede-dev-bounces at lists.infradead.org] On Behalf Of John Crispin
Sent: 8 November 2016 02:16:43 PST
To: James W <james.wood at purplewifi.com>; lede-dev at lists.infradead.org;
Subject: Re: [LEDE-DEV] Crash on D-Link DIR-869-A1 (ar71xx) with ath10k / Coova-Chilli

can you retry with KALLSYMS enabled such that the stack trace is a
little more descriptive please

	John

On 08/11/2016 10:33, James Wood wrote:
> Hi,
> 
> I'm trying to use Coova-Chilli on this ar71xx based device which supports
> both 2.5 and 5GHz respectively. I'm facing a problem in that when I start
> Coova-Chilli, it crashes out and either locks up the device or kills some
> processes due to being out of memory.
> 
> This only happens when I set Coova-Chilli to use the ath10k 5GHz wifi
> network, not 2.4GHz or LAN port (it works fine on those). Haven't seen this
> before on other devices that use the same ath10k driver / ar71xx chip.
> 
> Below is what is printed in the log when Coova-Chilli starts up. You can see
> it goes a bit crazy and ends up killing other processes.
> 
> Tue Nov  8 09:20:20 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA
> overrun on vdev 1, skipped old beacon
> Tue Nov  8 09:20:20 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA
> overrun on vdev 0, skipped old beacon
> Tue Nov  8 09:20:20 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA
> overrun on vdev 1, skipped old beacon
> Tue Nov  8 09:20:21 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA
> overrun on vdev 0, skipped old beacon
> Tue Nov  8 09:20:21 2016 local6.info coova-chilli[6371]:
> CoovaChilli(ChilliSpot) 1.3.0. Copyright 2002-2005 Mondru AB. Licensed under
> GPL. Copyright 2006-2012 David Bird (Coova Technologies)
> <support at coova.com>. Licensed under GPL. See http://www.coova.org/ for
> details.
> Tue Nov  8 09:20:21 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA
> overrun on vdev 1, skipped old beacon
> Tue Nov  8 09:20:21 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA
> overrun on vdev 0, skipped old beacon
> Tue Nov  8 09:20:25 2016 kern.warn kernel: chilli invoked oom-killer:
> gfp_mask=0x2420848, order=0, oom_score_adj=0
> Tue Nov  8 09:20:25 2016 kern.warn kernel: CPU: 0 PID: 6371 Comm: chilli Not
> tainted 4.4.27 #0
> Tue Nov  8 09:20:25 2016 kern.warn kernel: Stack : 80334d74 00000000
> 00000001 80380000 00000000 00000000 00000000 00000000
> Tue Nov  8 09:20:25 2016 kern.warn kernel:        00000000 00000000 00000000
> 00000000 00000000 00000000 00000000 00000000
> Tue Nov  8 09:20:25 2016 kern.warn kernel:        00000000 00000000 00000000
> 00000000 00000000 00000000 00000000 00000000
> Tue Nov  8 09:20:25 2016 kern.warn kernel:        00000000 00000000 00000000
> 00000000 00000000 00000000 00000000 00000000
> Tue Nov  8 09:20:25 2016 kern.warn kernel:        00000000 00000000 00000000
> 00000000 00000000 00000000 00000000 00000000
> Tue Nov  8 09:20:25 2016 kern.warn kernel:        ...
> Tue Nov  8 09:20:25 2016 kern.warn kernel: Call Trace:[<80071180>]
> 0x80071180
> Tue Nov  8 09:20:25 2016 kern.warn kernel: [<80071180>] 0x80071180
> Tue Nov  8 09:20:25 2016 kern.warn kernel: [<800d04b8>] 0x800d04b8
> Tue Nov  8 09:20:25 2016 kern.warn kernel: [<800db8c4>] 0x800db8c4
> Tue Nov  8 09:20:25 2016 kern.warn kernel: [<800d089c>] 0x800d089c
> Tue Nov  8 09:20:25 2016 kern.warn kernel: [<800d0fa4>] 0x800d0fa4
> Tue Nov  8 09:20:25 2016 kern.warn kernel: [<800d4898>] 0x800d4898
> Tue Nov  8 09:20:25 2016 kern.warn kernel: [<800cda48>] 0x800cda48
> Tue Nov  8 09:20:25 2016 kern.warn kernel: [<8012e88c>] 0x8012e88c
> Tue Nov  8 09:20:25 2016 kern.warn kernel: [<8012eb0c>] 0x8012eb0c
> Tue Nov  8 09:20:25 2016 kern.warn kernel: [<8012ed5c>] 0x8012ed5c
> Tue Nov  8 09:20:25 2016 kern.warn kernel: [<8015397c>] 0x8015397c
> Tue Nov  8 09:20:25 2016 kern.warn kernel: [<80157b8c>] 0x80157b8c
> Tue Nov  8 09:20:25 2016 kern.warn kernel: [<80154680>] 0x80154680
> Tue Nov  8 09:20:25 2016 kern.warn kernel: [<80155808>] 0x80155808
> Tue Nov  8 09:20:25 2016 kern.warn kernel: [<800d8034>] 0x800d8034
> Tue Nov  8 09:20:25 2016 kern.warn kernel: [<800ccb78>] 0x800ccb78
> Tue Nov  8 09:20:25 2016 kern.warn kernel: [<800cf7f0>] 0x800cf7f0
> Tue Nov  8 09:20:25 2016 kern.warn kernel: [<80097bdc>] 0x80097bdc
> Tue Nov  8 09:20:25 2016 kern.warn kernel: [<800ea484>] 0x800ea484
> Tue Nov  8 09:20:25 2016 kern.warn kernel: [<800ed1ec>] 0x800ed1ec
> Tue Nov  8 09:20:25 2016 kern.warn kernel: [<800ed724>] 0x800ed724
> Tue Nov  8 09:20:25 2016 kern.warn kernel: [<80075da8>] 0x80075da8
> Tue Nov  8 09:20:25 2016 kern.warn kernel: [<80253e5c>] 0x80253e5c
> Tue Nov  8 09:20:25 2016 kern.warn kernel: [<8009db20>] 0x8009db20
> Tue Nov  8 09:20:25 2016 kern.warn kernel: [<80113130>] 0x80113130
> Tue Nov  8 09:20:25 2016 kern.warn kernel: [<8009e468>] 0x8009e468
> Tue Nov  8 09:20:25 2016 kern.warn kernel: [<8009a260>] 0x8009a260
> Tue Nov  8 09:20:25 2016 kern.warn kernel: [<800662a0>] 0x800662a0
> Tue Nov  8 09:20:25 2016 kern.warn kernel: [<80060820>] 0x80060820
> Tue Nov  8 09:20:25 2016 kern.warn kernel:
> Tue Nov  8 09:20:25 2016 kern.warn kernel: Mem-Info:
> Tue Nov  8 09:20:25 2016 kern.warn kernel: active_anon:416 inactive_anon:7
> isolated_anon:0
> Tue Nov  8 09:20:25 2016 kern.warn kernel:  active_file:99 inactive_file:174
> isolated_file:0
> Tue Nov  8 09:20:25 2016 kern.warn kernel:  unevictable:0 dirty:0
> writeback:0 unstable:0
> Tue Nov  8 09:20:25 2016 kern.warn kernel:  slab_reclaimable:141
> slab_unreclaimable:1417
> Tue Nov  8 09:20:25 2016 kern.warn kernel:  mapped:2 shmem:71 pagetables:62
> bounce:0
> Tue Nov  8 09:20:25 2016 kern.warn kernel:  free:2027 free_pcp:2 free_cma:0
> Tue Nov  8 09:20:25 2016 kern.warn kernel: Normal free:8108kB min:8192kB
> low:10240kB high:12288kB active_anon:1664kB inactive_anon:28kB
> active_file:396kB inactive_file:696kB unevictable:0kB isolated(anon):0kB
> isolated(file):0kB present:65536kB managed:61020kB mlocked:0kB dirty:0kB
> writeback:0kB mapped:8kB shmem:284kB slab_reclaimable:564kB
> slab_unreclaimable:5668kB kernel_stack:384kB pagetables:248kB unstable:0kB
> bounce:0kB free_pcp:8kB local_pcp:8kB free_cma:0kB writeback_tmp:0kB
> pages_scanned:0 all_unrecTue Nov  8 09:20:25 2016 kern.warn kernel:
> lowmem_reserve[]: 0 0
> Tue Nov  8 09:20:25 2016 kern.warn kernel: Normal: 255*4kB (UME) 318*8kB
> (UE) 228*16kB (UE) 28*32kB (UM) 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB
> 0*2048kB 0*4096kB = 8108kB
> Tue Nov  8 09:20:25 2016 kern.warn kernel: 344 total pagecache pages
> Tue Nov  8 09:20:25 2016 kern.warn kernel: 0 pages in swap cache
> Tue Nov  8 09:20:25 2016 kern.warn kernel: Swap cache stats: add 0, delete
> 0, find 0/0
> Tue Nov  8 09:20:25 2016 kern.warn kernel: Free swap  = 0kB
> Tue Nov  8 09:20:25 2016 kern.warn kernel: Total swap = 0kB
> Tue Nov  8 09:20:25 2016 kern.warn kernel: 16384 pages RAM
> Tue Nov  8 09:20:25 2016 kern.warn kernel: 0 pages HighMem/MovableOnly
> Tue Nov  8 09:20:25 2016 kern.warn kernel: 1129 pages reserved
> Tue Nov  8 09:20:25 2016 kern.info kernel: [ pid ]   uid  tgid total_vm
> rss nr_ptes nr_pmds swapents oom_score_adj name
> Tue Nov  8 09:20:25 2016 kern.info kernel: [  417]     0   417      295
> 15       3       0        0             0 ubusd
> Tue Nov  8 09:20:25 2016 kern.info kernel: [  418]     0   418      224
> 9       3       0        0             0 askfirst
> Tue Nov  8 09:20:25 2016 kern.info kernel: [  908]     0   908      361
> 23       4       0        0             0 rpcd
> Tue Nov  8 09:20:25 2016 kern.info kernel: [  994]     0   994      297
> 10       4       0        0             0 crond
> Tue Nov  8 09:20:25 2016 kern.info kernel: [ 1020]     0  1020      322
> 20       3       0        0             0 uhttpd
> Tue Nov  8 09:20:25 2016 kern.info kernel: [ 2239]     0  2239      265
> 11       3       0        0             0 dropbear
> Tue Nov  8 09:20:25 2016 kern.info kernel: [ 3861]     0  3861      426
> 38       4       0        0             0 netifd
> Tue Nov  8 09:20:25 2016 kern.info kernel: [ 4095]     0  4095      296
> 9       3       0        0             0 udhcpc
> Tue Nov  8 09:20:25 2016 kern.info kernel: [ 4207]   453  4207      266
> 21       4       0        0             0 dnsmasq
> Tue Nov  8 09:20:25 2016 kern.info kernel: [ 4228]     0  4228      296
> 9       3       0        0             0 ntpd
> Tue Nov  8 09:20:25 2016 kern.info kernel: [ 5024]     0  5024      282
> 25       4       0        0             0 dropbear
> Tue Nov  8 09:20:25 2016 kern.info kernel: [ 5025]     0  5025      297
> 10       5       0        0             0 ash
> Tue Nov  8 09:20:25 2016 kern.info kernel: [ 5929]     0  5929      307
> 35       4       0        0             0 logd
> Tue Nov  8 09:20:25 2016 kern.info kernel: [ 6348]     0  6348      485
> 36       4       0        0             0 hostapd
> Tue Nov  8 09:20:25 2016 kern.info kernel: [ 6371]     0  6371      776
> 43       4       0        0             0 chilli
> Tue Nov  8 09:20:25 2016 kern.info kernel: [ 6373]     0  6373      400
> 36       3       0        0             0 procd
> Tue Nov  8 09:20:25 2016 kern.err kernel: Out of memory: Kill process 6371
> (chilli) score 3 or sacrifice child
> Tue Nov  8 09:20:25 2016 kern.err kernel: Killed process 6371 (chilli)
> total-vm:3104kB, anon-rss:168kB, file-rss:4kB
> Tue Nov  8 09:20:25 2016 kern.warn kernel: ath10k_warn: 22 callbacks
> suppressed
> Tue Nov  8 09:20:25 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA
> overrun on vdev 1, skipped old beacon
> Tue Nov  8 09:20:25 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA
> overrun on vdev 0, skipped old beacon
> Tue Nov  8 09:20:25 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA
> overrun on vdev 1, skipped old beacon
> Tue Nov  8 09:20:25 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA
> overrun on vdev 0, skipped old beacon
> Tue Nov  8 09:20:25 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA
> overrun on vdev 1, skipped old beacon
> Tue Nov  8 09:20:25 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA
> overrun on vdev 0, skipped old beacon
> Tue Nov  8 09:20:25 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA
> overrun on vdev 1, skipped old beacon
> Tue Nov  8 09:20:25 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA
> overrun on vdev 0, skipped old beacon
> Tue Nov  8 09:20:25 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA
> overrun on vdev 1, skipped old beacon
> Tue Nov  8 09:20:25 2016 kern.warn kernel: ath10k_pci 0000:00:00.0: SWBA
> overrun on vdev 0, skipped old beacon
> 
> Any help/advice would be much appreciated. I have also tried using the
> latest code from github as of this morning (I was a few weeks behind).
> 
> Thanks,
> 
> James W
> 
> 
> 





More information about the Lede-dev mailing list