[FS#804] mt7621: kernel errors - rcu_sched detected stalls on CPUs/tasks

LEDE Bugs lede-bugs at lists.infradead.org
Tue Jul 25 03:54:31 PDT 2017


The following task has a new comment added:

FS#804 - mt7621: kernel errors - rcu_sched detected stalls on CPUs/tasks
User who did this - camel (camel)

----------
meanwhile i tested ... hmm ...seems to be, that I'M getting a mem issue ...
not sure, what is all included ... but i guess it is not related to the RCU_SCHED errors ...

maybe that was related to a "speedtest.py" which i run every 5min to have the statistics about the router internet speed ...
also i have seen you are having squid installed and so on ...



Tue Jul 25 12:50:04 2017 kern.warn kernel: [ 1065.520000] luci invoked oom-killer: gfp_mask=0x27000c0(GFP_KERNEL_ACCOUNT|__GFP_NOTRACK), nodemask=0, order=1, oom_score_adj=0
Tue Jul 25 12:50:04 2017 kern.warn kernel: [ 1065.530000] COMPACTION is disabled!!!
Tue Jul 25 12:50:04 2017 kern.warn kernel: [ 1065.540000] CPU: 2 PID: 32685 Comm: luci Not tainted 4.9.37 #0
Tue Jul 25 12:50:04 2017 kern.warn kernel: [ 1065.540000] Stack : 00000000 00000000 80537b2a 00000032 803f4084 00000000 00000000 80530000
Tue Jul 25 12:50:04 2017 kern.warn kernel: [ 1065.550000]         81fa462c 804d7da7 8046dff0 00000002 00007fad 80533824 00000001 00200000
Tue Jul 25 12:50:04 2017 kern.warn kernel: [ 1065.560000]         00001321 80069890 00000000 800696b0 00000000 00000004 80472c00 82745c3c
Tue Jul 25 12:50:04 2017 kern.warn kernel: [ 1065.570000]         00000000 800a5d98 00000000 00000000 80537b2a 00000000 82745d28 00745c3c
Tue Jul 25 12:50:04 2017 kern.warn kernel: [ 1065.580000]         00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
Tue Jul 25 12:50:04 2017 kern.warn kernel: [ 1065.580000]         ...
Tue Jul 25 12:50:04 2017 kern.warn kernel: [ 1065.590000] Call Trace:
Tue Jul 25 12:50:04 2017 kern.warn kernel: [ 1065.590000] [] show_stack+0x54/0x88
Tue Jul 25 12:50:04 2017 kern.warn kernel: [ 1065.590000] [] dump_stack+0x84/0xc0
Tue Jul 25 12:50:04 2017 kern.warn kernel: [ 1065.600000] [] dump_header.isra.4+0x84/0x1b4
Tue Jul 25 12:50:04 2017 kern.warn kernel: [ 1065.600000] [] oom_kill_process+0xd0/0x484
Tue Jul 25 12:50:04 2017 kern.warn kernel: [ 1065.610000] [] out_of_memory+0x3bc/0x3fc
Tue Jul 25 12:50:04 2017 kern.warn kernel: [ 1065.610000] [] __alloc_pages_nodemask+0x5e4/0xa58
Tue Jul 25 12:50:04 2017 kern.warn kernel: [ 1065.620000] [] copy_process.isra.8.part.9+0x10c/0x1300
Tue Jul 25 12:50:04 2017 kern.warn kernel: [ 1065.620000] [] _do_fork+0xcc/0x2d8
Tue Jul 25 12:50:04 2017 kern.warn kernel: [ 1065.630000] [] SyS_clone+0x20/0x2c
Tue Jul 25 12:50:04 2017 kern.warn kernel: [ 1065.630000] [] syscall_common+0x34/0x58
Tue Jul 25 12:50:04 2017 kern.warn kernel: [ 1065.640000] Mem-Info:
Tue Jul 25 12:50:04 2017 kern.warn kernel: [ 1065.640000] active_anon:13977 inactive_anon:1643 isolated_anon:0
Tue Jul 25 12:50:04 2017 kern.warn kernel: [ 1065.640000]  active_file:805 inactive_file:2995 isolated_file:0
Tue Jul 25 12:50:04 2017 kern.warn kernel: [ 1065.640000]  unevictable:1 dirty:2 writeback:0 unstable:0
Tue Jul 25 12:50:04 2017 kern.warn kernel: [ 1065.640000]  slab_reclaimable:3926 slab_unreclaimable:35491
Tue Jul 25 12:50:04 2017 kern.warn kernel: [ 1065.640000]  mapped:3433 shmem:8024 pagetables:227 bounce:0
Tue Jul 25 12:50:04 2017 kern.warn kernel: [ 1065.640000]  free:49832 free_pcp:28 free_cma:0
Tue Jul 25 12:50:04 2017 kern.warn kernel: [ 1065.670000] Node 0 active_anon:55908kB inactive_anon:6572kB active_file:3220kB inactive_file:11980kB unevictable:4kB isolated(anon):0kB isolated(file):0kB mapped:13732kB dirty:8kB writeback:0kB shmem:32096kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
Tue Jul 25 12:50:04 2017 kern.warn kernel: [ 1065.700000] Normal free:20008kB min:16384kB low:20480kB high:24576kB active_anon:0kB inactive_anon:0kB active_file:4kB inactive_file:84kB unevictable:0kB writepending:8kB present:262144kB managed:251688kB mlocked:0kB slab_reclaimable:15704kB slab_unreclaimable:141964kB kernel_stack:56192kB pagetables:908kB bounce:0kB free_pcp:232kB local_pcp:0kB free_cma:0kB
Tue Jul 25 12:50:05 2017 kern.emerg kernel: lowmem_reserve[]: 0 2048 2048
Tue Jul 25 12:50:05 2017 kern.warn kernel: [ 1065.730000] HighMem free:179216kB min:256kB low:4520kB high:8784kB active_anon:55908kB inactive_anon:6572kB active_file:3148kB inactive_file:11888kB unevictable:4kB writepending:0kB present:262144kB managed:262144kB mlocked:4kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:52kB local_pcp:0kB free_cma:0kB
Tue Jul 25 12:50:05 2017 kern.emerg kernel: lowmem_reserve[]: 0 0 0
Tue Jul 25 12:50:05 2017 kern.warn kernel: [ 1065.770000] Normal: 23*4kB (UMH) 34*8kB (UMEH) 19*16kB (UMH) 25*32kB (UMEH) 16*64kB (UME) 9*128kB (UMEH) 4*256kB (UME) 6*512kB (UM) 6*1024kB (UMEH) 3*2048kB (UME) 0*4096kB = 20028kB
Tue Jul 25 12:50:05 2017 kern.emerg kernel: HighMem: 881*4kB (UM) 957*8kB (UM) 543*16kB (UM) 360*32kB (UM) 133*64kB (UM) 18*128kB (M) 8*256kB (UM) 3*512kB (M) 4*1024kB (M) 1*2048kB (U) 31*4096kB (M) = 178908kB
Tue Jul 25 12:50:05 2017 kern.emerg kernel: 11849 total pagecache pages
Tue Jul 25 12:50:05 2017 kern.warn kernel: [ 1065.800000] 0 pages in swap cache
Tue Jul 25 12:50:05 2017 kern.warn kernel: [ 1065.810000] Swap cache stats: add 0, delete 0, find 0/0
Tue Jul 25 12:50:05 2017 kern.warn kernel: [ 1065.810000] Free swap  = 0kB
Tue Jul 25 12:50:05 2017 kern.warn kernel: [ 1065.810000] Total swap = 0kB
Tue Jul 25 12:50:05 2017 kern.warn kernel: [ 1065.820000] 131072 pages RAM
Tue Jul 25 12:50:05 2017 kern.warn kernel: [ 1065.820000] 65536 pages HighMem/MovableOnly
Tue Jul 25 12:50:05 2017 kern.warn kernel: [ 1065.820000] 2614 pages reserved
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1065.830000] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1065.840000] [  731]     0   731      298      149       3       0        0             0 ubusd
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1065.840000] [  738]     0   738      225      123       3       0        0             0 askfirst
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1065.850000] [ 1317]     0  1317      823      694       5       0        0             0 logd
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1065.860000] [ 1318]     0  1318      336      198       4       0        0             0 logread
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1065.870000] [ 1330]     0  1330      381      213       4       0        0             0 rpcd
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1065.880000] [ 1499]     0  1499      435      257       4       0        0             0 netifd
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1065.890000] [ 1548]     0  1548      356      183       4       0        0             0 odhcpd
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1065.900000] [ 1581]     0  1581      300      202       3       0        0             0 crond
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1065.910000] [ 1603]     0  1603      267      153       4       0        0             0 dropbear
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1065.910000] [ 1695]     0  1695      299      153       3       0        0             0 udhcpc
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1065.920000] [ 1703]     0  1703      256      139       3       0        0             0 odhcp6c
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1065.930000] [ 1762] 65536  1762      963      497       4       0        0             0 lighttpd
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1065.940000] [ 1964]     0  1964      633      413       4       0        0             0 uhttpd
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1065.950000] [ 1996]     0  1996      242       10       3       0        0             0 vsftpd
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1065.960000] [ 2029]     0  2029      751      180       4       0        0             0 keepalived
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1065.970000] [ 2045]     0  2045      759       37       5       0        0             0 keepalived
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1065.980000] [ 2237]     0  2237      280      139       3       0        0             0 pppd
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1065.990000] [ 2286]   453  2286      269      203       3       0        0             0 dnsmasq
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1065.990000] [ 2323]     0  2323      420       26       4       0        0             0 hostapd
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.000000] [ 2325]     0  2325      420       26       3       0        0             0 hostapd
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.010000] [ 2447]     0  2447     1462      564       5       0        0             0 collectd
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.020000] [ 2488]     0  2488      228        9       3       0        0             0 ntpclient
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.030000] [ 2535] 65534  2535      300      220       4       0        0             0 collectd_ifacei
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.040000] [ 2541] 65534  2541      301      236       3       0        0             0 collectd_gsminf
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.050000] [ 2542] 65534  2542      300      235       3       0        0             0 collectd_mwan-s
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.060000] [ 2543] 65534  2543      300      236       4       0        0             0 collectd_speedt
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.070000] [ 2635]     0  2635     3576     2803       8       0        0             0 squid
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.080000] [ 3059]     0  3059      317      253       3       0        0             0 mwan3track
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.090000] [ 3945]     0  3945      333      227       4       0        0             0 luci-bwc
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.090000] [ 4547]     0  4547      284        9       5       0        0             0 dropbear
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.100000] [ 4683]     0  4683      300      235       4       0        0             0 ash
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.110000] [10425]     0 10425      306      216       3       0        0             0 smsd
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.120000] [10429]     0 10429      315       64       4       0        0             0 smsd
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.130000] [10631]     0 10631      244      167       3       0        0             0 vnstatd
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.140000] [12948]     0 12948      284        9       5       0        0             0 dropbear
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.150000] [12962]     0 12962      300      236       4       0        0             0 ash
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.150000] [18822]     0 18822      842      733       5       0        0             0 openvpn
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.160000] [19980]     0 19980      284        9       5       0        0             0 dropbear
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.170000] [20365]     0 20365      300      154       5       0        0             0 ash
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.180000] [11049] 65534 11049      300       10       4       0        0             0 collectd_speedt
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.190000] [11050]     0 11050     5266     4606       9       0        0             0 python
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.200000] [12184]     0 12184      300      139       4       0        0             0 sleep
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.210000] [12380] 65534 12380      301       10       3       0        0             0 collectd_gsminf
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.220000] [12381]     0 12381      303      154       4       0        0             0 3gsignal
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.230000] [12382] 65534 12382      299      138       3       0        0             0 sed
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.240000] [12430]     0 12430      243      145       4       0        0             0 gcom
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.240000] [16962] 65534 16962      299      137       3       0        0             0 sleep
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.250000] [19601] 65534 19601      299      154       3       0        0             0 sleep
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.260000] [24961]     0 24961      336      199       3       0        0             0 logread
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.270000] [25709]     0 25709      310      154       4       0        0             0 hotplug-call
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.280000] [25717]     0 25717      337      229       4       0        0             0 hotplug-call
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.290000] [25747]     0 25747      278      144       4       0        0             0 ipset
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.300000] [26138]     0 26138      842      728       4       0        0             0 openvpn
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.310000] [32683]     0 32683      667      419       3       0        0             0 luci
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.310000] [32684]     0 32684      667      416       4       0        0             0 luci
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.320000] [32685]     0 32685      667      418       6       0        0             0 luci
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.330000] [32687]     0 32687      257      176       4       0        0             0 modprobe
Tue Jul 25 12:50:05 2017 kern.info kernel: [ 1066.340000] [32740]     0 32740      299      138       3       0        0             0 sh
Tue Jul 25 12:50:05 2017 kern.err kernel: [ 1066.350000] Out of memory: Kill process 11050 (python) score 34 or sacrifice child
Tue Jul 25 12:50:05 2017 kern.err kernel: [ 1066.360000] Killed process 11050 (python) total-vm:21064kB, anon-rss:14176kB, file-rss:4244kB, shmem-rss:4kB


for traffic shapping i would need the pptp in any case, as the VPN's are shapped ..


----------

More information can be found at the following URL:
https://bugs.lede-project.org/index.php?do=details&task_id=804#comment3115



More information about the lede-bugs mailing list