[FS#176] Disapearing radios for ath9k introduced between August 31 and September 4th

LEDE Bugs lede-bugs at lists.infradead.org
Tue Sep 13 15:18:53 PDT 2016


A new Flyspray task has been opened.  Details are below. 

User who did this - moeller0 (moeller0) 

Attached to Project - LEDE Project
Summary - Disapearing radios for ath9k introduced between August 31 and September 4th
Task Type - Bug Report
Category - Base system
Status - Unconfirmed
Assigned To - 
Operating System - All
Severity - High
Priority - Very Low
Reported Version - Trunk
Due in Version - Undecided
Due Date - Undecided
Details - I have encountered a similar issue to other ath9k users, after a while of uptime both the 2.4GHz and the 5GHz radios seem to disappear from the air; previously connected clients are disconnected first and the radios stay AWOl, until restarted (using "wifi" on the router's CLI or via enabling them againthe GUI). I have tested a number of hnyman's builds and pin pointed the issue to have happened between August 31st (good) and September 4th (bad). I would not be amazed if the powersave changes introduced between those two dates might be involved in the issue, but do not have clear evidence (yet).

Here is the output of a few potentially interesting diagnostic values, first from the working August 31st build, followed by two sections the September 4th build, first after boot-up with functional radios and then ~two hours later just after the radios disappeared. I would be happy to help get to the bottom of this issue...


echo “cat /etc/banner”; cat /etc/banner ; echo ""; echo "uptime" ; uptime ; echo ""; echo "iwinfo" ; iwinfo ; echo ""; echo "cat /sys/kernel/debug/ieee80211/phy0/ath9k/reset" ; cat /sys/kernel/debug/ieee80211/phy0/ath9k/reset ; echo ""; echo "cat /sys/kernel/debug/ieee80211/phy1/ath9k/reset" ; cat /sys/kernel/debug/ieee80211/phy1/ath9k/reset ; echo ""; echo "cat /sys/kernel/debug/ieee80211/phy0/ath9k/ani" ; cat /sys/kernel/debug/ieee80211/phy0/ath9k/ani 

echo ""; echo "cat /sys/kernel/debug/ieee80211/phy1/ath9k/ani" ; cat /sys/kernel/debug/ieee80211/phy1/ath9k/ani ; echo ""; echo "iw dev wlan0 station dump" ; iw dev wlan0 station dump ; echo ""; echo "iw dev wlan1 station dump" ; iw dev wlan1 station dump


Last tested release without the disappearing radios:
WNDR3700v2-lede-r1476-20160831-1058-sqfs-sysupgrade.bin
BusyBox v1.24.2 () built-in shell (ash)

     _________
    /        /\      _    ___ ___  ___
   /  LE    /  \    | |  | __|   \| __|
  /    DE  /    \   | |__| _|| |) | _|
 /________/  LE  \  |____|___|___/|___|                      lede-project.org
 \        \   DE /
  \    LE  \    /  -----------------------------------------------------------
   \  DE    \  /    Reboot (HEAD, r1476)
    \________\/    -----------------------------------------------------------

root at nacktmulle:~# uptime
 21:55:34 up  5:23,  load average: 0.17, 0.09, 0.01


root at nacktmulle:~# iwinfo
wlan0     ESSID: "nacktmulle_2.4GHz"
          Access Point: A0:21:B7:B9:5C:22
          Mode: Master  Channel: 11 (2.462 GHz)
          Tx-Power: 26 dBm  Link Quality: 51/70
          Signal: -59 dBm  Noise: -95 dBm
          Bit Rate: 65.0 MBit/s
          Encryption: WPA2 PSK (CCMP)
          Type: nl80211  HW Mode(s): 802.11bgn
          Hardware: 168C:0029 168C:A095 [Atheros AR9223]
          TX power offset: none
          Frequency offset: none
          Supports VAPs: yes  PHY name: phy0

wlan1     ESSID: "nacktmulle_5GHz"
          Access Point: A0:21:B7:B9:5C:24
          Mode: Master  Channel: 44 (5.220 GHz)
          Tx-Power: 17 dBm  Link Quality: 55/70
          Signal: -55 dBm  Noise: -95 dBm
          Bit Rate: 113.1 MBit/s
          Encryption: WPA2 PSK (CCMP)
          Type: nl80211  HW Mode(s): 802.11an
          Hardware: 168C:0029 168C:A094 [Atheros AR9220]
          TX power offset: none
          Frequency offset: none
          Supports VAPs: yes  PHY name: phy1


root at nacktmulle:~# cat /sys/kernel/debug/ieee80211/phy0/ath9k/reset
    Baseband Hang:  0
Baseband Watchdog:  0
   Fatal HW Error:  0
      TX HW error:  0
 Transmit timeout:  0
     TX Path Hang:  0
      PLL RX Hang:  0
         MAC Hang: 142
     Stuck Beacon: 258
        MCI Reset:  0
Calibration error:  0
Tx DMA stop error: 91
Rx DMA stop error:  0


root at nacktmulle:~# cat /sys/kernel/debug/ieee80211/phy1/ath9k/reset
    Baseband Hang:  0
Baseband Watchdog:  0
   Fatal HW Error:  0
      TX HW error:  0
 Transmit timeout:  0
     TX Path Hang:  0
      PLL RX Hang:  0
         MAC Hang: 1112
     Stuck Beacon:  0
        MCI Reset:  0
Calibration error:  0
Tx DMA stop error: 1112
Rx DMA stop error:  0


root at nacktmulle:~# cat /sys/kernel/debug/ieee80211/phy0/ath9k/ani
            ANI: ENABLED
      ANI RESET: 469
     OFDM LEVEL: 0
      CCK LEVEL: 0
        SPUR UP: 7135
      SPUR DOWN: 7135
 OFDM WS-DET ON: 1
OFDM WS-DET OFF: 1
     MRC-CCK ON: 0
    MRC-CCK OFF: 0
    FIR-STEP UP: 7179
  FIR-STEP DOWN: 7564
 INV LISTENTIME: 0
    OFDM ERRORS: 17874314
     CCK ERRORS: 366582


root at nacktmulle:~# cat /sys/kernel/debug/ieee80211/phy1/ath9k/ani
            ANI: ENABLED
      ANI RESET: 1120
     OFDM LEVEL: 0
      CCK LEVEL: 0
        SPUR UP: 69
      SPUR DOWN: 69
 OFDM WS-DET ON: 0
OFDM WS-DET OFF: 0
     MRC-CCK ON: 0
    MRC-CCK OFF: 0
    FIR-STEP UP: 69
  FIR-STEP DOWN: 734
 INV LISTENTIME: 0
    OFDM ERRORS: 132975
     CCK ERRORS: 0


root at nacktmulle:~# iw dev wlan0 station dump
Station a0:02:dc:07:d9:06 (on wlan0)
	inactive time:	3950 ms
	rx bytes:	4195114
	rx packets:	31910
	tx bytes:	86381863
	tx packets:	58702
	tx retries:	1007
	tx failed:	25
	signal:  	-61 [-70, -62] dBm
	signal avg:	-61 [-70, -62] dBm
	tx bitrate:	65.0 MBit/s MCS 7
	rx bitrate:	1.0 MBit/s
	expected throughput:	32.42Mbps
	authorized:	yes
	authenticated:	yes
	preamble:	short
	WMM/WME:	yes
	MFP:		no
	TDLS peer:	no
	connected time:	19282 seconds


root at nacktmulle:~# iw dev wlan1 station dump
Station 10:68:3f:4b:0b:48 (on wlan1)
	inactive time:	23020 ms
	rx bytes:	1351656
	rx packets:	10344
	tx bytes:	6353661
	tx packets:	8128
	tx retries:	86
	tx failed:	1400
	signal:  	-32 [-32, -40] dBm
	signal avg:	-23 [-23, -35] dBm
	tx bitrate:	65.0 MBit/s MCS 7
	rx bitrate:	6.0 MBit/s
	expected throughput:	32.42Mbps
	authorized:	yes
	authenticated:	yes
	preamble:	short
	WMM/WME:	yes
	MFP:		no
	TDLS peer:	no
	connected time:	18474 seconds
Station 78:f8:82:9f:3c:47 (on wlan1)
	inactive time:	28460 ms
	rx bytes:	23682809
	rx packets:	199402
	tx bytes:	142204276
	tx packets:	138582
	tx retries:	10586
	tx failed:	553
	signal:  	-60 [-62, -65] dBm
	signal avg:	-63 [-64, -66] dBm
	tx bitrate:	180.0 MBit/s MCS 12 40MHz short GI
	rx bitrate:	6.0 MBit/s
	expected throughput:	50.811Mbps
	authorized:	yes
	authenticated:	yes
	preamble:	short
	WMM/WME:	yes
	MFP:		no
	TDLS peer:	no
	connected time:	12727 seconds
Station a4:d1:8c:5e:12:20 (on wlan1)
	inactive time:	24660 ms
	rx bytes:	114469
	rx packets:	1036
	tx bytes:	20303
	tx packets:	81
	tx retries:	0
	tx failed:	6
	signal:  	-56 [-59, -59] dBm
	signal avg:	-55 [-58, -57] dBm
	tx bitrate:	65.0 MBit/s MCS 7
	rx bitrate:	24.0 MBit/s
	expected throughput:	58.593Mbps
	authorized:	yes
	authenticated:	yes
	preamble:	long
	WMM/WME:	yes
	MFP:		no
	TDLS peer:	no
	connected time:	2123 seconds
Station 64:bc:0c:83:f5:d5 (on wlan1)
	inactive time:	1470 ms
	rx bytes:	1478823
	rx packets:	14914
	tx bytes:	2861270
	tx packets:	5818
	tx retries:	243
	tx failed:	74
	signal:  	-58 [-62, -60] dBm
	signal avg:	-59 [-64, -61] dBm
	tx bitrate:	162.0 MBit/s MCS 12 40MHz
	rx bitrate:	6.0 MBit/s
	expected throughput:	49.163Mbps
	authorized:	yes
	authenticated:	yes
	preamble:	long
	WMM/WME:	yes
	MFP:		no
	TDLS peer:	no
	connected time:	561 seconds





First tested release with disappearing radios:
WNDR3700v2-lede-r1497-20160904-1350-sqfs-sysupgrade.bin
While radios are still up:
BusyBox v1.24.2 () built-in shell (ash)

     _________
    /        /\      _    ___ ___  ___
   /  LE    /  \    | |  | __|   \| __|
  /    DE  /    \   | |__| _|| |) | _|
 /________/  LE  \  |____|___|___/|___|                      lede-project.org
 \        \   DE /
  \    LE  \    /  -----------------------------------------------------------
   \  DE    \  /    Reboot (HEAD, r1497)
    \________\/    -----------------------------------------------------------

root at nacktmulle:~# uptime
 22:04:18 up 3 min,  load average: 0.61, 0.52, 0.21


root at nacktmulle:~# iwinfo
wlan0     ESSID: "nacktmulle_2.4GHz"
          Access Point: A0:21:B7:B9:5C:22
          Mode: Master  Channel: 11 (2.462 GHz)
          Tx-Power: 26 dBm  Link Quality: 70/70
          Signal: -22 dBm  Noise: -94 dBm
          Bit Rate: 65.0 MBit/s
          Encryption: WPA2 PSK (CCMP)
          Type: nl80211  HW Mode(s): 802.11bgn
          Hardware: 168C:0029 168C:A095 [Atheros AR9223]
          TX power offset: none
          Frequency offset: none
          Supports VAPs: yes  PHY name: phy0

wlan1     ESSID: "nacktmulle_5GHz"
          Access Point: A0:21:B7:B9:5C:24
          Mode: Master  Channel: 44 (5.220 GHz)
          Tx-Power: 17 dBm  Link Quality: 57/70
          Signal: -53 dBm  Noise: -95 dBm
          Bit Rate: 285.0 MBit/s
          Encryption: WPA2 PSK (CCMP)
          Type: nl80211  HW Mode(s): 802.11an
          Hardware: 168C:0029 168C:A094 [Atheros AR9220]
          TX power offset: none
          Frequency offset: none
          Supports VAPs: yes  PHY name: phy1


root at nacktmulle:~# cat /sys/kernel/debug/ieee80211/phy0/ath9k/reset
    Baseband Hang:  0
Baseband Watchdog:  0
   Fatal HW Error:  0
      TX HW error:  0
 Transmit timeout:  0
     TX Path Hang:  0
      PLL RX Hang:  0
         MAC Hang:  0
     Stuck Beacon:  1
        MCI Reset:  0
Calibration error:  0
Tx DMA stop error:  0
Rx DMA stop error:  0


root at nacktmulle:~# cat /sys/kernel/debug/ieee80211/phy1/ath9k/reset
    Baseband Hang:  0
Baseband Watchdog:  0
   Fatal HW Error:  0
      TX HW error:  0
 Transmit timeout:  0
     TX Path Hang:  0
      PLL RX Hang:  0
         MAC Hang:  0
     Stuck Beacon:  0
        MCI Reset:  0
Calibration error:  0
Tx DMA stop error:  0
Rx DMA stop error:  0


root at nacktmulle:~# cat /sys/kernel/debug/ieee80211/phy0/ath9k/ani
            ANI: ENABLED
      ANI RESET: 70
     OFDM LEVEL: 0
      CCK LEVEL: 0
        SPUR UP: 20
      SPUR DOWN: 20
 OFDM WS-DET ON: 0
OFDM WS-DET OFF: 0
     MRC-CCK ON: 0
    MRC-CCK OFF: 0
    FIR-STEP UP: 20
  FIR-STEP DOWN: 24
 INV LISTENTIME: 0
    OFDM ERRORS: 52409
     CCK ERRORS: 150


root at nacktmulle:~# cat /sys/kernel/debug/ieee80211/phy1/ath9k/ani
            ANI: ENABLED
      ANI RESET: 8
     OFDM LEVEL: 0
      CCK LEVEL: 0
        SPUR UP: 0
      SPUR DOWN: 0
 OFDM WS-DET ON: 0
OFDM WS-DET OFF: 0
     MRC-CCK ON: 0
    MRC-CCK OFF: 0
    FIR-STEP UP: 0
  FIR-STEP DOWN: 2
 INV LISTENTIME: 0
    OFDM ERRORS: 869
     CCK ERRORS: 0


root at nacktmulle:~# iw dev wlan0 station dump
Station 10:68:3f:4b:0b:48 (on wlan0)
	inactive time:	9340 ms
	rx bytes:	164542
	rx packets:	1082
	tx bytes:	1157129
	tx packets:	1470
	tx retries:	22
	tx failed:	31
	signal:  	-21 [-27, -22] dBm
	signal avg:	-24 [-30, -25] dBm
	tx bitrate:	65.0 MBit/s MCS 7
	rx bitrate:	6.0 MBit/s
	expected throughput:	32.42Mbps
	authorized:	yes
	authenticated:	yes
	preamble:	short
	WMM/WME:	yes
	MFP:		no
	TDLS peer:	no
	connected time:	108 seconds


root at nacktmulle:~# iw dev wlan1 station dump
Station a4:d1:8c:5e:12:20 (on wlan1)
	inactive time:	24510 ms
	rx bytes:	39626
	rx packets:	222
	tx bytes:	16338
	tx packets:	49
	tx retries:	0
	tx failed:	2
	signal:  	-55 [-60, -57] dBm
	signal avg:	-54 [-58, -56] dBm
	tx bitrate:	270.0 MBit/s MCS 14 40MHz short GI
	rx bitrate:	24.0 MBit/s
	expected throughput:	57.219Mbps
	authorized:	yes
	authenticated:	yes
	preamble:	long
	WMM/WME:	yes
	MFP:		no
	TDLS peer:	no
	connected time:	100 seconds
Station 78:f8:82:9f:3c:47 (on wlan1)
	inactive time:	8320 ms
	rx bytes:	66313
	rx packets:	552
	tx bytes:	182017
	tx packets:	393
	tx retries:	37
	tx failed:	7
	signal:  	-57 [-61, -59] dBm
	signal avg:	-55 [-59, -58] dBm
	tx bitrate:	300.0 MBit/s MCS 15 40MHz short GI
	rx bitrate:	6.0 MBit/s
	expected throughput:	58.593Mbps
	authorized:	yes
	authenticated:	yes
	preamble:	long
	WMM/WME:	yes
	MFP:		no
	TDLS peer:	no
	connected time:	86 seconds
root at nacktmulle:~# 



After disappearing networks:
root at nacktmulle:~# echo “cat /etc/banner”; cat /etc/banner ; echo ""; echo "uptime" ; uptime ; echo ""; echo "iwinfo" ; iwinfo ;
 echo ""; echo "cat /sys/kernel/debug/ieee80211/phy0/ath9k/reset" ; cat /sys/kernel/debug/ieee80211/phy0/ath9k/reset ; echo ""; echo
 "cat /sys/kernel/debug/ieee80211/phy1/ath9k/reset" ; cat /sys/kernel/debug/ieee80211/phy1/ath9k/reset ; echo ""; echo "cat /sys/ker
nel/debug/ieee80211/phy0/ath9k/ani" ; cat /sys/kernel/debug/ieee80211/phy0/ath9k/ani 
“cat /etc/banner”
     _________
    /        /\      _    ___ ___  ___
   /  LE    /  \    | |  | __|   \| __|
  /    DE  /    \   | |__| _|| |) | _|
 /________/  LE  \  |____|___|___/|___|                      lede-project.org
 \        \   DE /
  \    LE  \    /  -----------------------------------------------------------
   \  DE    \  /    Reboot (HEAD, r1497)
    \________\/    -----------------------------------------------------------


uptime
 23:52:32 up  1:51,  load average: 0.71, 0.76, 0.54

iwinfo
wlan0     ESSID: "nacktmulle_2.4GHz"
          Access Point: A0:21:B7:B9:5C:22
          Mode: Master  Channel: 11 (2.462 GHz)
          Tx-Power: 26 dBm  Link Quality: unknown/70
          Signal: unknown  Noise: -95 dBm
          Bit Rate: unknown
          Encryption: WPA2 PSK (CCMP)
          Type: nl80211  HW Mode(s): 802.11bgn
          Hardware: 168C:0029 168C:A095 [Atheros AR9223]
          TX power offset: none
          Frequency offset: none
          Supports VAPs: yes  PHY name: phy0

wlan1     ESSID: "nacktmulle_5GHz"
          Access Point: A0:21:B7:B9:5C:24
          Mode: Master  Channel: 44 (5.220 GHz)
          Tx-Power: 17 dBm  Link Quality: unknown/70
          Signal: unknown  Noise: -95 dBm
          Bit Rate: unknown
          Encryption: WPA2 PSK (CCMP)
          Type: nl80211  HW Mode(s): 802.11an
          Hardware: 168C:0029 168C:A094 [Atheros AR9220]
          TX power offset: none
          Frequency offset: none
          Supports VAPs: yes  PHY name: phy1


cat /sys/kernel/debug/ieee80211/phy0/ath9k/reset
    Baseband Hang:  0
Baseband Watchdog:  0
   Fatal HW Error:  1
      TX HW error:  0
 Transmit timeout:  0
     TX Path Hang:  0
      PLL RX Hang:  0
         MAC Hang: 18
     Stuck Beacon: 1701
        MCI Reset:  0
Calibration error:  0
Tx DMA stop error: 224
Rx DMA stop error:  0


cat /sys/kernel/debug/ieee80211/phy1/ath9k/reset
    Baseband Hang:  0
Baseband Watchdog:  0
   Fatal HW Error:  0
      TX HW error:  0
 Transmit timeout:  0
     TX Path Hang:  0
      PLL RX Hang:  0
         MAC Hang: 39
     Stuck Beacon: 3026
        MCI Reset:  0
Calibration error:  1
Tx DMA stop error: 51
Rx DMA stop error:  1


cat /sys/kernel/debug/ieee80211/phy0/ath9k/ani
            ANI: ENABLED
      ANI RESET: 1789
     OFDM LEVEL: 3
      CCK LEVEL: 2
        SPUR UP: 2150
      SPUR DOWN: 2150
 OFDM WS-DET ON: 0
OFDM WS-DET OFF: 0
     MRC-CCK ON: 0
    MRC-CCK OFF: 0
    FIR-STEP UP: 2144
  FIR-STEP DOWN: 2244
 INV LISTENTIME: 0
    OFDM ERRORS: 5399567
     CCK ERRORS: 28670
root at nacktmulle:~# 


cat /sys/kernel/debug/ieee80211/phy1/ath9k/ani
            ANI: ENABLED
      ANI RESET: 3360
     OFDM LEVEL: 3
      CCK LEVEL: 2
        SPUR UP: 5
      SPUR DOWN: 5
 OFDM WS-DET ON: 0
OFDM WS-DET OFF: 0
     MRC-CCK ON: 0
    MRC-CCK OFF: 0
    FIR-STEP UP: 5
  FIR-STEP DOWN: 23
 INV LISTENTIME: 0
    OFDM ERRORS: 21751
     CCK ERRORS: 0


iw dev wlan0 station dump


iw dev wlan1 station dump


More information can be found at the following URL:
https://bugs.lede-project.org/index.php?do=details&task_id=176



More information about the lede-bugs mailing list