AER notifications

Thu Mar 23 08:15:57 PDT 2017

On 23/03/2017 15:14, Mason wrote:

> My PCIe host bridge is supposed to support AER, so I enabled
> kernel support, out of curiosity. For these tests, I plugged
> a USB3 card into the PCIe slot.
> 
> I see two classes of reports.
> 
> 1) When the system is idling, with no USB device plugged into
> the PCIe card, I occasionally see these:
> 
> [ 5003.638675] pcieport 0000:00:00.0: AER: Multiple Corrected error received: id=0000
> [ 5003.646365] pcieport 0000:00:00.0: PCIe Bus Error: severity=Corrected, type=Physical Layer, id=0000(Receiver ID)
> [ 5003.656991] pcieport 0000:00:00.0:   device [1105:0028] error status/mask=00000001/00002000
> [ 5003.665566] pcieport 0000:00:00.0:    [ 0] Receiver Error         (First)
> 
> [ 6104.766906] pcieport 0000:00:00.0: AER: Multiple Corrected error received: id=0000
> [ 6104.774579] pcieport 0000:00:00.0: PCIe Bus Error: severity=Corrected, type=Physical Layer, id=0000(Receiver ID)
> [ 6104.785140] pcieport 0000:00:00.0:   device [1105:0028] error status/mask=00000001/00002000
> [ 6104.793701] pcieport 0000:00:00.0:    [ 0] Receiver Error         (First)
> 
> [ 8388.051130] pcieport 0000:00:00.0: AER: Multiple Corrected error received: id=0000
> [ 8388.058818] pcieport 0000:00:00.0: PCIe Bus Error: severity=Corrected, type=Physical Layer, id=0000(Receiver ID)
> [ 8388.069429] pcieport 0000:00:00.0:   device [1105:0028] error status/mask=00000001/00002000
> [ 8388.078041] pcieport 0000:00:00.0:    [ 0] Receiver Error         (First)
> 
> [11022.907894] pcieport 0000:00:00.0: AER: Multiple Corrected error received: id=0000
> [11022.915570] pcieport 0000:00:00.0: PCIe Bus Error: severity=Corrected, type=Physical Layer, id=0000(Receiver ID)
> [11022.926102] pcieport 0000:00:00.0:   device [1105:0028] error status/mask=00000001/00002000
> [11022.934666] pcieport 0000:00:00.0:    [ 0] Receiver Error         (First)
> 
> 1105:0024 is the rev1 host bridge.
> 1105:0028 is the rev2 host bridge.
> 
> I'll let a rev1 host bridge idle for a long time, but I don't
> remember seeing these reports on rev1.
> 
> 
> 2) When I unplug my USB3 Flash drive, I always get some kind of
> error from the USB framework, and sometimes they are coupled with
> AER messages.
> 
> [   40.158166] pcieport 0000:00:00.0: AER: Uncorrected (Non-Fatal) error received: id=0000
> [   40.166291] pcieport 0000:00:00.0: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, id=0000(Requester ID)
> [   40.178519] pcieport 0000:00:00.0:   device [1105:0024] error status/mask=00004000/00000000
> [   40.187033] pcieport 0000:00:00.0:    [14] Completion Timeout     (First)
> [   40.193957] pcieport 0000:00:00.0: broadcast error_detected message
> [   40.200345] pcieport 0000:00:00.0: AER: Device recovery failed
> [   40.485352] xhci_hcd 0000:01:00.0: Cannot set link state.
> [   40.490887] usb usb2-port2: cannot disable (err = -32)
> [   40.496070] usb 2-2: USB disconnect, device number 2
> [   40.508478] pcieport 0000:00:00.0: AER: Uncorrected (Non-Fatal) error received: id=0000
> [   40.517291] pcieport 0000:00:00.0: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, id=0000(Requester ID)
> [   40.529266] pcieport 0000:00:00.0:   device [1105:0024] error status/mask=00004000/00000000
> [   40.538284] pcieport 0000:00:00.0:    [14] Completion Timeout     (First)
> [   40.545233] pcieport 0000:00:00.0: broadcast error_detected message
> [   40.551883] pcieport 0000:00:00.0: AER: Device recovery failed
> [   40.557859] pcieport 0000:00:00.0: AER: Uncorrected (Non-Fatal) error received: id=0000
> [   40.566367] pcieport 0000:00:00.0: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, id=0000(Requester ID)
> [   40.578667] pcieport 0000:00:00.0:   device [1105:0024] error status/mask=00004000/00000000
> [   40.587098] pcieport 0000:00:00.0:    [14] Completion Timeout     (First)
> [   40.593950] pcieport 0000:00:00.0: broadcast error_detected message
> [   40.600268] pcieport 0000:00:00.0: AER: Device recovery failed
> [   40.606148] pcieport 0000:00:00.0: AER: Uncorrected (Non-Fatal) error received: id=0000
> [   40.614223] pcieport 0000:00:00.0: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, id=0000(Requester ID)
> [   40.626046] pcieport 0000:00:00.0:   device [1105:0024] error status/mask=00004000/00000000
> [   40.634455] pcieport 0000:00:00.0:    [14] Completion Timeout     (First)
> [   40.641295] pcieport 0000:00:00.0: broadcast error_detected message
> [   40.647605] pcieport 0000:00:00.0: AER: Device recovery failed

Apparently, the above error trace occurs *every time* I unplug the
USB3 Flash drive. I'm sure it didn't use to happen systematically...

[   59.058798] usb 2-2: new SuperSpeed USB device number 2 using xhci_hcd
[   59.092272] usb 2-2: New USB device found, idVendor=0951, idProduct=1666
[   59.099029] usb 2-2: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[   59.106377] usb 2-2: Product: DataTraveler 3.0
[   59.110929] usb 2-2: Manufacturer: Kingston
[   59.115209] usb 2-2: SerialNumber: 002618887865F0C0F8646BFA
[   59.124163] usb-storage 2-2:1.0: USB Mass Storage device detected
[   59.130727] scsi host0: usb-storage 2-2:1.0
[   60.158296] scsi 0:0:0:0: Direct-Access     Kingston DataTraveler 3.0      PQ: 0 ANSI: 6
[   60.168252] sd 0:0:0:0: [sda] 15109516 512-byte logical blocks: (7.74 GB/7.20 GiB)
[   60.178876] sd 0:0:0:0: [sda] Write Protect is off
[   60.184356] sd 0:0:0:0: [sda] Mode Sense: 4f 00 00 00
[   60.189738] sd 0:0:0:0: [sda] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
[   60.202228]  sda: sda1
[   60.206629] sd 0:0:0:0: [sda] Attached SCSI removable disk

[   65.963480] pcieport 0000:00:00.0: AER: Uncorrected (Non-Fatal) error received: id=0000
[   65.971582] pcieport 0000:00:00.0: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, id=0000(Requester ID)
[   65.983816] pcieport 0000:00:00.0:   device [1105:0024] error status/mask=00004000/00000000
[   65.992331] pcieport 0000:00:00.0:    [14] Completion Timeout     (First)
[   65.999274] pcieport 0000:00:00.0: broadcast error_detected message
[   66.005664] pcieport 0000:00:00.0: AER: Device recovery failed
[   66.280717] xhci_hcd 0000:01:00.0: Cannot set link state.
[   66.286295] usb usb2-port2: cannot disable (err = -32)
[   66.291486] usb 2-2: USB disconnect, device number 2
[   66.297725] pcieport 0000:00:00.0: AER: Uncorrected (Non-Fatal) error received: id=0000
[   66.306012] pcieport 0000:00:00.0: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, id=0000(Requester ID)
[   66.318142] pcieport 0000:00:00.0:   device [1105:0024] error status/mask=00004000/00000000
[   66.326704] pcieport 0000:00:00.0:    [14] Completion Timeout     (First)
[   66.333641] pcieport 0000:00:00.0: broadcast error_detected message
[   66.340043] pcieport 0000:00:00.0: AER: Device recovery failed
[   66.345996] pcieport 0000:00:00.0: AER: Uncorrected (Non-Fatal) error received: id=0000
[   66.354141] pcieport 0000:00:00.0: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, id=0000(Requester ID)
[   66.366026] pcieport 0000:00:00.0:   device [1105:0024] error status/mask=00004000/00000000
[   66.374444] pcieport 0000:00:00.0:    [14] Completion Timeout     (First)
[   66.381321] pcieport 0000:00:00.0: broadcast error_detected message
[   66.387635] pcieport 0000:00:00.0: AER: Device recovery failed

[   72.715540] usb 2-2: new SuperSpeed USB device number 3 using xhci_hcd
[   72.748836] usb 2-2: New USB device found, idVendor=0951, idProduct=1666
[   72.755594] usb 2-2: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[   72.762778] usb 2-2: Product: DataTraveler 3.0
[   72.767329] usb 2-2: Manufacturer: Kingston
[   72.771547] usb 2-2: SerialNumber: 002618887865F0C0F8646BFA
[   72.780539] usb-storage 2-2:1.0: USB Mass Storage device detected
[   72.786987] scsi host0: usb-storage 2-2:1.0
[   73.811611] scsi 0:0:0:0: Direct-Access     Kingston DataTraveler 3.0      PQ: 0 ANSI: 6
[   73.821656] sd 0:0:0:0: [sda] 15109516 512-byte logical blocks: (7.74 GB/7.20 GiB)
[   73.832641] sd 0:0:0:0: [sda] Write Protect is off
[   73.837909] sd 0:0:0:0: [sda] Mode Sense: 4f 00 00 00
[   73.843538] sd 0:0:0:0: [sda] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
[   73.856237]  sda: sda1
[   73.864146] sd 0:0:0:0: [sda] Attached SCSI removable disk

[   78.138502] pcieport 0000:00:00.0: AER: Uncorrected (Non-Fatal) error received: id=0000
[   78.146629] pcieport 0000:00:00.0: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, id=0000(Requester ID)
[   78.158469] pcieport 0000:00:00.0:   device [1105:0024] error status/mask=00004000/00000000
[   78.166904] pcieport 0000:00:00.0:    [14] Completion Timeout     (First)
[   78.173768] pcieport 0000:00:00.0: broadcast error_detected message
[   78.180081] pcieport 0000:00:00.0: AER: Device recovery failed
[   78.464045] xhci_hcd 0000:01:00.0: Cannot set link state.
[   78.469507] usb usb2-port2: cannot disable (err = -32)
[   78.474689] usb 2-2: USB disconnect, device number 3
[   78.480947] pcieport 0000:00:00.0: AER: Uncorrected (Non-Fatal) error received: id=0000
[   78.489209] pcieport 0000:00:00.0: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, id=0000(Requester ID)
[   78.501131] pcieport 0000:00:00.0:   device [1105:0024] error status/mask=00004000/00000000
[   78.509573] pcieport 0000:00:00.0:    [14] Completion Timeout     (First)
[   78.516495] pcieport 0000:00:00.0: broadcast error_detected message
[   78.522833] pcieport 0000:00:00.0: AER: Device recovery failed
[   78.528715] pcieport 0000:00:00.0: AER: Uncorrected (Non-Fatal) error received: id=0000
[   78.536799] pcieport 0000:00:00.0: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, id=0000(Requester ID)
[   78.548644] pcieport 0000:00:00.0:   device [1105:0024] error status/mask=00004000/00000000
[   78.557053] pcieport 0000:00:00.0:    [14] Completion Timeout     (First)
[   78.563905] pcieport 0000:00:00.0: broadcast error_detected message
[   78.570214] pcieport 0000:00:00.0: AER: Device recovery failed

And I also see a third kind of report:

[   17.826017] pcieport 0000:00:00.0: AER: Corrected error received: id=0000
[   17.833917] pcieport 0000:00:00.0: PCIe Bus Error: severity=Corrected, type=Data Link Layer, id=0000(Transmitter ID)
[   17.844583] pcieport 0000:00:00.0:   device [1105:0024] error status/mask=00001000/00002000
[   17.853217] pcieport 0000:00:00.0:    [12] Replay Timer Timeout  

[ 7100.130522] pcieport 0000:00:00.0: AER: Corrected error received: id=0000
[ 7100.137405] pcieport 0000:00:00.0: PCIe Bus Error: severity=Corrected, type=Data Link Layer, id=0000(Transmitter ID)
[ 7100.148351] pcieport 0000:00:00.0:   device [1105:0024] error status/mask=00001000/00002000
[ 7100.156888] pcieport 0000:00:00.0:    [12] Replay Timer Timeout  

I'll try enabling AER on the legacy kernel (3.4) to see if I get
the same behavior.

Regards.