Problems about NIC, PCIe and usb on RK3568 EVB

Thu Apr 13 02:21:55 PDT 2023

On Thu, Apr 13, 2023 at 4:02 PM Frank Wunderlich
<frank-w at public-files.de> wrote:
>
> Hi
> > Gesendet: Donnerstag, 13. April 2023 um 08:28 Uhr
> > Von: "Johannes Zink" <j.zink at pengutronix.de>
> > An: linux-rockchip at lists.infradead.org
> > Betreff: Re: Problems about NIC, PCIe and usb on RK3568 EVB
> >
> > Hi Doug,
> >
> > On 4/13/23 07:55, Doug Brewer wrote:
> > > Hi,
> > >
> > > I tested Linux kernel 6.3-rc6 on my rk3568 evaluation board, it seems there
> > > are problems with Ethernet, PCIe and usb devices.
> > >
> > > First, NICs doesn't work.
> > >
> > > rk_gmac-dwmac fe010000.ethernet: IRQ eth_lpi not found
> > > rk_gmac-dwmac fe010000.ethernet: no regulator found
> > > rk_gmac-dwmac fe010000.ethernet: clock input or output? (output).
> > > rk_gmac-dwmac fe010000.ethernet: Can not read property: tx_delay.
> > > rk_gmac-dwmac fe010000.ethernet: set tx_delay to 0x30
> > > rk_gmac-dwmac fe010000.ethernet: Can not read property: rx_delay.
> > > rk_gmac-dwmac fe010000.ethernet: set rx_delay to 0x10
> > > rk_gmac-dwmac fe010000.ethernet: integrated PHY? (no).
> > > rk_gmac-dwmac fe010000.ethernet: init for RGMII_ID
> > > rk_gmac-dwmac fe010000.ethernet: User ID: 0x30, Synopsys ID: 0x51
> > > rk_gmac-dwmac fe010000.ethernet:         DWMAC4/5
> > > rk_gmac-dwmac fe010000.ethernet: DMA HW capability register suppd
> > > rk_gmac-dwmac fe010000.ethernet: RX Checksum Offload Engine suppd
> > > rk_gmac-dwmac fe010000.ethernet: TX Checksum insertion supported
> > > rk_gmac-dwmac fe010000.ethernet: Wake-Up On Lan supported
> > > rk_gmac-dwmac fe010000.ethernet: TSO supported
> > > rk_gmac-dwmac fe010000.ethernet: Enable RX Mitigation via HW Watr
> > > rk_gmac-dwmac fe010000.ethernet: Enabled RFS Flow TC (entries=10)
> > > rk_gmac-dwmac fe010000.ethernet: TSO feature enabled
> > > rk_gmac-dwmac fe010000.ethernet: Using 32/32 bits DMA host/devich
> > > mdio_bus stmmac-1: MDIO device at address 0 is missing.
> > > rk_gmac-dwmac fe2a0000.ethernet: IRQ eth_lpi not found
> > > rk_gmac-dwmac fe2a0000.ethernet: no regulator found
> > > rk_gmac-dwmac fe2a0000.ethernet: clock input or output? (output).
> > > rk_gmac-dwmac fe2a0000.ethernet: Can not read property: tx_delay.
> > > rk_gmac-dwmac fe2a0000.ethernet: set tx_delay to 0x30
> > > rk_gmac-dwmac fe2a0000.ethernet: Can not read property: rx_delay.
> > > rk_gmac-dwmac fe2a0000.ethernet: set rx_delay to 0x10
> > > rk_gmac-dwmac fe2a0000.ethernet: integrated PHY? (no).
> > > rk_gmac-dwmac fe2a0000.ethernet: init for RGMII_ID
> > > rk_gmac-dwmac fe2a0000.ethernet: User ID: 0x30, Synopsys ID: 0x51
> > > rk_gmac-dwmac fe2a0000.ethernet:         DWMAC4/5
> > > rk_gmac-dwmac fe2a0000.ethernet: DMA HW capability register suppd
> > > rk_gmac-dwmac fe2a0000.ethernet: RX Checksum Offload Engine suppd
> > > rk_gmac-dwmac fe2a0000.ethernet: TX Checksum insertion supported
> > > rk_gmac-dwmac fe2a0000.ethernet: Wake-Up On Lan supported
> > > rk_gmac-dwmac fe2a0000.ethernet: TSO supported
> > > rk_gmac-dwmac fe2a0000.ethernet: Enable RX Mitigation via HW Watr
> > > rk_gmac-dwmac fe2a0000.ethernet: Enabled RFS Flow TC (entries=10)
> > > rk_gmac-dwmac fe2a0000.ethernet: TSO feature enabled
> > > rk_gmac-dwmac fe2a0000.ethernet: Using 32/32 bits DMA host/devich
> > > mdio_bus stmmac-0: MDIO device at address 0 is missing.
> > > rk_gmac-dwmac fe010000.ethernet eth0: Register MEM_TYPE_PAGE_POO0
> > > rk_gmac-dwmac fe010000.ethernet eth0: __stmmac_open: Cannot atta)
> > >
> > > Second, running 'lspci' and 'lsusb' doesn't see any devices on PCIe and USB.
> > > I guess the device tree might be updated.  Anyone has idea how to fix it?
> > > Thanks.
> > >
> > > - Doug
> >
> > I've seen similar errors on other boards when the phy is not powered or
> > does not have a clock supplied. Could you check your DT if there is any
> > diffs in the phy-supply or any gpio-Hog pulling the enable of a
> > regulator that might enable the phy? Also you could check if you have
> > all the required regulator drivers available and probed.
> >
> > Best regards
> > Johannes
>
> i tested 6.3.0-rc4 on my banaanpi r2pro and there it seem no problem...do you have the issue on rc4 too?

I just tested 6.3.0-rc4 on my rk3568 evb, no luck.

# dmesg |grep rk_gmac
[   11.381071] rk_gmac-dwmac fe010000.ethernet: IRQ eth_lpi not found
[   11.381892] rk_gmac-dwmac fe010000.ethernet: no regulator found
[   11.382529] rk_gmac-dwmac fe010000.ethernet: clock input or output? (output).
[   11.383178] rk_gmac-dwmac fe010000.ethernet: Can not read property: tx_delay.
[   11.383815] rk_gmac-dwmac fe010000.ethernet: set tx_delay to 0x30
[   11.384373] rk_gmac-dwmac fe010000.ethernet: Can not read property: rx_delay.
[   11.385008] rk_gmac-dwmac fe010000.ethernet: set rx_delay to 0x10
[   11.385561] rk_gmac-dwmac fe010000.ethernet: integrated PHY? (no).
[   11.396162] rk_gmac-dwmac fe010000.ethernet: init for RGMII_ID
[   11.400201] rk_gmac-dwmac fe010000.ethernet: User ID: 0x30, Synopsys ID: 0x51
[   11.400878] rk_gmac-dwmac fe010000.ethernet:         DWMAC4/5
[   11.401349] rk_gmac-dwmac fe010000.ethernet: DMA HW capability register suppd
[   11.402067] rk_gmac-dwmac fe010000.ethernet: RX Checksum Offload Engine suppd
[   11.402755] rk_gmac-dwmac fe010000.ethernet: TX Checksum insertion
supported
[   11.403401] rk_gmac-dwmac fe010000.ethernet: Wake-Up On Lan supported
[   11.404185] rk_gmac-dwmac fe010000.ethernet: TSO supported
[   11.406883] rk_gmac-dwmac fe010000.ethernet: Enable RX Mitigation via HW Watr
[   11.407964] rk_gmac-dwmac fe010000.ethernet: Enabled RFS Flow TC (entries=10)
[   11.408624] rk_gmac-dwmac fe010000.ethernet: TSO feature enabled
[   11.411098] rk_gmac-dwmac fe010000.ethernet: Using 32/32 bits DMA host/devich
[   11.421076] rk_gmac-dwmac fe2a0000.ethernet: IRQ eth_lpi not found
[   11.422308] rk_gmac-dwmac fe2a0000.ethernet: no regulator found
[   11.422870] rk_gmac-dwmac fe2a0000.ethernet: clock input or output? (output).
[   11.423515] rk_gmac-dwmac fe2a0000.ethernet: Can not read property: tx_delay.
[   11.425161] rk_gmac-dwmac fe2a0000.ethernet: set tx_delay to 0x30
[   11.425862] rk_gmac-dwmac fe2a0000.ethernet: Can not read property: rx_delay.
[   11.426731] rk_gmac-dwmac fe2a0000.ethernet: set rx_delay to 0x10
[   11.427430] rk_gmac-dwmac fe2a0000.ethernet: integrated PHY? (no).
[   11.433094] rk_gmac-dwmac fe2a0000.ethernet: init for RGMII_ID
[   11.445612] rk_gmac-dwmac fe2a0000.ethernet: User ID: 0x30, Synopsys ID: 0x51
[   11.446753] rk_gmac-dwmac fe2a0000.ethernet:         DWMAC4/5
[   11.447265] rk_gmac-dwmac fe2a0000.ethernet: DMA HW capability register suppd
[   11.447940] rk_gmac-dwmac fe2a0000.ethernet: RX Checksum Offload Engine suppd
[   11.448612] rk_gmac-dwmac fe2a0000.ethernet: TX Checksum insertion
supported
[   11.449536] rk_gmac-dwmac fe2a0000.ethernet: Wake-Up On Lan supported
[   11.452947] rk_gmac-dwmac fe2a0000.ethernet: TSO supported
[   11.453468] rk_gmac-dwmac fe2a0000.ethernet: Enable RX Mitigation via HW Watr
[   11.454401] rk_gmac-dwmac fe2a0000.ethernet: Enabled RFS Flow TC (entries=10)
[   11.455054] rk_gmac-dwmac fe2a0000.ethernet: TSO feature enabled
[   11.456887] rk_gmac-dwmac fe2a0000.ethernet: Using 32/32 bits DMA host/devich
[   12.340615] rk_gmac-dwmac fe010000.ethernet eth0: Register MEM_TYPE_PAGE_POO0
[   12.342575] rk_gmac-dwmac fe010000.ethernet eth0: no phy found
[   12.343121] rk_gmac-dwmac fe010000.ethernet eth0: __stmmac_open: Cannot atta)

>
> root at bpi-r2pro:~# dmesg | grep rk_gmac-dwmac
> [    3.033681] rk_gmac-dwmac fe010000.ethernet: IRQ eth_lpi not found
> [    3.034528] rk_gmac-dwmac fe010000.ethernet: Looking up phy-supply from devie
> [    3.035243] rk_gmac-dwmac fe010000.ethernet: Looking up phy-supply property d
> [    3.036170] rk_gmac-dwmac fe010000.ethernet: no regulator found
> [    3.036713] rk_gmac-dwmac fe010000.ethernet: clock input or output? (output).
> [    3.037361] rk_gmac-dwmac fe010000.ethernet: TX delay(0x3c).
> [    3.037877] rk_gmac-dwmac fe010000.ethernet: RX delay(0x2f).
> [    3.038398] rk_gmac-dwmac fe010000.ethernet: integrated PHY? (no).
> [    3.044063] rk_gmac-dwmac fe010000.ethernet: init for RGMII
> [    3.044896] rk_gmac-dwmac fe010000.ethernet: User ID: 0x30, Synopsys ID: 0x51
> [    3.045559] rk_gmac-dwmac fe010000.ethernet:         DWMAC4/5
> [    3.046033] rk_gmac-dwmac fe010000.ethernet: DMA HW capability register suppd
> [    3.046747] rk_gmac-dwmac fe010000.ethernet: RX Checksum Offload Engine suppd
> [    3.047428] rk_gmac-dwmac fe010000.ethernet: TX Checksum insertion supported
> [    3.048062] rk_gmac-dwmac fe010000.ethernet: Wake-Up On Lan supported
> [    3.048725] rk_gmac-dwmac fe010000.ethernet: TSO supported
> [    3.049229] rk_gmac-dwmac fe010000.ethernet: Enable RX Mitigation via HW Watr
> [    3.049954] rk_gmac-dwmac fe010000.ethernet: Enabled RFS Flow TC (entries=10)
> [    3.050628] rk_gmac-dwmac fe010000.ethernet: TSO feature enabled
> [    3.051176] rk_gmac-dwmac fe010000.ethernet: Using 32/32 bits DMA host/devich
> [    3.189988] rk_gmac-dwmac fe2a0000.ethernet: IRQ eth_lpi not found
> [    3.190982] rk_gmac-dwmac fe2a0000.ethernet: Looking up phy-supply from devie
> [    3.191715] rk_gmac-dwmac fe2a0000.ethernet: Looking up phy-supply property d
> [    3.192636] rk_gmac-dwmac fe2a0000.ethernet: no regulator found
> [    3.193180] rk_gmac-dwmac fe2a0000.ethernet: clock input or output? (input).
> [    3.193818] rk_gmac-dwmac fe2a0000.ethernet: TX delay(0x4f).
> [    3.194336] rk_gmac-dwmac fe2a0000.ethernet: RX delay(0xf).
> [    3.194885] rk_gmac-dwmac fe2a0000.ethernet: integrated PHY? (no).
> [    3.195499] rk_gmac-dwmac fe2a0000.ethernet: clock input from PHY
> [    3.201067] rk_gmac-dwmac fe2a0000.ethernet: init for RGMII
> [    3.201885] rk_gmac-dwmac fe2a0000.ethernet: User ID: 0x30, Synopsys ID: 0x51
> [    3.202575] rk_gmac-dwmac fe2a0000.ethernet:         DWMAC4/5
> [    3.203052] rk_gmac-dwmac fe2a0000.ethernet: DMA HW capability register suppd
> [    3.203730] rk_gmac-dwmac fe2a0000.ethernet: RX Checksum Offload Engine suppd
> [    3.204405] rk_gmac-dwmac fe2a0000.ethernet: TX Checksum insertion supported
> [    3.205039] rk_gmac-dwmac fe2a0000.ethernet: Wake-Up On Lan supported
> [    3.205702] rk_gmac-dwmac fe2a0000.ethernet: TSO supported
> [    3.206207] rk_gmac-dwmac fe2a0000.ethernet: Enable RX Mitigation via HW Watr
> [    3.206969] rk_gmac-dwmac fe2a0000.ethernet: Enabled RFS Flow TC (entries=10)
> [    3.207621] rk_gmac-dwmac fe2a0000.ethernet: TSO feature enabled
> [    3.208167] rk_gmac-dwmac fe2a0000.ethernet: Using 32/32 bits DMA host/devich
> [   80.517694] rk_gmac-dwmac fe010000.ethernet eth0: Register MEM_TYPE_PAGE_POO0
> [   80.520178] rk_gmac-dwmac fe010000.ethernet eth0: PHY [stmmac-1:00] driver [)
> [   80.520230] rk_gmac-dwmac fe010000.ethernet eth0: No Safety Features supportd
> [   80.520258] rk_gmac-dwmac fe010000.ethernet eth0: IEEE 1588-2008 Advanced Tid
> [   80.520514] rk_gmac-dwmac fe010000.ethernet eth0: registered PTP clock
> [   80.520898] rk_gmac-dwmac fe010000.ethernet eth0: configuring for phy/rgmii e
> [   84.615184] rk_gmac-dwmac fe010000.ethernet eth0: Link is Up - 1Gbps/Full - x
> root at bpi-r2pro:~# ip a
> 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group defau0
>     link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
>     inet 127.0.0.1/8 scope host lo
>        valid_lft forever preferred_lft forever
>     inet6 ::1/128 scope host
>        valid_lft forever preferred_lft forever
> 2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group def0
>     link/ether 76:95:00:96:b3:89 brd ff:ff:ff:ff:ff:ff
>     inet 192.168.0.12/24 scope global eth0
>        valid_lft forever preferred_lft forever
>     inet6 fe80::7495:ff:fe96:b389/64 scope link
>        valid_lft forever preferred_lft forever
> 3: eth1: <BROADCAST,MULTICAST> mtu 1504 qdisc noop state DOWN group default qle0
>     link/ether 76:95:00:96:b3:88 brd ff:ff:ff:ff:ff:ff
> 4: sit0 at NONE: <NOARP> mtu 1480 qdisc noop state DOWN group default qlen 1000
>     link/sit 0.0.0.0 brd 0.0.0.0
> 5: lan0 at eth1: <BROADCAST,MULTICAST,M-DOWN> mtu 1500 qdisc noop state DOWN group0
>     link/ether 76:95:00:96:b3:88 brd ff:ff:ff:ff:ff:ff
> 6: lan1 at eth1: <BROADCAST,MULTICAST,M-DOWN> mtu 1500 qdisc noop state DOWN group0
>     link/ether 76:95:00:96:b3:88 brd ff:ff:ff:ff:ff:ff
> 7: lan2 at eth1: <BROADCAST,MULTICAST,M-DOWN> mtu 1500 qdisc noop state DOWN group0
>     link/ether 76:95:00:96:b3:88 brd ff:ff:ff:ff:ff:ff
> 8: lan3 at eth1: <BROADCAST,MULTICAST,M-DOWN> mtu 1500 qdisc noop state DOWN group0
>     link/ether 76:95:00:96:b3:88 brd ff:ff:ff:ff:ff:ff
> root at bpi-r2pro:~# lsusb
> Bus 006 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
> Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
> Bus 004 Device 001: ID 1d6b:0001 Linux Foundation 1.1 root hub
> Bus 002 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
> Bus 008 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
> Bus 007 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
> Bus 005 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
> Bus 003 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
> root at bpi-r2pro:~# lspci
> 0001:00:00.0 PCI bridge: Rockchip Electronics Co., Ltd RK3568 Remote Signal Pro)
> 0002:00:00.0 PCI bridge: Rockchip Electronics Co., Ltd RK3568 Remote Signal Pro)
> root at bpi-r2pro:~# uname -a
> Linux bpi-r2pro 6.3.0-rc4-bpi-r2pro #1 SMP PREEMPT Mon Apr 10 13:39:18 CEST 202x
> root at bpi-r2pro:~#
>
> tested eth1 too...also working. so maybe "only" a evb related dts-change or between rc4 and rc6

Maybe the device tree is not correct on evb...

>
> regards Frank

- Doug