Testing new release 6.0.0+ on Firefly ITX-3588J fails: "ITS queue timeout"
Shimmy Shai
shimmyshai00 at gmail.com
Tue Oct 4 18:28:37 PDT 2022
Hi.
I sent you an earlier message about this issue when I saw it before
the 6.0.0 release was finalized. Want to tell you again because it's
still present on the finalized release which I just got done testing
with. It is not possible to bring up the kernel on the Firefly
ITX-3588J board with Rockchip RK3588 processor, despite that it has
been claimed basic RK3588 support has been added that is sufficient
for bring-up - so I suspect it has something to do with how the
hardware is configured on this board (perhaps).
The following errors are generated, which seem similar to this older issue:
https://lore.kernel.org/lkml/871rbdt4tu.wl-maz@kernel.org/T/
but perhaps importantly, it is *not* saying that "Devices don't stick
... ITS: No ITS available, not enabling LPIs". It is instead just
giving "ITS queue timeout" errors.
The serial console output from the failed boot is given below for reference.
=============================
[ 0.000000] Booting Linux on physical CPU 0x0000000000 [0x412fd050]
[ 0.000000] Linux version 6.0.0+ (shimmy at sdf-central-karyo)
(aarch64-linux-gnu-gcc (Ubuntu 9.4.0-1ubuntu1~20.04.1) 9.4.0, GNU ld
(GNU Binutils for Ubuntu) 2.34) #1 SMP Tue Oct 4 16:03:46 PDT 2022
[ 0.000000] Machine model: Firefly ITX-3588J HDMI(Linux)
[ 0.000000] earlycon: uart8250 at MMIO32 0x00000000feb50000 (options '')
[ 0.000000] printk: bootconsole [uart8250] enabled
[ 0.000000] efi: UEFI not found.
[ 0.000000] OF: fdt: Reserved memory: failed to reserve memory for
node 'drm-cubic-lut at 00000000': base 0x0000000000000000, size 0 MiB
[ 0.000000] Reserved memory: created CMA memory pool at
0x0000000010000000, size 256 MiB
[ 0.000000] OF: reserved mem: initialized node cma, compatible id
shared-dma-pool
[ 0.000000] Zone ranges:
[ 0.000000] DMA [mem 0x0000000000200000-0x00000000ffffffff]
[ 0.000000] DMA32 empty
[ 0.000000] Normal [mem 0x0000000100000000-0x00000001ffffffff]
[ 0.000000] Movable zone start for each node
[ 0.000000] Early memory node ranges
[ 0.000000] node 0: [mem 0x0000000000200000-0x00000000083fffff]
[ 0.000000] node 0: [mem 0x0000000009400000-0x00000000efffffff]
[ 0.000000] node 0: [mem 0x0000000100000000-0x00000001ffffffff]
[ 0.000000] Initmem setup node 0 [mem 0x0000000000200000-0x00000001ffffffff]
[ 0.000000] On node 0, zone DMA: 512 pages in unavailable ranges
[ 0.000000] On node 0, zone DMA: 4096 pages in unavailable ranges
[ 0.000000] psci: probing for conduit method from DT.
[ 0.000000] psci: PSCIv1.1 detected in firmware.
[ 0.000000] psci: Using standard PSCI v0.2 function IDs
[ 0.000000] psci: Trusted OS migration not required
[ 0.000000] psci: SMC Calling Convention v1.2
[ 0.000000] percpu: Embedded 27 pages/cpu s73400 r8192 d29000 u110592
[ 0.000000] Detected VIPT I-cache on CPU0
[ 0.000000] CPU features: detected: GIC system register CPU interface
[ 0.000000] CPU features: detected: Virtualization Host Extensions
[ 0.000000] CPU features: detected: ARM errata 1165522, 1319367, or 1530923
[ 0.000000] alternatives: patching kernel code
[ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1995336
[ 0.000000] Kernel command line: rw rootwait root=/dev/sda2
console=tty1 console=ttyFIQ0,1500000
earlycon=uart8250,mmio32,0xfeb50000
[ 0.000000] Dentry cache hash table entries: 1048576 (order: 11,
8388608 bytes, linear)
[ 0.000000] Inode-cache hash table entries: 524288 (order: 10,
4194304 bytes, linear)
[ 0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[ 0.000000] software IO TLB: area num 8.
[ 0.000000] software IO TLB: mapped [mem
0x00000000e9f00000-0x00000000edf00000] (64MB)
[ 0.000000] Memory: 7580108K/8108032K available (15808K kernel
code, 3386K rwdata, 5628K rodata, 6656K init, 635K bss, 265780K
reserved, 262144K cma-reserved)
[ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1
[ 0.000000] ftrace: allocating 61698 entries in 242 pages
[ 0.000000] ftrace: allocated 242 pages with 5 groups
[ 0.000000] trace event string verifier disabled
[ 0.000000] rcu: Hierarchical RCU implementation.
[ 0.000000] rcu: RCU event tracing is enabled.
[ 0.000000] Rude variant of Tasks RCU enabled.
[ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay
is 30 jiffies.
[ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
[ 0.000000] GICv3: GIC: Using split EOI/Deactivate mode
[ 0.000000] GICv3: 480 SPIs implemented
[ 0.000000] GICv3: 0 Extended SPIs implemented
[ 0.000000] Root IRQ handler: gic_handle_irq
[ 0.000000] GICv3: GICv3 features: 16 PPIs
[ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000fe680000
[ 0.000000] ITS [mem 0xfe640000-0xfe65ffff]
[ 0.000000] ITS at 0x00000000fe640000: allocated 8192 Devices
@100210000 (indirect, esz 8, psz 64K, shr 1)
[ 0.000000] ITS at 0x00000000fe640000: allocated 32768 Interrupt
Collections @100220000 (flat, esz 2, psz 64K, shr 1)
[ 0.000000] ITS [mem 0xfe660000-0xfe67ffff]
[ 0.000000] ITS at 0x00000000fe660000: allocated 8192 Devices
@100240000 (indirect, esz 8, psz 64K, shr 1)
[ 0.000000] ITS at 0x00000000fe660000: allocated 32768 Interrupt
Collections @100250000 (flat, esz 2, psz 64K, shr 1)
[ 0.000000] GICv3: using LPI property table @0x0000000100260000
[ 0.000000] GICv3: CPU0: using allocated LPI pending table
@0x0000000100270000
[ 0.000000] ITS queue timeout (64 1)
[ 0.000000] ITS cmd its_build_mapc_cmd failed
[ 0.000000] ITS queue timeout (128 1)
[ 0.000000] ITS cmd its_build_invall_cmd failed
[ 0.000000] ITS queue timeout (64 1)
[ 0.000000] ITS cmd its_build_mapc_cmd failed
[ 0.000000] ITS queue timeout (128 1)
[ 0.000000] ITS cmd its_build_invall_cmd failed
[ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.
[ 0.000000] arch_timer: cp15 timer(s) running at 24.00MHz (phys).
[ 0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff
max_cycles: 0x588fe9dc0, max_idle_ns: 440795202592 ns
[ 0.000000] sched_clock: 56 bits at 24MHz, resolution 41ns, wraps
every 4398046511097ns
[ 0.001168] Failed to get pclk for 'rk_timer'
[ 0.002168] Console: colour dummy device 80x25
[ 0.003236] printk: console [tty1] enabled
[ 0.003656] Calibrating delay loop (skipped), value calculated
using timer frequency.. 48.00 BogoMIPS (lpj=80000)
[ 0.004620] pid_max: default: 32768 minimum: 301
[ 0.005205] Mount-cache hash table entries: 16384 (order: 5, 131072
bytes, linear)
[ 0.005953] Mountpoint-cache hash table entries: 16384 (order: 5,
131072 bytes, linear)
[ 0.008691] cblist_init_generic: Setting adjustable number of
callback queues.
[ 0.009402] cblist_init_generic: Setting shift to 3 and lim to 1.
[ 0.010203] rcu: Hierarchical SRCU implementation.
[ 0.010658] rcu: Max phase no-delay instances is 1000.
[ 0.012027] Platform MSI: msi-controller at fe640000 domain created
[ 0.012609] Platform MSI: msi-controller at fe660000 domain created
[ 0.013492] PCI/MSI:
/interrupt-controller at fe600000/msi-controller at fe640000 domain created
[ 0.014288] PCI/MSI:
/interrupt-controller at fe600000/msi-controller at fe660000 domain created
[ 0.015185] EFI services will not be available.
[ 0.016038] smp: Bringing up secondary CPUs ...
I/TC: Secondary CPU 1 initializing
I/TC: Secondary CPU 1 switching to normal world boot
[ 0.017820] Detected VIPT I-cache on CPU1
[ 0.017921] GICv3: CPU1: found redistributor 100 region 0:0x00000000fe6a0000
[ 0.017937] GICv3: CPU1: using allocated LPI pending table
@0x0000000100280000
[ 1.476279] ITS queue timeout (192 1)
[ 1.476283] ITS cmd its_build_mapc_cmd failed
[ 2.934628] ITS queue timeout (256 1)
[ 2.934632] ITS cmd its_build_invall_cmd failed
[ 4.392971] ITS queue timeout (192 1)
[ 4.392976] ITS cmd its_build_mapc_cmd failed
[ 5.179300] CPU1: failed to come online
[ 5.183626] CPU1: failed in unknown state : 0x0
[ 5.184056] ------------[ cut here ]------------
[ 5.184489] Dying CPU not properly vacated!
[ 5.184501] WARNING: CPU: 0 PID: 1 at kernel/sched/core.c:9534
sched_cpu_dying+0xf0/0x1b0
[ 5.185669] Modules linked in:
[ 5.185964] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 6.0.0+ #1
[ 5.186522] Hardware name: Firefly ITX-3588J HDMI(Linux) (DT)
[ 5.187060] pstate: 600000c9 (nZCv daIF -PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[ 5.187714] pc : sched_cpu_dying+0xf0/0x1b0
[ 5.188113] lr : sched_cpu_dying+0xf0/0x1b0
[ 5.188512] sp : ffffffc009fbbc50
[ 5.188825] x29: ffffffc009fbbc50 x28: 0000000000000000 x27: 0000000000000000
[ 5.189502] x26: ffffffc1f5898000 x25: ffffffc00964b770 x24: ffffff81feee3770
[ 5.190177] x23: 0000000000000000 x22: 000000000000005f x21: ffffffc009bb92a0
[ 5.190853] x20: 0000000000000001 x19: ffffff81feef1940 x18: 0000000000000000
[ 5.191528] x17: 0000000000000000 x16: 0000000000000000 x15: 0720072007200720
[ 5.192204] x14: 0720072d072d072d x13: 2164657461636176 x12: 20796c7265706f72
[ 5.192880] x11: 0720072007200720 x10: 0720072007200720 x9 : ffffffc0080e1c80
[ 5.193555] x8 : 0720072007200720 x7 : 727020746f6e2055 x6 : ffffffc009eed7f1
[ 5.194231] x5 : 00000000000affa8 x4 : 000000000000000d x3 : 0000000000000000
[ 5.194906] x2 : 0000000000000000 x1 : 0000000000000000 x0 : 0000000000000000
[ 5.195580] Call trace:
[ 5.195813] sched_cpu_dying+0xf0/0x1b0
[ 5.196180] cpuhp_invoke_callback+0x108/0x268
[ 5.196604] cpuhp_invoke_callback_range+0x78/0xac
[ 5.197058] _cpu_up+0x180/0x1a8
[ 5.197367] cpu_up+0x88/0x9c
[ 5.197652] bringup_nonboot_cpus+0x94/0x98
[ 5.198050] smp_init+0x38/0x80
[ 5.198355] kernel_init_freeable+0x128/0x2a0
[ 5.198769] kernel_init+0x30/0x134
[ 5.199102] ret_from_fork+0x10/0x20
[ 5.199445] ---[ end trace 0000000000000000 ]---
[ 5.199879] CPU1 enqueued tasks (0 total):
I/TC: Secondary CPU 2 initializing
I/TC: Secondary CPU 2 switching to normal world boot
** 620219 printk messages dropped **
[ 10.277040] bad: scheduling from the idle thread!
[ 10.277044] CPU: 1 PID: 0 Comm: swapper/1 Tainted: G W
6.0.0+ #1
[ 10.277051] Hardware name: Firefly ITX-3588J HDMI(Linux) (DT)
[ 10.277055] Call trace:
[ 10.277058] dump_backtrace+0xe0/0x104
[ 10.277065] show_stack+0x20/0x30
[ 10.277072] dump_stack_lvl+0x7c/0xa0
[ 10.277080] dump_stack+0x18/0x34
[ 10.277087] dequeue_task_idle+0x34/0x54
[ 10.277094] dequeue_task+0x94/0xd8
[ 10.277102] deactivate_task+0x28/0x34
[ 10.277110] __schedule+0x4f4/0x698
[ 10.277116] schedule+0x8c/0xdc
[ 10.277123] schedule_preempt_disabled+0x18/0x24
[ 10.277130] __mutex_lock.isra.0+0x1b0/0x298
[ 10.277137] __mutex_lock_slowpath+0x1c/0x28
[ 10.277145] mutex_lock+0x3c/0x4c
[ 10.277151] irq_lock_sparse+0x24/0x30
[ 10.277160] bringup_cpu+0x2c/0xbc
[ 10.277168] cpuhp_invoke_callback+0x108/0x268
[ 10.277176] cpuhp_invoke_callback_range+0x78/0xac
[ 10.277184] notify_cpu_starting+0x80/0x9c
[ 10.277192] secondary_start_kernel+0x114/0x1bc
[ 10.277199] __secondary_switched+0xb0/0xb4
[ 10.277211] bad: scheduling from the idle thread!
[ 10.277215] CPU: 1 PID: 0 Comm: swapper/1 Tainted: G W
6.0.0+ #1
[ 10.277222] Hardware name: Firefly ITX-3588J HDMI(Linux) (DT)
[ 10.277226] Call trace:
[ 10.277228] dump_backtrace+0xe0/0x104
[ 10.277236] show_stack+0x20/0x30
[ 10.277243] dump_stack_lvl+0x7c/0xa0
[ 10.277251] dump_stack+0x18/0x34
[ 10.277258] dequeue_task_idle+0x34/0x54
[ 10.277265] dequeue_task+0x94/0xd8
[ 10.277273] deactivate_task+0x28/0x34
[ 10.277281] __schedule+0x4f4/0x698
[ 10.277288] schedule+0x8c/0xdc
[ 10.277294] schedule_preempt_disabled+0x18/0x24
[ 10.277301] __mutex_lock.isra.0+0x1b0/0x298
[ 10.277308] __mutex_lock_slowpath+0x1c/0x28
[ 10.277316] mutex_lock+0x3c/0x4c
[ 10.277323] irq_lock_sparse+0x24/0x30
[ 10.277332] bringup_cpu+0x2c/0xbc
[ 10.277339] cpuhp_invoke_callback+0x108/0x268
[ 10.277348] cpuhp_invoke_callback_range+0x78/0xac
[ 10.277356] notify_cpu_starting+0x80/0x9c
[ 10.277364] secondary_start_kernel+0x114/0x1bc
[ 10.277371] __secondary_switched+0xb0/0xb4
[ 10.277383] bad: scheduling from the idle thread!
[ 10.277387] CPU: 1 PID: 0 Comm: swapper/1 Tainted: G W
6.0.0+ #1
[ 10.277395] Hardware name: Firefly ITX-3588J HDMI(Linux) (DT)
(becomes repetitive spew after this point)
=============================
Thanks,
Shimrra SHAI.
More information about the linux-arm-kernel
mailing list