? FAIL (91/181 SKIPPED): Test report for for-kernelci (6.2.0-rc5, arm-next, 2e84eedb)

[Mark Rutland]

On Thu, Jan 26, 2023 at 12:52:03PM +0000, Will Deacon wrote:
> [+Mark and Ard in case they have ideas]
> 
> On Wed, Jan 25, 2023 at 09:21:19AM -0000, cki-project at redhat.com wrote:
> > Hi, we tested your kernel and here are the results:
> > 
> >     Overall result: FAILED
> >              Merge: OK
> >            Compile: OK
> >               Test: FAILED
> > 
> > 
> > Kernel information:
> >     Commit message: Merge branch 'for-next/core' into for-kernelci
> > 
> > You can find all the details about the test run at
> >     https://datawarehouse.cki-project.org/kcidb/checkouts/66828
> > 
> > One or more kernel tests failed:
> >     Unrecognized or new issues:
> >          aarch64 - kdump - kexec_boot
> >                    Logs: https://datawarehouse.cki-project.org/kcidb/tests/6799495
> 
> This looks like we run into an undefined instruction when we jump to the
> kexec relocation code. Do you know if the failure is reproducible, and is
> the log identical each time?

I had a go in a QEMU KVM VM on ThunderX2, and a QEMU KVM TCG VM. With defconfig
I don't see the issue, but with the config from the test run link above I
consistently see the issue both under KVM and TCG (logs below).

It should be simple enough to figure out which config option is tickling this;
I'll go dig in to that..

KVM:

| # ./kexec --reuse-cmdline -f Image 
| [   46.965800] kexec_core: Starting new kernel
| [   47.143641] psci: CPU1 killed (polled 0 ms)
| [   47.233653] psci: CPU2 killed (polled 0 ms)
| [   47.323465] psci: CPU3 killed (polled 0 ms)
| [   47.324776] Bye!
| [   47.327072] Internal error: Oops - Undefined instruction: 0000000002000000 [#1] SMP
| [   47.328510] Modules linked in:
| [   47.329086] CPU: 0 PID: 259 Comm: kexec Not tainted 6.2.0-rc5+ #3
| [   47.330223] Hardware name: QEMU KVM Virtual Machine, BIOS 0.0.0 02/06/2015
| [   47.331497] pstate: 604003c5 (nZCv DAIF +PAN -UAO -TCO -DIT -SSBS BTYPE=--)
| [   47.332782] pc : 0x43a95000
| [   47.333338] lr : machine_kexec+0x190/0x1e0
| [   47.334169] sp : ffff80000d293b70
| [   47.334845] x29: ffff80000d293b70 x28: ffff000002cc0000 x27: 0000000000000000
| [   47.336292] x26: 0000000000000000 x25: 0000000000000000 x24: 0000000000000000
| [   47.337744] x23: ffff80000a837858 x22: 0000000048ec9000 x21: 0000000000000010
| [   47.339192] x20: 00000000adc83000 x19: ffff000000827000 x18: 0000000000000006
| [   47.340638] x17: ffff800075a61000 x16: ffff800008000000 x15: ffff80000d293658
| [   47.342085] x14: 0000000000000000 x13: ffff80000d2937f7 x12: ffff80000a7ff6e0
| [   47.343530] x11: 00000000ffffdfff x10: ffff80000a8ef8e0 x9 : ffff80000813ef00
| [   47.344976] x8 : 000000000002ffe8 x7 : c0000000ffffdfff x6 : 00000000000affa8
| [   47.346431] x5 : 0000000000001fff x4 : 0000000000000001 x3 : ffff80000a0a3008
| [   47.347877] x2 : ffff80000a8220f8 x1 : 0000000043a95000 x0 : ffff000000827000
| [   47.349334] Call trace:
| [   47.349834]  0x43a95000
| [   47.350338]  kernel_kexec+0x88/0x100
| [   47.351070]  __do_sys_reboot+0x108/0x268
| [   47.351873]  __arm64_sys_reboot+0x2c/0x40
| [   47.352689]  invoke_syscall+0x78/0x108
| [   47.353458]  el0_svc_common.constprop.0+0x4c/0x100
| [   47.354426]  do_el0_svc+0x34/0x50
| [   47.355102]  el0_svc+0x34/0x108
| [   47.355747]  el0t_64_sync_handler+0xf4/0x120
| [   47.356617]  el0t_64_sync+0x194/0x198
| [   47.357374] Code: bad PC value
| [   47.357999] ---[ end trace 0000000000000000 ]---
| [   47.358937] Kernel panic - not syncing: Oops - Undefined instruction: Fatal exception
| [   47.360515] Kernel Offset: disabled
| [   47.361230] CPU features: 0x002000,00050108,c8004203
| [   47.362232] Memory Limit: none

TCG:

| #  ./kexec --reuse-cmdline -f Image
| [   94.257277] kvm: exiting hardware virtualization
| [   94.315790] kexec_core: Starting new kernel
| [   94.447279] psci: CPU1 killed (polled 0 ms)
| [   94.542471] psci: CPU2 killed (polled 0 ms)
| [   94.643061] psci: CPU3 killed (polled 0 ms)
| [   94.657775] Bye!
| [   94.659186] Internal error: Oops - Undefined instruction: 0000000002000000 [#1] SMP
| [   94.660439] Modules linked in:
| [   94.662160] CPU: 0 PID: 258 Comm: kexec Not tainted 6.2.0-rc5+ #3
| [   94.662936] Hardware name: QEMU QEMU Virtual Machine, BIOS 0.0.0 02/06/2015
| [   94.663793] pstate: 61400bc9 (nZCv DAIF +PAN -UAO -TCO +DIT -SSBS BTYPE=-c)
| [   94.664470] pc : 0x43a95000
| [   94.665780] lr : machine_kexec+0x190/0x1e0
| [   94.667025] sp : ffff80000d1f3ac0
| [   94.667346] x29: ffff80000d1f3ac0 x28: ffff000002014380 x27: 0000000000000000
| [   94.668315] x26: 0000000000000000 x25: 0000000000000000 x24: 0000000000000000
| [   94.668970] x23: ffff80000a837858 x22: 0000000048b06000 x21: 0000000000000010
| [   94.669618] x20: 00000000adc83000 x19: ffff000000805c00 x18: 0000000000000006
| [   94.670253] x17: 0000000000000000 x16: 0000000000000000 x15: ffff80000d1f35a8
| [   94.670895] x14: 0000000000000000 x13: ffff80000d1f3747 x12: ffff80000a7ff6e0
| [   94.671538] x11: 00000000ffffdfff x10: ffff80000a8ef8e0 x9 : ffff80000813ef00
| [   94.672279] x8 : 000000000002ffe8 x7 : c0000000ffffdfff x6 : 00000000000affa8
| [   94.672926] x5 : 0000000000000000 x4 : 0000000000000002 x3 : ffff80000a0a3008
| [   94.673572] x2 : ffff80000a8220f8 x1 : 0000000043a95000 x0 : ffff000000805c00
| [   94.674430] Call trace:
| [   94.674750]  0x43a95000
| [   94.675133]  kernel_kexec+0x88/0x100
| [   94.675492]  __do_sys_reboot+0x108/0x268
| [   94.675863]  __arm64_sys_reboot+0x2c/0x40
| [   94.676230]  invoke_syscall+0x78/0x108
| [   94.676581]  el0_svc_common.constprop.0+0x4c/0x100
| [   94.676990]  do_el0_svc+0x34/0x50
| [   94.677299]  el0_svc+0x34/0x108
| [   94.677630]  el0t_64_sync_handler+0xf4/0x120
| [   94.678004]  el0t_64_sync+0x194/0x198
| [   94.678716] Code: bad PC value
| [   94.679828] ---[ end trace 0000000000000000 ]---
| [   94.680585] Kernel panic - not syncing: Oops - Undefined instruction: Fatal exception
| [   94.681870] Kernel Offset: disabled
| [   94.682241] CPU features: 0x000000,0075016b,4d23e33f
| [   94.683007] Memory Limit: none

Thanks,
Mark.