[bug report] blktests nvme/043 nvme/045 failed

Yi Zhang yi.zhang at redhat.com
Wed Aug 30 04:22:14 PDT 2023


Hello

I found blkests nvme/043 nvme/045 failed on one of our x86_64 servers,
and it works on the other servers, from the log, it failed when
Testing DH group ffdhe6144 and ffdhe8192, is it hw limitation?

# ./check nvme/043 nvme/045
nvme/043 (Test hash and DH group variations for authenticated
connections) [failed]
    runtime  7.057s  ...  7.298s
    --- tests/nvme/043.out 2023-08-30 00:19:38.518253725 -0400
    +++ /root/blktests/results/nodev/nvme/043.out.bad 2023-08-30
07:09:47.805056014 -0400
    @@ -12,7 +12,9 @@
     Testing DH group ffdhe4096
     NQN:blktests-subsystem-1 disconnected 1 controller(s)
     Testing DH group ffdhe6144
    +tests/nvme/rc: line 780: echo: write error: Invalid argument
     NQN:blktests-subsystem-1 disconnected 1 controller(s)
     Testing DH group ffdhe8192
    +tests/nvme/rc: line 780: echo: write error: Invalid argument
    ...
    (Run 'diff -u tests/nvme/043.out
/root/blktests/results/nodev/nvme/043.out.bad' to see the entire diff)
nvme/045 (Test re-authentication)                            [failed]
    runtime  1.129s  ...  1.031s
    --- tests/nvme/045.out 2023-08-30 00:19:38.518253725 -0400
    +++ /root/blktests/results/nodev/nvme/045.out.bad 2023-08-30
07:09:49.162053096 -0400
    @@ -5,6 +5,7 @@
     Renew ctrl key on the controller
     Re-authenticate with new ctrl key
     Change DH group to ffdhe8192
    +tests/nvme/rc: line 780: echo: write error: Invalid argument
     Re-authenticate with changed DH group
     Change hash to hmac(sha512)
     Re-authenticate with changed hash
# cat results/nodev/nvme/043.out.bad
Running nvme/043
Testing hash hmac(sha256)
NQN:blktests-subsystem-1 disconnected 1 controller(s)
Testing hash hmac(sha384)
NQN:blktests-subsystem-1 disconnected 1 controller(s)
Testing hash hmac(sha512)
NQN:blktests-subsystem-1 disconnected 1 controller(s)
Testing DH group ffdhe2048
NQN:blktests-subsystem-1 disconnected 1 controller(s)
Testing DH group ffdhe3072
NQN:blktests-subsystem-1 disconnected 1 controller(s)
Testing DH group ffdhe4096
NQN:blktests-subsystem-1 disconnected 1 controller(s)
Testing DH group ffdhe6144
tests/nvme/rc: line 780: echo: write error: Invalid argument
NQN:blktests-subsystem-1 disconnected 1 controller(s)
Testing DH group ffdhe8192
tests/nvme/rc: line 780: echo: write error: Invalid argument
NQN:blktests-subsystem-1 disconnected 1 controller(s)
Test complete

# cat results/nodev/nvme/045.out.bad
Running nvme/045
Re-authenticate with original host key
Renew host key on the controller
Re-authenticate with new host key
Renew ctrl key on the controller
Re-authenticate with new ctrl key
Change DH group to ffdhe8192
tests/nvme/rc: line 780: echo: write error: Invalid argument
Re-authenticate with changed DH group
Change hash to hmac(sha512)
Re-authenticate with changed hash
NQN:blktests-subsystem-1 disconnected 1 controller(s)
Test complete

# dmesg
[   69.957138] run blktests nvme/043 at 2023-08-30 07:09:40
[   69.978405] nvmet: adding nsid 1 to subsystem blktests-subsystem-1
[   70.014107] nvmet: creating nvm controller 1 for subsystem
blktests-subsystem-1 for NQN
nqn.2014-08.org.nvmexpress:uuid:0f01fb42-9f7f-4856-b0b3-51e60b8de349
with DH-HMAC-CHAP.
[   70.035854] nvme nvme0: qid 0: authenticated with hash hmac(sha256)
dhgroup null
[   70.044156] nvme nvme0: qid 0: authenticated
[   70.049073] nvme nvme0: creating 56 I/O queues.
[   70.267615] nvme nvme0: new ctrl: "blktests-subsystem-1"
[   70.295125] nvme nvme0: Removing ctrl: NQN "blktests-subsystem-1"
[   70.725627] nvmet: creating nvm controller 1 for subsystem
blktests-subsystem-1 for NQN
nqn.2014-08.org.nvmexpress:uuid:0f01fb42-9f7f-4856-b0b3-51e60b8de349
with DH-HMAC-CHAP.
[   70.747942] nvme nvme0: qid 0: authenticated with hash hmac(sha384)
dhgroup null
[   70.756237] nvme nvme0: qid 0: authenticated
[   70.761208] nvme nvme0: creating 56 I/O queues.
[   70.991654] nvme nvme0: new ctrl: "blktests-subsystem-1"
[   71.017200] nvme nvme0: Removing ctrl: NQN "blktests-subsystem-1"
[   71.435492] nvmet: creating nvm controller 1 for subsystem
blktests-subsystem-1 for NQN
nqn.2014-08.org.nvmexpress:uuid:0f01fb42-9f7f-4856-b0b3-51e60b8de349
with DH-HMAC-CHAP.
[   71.457799] nvme nvme0: qid 0: authenticated with hash hmac(sha512)
dhgroup null
[   71.466085] nvme nvme0: qid 0: authenticated
[   71.471047] nvme nvme0: creating 56 I/O queues.
[   71.699797] nvme nvme0: new ctrl: "blktests-subsystem-1"
[   71.725256] nvme nvme0: Removing ctrl: NQN "blktests-subsystem-1"
[   72.153759] nvmet: creating nvm controller 1 for subsystem
blktests-subsystem-1 for NQN
nqn.2014-08.org.nvmexpress:uuid:0f01fb42-9f7f-4856-b0b3-51e60b8de349
with DH-HMAC-CHAP.
[   72.172640] nvme nvme0: qid 0: authenticated with hash hmac(sha512)
dhgroup ffdhe2048
[   72.181470] nvme nvme0: qid 0: authenticated
[   72.186384] nvme nvme0: creating 56 I/O queues.
[   72.282281] nvme nvme0: new ctrl: "blktests-subsystem-1"
[   72.310214] nvme nvme0: Removing ctrl: NQN "blktests-subsystem-1"
[   72.766366] nvmet: creating nvm controller 1 for subsystem
blktests-subsystem-1 for NQN
nqn.2014-08.org.nvmexpress:uuid:0f01fb42-9f7f-4856-b0b3-51e60b8de349
with DH-HMAC-CHAP.
[   72.787046] nvme nvme0: qid 0: authenticated with hash hmac(sha512)
dhgroup ffdhe3072
[   72.795893] nvme nvme0: qid 0: authenticated
[   72.800826] nvme nvme0: creating 56 I/O queues.
[   72.990987] nvme nvme0: new ctrl: "blktests-subsystem-1"
[   73.020641] nvme nvme0: Removing ctrl: NQN "blktests-subsystem-1"
[   73.523419] nvmet: creating nvm controller 1 for subsystem
blktests-subsystem-1 for NQN
nqn.2014-08.org.nvmexpress:uuid:0f01fb42-9f7f-4856-b0b3-51e60b8de349
with DH-HMAC-CHAP.
[   73.550242] nvme nvme0: qid 0: authenticated with hash hmac(sha512)
dhgroup ffdhe4096
[   73.559040] nvme nvme0: qid 0: authenticated
[   73.563938] nvme nvme0: creating 56 I/O queues.
[   74.113282] nvme nvme0: new ctrl: "blktests-subsystem-1"
[   74.142589] nvme nvme0: Removing ctrl: NQN "blktests-subsystem-1"
[   74.548668] alg: ffdhe6144(dh): test failed on vector 1, err=-22
[   74.555389] alg: self-tests for ffdhe6144(dh) using
ffdhe6144(qat-dh) failed (rc=-22)
[   74.555391] ------------[ cut here ]------------
[   74.569289] alg: self-tests for ffdhe6144(dh) using
ffdhe6144(qat-dh) failed (rc=-22)
[   74.569310] WARNING: CPU: 54 PID: 2303 at crypto/testmgr.c:5936
alg_test+0x516/0x630
[   74.586705] Modules linked in: nvme_loop nvmet nvme_fabrics
nvme_core nvme_common rfkill ixgbe sunrpc intel_rapl_msr
intel_rapl_common sb_edac x86_pkg_temp_thermal intel_powerclamp
coretemp ipmi_ssif kvm_intel pcspkr i2c_i801 kvm iTCO_wdt
iTCO_vendor_support pktcdvd mei_me irqbypass mdio rapl i2c_smbus
intel_cstate acpi_ipmi mei dca intel_uncore ipmi_si joydev
ipmi_devintf ipmi_msghandler lpc_ich acpi_pad acpi_power_meter fuse
loop zram xfs sd_mod sr_mod cdrom t10_pi ahci libahci qat_dh895xcc
crct10dif_pclmul crc32_pclmul crc32c_intel libata intel_qat
ghash_clmulni_intel mgag200 crc8 i2c_algo_bit wmi dm_mod
[   74.646779] CPU: 54 PID: 2303 Comm: cryptomgr_test Not tainted
6.6.0-0.rc0.20230829git1c59d383390f.59.eln130.x86_64 #1
[   74.658722] Hardware name: Intel Corporation S2600WTT/S2600WTT,
BIOS GRNDSDP1.86B.0046.R00.1502111331 02/11/2015
[   74.670081] RIP: 0010:alg_test+0x516/0x630
[   74.674655] Code: ff ff 4c 89 e6 4c 89 e7 41 89 c7 e8 d4 da fe ff
e9 37 ff ff ff 44 89 f9 48 89 ea 4c 89 ee 48 c7 c7 b8 54 62 ba e8 6a
66 b5 ff <0f> 0b e9 7d fe ff ff 48 89 c2 48 89 ee 48 c7 c7 f0 53 62 ba
45 89
[   74.695613] RSP: 0018:ffffbbb7c885fe10 EFLAGS: 00010286
[   74.701438] RAX: 0000000000000000 RBX: 0000000000000089 RCX: 0000000000000027
[   74.709413] RDX: ffff9058afca0848 RSI: 0000000000000001 RDI: ffff9058afca0840
[   74.717369] RBP: ffff9054ccf5cc00 R08: 0000000000000000 R09: ffffbbb7c885fca0
[   74.725335] R10: 0000000000000003 R11: ffffffffbb1e5f68 R12: 000000000000008a
[   74.733302] R13: ffff9054ccf5cc80 R14: 00000000ffffffff R15: 00000000ffffffea
[   74.741258] FS:  0000000000000000(0000) GS:ffff9058afc80000(0000)
knlGS:0000000000000000
[   74.750289] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   74.756701] CR2: 00007f6bbb4a0f08 CR3: 0000000340e20001 CR4: 00000000001706e0
[   74.764665] Call Trace:
[   74.767405]  <TASK>
[   74.769745]  ? alg_test+0x516/0x630
[   74.773640]  ? __warn+0x81/0x130
[   74.777245]  ? alg_test+0x516/0x630
[   74.781139]  ? report_bug+0x171/0x1a0
[   74.785232]  ? console_unlock+0x64/0x110
[   74.789612]  ? handle_bug+0x3a/0x70
[   74.793507]  ? exc_invalid_op+0x17/0x70
[   74.797788]  ? asm_exc_invalid_op+0x1a/0x20
[   74.802462]  ? alg_test+0x516/0x630
[   74.806356]  ? __update_idle_core+0x27/0xd0
[   74.811033]  ? __switch_to_asm+0x3e/0x70
[   74.815416]  ? finish_task_switch.isra.0+0x94/0x2c0
[   74.820862]  ? __schedule+0x28b/0x790
[   74.824954]  ? __pfx_cryptomgr_test+0x10/0x10
[   74.829818]  cryptomgr_test+0x24/0x40
[   74.833898]  kthread+0xe8/0x120
[   74.837412]  ? __pfx_kthread+0x10/0x10
[   74.841597]  ret_from_fork+0x34/0x50
[   74.845588]  ? __pfx_kthread+0x10/0x10
[   74.849773]  ret_from_fork_asm+0x1b/0x30
[   74.854155]  </TASK>
[   74.856594] ---[ end trace 0000000000000000 ]---
[   74.868165] nvmet: creating nvm controller 1 for subsystem
blktests-subsystem-1 for NQN
nqn.2014-08.org.nvmexpress:uuid:0f01fb42-9f7f-4856-b0b3-51e60b8de349
with DH-HMAC-CHAP.
[   74.895088] nvme nvme0: qid 0: authenticated with hash hmac(sha512)
dhgroup ffdhe4096
[   74.903903] nvme nvme0: qid 0: authenticated
[   74.908814] nvme nvme0: creating 56 I/O queues.
[   75.456877] nvme nvme0: new ctrl: "blktests-subsystem-1"
[   75.490947] nvme nvme0: Removing ctrl: NQN "blktests-subsystem-1"
[   75.894980] alg: ffdhe8192(dh): test failed on vector 1, err=-22
[   75.901702] alg: self-tests for ffdhe8192(dh) using
ffdhe8192(qat-dh) failed (rc=-22)
[   75.901703] ------------[ cut here ]------------
[   75.915598] alg: self-tests for ffdhe8192(dh) using
ffdhe8192(qat-dh) failed (rc=-22)
[   75.915607] WARNING: CPU: 54 PID: 2315 at crypto/testmgr.c:5936
alg_test+0x516/0x630
[   75.932994] Modules linked in: nvme_loop nvmet nvme_fabrics
nvme_core nvme_common rfkill ixgbe sunrpc intel_rapl_msr
intel_rapl_common sb_edac x86_pkg_temp_thermal intel_powerclamp
coretemp ipmi_ssif kvm_intel pcspkr i2c_i801 kvm iTCO_wdt
iTCO_vendor_support pktcdvd mei_me irqbypass mdio rapl i2c_smbus
intel_cstate acpi_ipmi mei dca intel_uncore ipmi_si joydev
ipmi_devintf ipmi_msghandler lpc_ich acpi_pad acpi_power_meter fuse
loop zram xfs sd_mod sr_mod cdrom t10_pi ahci libahci qat_dh895xcc
crct10dif_pclmul crc32_pclmul crc32c_intel libata intel_qat
ghash_clmulni_intel mgag200 crc8 i2c_algo_bit wmi dm_mod
[   75.993054] CPU: 54 PID: 2315 Comm: cryptomgr_test Tainted: G
 W         -------  ---
6.6.0-0.rc0.20230829git1c59d383390f.59.eln130.x86_64 #1
[   76.007905] Hardware name: Intel Corporation S2600WTT/S2600WTT,
BIOS GRNDSDP1.86B.0046.R00.1502111331 02/11/2015
[   76.019254] RIP: 0010:alg_test+0x516/0x630
[   76.023828] Code: ff ff 4c 89 e6 4c 89 e7 41 89 c7 e8 d4 da fe ff
e9 37 ff ff ff 44 89 f9 48 89 ea 4c 89 ee 48 c7 c7 b8 54 62 ba e8 6a
66 b5 ff <0f> 0b e9 7d fe ff ff 48 89 c2 48 89 ee 48 c7 c7 f0 53 62 ba
45 89
[   76.044777] RSP: 0018:ffffbbb7c88afe10 EFLAGS: 00010286
[   76.050602] RAX: 0000000000000000 RBX: 000000000000008a RCX: 0000000000000027
[   76.058568] RDX: ffff9058afca0848 RSI: 0000000000000001 RDI: ffff9058afca0840
[   76.066533] RBP: ffff9054ccf5e400 R08: 0000000000000000 R09: ffffbbb7c88afca0
[   76.074496] R10: 0000000000000003 R11: ffffffffbb1e5f68 R12: 000000000000008b
[   76.082460] R13: ffff9054ccf5e480 R14: 00000000ffffffff R15: 00000000ffffffea
[   76.090426] FS:  0000000000000000(0000) GS:ffff9058afc80000(0000)
knlGS:0000000000000000
[   76.099450] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   76.105862] CR2: 00007f6bbb4a0f08 CR3: 0000000340e20001 CR4: 00000000001706e0
[   76.113825] Call Trace:
[   76.116553]  <TASK>
[   76.118894]  ? alg_test+0x516/0x630
[   76.122780]  ? __warn+0x81/0x130
[   76.126388]  ? alg_test+0x516/0x630
[   76.130292]  ? report_bug+0x171/0x1a0
[   76.134381]  ? console_unlock+0x64/0x110
[   76.138759]  ? handle_bug+0x3a/0x70
[   76.142652]  ? exc_invalid_op+0x17/0x70
[   76.146933]  ? asm_exc_invalid_op+0x1a/0x20
[   76.151595]  ? alg_test+0x516/0x630
[   76.155480]  ? __update_idle_core+0x27/0xd0
[   76.160150]  ? __switch_to_asm+0x3e/0x70
[   76.164529]  ? finish_task_switch.isra.0+0x94/0x2c0
[   76.169973]  ? __schedule+0x28b/0x790
[   76.174060]  ? __pfx_cryptomgr_test+0x10/0x10
[   76.178922]  cryptomgr_test+0x24/0x40
[   76.183008]  kthread+0xe8/0x120
[   76.186515]  ? __pfx_kthread+0x10/0x10
[   76.190699]  ret_from_fork+0x34/0x50
[   76.194689]  ? __pfx_kthread+0x10/0x10
[   76.198872]  ret_from_fork_asm+0x1b/0x30
[   76.203251]  </TASK>
[   76.205688] ---[ end trace 0000000000000000 ]---
[   76.217339] nvmet: creating nvm controller 1 for subsystem
blktests-subsystem-1 for NQN
nqn.2014-08.org.nvmexpress:uuid:0f01fb42-9f7f-4856-b0b3-51e60b8de349
with DH-HMAC-CHAP.
[   76.244233] nvme nvme0: qid 0: authenticated with hash hmac(sha512)
dhgroup ffdhe4096
[   76.253049] nvme nvme0: qid 0: authenticated
[   76.257961] nvme nvme0: creating 56 I/O queues.
[   76.803497] nvme nvme0: new ctrl: "blktests-subsystem-1"
[   76.838043] nvme nvme0: Removing ctrl: NQN "blktests-subsystem-1"
[   77.580673] run blktests nvme/045 at 2023-08-30 07:09:48
[   77.604563] nvmet: adding nsid 1 to subsystem blktests-subsystem-1
[   77.621293] nvmet: creating nvm controller 1 for subsystem
blktests-subsystem-1 for NQN
nqn.2014-08.org.nvmexpress:uuid:0f01fb42-9f7f-4856-b0b3-51e60b8de349
with DH-HMAC-CHAP.
[   77.640212] nvme nvme0: qid 0: authenticated with hash hmac(sha256)
dhgroup ffdhe2048
[   77.648962] nvme nvme0: qid 0: controller authenticated
[   77.654884] nvme nvme0: qid 0: authenticated
[   77.659805] nvme nvme0: creating 56 I/O queues.
[   77.750259] nvme nvme0: new ctrl: "blktests-subsystem-1"
[   77.779762] nvme nvme0: re-authenticating controller
[   77.786634] nvme nvme0: qid 0: authenticated with hash hmac(sha256)
dhgroup ffdhe2048
[   77.795379] nvme nvme0: qid 0: controller authenticated
[   77.803966] nvme nvme0: re-authenticating controller
[   77.810766] nvme nvme0: qid 0: authenticated with hash hmac(sha256)
dhgroup ffdhe2048
[   77.819510] nvme nvme0: qid 0: controller authenticated
[   77.827801] nvme nvme0: re-authenticating controller
[   77.834727] nvme nvme0: qid 0: authenticated with hash hmac(sha256)
dhgroup ffdhe2048
[   77.843472] nvme nvme0: qid 0: controller authenticated
[   77.852087] nvme nvme0: re-authenticating controller
[   77.859042] nvme nvme0: qid 0: authenticated with hash hmac(sha256)
dhgroup ffdhe2048
[   77.867788] nvme nvme0: qid 0: controller authenticated
[   77.876093] nvme nvme0: re-authenticating controller
[   77.882985] nvme nvme0: qid 0: authenticated with hash hmac(sha512)
dhgroup ffdhe2048
[   77.891731] nvme nvme0: qid 0: controller authenticated
[   78.209366] nvme nvme0: Removing ctrl: NQN "blktests-subsystem-1"

-- 
Best Regards,
  Yi Zhang




More information about the Linux-nvme mailing list