nvmeof Issues with Zen 3/Ryzen 5000 Initiator

[Jonathan Wright]

I grabbed/built the kernel from the nvme-5.14 branch 
(http://git.infradead.org/nvme.git/shortlog/refs/heads/nvme-5.14) and 
managed to get the NIC drivers compiled.

Unfortunately the issue still persists.

Target:
[  790.591424] nvmet: ctrl 1 keep-alive timer (5 seconds) expired!
[  790.591846] nvmet: ctrl 1 fatal error occurred!

Initiator:
[  688.683933] nvme nvme2: I/O 1 QID 2 timeout
[  688.684066] nvme nvme2: starting error recovery
[  688.684089] nvme nvme2: I/O 2 QID 2 timeout
[  691.756492] nvme nvme2: I/O 3 QID 2 timeout
[  691.756522] nvme nvme2: I/O 4 QID 2 timeout
[  691.756542] nvme nvme2: I/O 5 QID 2 timeout
[  691.756561] nvme nvme2: I/O 6 QID 2 timeout
[  691.756578] nvme nvme2: I/O 7 QID 2 timeout
[  691.757922] nvme nvme2: I/O 8 QID 2 timeout
[  691.758995] nvme nvme2: I/O 9 QID 2 timeout
[  691.760063] nvme nvme2: I/O 10 QID 2 timeout
[  691.761129] nvme nvme2: I/O 11 QID 2 timeout
[  691.762192] nvme nvme2: I/O 12 QID 2 timeout
[  691.763236] nvme nvme2: I/O 13 QID 2 timeout
[  691.764268] nvme nvme2: I/O 14 QID 2 timeout
[  691.765283] nvme nvme2: I/O 15 QID 2 timeout
[  691.766285] nvme nvme2: I/O 16 QID 2 timeout
[  691.767268] nvme nvme2: I/O 17 QID 2 timeout
[  691.768230] nvme nvme2: I/O 18 QID 2 timeout
[  691.768275] block nvme2n1: no usable path - requeuing I/O
[  691.769194] nvme nvme2: I/O 19 QID 2 timeout
[  691.770265] block nvme2n1: no usable path - requeuing I/O
[  691.771210] nvme nvme2: I/O 20 QID 2 timeout
[  691.772159] block nvme2n1: no usable path - requeuing I/O
[  691.773086] nvme nvme2: I/O 21 QID 2 timeout
<snip>

[root at nvmeof-client-centos ~]# uname -a
Linux nvmeof-client-centos 5.12.0+ #2 SMP Wed May 26 18:39:31 EDT 2021 
x86_64 x86_64 x86_64 GNU/Linux

I wasn't totally sure who to start talking to about this issue but I 
became pretty confident that it wasn't distro-specific which is why I 
sent my message here.  If I'm still in the wrong place please let me know.

On 5/26/21 4:50 PM, Chaitanya Kulkarni wrote:
> On 5/26/21 13:53, Jonathan Wright wrote:
>> Here are some things I've tried which make no difference (or make things
>> worse):
>>
>> Ubuntu 20.04.2 kernel 5.4.
>> Ubuntu 20.04.2 kernel 5.8
>> Ubuntu 20.04.2 kernel 5.10
>> CentOS 8 kernel 4.18
>> CentOS 8 kernel 5.10 (from elrepo)
>> CentOS 8 kernel 5.12 (from elrepo) - whole system actually freezes upon
>> "nvme connect" command on this one
>> With and without multipath (native)
>> With and without round-robin on multipath (native)
>> Different NVMe drive models
>> With and without PFC
>> 10G DAC
>> 25G DAC
>> 25G DAC negotiated at 10G
>> With and without a switch
>> iWARP and RoCE2
> I think you need to talk to respective distros.
>
> Have you seen any issues with the nvme repo branch 5.14 ?
>
>
>
> _______________________________________________
> Linux-nvme mailing list
> Linux-nvme at lists.infradead.org
> http://lists.infradead.org/mailman/listinfo/linux-nvme

-- 
Jonathan Wright
KnownHost, LLC
https://www.knownhost.com