[PATCH 00/10] nvme multipath support on top of nvme-4.13 branch
Anish M Jhaveri
anish.jhaveri at paviliondata.com
Mon Sep 11 21:20:48 PDT 2017
Hello everyone,
Please find patchset for supporting Multipathing using nvme namespace
and nvme controller.
Basic idea behind the design and implementation is to re-use the same
logic which is between generic nvme namespace and it's controller.
One controller to many namespaces. Similarly, this implementation uses
one multipath controller and sibling namespaces.
It creates a head multipath nvme namespace as soon as it find a nvme
namespace during enumeration which has property of being shared. Prior
to creating new head multipath device, nvme namespace check for match-
ing NGUID, if it finds one, this nvme namespace is added as a sibling
to that given namespaces head device.
Failover is triggered either due to keep-alive timer expiration or RDMA
timeout. Selection is of device is based on first available standby
device. As of present this implementation support Active-Standby multi-
path model.
On selection of device, a command is sent to target for acknowledgement
of active device. In meanwhile if any IO are received, they get queued
under head multipath device congestion queue and processed as soon as
a single path becomes active. In scenario where new active path results
in failure, it will cancel those IOs after multiple retries.
I have gone through the solutiion Christoph Hellwig suggested and this
one follow similar path except for it doesn't require any change from
kernel and will work prior version of kernel.
It can made standalone module and be used with other block devices as
we open any block device handle.
It has been tested with interface up/down on host and target, target
node crash and disconnect command. Performance has been tested with
multiple multipath devices on single host and there is un-noticeable
difference in numbers.
The git tree for above changes is available at
https://github.com/paviliondata/nvme.git
Branch nvme-4.13
Web interface
https://github.com/paviliondata/nvme/tree/nvme-4.13
Please peruse through the patchset and comment.
Anish M Jhaveri (10):
Initial multipath implementation.
RDMA timeout triggers failover.
Failover timeout and time between failover same ns.
NVME command to set namespace active.
Init multipath head controller.
Init multipath head namespace.
Selection of active namespace.
Multipath make request, retry and cancel IO.
Sysfs entries for multipath head
Reserved tag for active ns command
drivers/nvme/host/core.c | 1245 +++++++++++++++++++++++++++++++++++++++++++++-
drivers/nvme/host/nvme.h | 37 +-
drivers/nvme/host/rdma.c | 5 +-
3 files changed, 1259 insertions(+), 28 deletions(-)
--
2.9.3
More information about the Linux-nvme
mailing list