[PATCHv2 0/3] nvme-tcp: improve scalability

Sagi Grimberg sagi at grimberg.me
Wed Jul 10 04:56:12 PDT 2024



On 08/07/2024 10:10, Hannes Reinecke wrote:
> Hi all,
>
> for workloads with a lot of controllers we run into workqueue contention,
> where the single workqueue is not able to service requests fast enough,
> leading to spurious I/O errors and connect resets during high load.
> This patchset improves the situation by improve the fairness between
> rx and tx scheduling, introducing per-controller workqueues,
> and distribute the load accoring to the blk-mq cpu mapping.
> With this we reduce the spurious I/O errors and improve the overall
> performance for highly contended workloads.
>
> All performance number are derived from the 'tiobench-example.fio'

Did you keep the fio file unmodified? I'd suggest to run it for longer
say 60 seconds each workload. 512 MB is a very short benchmark...



More information about the Linux-nvme mailing list