[PATCH v24 03/20] iov_iter: skip copy if src == dst for direct data placement
David Laight
David.Laight at ACULAB.COM
Tue Apr 16 13:30:09 PDT 2024
From: Aurelien Aptel
> Sent: 04 April 2024 13:37
>
> From: Ben Ben-Ishay <benishay at nvidia.com>
>
> When using direct data placement (DDP) the NIC could write the payload
> directly into the destination buffer and constructs SKBs such that
> they point to this data. To skip copies when SKB data already resides
> in the destination buffer we check if (src == dst), and skip the copy
> when it's true.
...
> diff --git a/lib/iov_iter.c b/lib/iov_iter.c
> index 4a6a9f419bd7..a85125485174 100644
> --- a/lib/iov_iter.c
> +++ b/lib/iov_iter.c
> @@ -62,7 +62,14 @@ static __always_inline
> size_t memcpy_to_iter(void *iter_to, size_t progress,
> size_t len, void *from, void *priv2)
> {
> - memcpy(iter_to, from + progress, len);
> + /*
> + * When using direct data placement (DDP) the hardware writes
> + * data directly to the destination buffer, and constructs
> + * IOVs such that they point to this data.
> + * Thus, when the src == dst we skip the memcpy.
> + */
> + if (iter_to != from + progress)
> + memcpy(iter_to, from + progress, len);
How must does this conditional cost for the normal case
when it is true?
I suspect it is mispredicted 50% of the time.
So, while it may speed up your test, the overall system
impact will be negative.
David
> return 0;
> }
>
> --
> 2.34.1
>
-
Registered Address Lakeside, Bramley Road, Mount Farm, Milton Keynes, MK1 1PT, UK
Registration No: 1397386 (Wales)
More information about the Linux-nvme
mailing list