[PATCH 1/2] arm64/gettimeofday: correct the note about isb in __arch_get_hw_counter()
Will Deacon
will at kernel.org
Tue Mar 30 12:08:27 BST 2021
On Tue, Mar 30, 2021 at 06:57:18PM +0800, Pingfan Liu wrote:
> The seq lock in vdso_read_retry() is behind smp_rmb(), and can not be
> speculated before the counter value due to the read dependency. Hence
> the original note is misleading.
>
> The description of getting counter value is not very clear. [1]
> 'mrs Xt, cntpct' may execute out of program order, either forward or
> backward.
>
> Hence this isb is still required to protect against backward speculation.
> Correct the note around the code to show the motivation.
>
> [1]: AArch64 Programmer's Guides Generic Timer: 3.1. Count and frequency
> Signed-off-by: Pingfan Liu <kernelfans at gmail.com>
> Cc: Catalin Marinas <catalin.marinas at arm.com>
> Cc: Will Deacon <will at kernel.org>
> Cc: Vincenzo Frascino <vincenzo.frascino at arm.com>
> Cc: Thomas Gleixner <tglx at linutronix.de>
> Cc: Mark Rutland <mark.rutland at arm.com>
> Cc: Andrei Vagin <avagin at gmail.com>
> Cc: Marc Zyngier <maz at kernel.org>
> To: linux-arm-kernel at lists.infradead.org
> ---
> arch/arm64/include/asm/vdso/compat_gettimeofday.h | 9 ++++++---
> arch/arm64/include/asm/vdso/gettimeofday.h | 9 ++++++---
> 2 files changed, 12 insertions(+), 6 deletions(-)
>
> diff --git a/arch/arm64/include/asm/vdso/compat_gettimeofday.h b/arch/arm64/include/asm/vdso/compat_gettimeofday.h
> index 7508b0ac1d21..b5dfda25a5dc 100644
> --- a/arch/arm64/include/asm/vdso/compat_gettimeofday.h
> +++ b/arch/arm64/include/asm/vdso/compat_gettimeofday.h
> @@ -123,10 +123,13 @@ static __always_inline u64 __arch_get_hw_counter(s32 clock_mode,
> isb();
> asm volatile("mrrc p15, 1, %Q0, %R0, c14" : "=r" (res));
> /*
> - * This isb() is required to prevent that the seq lock is
> - * speculated.
> + * Getting count value may execute out of program order, either forward
> + * or backward. Although the caller has a read dependency on @res, but
> + * it can not protect backward speculation against no dependency
> + * instruction. Beside this purpose, this isb also severs as a
> + * compiler barrier for this __always_inline function.
I agree that the existing comment is pretty rubbish, but I don't think this
is really much better.
> diff --git a/arch/arm64/include/asm/vdso/gettimeofday.h b/arch/arm64/include/asm/vdso/gettimeofday.h
> index 631ab1281633..6988a730b878 100644
> --- a/arch/arm64/include/asm/vdso/gettimeofday.h
> +++ b/arch/arm64/include/asm/vdso/gettimeofday.h
> @@ -84,10 +84,13 @@ static __always_inline u64 __arch_get_hw_counter(s32 clock_mode,
> isb();
> asm volatile("mrs %0, cntvct_el0" : "=r" (res) :: "memory");
> /*
> - * This isb() is required to prevent that the seq lock is
> - * speculated.#
> + * Getting count value may execute out of program order, either forward
> + * or backward. Although the caller has a read dependency on @res, but
> + * it can not protect backward speculation against no dependency
> + * instruction. Beside this purpose, this isb also severs as a
> + * compiler barrier for this __always_inline function.
> */
> - isb();
> + isb();
This ISB doesn't exist in linux-next (I've changed it to use the dependency
trick, which you seem to have doubts about).
Will
More information about the linux-arm-kernel
mailing list