[PATCH 00/30] KVM: arm64: Add support for protected guest memory with pKVM
Mostafa Saleh
smostafa at google.com
Fri Mar 13 08:31:30 PDT 2026
Hi Will,
On Mon, Jan 05, 2026 at 03:49:08PM +0000, Will Deacon wrote:
> Hi folks,
>
> Although pKVM has been shipping in Android kernels for a while now,
> protected guest (pVM) support has been somewhat languishing upstream.
> This has partly been because we've been waiting for guest_memfd() but
> also because it hasn't been clear how to expose pVMs to userspace (which
> is necessary for testing) without getting everything in place beforehand.
> This has led to frustration on both sides of the fence [1] and so this
> patch series attempts to get things moving again by exposing pVM
> features in an incremental fashion based on top of anonymous memory,
> which is what we have been using in Android. The big difference between
> this series and the Android implementation is the graceful handling of
> host stage-2 faults arising from accesses made using kernel mappings.
> The hope is that this will unblock pKVM upstreaming efforts while the
> guest_memfd() work continues to evolve.
>
> Specifically, this patch series implements support for protected guest
> memory with pKVM, where pages are unmapped from the host as they are
> faulted into the guest and can be shared back from the guest using pKVM
> hypercalls. Protected guests are created using a new machine type
> identifier and can be booted to a shell using the kvmtool patches
> available at [2], which finally means that we are able to test the pVM
> logic in pKVM. Since this is an incremental step towards full isolation
> from the host (for example, the CPU register state and DMA accesses are
> not yet isolated), creating a pVM requires a developer Kconfig option to
> be enabled in addition to booting with 'kvm-arm.mode=protected' and
> results in a kernel taint.
>
> More information about what is and what isn't implemented is described
> in the pkvm.rst documentation added by this series. The intention is to
> update this file as we introduce additional protection features and
> ultimately to remove the taint.
>
> The series is loosely structured as follows:
>
> Patch 1: A dependent pgtable fix that I sent out previously
> Patches 2-8: Cleanups/fixes to the existing code to prepare for pVMs
> Patches 9-14: Support for memory donation and reclaim
> Patches 15-22: Handling of bad host accesses to protected memory
> Patches 23-25: Support for SHARE and UNSHARE guest hypercalls
> Patches 26-27: UAPI and developer documentation
> Patches 28-30: Selftest additions for new page ownership transitions
>
> Patches are based on v6.19-rc4 and are also available at [3].
>
> All feedback welcome.
>
> Cheers,
>
> Will
>
> [1] https://lore.kernel.org/all/aS9rmMgNna7I5g4F@kernel.org/
> [2] https://git.kernel.org/pub/scm/linux/kernel/git/will/kvmtool.git/log/?h=pkvm
> [3] https://git.kernel.org/pub/scm/linux/kernel/git/will/linux.git/log/?h=kvm/protected-memory
>
> Cc: Marc Zyngier <maz at kernel.org>
> Cc: Oliver Upton <oupton at kernel.org>
> Cc: Joey Gouly <joey.gouly at arm.com>
> Cc: Suzuki K Poulose <suzuki.poulose at arm.com>
> Cc: Zenghui Yu <yuzenghui at huawei.com>
> Cc: Catalin Marinas <catalin.marinas at arm.com>
> Cc: Quentin Perret <qperret at google.com>
> Cc: Fuad Tabba <tabba at google.com>
> Cc: Vincent Donnefort <vdonnefort at google.com>
> Cc: Mostafa Saleh <smostafa at google.com>
>
> --->8
>
> Fuad Tabba (1):
> KVM: arm64: Expose self-hosted debug regs as RAZ/WI for protected
> guests
>
> Quentin Perret (2):
> KVM: arm64: Refactor enter_exception64()
> KVM: arm64: Inject SIGSEGV on illegal accesses
>
> Will Deacon (27):
> KVM: arm64: Invert KVM_PGTABLE_WALK_HANDLE_FAULT to fix pKVM walkers
> KVM: arm64: Remove redundant 'pgt' pointer checks from MMU notifiers
> KVM: arm64: Rename __pkvm_pgtable_stage2_unmap()
> KVM: arm64: Don't advertise unsupported features for protected guests
> KVM: arm64: Remove pointless is_protected_kvm_enabled() checks from
> hyp
> KVM: arm64: Ignore MMU notifier callbacks for protected VMs
> KVM: arm64: Prevent unsupported memslot operations on protected VMs
> KVM: arm64: Split teardown hypercall into two phases
> KVM: arm64: Introduce __pkvm_host_donate_guest()
> KVM: arm64: Hook up donation hypercall to pkvm_pgtable_stage2_map()
> KVM: arm64: Handle aborts from protected VMs
> KVM: arm64: Introduce __pkvm_reclaim_dying_guest_page()
> KVM: arm64: Hook up reclaim hypercall to pkvm_pgtable_stage2_destroy()
> KVM: arm64: Generalise kvm_pgtable_stage2_set_owner()
> KVM: arm64: Introduce host_stage2_set_owner_metadata_locked()
> KVM: arm64: Annotate guest donations with handle and gfn in host
> stage-2
> KVM: arm64: Introduce hypercall to force reclaim of a protected page
> KVM: arm64: Reclaim faulting page from pKVM in spurious fault handler
> KVM: arm64: Return -EFAULT from VCPU_RUN on access to a poisoned pte
> KVM: arm64: Add hvc handler at EL2 for hypercalls from protected VMs
> KVM: arm64: Implement the MEM_SHARE hypercall for protected VMs
> KVM: arm64: Implement the MEM_UNSHARE hypercall for protected VMs
> KVM: arm64: Allow userspace to create protected VMs when pKVM is
> enabled
> KVM: arm64: Add some initial documentation for pKVM
> KVM: arm64: Extend pKVM page ownership selftests to cover guest
> donation
> KVM: arm64: Register 'selftest_vm' in the VM table
> KVM: arm64: Extend pKVM page ownership selftests to cover forced
> reclaim
I tested the patches on Lenovo ideacenter Mini X Gen 10 Snapdragon with
nvhe as for some reason I am facing issues with hvhe on this HW even
with upstream.
I can boot ToT Linux kernel as both protected and non-protected VMs using
the kvmtool version in here.
For reference, I am using:
- Config: defconfig + CONFIG_PROTECTED_VM_UAPI + CONFIG_ARM_PKVM_GUEST
- Run: ./lkvm-static run --irqchip gicv3 -k Image -d rootfs.ext2 --force-pci -c 1 --debug (--protected)
For the whole series:
Tested-by: Mostafa Saleh <smostafa at google.com>
Thanks,
Mostafa
>
> .../admin-guide/kernel-parameters.txt | 4 +-
> Documentation/virt/kvm/arm/index.rst | 1 +
> Documentation/virt/kvm/arm/pkvm.rst | 101 ++++
> arch/arm64/include/asm/kvm_asm.h | 7 +-
> arch/arm64/include/asm/kvm_emulate.h | 5 +
> arch/arm64/include/asm/kvm_host.h | 7 +
> arch/arm64/include/asm/kvm_pgtable.h | 27 +-
> arch/arm64/include/asm/kvm_pkvm.h | 4 +-
> arch/arm64/include/asm/virt.h | 6 +
> arch/arm64/kvm/Kconfig | 10 +
> arch/arm64/kvm/arm.c | 8 +-
> arch/arm64/kvm/hyp/exception.c | 100 ++--
> arch/arm64/kvm/hyp/include/nvhe/mem_protect.h | 9 +
> arch/arm64/kvm/hyp/include/nvhe/memory.h | 6 +
> arch/arm64/kvm/hyp/include/nvhe/pkvm.h | 7 +-
> arch/arm64/kvm/hyp/nvhe/hyp-main.c | 95 ++--
> arch/arm64/kvm/hyp/nvhe/mem_protect.c | 500 ++++++++++++++++--
> arch/arm64/kvm/hyp/nvhe/pkvm.c | 223 +++++++-
> arch/arm64/kvm/hyp/nvhe/switch.c | 1 +
> arch/arm64/kvm/hyp/nvhe/sys_regs.c | 8 +
> arch/arm64/kvm/hyp/pgtable.c | 22 +-
> arch/arm64/kvm/mmu.c | 122 ++++-
> arch/arm64/kvm/pkvm.c | 149 +++++-
> arch/arm64/mm/fault.c | 31 +-
> include/uapi/linux/kvm.h | 5 +
> 25 files changed, 1249 insertions(+), 209 deletions(-)
> create mode 100644 Documentation/virt/kvm/arm/pkvm.rst
>
> --
> 2.52.0.351.gbe84eed79e-goog
>
More information about the linux-arm-kernel
mailing list