From mboxrd@z Thu Jan 1 00:00:00 1970 Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.remote-ip=217.140.110.172 ARC-Seal: i=1; d=subspace.kernel.org; s=arc20261015; a=rsa-sha256; cv=none; t=1793039267; b=cLcBfBOAy2hgVDLAzVU1Ed/nVMFzo9fX4FUzCKBtOs58jXp9JqxYskx9Hgf1ll6e78Rq UyPj4wBWRJYkjeRGZvtGcQivx/YfK6eLOYsrbYQQtsIpYZUCY8qoDiDMKUqydwPxbyNxd aYCxLQLdEpqVGRic7uhJLaVEb5k24bJDbgRhpcqO7dIHDM6odSsvlQ0GljYZHWTTT0IL3 DJa7RFz2T1GvJuiZVK6j8DhH/Lp431krVgbjAqCZ3CuF31Mvk20I69kfmI4Yhhl2NrG+I fXlR4mAC9y8re3Mm+JGzLcF6Bdf8ltsTkuFDog7PBgbvavSrdlXHMBUtT/JUwPjewow== ARC-Message-Signature: i=1; d=subspace.kernel.org; s=arc20261015; a=rsa-sha256; c=relaxed/relaxed; t=1793039267; h=DMARC-Filter:Received:Received:DKIM-Signature:From:To:Cc:Subject: Date:Message-ID:X-Mailer:In-Reply-To:References:MIME-Version: Content-Type:Content-Disposition:Content-Transfer-Encoding; bh=m17HfQlom9o+TT+ICKW4l/FrhcCsf51TXru61RqQFHU=; b=hgVJOcexIBZ+LFc+tyXZrIqHc7vMD0A4k4xrNQYxzG10oJ5kU+lvMilDCKxYyrZp/nEy DS0k1XslpOtmAUy1f9SypLoODUD+umHTn5BSTqUrD8whHzdsrCf+fsa1txT6161iZu8If I4k1ZtWN85+/3opn71mXLRaEFa13Vd3EqWBJODXHhP1JAl+AUyPAPGCg/DegBBnjRhAwB kHW87/6WK4X2OisZhTJeY9/tdGrXscLGYDuvFRV5EN2vwRbRzA3BxL8cvwQZjvn1JAIsU uIDaXxUYCbiYicVa6q/zQE0HPPRpYw5V4DBV4iUBHGl8ZIt/Ro84PTxhlKHuFgYvhrg== ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass header.from=arm.com; spf=pass smtp.mailfrom=arm.com; dkim=pass header.d=arm.com header.i=@arm.com header.a=rsa-sha256 header.s=foss header.b=rDZORlbL; arc=none smtp.remote-ip=217.140.110.172 Received: from foss.arm.com (foss.arm.com [217.140.110.172]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 13A45606A31A; Mon, 26 Oct 2026 18:27:46 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.4.2 smtp.subspace.kernel.org 13A45606A31A Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=arm.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=arm.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key, unprotected) header.d=arm.com header.i=@arm.com header.a=rsa-sha256 header.s=foss header.b=rDZORlbL Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id D346715A1; Mon, 26 Oct 2026 11:27:42 -0700 (PDT) Received: from LeoBrasDK.cambridge.arm.com (LeoBrasDK.cambridge.arm.com [10.2.212.21]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPSA id 4D4E83F7B4; Mon, 26 Oct 2026 11:27:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=arm.com; s=foss; t=1793039266; bh=eG5wufS78QQNgfSshH/td64uy1yHCNMpaJvaYmYGfrA=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=rDZORlbLJSkDBw0L1OYNKgQBsQDLudUmm2rxG3aC2uFon44hbr3Z3V+PdCRwX641q U70qCW4CWzq/Wgsrgzh1Hb4thbbeyZDM+0AvokIZ5Fn76ZGTnx7nyE/fuNA7hvPTuS octvaayC0l/xT4uiFfN/oMiHrI4lu9A1SWOutTgc= From: Leonardo Bras To: Tian Zheng Cc: Leonardo Bras , maz@kernel.org, oupton@kernel.org, catalin.marinas@arm.com, will@kernel.org, corbet@lwn.net, pbonzini@redhat.com, yuzenghui@huawei.com, wangzhou1@hisilicon.com, yangjinqian1@huawei.com, caijian11@h-partners.com, liuyonglong@huawei.com, tangchengchang@huawei.com, yezhenyu2@huawei.com, yubihong@huawei.com, linuxarm@huawei.com, joey.gouly@arm.com, kvmarm@lists.linux.dev, kvm@vger.kernel.org, linux-arm-kernel@lists.infradead.org, linux-kernel@vger.kernel.org, seiden@linux.ibm.com, suzuki.poulose@arm.com, fuad.tabba@linux.dev, mark.rutland@arm.com, seanjc@google.com, rdunlap@infradead.org, linux-doc@vger.kernel.org, linux-kselftest@vger.kernel.org, skhan@linuxfoundation.org Subject: Re: [PATCH v5 07/15] KVM: arm64: Add HDBSS per-vCPU buffer management Date: Mon, 26 Oct 2026 18:27:40 +0000 Message-ID: X-Mailer: git-send-email 2.56.0 In-Reply-To: <20260929103655.85107-8-zhengtian10@huawei.com> References: <20260929103655.85107-1-zhengtian10@huawei.com> <20260929103655.85107-8-zhengtian10@huawei.com> X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Post: List-Help: List-Subscribe: List-Unsubscribe: List-Owner: Precedence: list MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: 8bit On Tue, Sep 29, 2026 at 06:36:47PM +0800, Tian Zheng wrote: > From: Eillon > > Each vCPU owns an HDBSS buffer, described by HDBSSBR_EL2 (base > address and encoded size) and advanced by HDBSSPROD_EL2 as hardware > appends entries. Tie the buffer lifetime to the vCPU: allocate at > vCPU creation, free at destruction. The buffer is allocated zeroed, > so a stale producer index can only ever observe invalid entries. > > Registers are programmed whenever the vCPU owns a buffer, regardless > of whether HDBSS is enabled. The feature can be turned on > mid-KVM_RUN, and hardware dirty-state updates write to > HDBSSBR_EL2.BADDR without any fault, so the registers must already > be in place by then. HDBSSPROD_EL2 is preserved across context > switches and vCPU migration. > > Two details: the buddy order is kept separate from the HDBSSBR_EL2.SZ > encoding, since the two only coincide on 4KB pages; and kvm_share_hyp() > is unwound in kvm_arch_vcpu_create() when the HDBSS allocation fails. Out of curiosity: why can't we allocate the buffers when dirty-tracking starts? (and free them when it stops) Since we have to request the vcpus to guest_exit, and enable VTCR_EL2{HA,HD,HDBSS}, we could as well allocate the buffers and set the HDBSSBR_EL2.BADDR. In case the buffer allocation fails, we could just not enable HDBSS, maybe. Buffer allocation could happen before the VCPU request, for every vcpu, or during the vcpu request, so every vcpu allocates it's own buffer. Am I missing something, or is it just to make things easier? > > Signed-off-by: Eillon > Signed-off-by: Tian Zheng > --- > arch/arm64/include/asm/kvm_dirty_bit.h | 28 +++++++++++++ > arch/arm64/include/asm/kvm_host.h | 13 ++++++ > arch/arm64/include/asm/sysreg.h | 9 +++++ > arch/arm64/kvm/Makefile | 1 + > arch/arm64/kvm/arm.c | 14 ++++++- > arch/arm64/kvm/dirty_bit.c | 55 ++++++++++++++++++++++++++ > arch/arm64/kvm/hyp/vhe/switch.c | 17 ++++++++ > arch/arm64/kvm/reset.c | 3 ++ > 8 files changed, 138 insertions(+), 2 deletions(-) > create mode 100644 arch/arm64/include/asm/kvm_dirty_bit.h > create mode 100644 arch/arm64/kvm/dirty_bit.c > > diff --git a/arch/arm64/include/asm/kvm_dirty_bit.h b/arch/arm64/include/asm/kvm_dirty_bit.h > new file mode 100644 > index 000000000000..fe703f02626b > --- /dev/null > +++ b/arch/arm64/include/asm/kvm_dirty_bit.h > @@ -0,0 +1,28 @@ > +/* SPDX-License-Identifier: GPL-2.0-only */ > +/* > + * Per-vCPU buffer management for HDBSS-based dirty page tracking. > + * > + * Copyright (C) 2026 Huawei Technologies Co., Ltd > + * Author: Tian Zheng > + */ > + > +#ifndef __ARM64_KVM_DIRTY_BIT_H__ > +#define __ARM64_KVM_DIRTY_BIT_H__ > + > +#include > +#include > +#include > + > +#define KVM_ARM_HDBSS_DEFAULT_SIZE PAGE_SIZE > +#define KVM_ARM_HDBSS_MAX_SIZE SZ_2M > + > +/* 0 means unconfigured, fall back to one page per vCPU. */ > +static inline u32 kvm_hdbss_buffer_size(struct kvm *kvm) > +{ > + return kvm->arch.hdbss_buffer_size ?: KVM_ARM_HDBSS_DEFAULT_SIZE; > +} Why not set arch.hdbss_buffer_size to KVM_ARM_HDBSS_DEFAULT_SIZE at start, instead of testing it here like this? > + > +int kvm_arm_vcpu_alloc_hdbss(struct kvm_vcpu *vcpu); > +void kvm_arm_vcpu_free_hdbss(struct kvm_vcpu *vcpu); > + > +#endif /* __ARM64_KVM_DIRTY_BIT_H__ */ > diff --git a/arch/arm64/include/asm/kvm_host.h b/arch/arm64/include/asm/kvm_host.h > index 86a4d6e50934..c8fc29f3db75 100644 > --- a/arch/arm64/include/asm/kvm_host.h > +++ b/arch/arm64/include/asm/kvm_host.h > @@ -425,6 +425,9 @@ struct kvm_arch { > */ > struct kvm_protected_vm pkvm; > > + /* HDBSS: per-VM buffer size in bytes (0 = not configured, use default) */ > + u32 hdbss_buffer_size; > + > #ifdef CONFIG_PTDUMP_STAGE2_DEBUGFS > /* Nested virtualization info */ > struct dentry *debugfs_nv_dentry; > @@ -844,6 +847,13 @@ struct vcpu_reset_state { > bool reset; > }; > > +struct vcpu_hdbss_state { > + struct page *hdbss_pg; /* HDBSS buffer */ > + u64 hdbssbr_el2; /* programmed into the CPU on load */ > + u64 hdbssprod_el2; /* producer index, saved on put */ > + unsigned int buddy_order; /* allocation order for __free_pages() */ > +}; > + > struct vncr_tlb; > > struct kvm_vcpu_arch { > @@ -951,6 +961,9 @@ struct kvm_vcpu_arch { > > /* Hyp-readable copy of kvm_vcpu::pid */ > pid_t pid; > + > + /* HDBSS buffer state */ > + struct vcpu_hdbss_state hdbss; > }; > > /* > diff --git a/arch/arm64/include/asm/sysreg.h b/arch/arm64/include/asm/sysreg.h > index 7aa08d59d494..7c71560b57e4 100644 > --- a/arch/arm64/include/asm/sysreg.h > +++ b/arch/arm64/include/asm/sysreg.h > @@ -1039,6 +1039,15 @@ > > #define GCS_CAP(x) ((((unsigned long)x) & GCS_CAP_ADDR_MASK) | \ > GCS_CAP_VALID_TOKEN) > + > +/* > + * Definitions for the HDBSS feature > + */ > +#define HDBSSBR_EL2(baddr, sz) (((baddr) & HDBSSBR_EL2_BADDR_MASK) | \ > + FIELD_PREP(HDBSSBR_EL2_SZ_MASK, sz)) > + > +#define HDBSSPROD_IDX(prod) FIELD_GET(HDBSSPROD_EL2_INDEX_MASK, prod) > + > /* > * Definitions for GICv5 instructions > */ > diff --git a/arch/arm64/kvm/Makefile b/arch/arm64/kvm/Makefile > index 59612d2f277c..ec2749af64fa 100644 > --- a/arch/arm64/kvm/Makefile > +++ b/arch/arm64/kvm/Makefile > @@ -18,6 +18,7 @@ kvm-y += arm.o mmu.o mmio.o psci.o hypercalls.o pvtime.o \ > guest.o debug.o reset.o sys_regs.o stacktrace.o \ > vgic-sys-reg-v3.o fpsimd.o pkvm.o \ > arch_timer.o trng.o vmid.o emulate-nested.o nested.o at.o \ > + dirty_bit.o \ > vgic/vgic.o vgic/vgic-init.o \ > vgic/vgic-irqfd.o vgic/vgic-v2.o \ > vgic/vgic-v3.o vgic/vgic-v4.o \ > diff --git a/arch/arm64/kvm/arm.c b/arch/arm64/kvm/arm.c > index d9ad765943d9..5ea4ac26995e 100644 > --- a/arch/arm64/kvm/arm.c > +++ b/arch/arm64/kvm/arm.c > @@ -36,6 +36,7 @@ > #include > #include > #include > +#include > #include > #include > #include > @@ -580,10 +581,19 @@ int kvm_arch_vcpu_create(struct kvm_vcpu *vcpu) > } > > err = kvm_share_hyp(vcpu, vcpu + 1); > - if (err) > + if (err) { > kvm_vgic_vcpu_destroy(vcpu); > + return err; > + } > > - return err; > + err = kvm_arm_vcpu_alloc_hdbss(vcpu); > + if (err) { > + kvm_unshare_hyp(vcpu, vcpu + 1); > + kvm_vgic_vcpu_destroy(vcpu); > + return err; > + } > + > + return 0; > } > > void kvm_arch_vcpu_postcreate(struct kvm_vcpu *vcpu) > diff --git a/arch/arm64/kvm/dirty_bit.c b/arch/arm64/kvm/dirty_bit.c > new file mode 100644 > index 000000000000..f9aeb9f34ad0 > --- /dev/null > +++ b/arch/arm64/kvm/dirty_bit.c > @@ -0,0 +1,55 @@ > +// SPDX-License-Identifier: GPL-2.0-only > +/* > + * Per-vCPU HDBSS buffer management. > + * > + * Copyright (C) 2026 Huawei Technologies Co., Ltd > + * Author: Tian Zheng > + */ > + > +#include > +#include > +#include > +#include > +#include > +#include > +#include > + > +int kvm_arm_vcpu_alloc_hdbss(struct kvm_vcpu *vcpu) > +{ > + struct page *hdbss_pg; > + u32 size; > + unsigned int buddy_order; > + u32 sz_encoded; > + > + if (vcpu->arch.hdbss.hdbss_pg || !system_supports_hdbss()) > + return 0; > + > + size = kvm_hdbss_buffer_size(vcpu->kvm); > + > + buddy_order = get_order(size); > + sz_encoded = ilog2(size) - 12; > + > + hdbss_pg = alloc_pages(GFP_KERNEL_ACCOUNT | __GFP_ZERO, buddy_order); > + if (!hdbss_pg) > + return -ENOMEM; > + > + vcpu->arch.hdbss = (struct vcpu_hdbss_state) { > + .hdbss_pg = hdbss_pg, > + .hdbssbr_el2 = HDBSSBR_EL2(page_to_phys(hdbss_pg), sz_encoded), > + .hdbssprod_el2 = 0, > + .buddy_order = buddy_order, > + }; > + > + return 0; > +} > + > +void kvm_arm_vcpu_free_hdbss(struct kvm_vcpu *vcpu) > +{ > + if (!vcpu->arch.hdbss.hdbss_pg) > + return; > + > + __free_pages(vcpu->arch.hdbss.hdbss_pg, vcpu->arch.hdbss.buddy_order); > + > + vcpu->arch.hdbss.hdbss_pg = NULL; > + vcpu->arch.hdbss.hdbssbr_el2 = 0; > +} > diff --git a/arch/arm64/kvm/hyp/vhe/switch.c b/arch/arm64/kvm/hyp/vhe/switch.c > index 7875911c0506..922fc9260e11 100644 > --- a/arch/arm64/kvm/hyp/vhe/switch.c > +++ b/arch/arm64/kvm/hyp/vhe/switch.c > @@ -19,6 +19,7 @@ > #include > #include > #include > +#include > #include > #include > #include > @@ -219,6 +220,17 @@ static void __vcpu_put_deactivate_traps(struct kvm_vcpu *vcpu) > local_irq_restore(flags); > } > > +static void __load_hdbss(struct kvm_vcpu *vcpu) > +{ > + if (!vcpu->arch.hdbss.hdbss_pg) > + return; > + > + write_sysreg_s(vcpu->arch.hdbss.hdbssbr_el2, SYS_HDBSSBR_EL2); > + write_sysreg_s(vcpu->arch.hdbss.hdbssprod_el2, SYS_HDBSSPROD_EL2); > + > + isb(); > +} > + > void kvm_vcpu_load_vhe(struct kvm_vcpu *vcpu) > { > host_data_ptr(host_ctxt)->__hyp_running_vcpu = vcpu; > @@ -226,10 +238,15 @@ void kvm_vcpu_load_vhe(struct kvm_vcpu *vcpu) > __vcpu_load_switch_sysregs(vcpu); > __vcpu_load_activate_traps(vcpu); > __load_stage2(vcpu->arch.hw_mmu); > + __load_hdbss(vcpu); > } > > void kvm_vcpu_put_vhe(struct kvm_vcpu *vcpu) > { > + /* Saved under the same ownership condition as __load_hdbss(). */ > + if (vcpu->arch.hdbss.hdbss_pg) > + vcpu->arch.hdbss.hdbssprod_el2 = read_sysreg_s(SYS_HDBSSPROD_EL2); Above suggestion would need you to reload HDBSSBR_EL2 as well. > + > __vcpu_put_deactivate_traps(vcpu); > __vcpu_put_switch_sysregs(vcpu); > > diff --git a/arch/arm64/kvm/reset.c b/arch/arm64/kvm/reset.c > index 10eb7249aa9e..05ebe304830e 100644 > --- a/arch/arm64/kvm/reset.c > +++ b/arch/arm64/kvm/reset.c > @@ -25,6 +25,7 @@ > #include > #include > #include > +#include > #include > #include > #include > @@ -149,6 +150,8 @@ void kvm_arm_vcpu_destroy(struct kvm_vcpu *vcpu) > free_page((unsigned long)vcpu->arch.ctxt.vncr_array); > kfree(vcpu->arch.vncr_tlb); > kfree(vcpu->arch.ccsidr); > + > + kvm_arm_vcpu_free_hdbss(vcpu); > } > > static void kvm_vcpu_reset_sve(struct kvm_vcpu *vcpu) > -- > 2.43.0 >