From: Tian Zheng <zhengtian10@huawei.com>
To: Leonardo Bras <leo.bras@arm.com>
Cc: <maz@kernel.org>, <oupton@kernel.org>, <catalin.marinas@arm.com>,
<will@kernel.org>, <corbet@lwn.net>, <pbonzini@redhat.com>,
<yuzenghui@huawei.com>, <wangzhou1@hisilicon.com>,
<yangjinqian1@huawei.com>, <caijian11@h-partners.com>,
<liuyonglong@huawei.com>, <tangchengchang@huawei.com>,
<yezhenyu2@huawei.com>, <yubihong@huawei.com>,
<linuxarm@huawei.com>, <joey.gouly@arm.com>,
<kvmarm@lists.linux.dev>, <kvm@vger.kernel.org>,
<linux-arm-kernel@lists.infradead.org>,
<linux-kernel@vger.kernel.org>, <seiden@linux.ibm.com>,
<suzuki.poulose@arm.com>, <fuad.tabba@linux.dev>,
<mark.rutland@arm.com>, <seanjc@google.com>,
<rdunlap@infradead.org>, <linux-doc@vger.kernel.org>,
<linux-kselftest@vger.kernel.org>, <skhan@linuxfoundation.org>
Subject: Re: [PATCH v5 05/15] KVM: arm64: Harvest stage-2 dirty state into the host folio account
Date: Fri, 6 Nov 2026 11:16:33 +0800 [thread overview]
Message-ID: <6e6fb626-d3d4-46f7-93ac-94e3d243eb69@huawei.com> (raw)
In-Reply-To: <auSMkdEhLI7k8QbV@LeoBrasDK>
On 10/30/2026 8:24 PM, Leonardo Bras wrote:
> On Thu, Oct 29, 2026 at 10:02:10PM +0800, Tian Zheng wrote:
>>
>>
>> On 10/27/2026 2:05 AM, Leonardo Bras wrote:
>>> Hi Tian,
>>> Sorry for the delay in reviewing...
>>>
>>> On Tue, Sep 29, 2026 at 06:36:45PM +0800, Tian Zheng wrote:
>>>> With VTCR_EL2.HD set, hardware promotes writable-clean descriptors to
>>>> writable-dirty without any VM exit, and the only record of the write
>>>> is the S2AP[1] bit in the stage-2 PTE. The write never passed through
>>>> the host stage-1, and no unmap path reads the bit, so the record dies
>>>> with the PTE and reclaim may discard written guest data (silent
>>>> corruption).
>>>
>>> Sorry, I didn't get what you are trying to achieve here.
>>>
>>> On your patch, I see you marking backing pages dirty at wrprotect and unmap
>>> walkers, and it's very confusing to me on why you are doing this.
>>>
>>> IIUC, what you are trying to do is make sure a page does not lose it's
>>> contents in case it is reclaimed by the OS.
>>>
>>> IIUC, when a page is reclaimed, it will unmap the S2 PTE, and save it's
>>> contents to swap, so when the guest read or write to that page will cause
>>> it to fault.
>>>
>>> The page can never be just unmaped, as if there was a single write to it,
>>> the backing pages should be writable, and the contents need to be saved
>>> somewhere.
>>>
>>> So, if I was able to understand your suggestion, we don't need to worry
>>> about this, and this patch wouldn't be necessary.
>>>
>>> Did you hit this issue?
>>> Can you please expand on your issue, if I could not describe it above?
>>>
>>> Thanks!
>>> Leo
>>
>> Hi Leo,
>>
>> Thanks for the review. I haven't hit this in practice, and based on your
>> analysis the patch doesn't look necessary.
>>
>> Reclaim only writes back folios whose PG_dirty flag is set; a clean
>> folio is simply freed. A stage-2 write never touches the host
>> stage-1, so the folio depends entirely on kvm_release_faultin_page()
>> at fault-in to be marked as dirty; without it, the page stays clean from
>> the host's perspective and reclaim drops the data.
>>
>
> Oh, okay. IIUC it will be enough if PG_dirty flag is set once, right?
>
> While on HAFDBS/HDBSS we will skip the fault for marking them dirty again,
> we always take the first fault for every PTE (or prefault them), so
> PG_dirty should always be set once the page is first wroten to.
>
>
>> Your **RFC v1** patch 2 changed that marking from writable to dirty:
>>
>> ```
>> - kvm_release_faultin_page(kvm, s2vi->page, !!ret, writable);
>> + kvm_release_faultin_page(kvm, s2vi->page, !!ret, dirty);
>> ```
>>
>> During logging, a read fault maps the page as WC: the folio is not
>> marked PG_dirty in kvm_s2_fault_map() and hardware promotes the PTE to
>> WD on write without any fault, so reclaim frees the page without saving
>> it (the folio was treated as clean).
>
> Ah, I see your point.
> During dirty-tracking guest reads a page, then HAFDBS promotes it to
> writable without marking it as dirty. Good catch!
>
> But wouldn't a simpler solution be to change the conditions in the fault
> handler, so that it indeed marks it as dirty if dirty-tracking is on, even
> if it's just a read fault?
>
> Thanks!
> Leo
>
Hi Leo,
Yes, that's exactly the simpler fix, and it's what I already did in
HDBSS v5 patch 2 — the folio is marked dirty for any write-permitting
mapping, so a read fault on a tracked memslot also marks it.
Since patch 2 covers this, patch 5 isn't needed. I'll drop it in the
next version.
Thanks,
Tian
>>
>> Therefore, **HDBSS v5** patch 2 reverted to marking the folio for any
>> write-permitting mapping:
>>
>> ```
>> kvm_release_faultin_page(kvm, s2vi->page, !!ret, writable);
>> ```
>>
>> Together with the v5 scheme, this makes patch 5 unnecessary:
>>
>> - kvm_s2_fault_compute_prot: always set PROT_W when map_writable
>> - stage2_set_prot_attr: PROT_W -> DBM unconditionally
>>
>>
>> ---------
>>
>> On a related note, I'd like to discuss the next version of the DBM
>> scheme, following Oliver's suggestion [1].
>
> Just as a note for future readers: on another thread we agreed to wait for
> the discussion to reach a point we are all happy before rebasing
> everything.
next prev parent reply other threads:[~2026-11-06 3:16 UTC|newest]
Thread overview: 51+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-09-29 10:36 [PATCH v5 00/15] KVM: arm64: FEAT_HDBSS support for stage-2 dirty tracking Tian Zheng
2026-09-29 10:36 ` [PATCH v5 01/15] KVM: arm64: pgtables: Change write bit from S2AP_W to DBM Tian Zheng
2026-09-30 0:25 ` Oliver Upton
2026-09-30 2:44 ` Tian Zheng
2026-10-26 15:02 ` Leonardo Bras
2026-10-29 7:08 ` Tian Zheng
2026-09-29 10:36 ` [PATCH v5 02/15] KVM: arm64: Add KVM_PGTABLE_PROT_DIRTY Tian Zheng
2026-09-30 0:35 ` Oliver Upton
2026-09-30 2:57 ` Tian Zheng
2026-09-29 10:36 ` [PATCH v5 03/15] KVM: arm64: Introduce a dedicated walker for stage2 write-protect Tian Zheng
2026-09-29 10:36 ` [PATCH v5 04/15] KVM: arm64: Add KVM_REQ_RELOAD_STAGE2 Tian Zheng
2026-09-29 10:36 ` [PATCH v5 05/15] KVM: arm64: Harvest stage-2 dirty state into the host folio account Tian Zheng
2026-10-26 18:05 ` Leonardo Bras
2026-10-29 14:02 ` Tian Zheng
2026-10-30 12:24 ` Leonardo Bras
2026-11-06 3:16 ` Tian Zheng [this message]
2026-11-06 12:04 ` Leonardo Bras
2026-09-29 10:36 ` [PATCH v5 06/15] KVM: arm64: Add support for FEAT_HDBSS Tian Zheng
2026-10-26 18:12 ` Leonardo Bras
2026-10-30 2:53 ` Tian Zheng
2026-10-30 14:15 ` Leonardo Bras
2026-09-29 10:36 ` [PATCH v5 07/15] KVM: arm64: Add HDBSS per-vCPU buffer management Tian Zheng
2026-10-26 18:27 ` Leonardo Bras
2026-10-30 3:47 ` Tian Zheng
2026-10-30 14:47 ` Leonardo Bras
2026-11-06 8:49 ` Tian Zheng
2026-11-06 15:21 ` Leonardo Bras
2026-09-29 10:36 ` [PATCH v5 08/15] KVM: arm64: Flush the HDBSS buffer on VM exit Tian Zheng
2026-10-27 18:13 ` Leonardo Bras
2026-10-30 4:57 ` Tian Zheng
2026-10-30 16:52 ` Leonardo Bras
2026-11-06 9:02 ` Tian Zheng
2026-09-29 10:36 ` [PATCH v5 09/15] KVM: arm64: Handle HDBSS faults Tian Zheng
2026-11-02 14:34 ` Leonardo Bras
2026-11-06 9:44 ` Tian Zheng
2026-09-29 10:36 ` [PATCH v5 10/15] KVM: Add kvm_arch_dirty_ring_size_updated() hook Tian Zheng
2026-09-29 10:36 ` [PATCH v5 11/15] KVM: arm64: Reserve dirty ring space for the HDBSS buffer Tian Zheng
2026-11-02 14:54 ` Leonardo Bras
2026-11-06 10:36 ` Tian Zheng
2026-11-06 15:36 ` Leonardo Bras
2026-11-06 10:58 ` Tian Zheng
2026-09-29 10:36 ` [PATCH v5 12/15] KVM: arm64: Derive the VM hardware dirty mode from dirty logging Tian Zheng
2026-11-02 15:03 ` Leonardo Bras
2026-11-06 10:46 ` Tian Zheng
2026-11-06 15:37 ` Leonardo Bras
2026-09-29 10:36 ` [PATCH v5 13/15] KVM: arm64: Add HDBSS buffer size ioctl for dirty-bitmap mode Tian Zheng
2026-11-02 15:12 ` Leonardo Bras
2026-11-06 10:27 ` Tian Zheng
2026-11-06 15:37 ` Leonardo Bras
2026-09-29 10:36 ` [PATCH v5 14/15] KVM: arm64: Document HDBSS buffer size ioctl Tian Zheng
2026-09-29 10:36 ` [PATCH v5 15/15] KVM: arm64: selftests: Add HDBSS buffer size ioctl interface test Tian Zheng
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=6e6fb626-d3d4-46f7-93ac-94e3d243eb69@huawei.com \
--to=zhengtian10@huawei.com \
--cc=caijian11@h-partners.com \
--cc=catalin.marinas@arm.com \
--cc=corbet@lwn.net \
--cc=fuad.tabba@linux.dev \
--cc=joey.gouly@arm.com \
--cc=kvm@vger.kernel.org \
--cc=kvmarm@lists.linux.dev \
--cc=leo.bras@arm.com \
--cc=linux-arm-kernel@lists.infradead.org \
--cc=linux-doc@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-kselftest@vger.kernel.org \
--cc=linuxarm@huawei.com \
--cc=liuyonglong@huawei.com \
--cc=mark.rutland@arm.com \
--cc=maz@kernel.org \
--cc=oupton@kernel.org \
--cc=pbonzini@redhat.com \
--cc=rdunlap@infradead.org \
--cc=seanjc@google.com \
--cc=seiden@linux.ibm.com \
--cc=skhan@linuxfoundation.org \
--cc=suzuki.poulose@arm.com \
--cc=tangchengchang@huawei.com \
--cc=wangzhou1@hisilicon.com \
--cc=will@kernel.org \
--cc=yangjinqian1@huawei.com \
--cc=yezhenyu2@huawei.com \
--cc=yubihong@huawei.com \
--cc=yuzenghui@huawei.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®