From: "Huang, Ying" <ying.huang@intel.com>
To: Barry Song <21cnbao@gmail.com>
Cc: David Hildenbrand <david@redhat.com>,
Ryan Roberts <ryan.roberts@arm.com>,
akpm@linux-foundation.org, linux-mm@kvack.org,
chrisl@kernel.org, yuzhao@google.com, hanchuanhua@oppo.com,
linux-kernel@vger.kernel.org, willy@infradead.org,
xiang@kernel.org, mhocko@suse.com, shy828301@gmail.com,
wangkefeng.wang@huawei.com, Barry Song <v-songbaohua@oppo.com>,
Hugh Dickins <hughd@google.com>
Subject: Re: [RFC PATCH] mm: hold PTL from the first PTE while reclaiming a large folio
Date: Tue, 05 Mar 2024 17:10:32 +0800 [thread overview]
Message-ID: <87il2182nr.fsf@yhuang6-desk2.ccr.corp.intel.com> (raw)
In-Reply-To: <CAGsJ_4xUdqpWaYDrNV3Fbh=3cWyoDJz3AbWa=mfsKbka+MAVag@mail.gmail.com> (Barry Song's message of "Tue, 5 Mar 2024 22:02:18 +1300")
Barry Song <21cnbao@gmail.com> writes:
> On Tue, Mar 5, 2024 at 8:55 PM Huang, Ying <ying.huang@intel.com> wrote:
>>
>> Barry Song <21cnbao@gmail.com> writes:
>>
>> > On Tue, Mar 5, 2024 at 10:15 AM David Hildenbrand <david@redhat.com> wrote:
>> >> > But we did "resolve" those bugs by entirely untouching all PTEs if we
>> >> > found some PTEs were skipped in try_to_unmap_one [1].
>> >> >
>> >> > While we find we only get the PTL from 2nd, 3rd but not
>> >> > 1st PTE, we entirely give up on try_to_unmap_one, and leave
>> >> > all PTEs untouched.
>> >> >
>> >> > /* we are not starting from head */
>> >> > if (!IS_ALIGNED((unsigned long)pvmw.pte, CONT_PTES * sizeof(*pvmw.pte))) {
>> >> > ret = false;
>> >> > atomic64_inc(&perf_stat.mapped_walk_start_from_non_head);
>> >> > set_pte_at(mm, address, pvmw.pte, pteval);
>> >> > page_vma_mapped_walk_done(&pvmw);
>> >> > break;
>> >> > }
>> >> > This will ensure all PTEs still have a unified state such as CONT-PTE
>> >> > after try_to_unmap fails.
>> >> > I feel this could have some false postive because when racing
>> >> > with unmap, 1st PTE might really become pte_none. So explicitly
>> >> > holding PTL from 1st PTE seems a better way.
>> >>
>> >> Can we estimate the "cost" of holding the PTL?
>> >>
>> >
>> > This is just moving PTL acquisition one or two PTE earlier in those corner
>> > cases. In normal cases, it doesn't affect when PTL is held.
>>
>> The mTHP may be mapped at the end of page table. In that case, the PTL
>> will be held longer. Or am I missing something?
>
> no. this patch doesn't change when we release PTL but change when we
> get PTL.
>
> when the original code iterates nr_pages PTEs in a large folio, it will skip
> invalid PTEs, when it meets a valid one, it will acquire PTL. so if it gets
> intermediate PTE values some other threads are modifying, it might
> skip PTE0, or sometimes PTE0 and PTE1 according to my test. but
> arriving at PTE2, likely other threads have written a new value, so we
> will begin to hold PTL and iterate till the end of the large folio.
Is there any guarantee that the mTHP will always be mapped at the
beginning of the page table (PTE0)? IIUC, mTHP can be mapped at PTE496.
If so, with your patch, PTL will be held from PTE0 instead of PTE496 in
some cases.
--
Best Regards,
Huang, Ying
> The proposal is that we directly get PTL from PTE0, thus we don't get
> intermediate values for the head of nr_pages PTEs. this will ensure
> a large folio is either completely unmapped or completely mapped.
> but not partially mapped and partially unmapped.
>
>>
>> --
>> Best Regards,
>> Huang, Ying
>>
>>
>> > In normal cases, page_vma_mapped_walk will find PTE0 is present, thus hold
>> > PTL immediately. in corner cases, page_vma_mapped_walk races with break-
>> > before-make, after skipping one or two PTEs whose states are transferring,
>> > it will find a present pte then acquire lock.
>> >
>> >> --
>> >> Cheers,
>> >>
>> >> David / dhildenb
>> >
> Thanks
> Barry
next prev parent reply other threads:[~2024-03-05 9:12 UTC|newest]
Thread overview: 28+ messages / expand[flat|nested] mbox.gz Atom feed top
2024-03-04 10:37 Barry Song
2024-03-04 12:20 ` Ryan Roberts
2024-03-04 12:41 ` David Hildenbrand
2024-03-04 13:03 ` Ryan Roberts
2024-03-04 14:27 ` David Hildenbrand
2024-03-04 20:42 ` Barry Song
2024-03-04 21:02 ` David Hildenbrand
2024-03-04 21:41 ` Barry Song
2024-03-04 21:04 ` Barry Song
2024-03-04 21:15 ` David Hildenbrand
2024-03-04 22:29 ` Barry Song
2024-03-05 7:53 ` Huang, Ying
2024-03-05 9:02 ` Barry Song
2024-03-05 9:10 ` Huang, Ying [this message]
2024-03-05 9:21 ` Barry Song
2024-03-05 10:28 ` Barry Song
2024-03-04 22:02 ` Ryan Roberts
2024-03-05 7:50 ` Huang, Ying
2024-03-04 21:57 ` Barry Song
2024-03-05 8:54 ` Ryan Roberts
2024-03-05 9:08 ` Barry Song
2024-03-05 9:11 ` Ryan Roberts
2024-03-05 9:15 ` Barry Song
2024-03-05 7:28 ` Huang, Ying
2024-03-05 8:56 ` Barry Song
2024-03-05 9:04 ` Huang, Ying
2024-03-05 9:08 ` Ryan Roberts
2024-03-05 9:11 ` Barry Song
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=87il2182nr.fsf@yhuang6-desk2.ccr.corp.intel.com \
--to=ying.huang@intel.com \
--cc=21cnbao@gmail.com \
--cc=akpm@linux-foundation.org \
--cc=chrisl@kernel.org \
--cc=david@redhat.com \
--cc=hanchuanhua@oppo.com \
--cc=hughd@google.com \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=mhocko@suse.com \
--cc=ryan.roberts@arm.com \
--cc=shy828301@gmail.com \
--cc=v-songbaohua@oppo.com \
--cc=wangkefeng.wang@huawei.com \
--cc=willy@infradead.org \
--cc=xiang@kernel.org \
--cc=yuzhao@google.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®