mirror of https://lore.kernel.org/lkml/
 help / color / mirror / Atom feed
From: "David Hildenbrand (Arm)" <david@kernel.org>
To: Zi Yan <ziy@nvidia.com>, Balbir Singh <balbirs@nvidia.com>,
	Matthew Brost <matthew.brost@intel.com>,
	Alistair Popple <apopple@nvidia.com>
Cc: Andrew Morton <akpm@linux-foundation.org>,
	Joshua Hahn <joshua.hahnjy@gmail.com>,
	Rakie Kim <rakie.kim@sk.com>, Byungchul Park <byungchul@sk.com>,
	Gregory Price <gourry@gourry.net>,
	Ying Huang <ying.huang@linux.alibaba.com>,
	Kefeng Wang <wangkefeng.wang@huawei.com>,
	linux-mm@kvack.org, linux-kernel@vger.kernel.org,
	Sashiko <sashiko-bot@kernel.org>
Subject: Re: [PATCH] mm/migrate_device: avoid overflowing migrate_vma collection arrays
Date: Mon, 13 Jul 2026 17:25:53 +0200	[thread overview]
Message-ID: <57cc487b-6ec3-4ca6-8735-f37644e2b0ab@kernel.org> (raw)
In-Reply-To: <A1606A10-AB38-4101-A058-8355E5E81C47@nvidia.com>

On 7/13/26 17:20, Zi Yan wrote:
> On 13 Jul 2026, at 8:57, David Hildenbrand (Arm) wrote:
> 
>> On 7/10/26 17:35, Zi Yan wrote:
>>>
>>> Not all the time. After a folio split and PTE lock is dropped, there are
>>> different cases:
>>>
>>> 1. no page table change, the collection grabs the PTE lock and continues;
>>
>> Yes.
>>
>>>
>>> 2. some PTE(s) is changed, the same as 1 and the collection continues;
>>
>> Yes.
>>
>>>
>>> 3. the PMD pointing to the PTE page table is changed to either a leaf
>>>    PMD or an invalid PMD, the collection cannot grab the PTE lock to
>>>    work on the remaming PTEs, since they are gone. For the collected
>>>    PFNs (they are mapped more than once) and folios with elevated
>>>    refcount (they are mapped once and unmapped here as an optimization),
>>>    they will be processed later in migrate_vma_unmap(). Since
>>>    migrate_vma_collect() is best effort, there is no need to revert and
>>>    try to recollect from the beginning (to get that possible large
>>>    folio or skip).
>>
>> Yes.
>>
>>>
>>> BTW, recollection will be more feasible if migrate_vma_collect() does
>>> not do unmap singly-mapped optimization, since in the case, no PTE is
>>> changed, we just need to reset migrate->->cpages and migrate->npages and
>>> restart from the beginning.
>>>
>>>
>>> Right. The PTE page table should be gone and the original PMD, pointing
>>> to the PTE page table, becomes a leaf PMD or an invalid PMD, since
>>> someone changed it when the PTE lock is dropped.
>>
>> Right, so I guess we'd have to remember how far to rollback, and rollback would
>> mean resetting migrate->->cpages and migrate->npages.
> 
> For case 1 and 2, we do not roll back. For case 3, since the PMD is changed,
> we just roll back to the start address and set migrate->cpages and migrate->npages
> both to 0.

Can't we walk multiple PMDs and have data already in there?

>>
>> And for the entries we rollback, we have to decide whether to folio_put() and
>> whether to folio_unlock() [fault_folio != folio]. That's the confusing bit given
>> that the code is rather "interesting".
> 
> IMHO, it might be much cleaner to remove the “unmap the mapping if the folio is
> only mapped once” optimization, so there is no need to roll back at all.

I guess most folios are only mapped once. Do we have any numbers on that?

-- 
Cheers,

David

  reply	other threads:[~2026-07-13 15:25 UTC|newest]

Thread overview: 19+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-07-08  1:50 Zi Yan
2026-07-08  2:45 ` Balbir Singh
2026-07-08  8:43 ` David Hildenbrand (Arm)
2026-07-08 14:35   ` Zi Yan
2026-07-08 14:43     ` Zi Yan
2026-07-10 11:30       ` Zi Yan
2026-07-10 11:56         ` David Hildenbrand (Arm)
2026-07-10 15:35           ` Zi Yan
2026-07-13 12:57             ` David Hildenbrand (Arm)
2026-07-13 15:20               ` Zi Yan
2026-07-13 15:25                 ` David Hildenbrand (Arm) [this message]
2026-07-13 15:39                   ` Zi Yan
2026-07-13 22:24                     ` Alistair Popple
2026-07-14  0:10                       ` Balbir Singh
2026-07-14  5:30                         ` Alistair Popple
2026-07-15  0:59                           ` Zi Yan
2026-07-15 12:40                             ` David Hildenbrand (Arm)
2026-07-15 13:30                               ` Zi Yan
2026-07-10  2:54 ` Zi Yan

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=57cc487b-6ec3-4ca6-8735-f37644e2b0ab@kernel.org \
    --to=david@kernel.org \
    --cc=akpm@linux-foundation.org \
    --cc=apopple@nvidia.com \
    --cc=balbirs@nvidia.com \
    --cc=byungchul@sk.com \
    --cc=gourry@gourry.net \
    --cc=joshua.hahnjy@gmail.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=matthew.brost@intel.com \
    --cc=rakie.kim@sk.com \
    --cc=sashiko-bot@kernel.org \
    --cc=wangkefeng.wang@huawei.com \
    --cc=ying.huang@linux.alibaba.com \
    --cc=ziy@nvidia.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox

all inboxes | Powered by JetHome®