From: Ketan Kishore <ketan.kishore@oss.qualcomm.com>
To: "David Hildenbrand (Arm)" <david@kernel.org>,
Wei Yang <richard.weiyang@gmail.com>
Cc: Yuan Liu <yuan1.liu@intel.com>,
Oscar Salvador <osalvador@suse.de>,
Mike Rapoport <rppt@kernel.org>,
linux-mm@kvack.org, linux-kernel@vger.kernel.org,
Chen Yu <yu.c.chen@intel.com>, Jason Zeng <jason.zeng@intel.com>,
Vlastimil Babka <vbabka@kernel.org>
Subject: Re: [BUG] mm/memory_hotplug: panic due to race between compaction and memory hot-unplug
Date: Wed, 4 Nov 2026 10:48:48 +0530 [thread overview]
Message-ID: <ae386ef8-324c-4704-bc0f-a1eca3280399@oss.qualcomm.com> (raw)
In-Reply-To: <12147238-575e-49ea-aa83-ea25c660ee38@kernel.org>
On 9/10/2026 1:10 PM, David Hildenbrand (Arm) wrote:
> On 9/10/26 05:16, Wei Yang wrote:
>> On Mon, Sep 07, 2026 at 04:27:50PM +0200, David Hildenbrand (Arm) wrote:
>>> On 9/3/26 11:55, Yuan Liu wrote:
>>>> Hi all,
>>>
>>> Hi!
>>>
>>>>
>>>> While stress testing memory hotplug on a VM guest running an
>>>> unmodified vanilla mainline kernel (7.3.0-rc1, as reported by
>>>> uname -r), we hit a kernel panic in the guest when memory
>>>> hot-unplug runs concurrently with memory compaction.
>>>>
>>>> The kernel was built from mainline at commit:
>>>>
>>>> cee9395acd80 ("Linux 7.3-rc1")
>>>>
>>>> To be more specific, after a large virtio-mem hot-unplug, the guest
>>>> kernel takes a fatal page fault in suitable_migration_target(), called
>>>> from isolate_freepages() during compaction.
>>>
>>> Sounds like a real problem we should tackle.
>>>
>>>>
>>>> We are not sure whether this race is reachable under realistic
>>>> workloads or only under this synthetic stress test. Sharing it here
>>>> in case it is useful, and in case this is already a known issue.
>>>> Thanks.
>>>>
>>>>
>>>> Call trace (top to bottom)
>>>> ==========================
>>>> - RIP: suitable_migration_target+0x5/0x70
>>>> isolate_freepages() <- compaction_alloc() <-
>>>> migrate_pages() <- compact_zone() <- compact_node() <-
>>>> sysctl_compaction_handler().
>>>>
>>>>
>>>> Why the race happens
>>>> ====================
>>>> CPU0 (compaction free-scanner) CPU1 (virtio-mem hot-unplug)
>>>> ---- ----
>>>> page = pageblock_pfn_to_page()
>>>> /* checks pass, section ONLINE */
>>>> /* returns valid struct page* */
>>>>
>>>> offline_pages()
>>>> /* section -> offline */
>>>> __remove_pages()
>>>> vmemmap_free()
>>>> /* struct page UNMAPPED */
>>>>
>>>> suitable_migration_target(page)
>>>> PageBuddy(page)
>>>> read page->page_type
>>>> *** not-present fault -> panic ***
>>>>
>>
>> Does it mean, the combination of pfn_to_online_page() / PageBuddy(page) is not
>> safe, when there is hot-remove, even for other users. Not only compaction.
>
> There is an inherent race between any
>
> pfn_to_online_page() user that then takes a look at the memmap (PageBuddy,
> whatever).
>
> Usually, that's not really relevant, because for things to go terrible wrong
> (instead of only being slightly suboptimal :) )
>
> You have to run both, memory offlining *and* memory removal.
>
Hello
We faced similar issue internally on one of our target's guest VM run,
where kcompactd de-referenced a vmemmap pointer for a PFN after the
hot-unplug path had already freed that vmemmap,with no lock preventing
the two from running simultaneously.
Call trace:
suitable_migration_target+0x0/0x8c (P)
migrate_pages_batch+0x1b4/0xc74
migrate_pages+0x150/0x654
compact_zone+0x5bc/0xb30
compact_node+0xa0/0x18c
kcompactd+0x228/0x4d0
Would it be okay to introduce something like "try_get_online_mems" as
shown below to try a readlock in compaction path for hot-unplug to wait
for kcompactd to complete before freeing the vmemmap?
get_online_mems()
-> percpu_down_read(&mem_hotplug_lock); /* may sleep */
try_get_online_mems()
-> percpu_down_read_trylock(&mem_hotplug_lock); /* won't sleep */
kcompactd / compaction memory hot-remove
---------------------- -----------------
try_get_online_mems() -> true
holds read lock
uses PFNs and struct page pointers
mem_hotplug_begin()
percpu_down_write()
waits for readers to leave
finishes compaction
put_online_mems() // releases read lock
writer acquires write lock
offline/remove memory
free vmemmap
mem_hotplug_done()
And to skip compaction if taking the lock is not successful here.
Appreciate any suggestions or feedback.
Thankyou.
> For things like
>
> page = pfn_to_online_page()
> if (PageBuddy(page))
>
> That's unlikely to hit (no reports), and we could likely easily fix it with the
> help of RCU.
>
> It gets more problematic when we do things like
>
> page = pfn_to_online_page()
> ... do all other kind of stuff
> if (PageBuddy(page))
>
> (what we have here)
>
> Using RCU is usually not easily possible. Mostly only comapction does something
> like that.
>
next prev parent reply other threads:[~2026-11-04 5:19 UTC|newest]
Thread overview: 8+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-09-03 9:55 Yuan Liu
2026-09-07 14:27 ` David Hildenbrand (Arm)
2026-09-10 3:16 ` Wei Yang
2026-09-10 7:40 ` David Hildenbrand (Arm)
2026-09-12 2:06 ` Wei Yang
2026-09-16 15:03 ` David Hildenbrand (Arm)
2026-11-04 5:18 ` Ketan Kishore [this message]
2026-11-04 9:08 ` David Hildenbrand (Arm)
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=ae386ef8-324c-4704-bc0f-a1eca3280399@oss.qualcomm.com \
--to=ketan.kishore@oss.qualcomm.com \
--cc=david@kernel.org \
--cc=jason.zeng@intel.com \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=osalvador@suse.de \
--cc=richard.weiyang@gmail.com \
--cc=rppt@kernel.org \
--cc=vbabka@kernel.org \
--cc=yu.c.chen@intel.com \
--cc=yuan1.liu@intel.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®