mirror of https://lore.kernel.org/lkml/
 help / color / mirror / Atom feed
From: Ketan Kishore <ketan.kishore@oss.qualcomm.com>
To: "David Hildenbrand (Arm)" <david@kernel.org>,
	Wei Yang <richard.weiyang@gmail.com>
Cc: Yuan Liu <yuan1.liu@intel.com>,
	Oscar Salvador <osalvador@suse.de>,
	Mike Rapoport <rppt@kernel.org>,
	linux-mm@kvack.org, linux-kernel@vger.kernel.org,
	Chen Yu <yu.c.chen@intel.com>, Jason Zeng <jason.zeng@intel.com>,
	Vlastimil Babka <vbabka@kernel.org>
Subject: Re: [BUG] mm/memory_hotplug: panic due to race between compaction and memory hot-unplug
Date: Wed, 4 Nov 2026 10:48:48 +0530	[thread overview]
Message-ID: <ae386ef8-324c-4704-bc0f-a1eca3280399@oss.qualcomm.com> (raw)
In-Reply-To: <12147238-575e-49ea-aa83-ea25c660ee38@kernel.org>



On 9/10/2026 1:10 PM, David Hildenbrand (Arm) wrote:
> On 9/10/26 05:16, Wei Yang wrote:
>> On Mon, Sep 07, 2026 at 04:27:50PM +0200, David Hildenbrand (Arm) wrote:
>>> On 9/3/26 11:55, Yuan Liu wrote:
>>>> Hi all,
>>>
>>> Hi!
>>>
>>>>
>>>> While stress testing memory hotplug on a VM guest running an
>>>> unmodified vanilla mainline kernel (7.3.0-rc1, as reported by
>>>> uname -r), we hit a kernel panic in the guest when memory
>>>> hot-unplug runs concurrently with memory compaction.
>>>>
>>>> The kernel was built from mainline at commit:
>>>>
>>>>      cee9395acd80 ("Linux 7.3-rc1")
>>>>
>>>> To be more specific, after a large virtio-mem hot-unplug, the guest
>>>> kernel takes a fatal page fault in suitable_migration_target(), called
>>>> from isolate_freepages() during compaction.
>>>
>>> Sounds like a real problem we should tackle.
>>>
>>>>
>>>> We are not sure whether this race is reachable under realistic
>>>> workloads or only under this synthetic stress test. Sharing it here
>>>> in case it is useful, and in case this is already a known issue.
>>>> Thanks.
>>>>
>>>>
>>>> Call trace (top to bottom)
>>>> ==========================
>>>> - RIP: suitable_migration_target+0x5/0x70
>>>>     isolate_freepages() <- compaction_alloc() <-
>>>>     migrate_pages() <- compact_zone() <- compact_node() <-
>>>>     sysctl_compaction_handler().
>>>>
>>>>
>>>> Why the race happens
>>>> ====================
>>>> CPU0 (compaction free-scanner)          CPU1 (virtio-mem hot-unplug)
>>>> ----                                    ----
>>>> page = pageblock_pfn_to_page()
>>>>     /* checks pass, section ONLINE */
>>>>     /* returns valid struct page* */
>>>>
>>>>                                           offline_pages()
>>>>                                             /* section -> offline */
>>>>                                           __remove_pages()
>>>>                                             vmemmap_free()
>>>>                                             /* struct page UNMAPPED */
>>>>
>>>> suitable_migration_target(page)
>>>>     PageBuddy(page)
>>>>       read page->page_type
>>>>       *** not-present fault -> panic ***
>>>>
>>
>> Does it mean, the combination of pfn_to_online_page() / PageBuddy(page) is not
>> safe, when there is hot-remove, even for other users. Not only compaction.
> 
> There is an inherent race between any
> 
> pfn_to_online_page() user that then takes a look at the memmap (PageBuddy,
> whatever).
> 
> Usually, that's not really relevant, because for things to go terrible wrong
> (instead of only being slightly suboptimal :) )
> 
> You have to run both, memory offlining *and* memory removal.
> 

Hello

We faced similar issue internally on one of our target's guest VM run,
where kcompactd de-referenced a vmemmap pointer for a PFN after the 
hot-unplug path had already freed that vmemmap,with no lock preventing 
the two from running simultaneously.
Call trace:
   suitable_migration_target+0x0/0x8c (P)
   migrate_pages_batch+0x1b4/0xc74
   migrate_pages+0x150/0x654
   compact_zone+0x5bc/0xb30
   compact_node+0xa0/0x18c
   kcompactd+0x228/0x4d0

Would it be okay to introduce something like "try_get_online_mems" as 
shown below to try a readlock in compaction path for hot-unplug to wait
for kcompactd to complete before freeing the vmemmap?

get_online_mems()
-> percpu_down_read(&mem_hotplug_lock);   /* may sleep */

try_get_online_mems()
-> percpu_down_read_trylock(&mem_hotplug_lock);	/* won't sleep */

   kcompactd / compaction                  memory hot-remove
   ----------------------                  -----------------
   try_get_online_mems() -> true
   holds read lock
   uses PFNs and struct page pointers

                                           mem_hotplug_begin()
                                             percpu_down_write()
                                             waits for readers to leave

   finishes compaction
   put_online_mems()  // releases read lock

                                           writer acquires write lock
                                           offline/remove memory
                                           free vmemmap
                                           mem_hotplug_done()

And to skip compaction if taking the lock is not successful here.

Appreciate any suggestions or feedback.
Thankyou.

> For things like
> 
> page = pfn_to_online_page()
> if (PageBuddy(page))
> 
> That's unlikely to hit (no reports), and we could likely easily fix it with the
> help of RCU.
> 
> It gets more problematic when we do things like
> 
> page = pfn_to_online_page()
> ... do all other kind of stuff
> if (PageBuddy(page))
> 
> (what we have here)
> 
> Using RCU is usually not easily possible. Mostly only comapction does something
> like that.
> 


  parent reply	other threads:[~2026-11-04  5:19 UTC|newest]

Thread overview: 8+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-09-03  9:55 Yuan Liu
2026-09-07 14:27 ` David Hildenbrand (Arm)
2026-09-10  3:16   ` Wei Yang
2026-09-10  7:40     ` David Hildenbrand (Arm)
2026-09-12  2:06       ` Wei Yang
2026-09-16 15:03         ` David Hildenbrand (Arm)
2026-11-04  5:18       ` Ketan Kishore [this message]
2026-11-04  9:08         ` David Hildenbrand (Arm)

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=ae386ef8-324c-4704-bc0f-a1eca3280399@oss.qualcomm.com \
    --to=ketan.kishore@oss.qualcomm.com \
    --cc=david@kernel.org \
    --cc=jason.zeng@intel.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=osalvador@suse.de \
    --cc=richard.weiyang@gmail.com \
    --cc=rppt@kernel.org \
    --cc=vbabka@kernel.org \
    --cc=yu.c.chen@intel.com \
    --cc=yuan1.liu@intel.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox

all inboxes | Powered by JetHome®