mirror of https://lore.kernel.org/lkml/
 help / color / mirror / Atom feed
From: "David Hildenbrand (Arm)" <david@kernel.org>
To: Muchun Song <muchun.song@linux.dev>
Cc: Muchun Song <songmuchun@bytedance.com>,
	Andrew Morton <akpm@linux-foundation.org>,
	Oscar Salvador <osalvador@suse.de>,
	Madhavan Srinivasan <maddy@linux.ibm.com>,
	Michael Ellerman <mpe@ellerman.id.au>,
	Jonathan Corbet <corbet@lwn.net>,
	linux-mm@kvack.org, linux-kernel@vger.kernel.org,
	linuxppc-dev@lists.ozlabs.org, linux-doc@vger.kernel.org,
	Lorenzo Stoakes <ljs@kernel.org>, Mike Rapoport <rppt@kernel.org>,
	Qi Zheng <qi.zheng@linux.dev>,
	Nicholas Piggin <npiggin@gmail.com>,
	Christophe Leroy <chleroy@kernel.org>,
	Randy Dunlap <rdunlap@infradead.org>,
	Lance Yang <lance.yang@linux.dev>
Subject: Re: [PATCH v5 03/12] mm/sparse-vmemmap: introduce CONFIG_VMEMMAP_OPTIMIZATION
Date: Tue, 29 Sep 2026 10:43:01 +0200	[thread overview]
Message-ID: <73625017-b944-446b-95b6-6c586c304f35@kernel.org> (raw)
In-Reply-To: <D0B0A406-100C-437D-8AA8-D276E8DA8278@linux.dev>

On 9/29/26 09:53, Muchun Song wrote:
> 
> 
>> On Sep 29, 2026, at 15:11, David Hildenbrand (Arm) <david@kernel.org> wrote:
>>
>> On 9/27/26 04:54, Muchun Song wrote:
>>> The section-based vmemmap optimization infrastructure is guarded by
>>> CONFIG_HUGETLB_PAGE_OPTIMIZE_VMEMMAP, but it can also be used by
>>> ZONE_DEVICE users that set dev_pagemap::vmemmap_shift. Introduce
>>> CONFIG_VMEMMAP_OPTIMIZATION as a common config for the shared
>>> infrastructure.
>>>
>>> Select the new option from HUGETLB_PAGE_OPTIMIZE_VMEMMAP and from
>>> ZONE_DEVICE when the architecture opts in to DAX vmemmap optimization,
>>> and use it to guard the generic sparse-vmemmap state and helpers.
>>>
>>> Signed-off-by: Muchun Song <songmuchun@bytedance.com>
>>> Acked-by: Qi Zheng <qi.zheng@linux.dev>
>>> Acked-by: Mike Rapoport (Microsoft) <rppt@kernel.org>
>>> ---
>>> v5:
>>> - Move this patch after the shared tail-page factoring.
>>> - Select VMEMMAP_OPTIMIZATION from ZONE_DEVICE instead of DEV_DAX,
>>>  covering all users of dev_pagemap::vmemmap_shift, reported by
>>>  Sashiko.
>>>
>>> v4:
>>> - Rename SPARSEMEM_VMEMMAP_OPTIMIZATION to VMEMMAP_OPTIMIZATION
>>>  (suggested by Mike Rapoport)
>>> - Collect Acked-by from Mike Rapoport
>>>
>>> v2:
>>> - Fix SPARSEMEM_VMEMMAP_OPTIMIZATION being selected without SPARSEMEM_VMEMMAP
>>>  reported by Sashiko.
>>> - Add an explicit DEV_DAX dependency on ZONE_DEVICE
>>> - Collect Acked-by from Qi Zheng
>>> ---
>>> arch/x86/entry/vdso/vdso32/fake_32bit_build.h |  2 +-
>>> fs/Kconfig                                    |  1 +
>>> include/linux/mm.h                            |  3 +++
>>> include/linux/mmzone.h                        | 10 +++++-----
>>> include/linux/page-flags.h                    |  5 ++---
>>> mm/Kconfig                                    |  5 +++++
>>> mm/sparse-vmemmap.c                           |  2 +-
>>> mm/sparse.h                                   |  6 +++---
>>> 8 files changed, 21 insertions(+), 13 deletions(-)
>>>
>>> diff --git a/arch/x86/entry/vdso/vdso32/fake_32bit_build.h b/arch/x86/entry/vdso/vdso32/fake_32bit_build.h
>>> index bc3e549795c3..72a92cb9b53d 100644
>>> --- a/arch/x86/entry/vdso/vdso32/fake_32bit_build.h
>>> +++ b/arch/x86/entry/vdso/vdso32/fake_32bit_build.h
>>> @@ -11,7 +11,7 @@
>>> #undef CONFIG_PGTABLE_LEVELS
>>> #undef CONFIG_ILLEGAL_POINTER_VALUE
>>> #undef CONFIG_SPARSEMEM_VMEMMAP
>>> -#undef CONFIG_HUGETLB_PAGE_OPTIMIZE_VMEMMAP
>>> +#undef CONFIG_VMEMMAP_OPTIMIZATION
>>> #undef CONFIG_NR_CPUS
>>> #undef CONFIG_PARAVIRT_XXL
>>>
>>> diff --git a/fs/Kconfig b/fs/Kconfig
>>> index d1c210c6508f..1454b7fe9641 100644
>>> --- a/fs/Kconfig
>>> +++ b/fs/Kconfig
>>> @@ -278,6 +278,7 @@ config HUGETLB_PAGE_OPTIMIZE_VMEMMAP
>>> def_bool HUGETLB_PAGE
>>> 	depends on ARCH_WANT_OPTIMIZE_HUGETLB_VMEMMAP
>>> 	depends on SPARSEMEM_VMEMMAP
>>> + 	select VMEMMAP_OPTIMIZATION
>>
>> Acked-by: David Hildenbrand (Arm) <david@kernel.org>
> 
> Thanks.
> 
>>
>> Is there a path to remove HUGETLB_PAGE_OPTIMIZE_VMEMMAP, and to merge
>> ARCH_WANT_OPTIMIZE_DAX_VMEMMAP+ARCH_WANT_OPTIMIZE_HUGETLB_VMEMMAP into a
>> ARCH_SUPPORTS_VMEMMAP_OPTIMIZATION?
> 
> These are actually two completely different capabilities.
> 
> ARCH_WANT_OPTIMIZE_HUGETLB_VMEMMAP requires the architecture
> to support dynamic updates to vmemmap page tables, meaning a
> PTE entry can be changed from one valid entry to another
> valid entry. This does not meet the requirements on arm64,
> because arm64 requires page table operations to satisfy BBM
> (there is, of course, a series [1] attempting to do this).
> 
> However, for ARCH_WANT_OPTIMIZE_DAX_VMEMMAP, the vmemmap page
> tables do not involve dynamic updates, so the BBM requirement
> can be satisfied. Therefore, arm64 can enable
> ARCH_WANT_OPTIMIZE_DAX_VMEMMAP, but cannot enable
> ARCH_WANT_OPTIMIZE_HUGETLB_VMEMMAP. To make the naming clearer,
> I have another patch [2] that renames it for greater clarity.

Ah, perfect. Too many patches floating around :)

I thought there is a patch set to avoid the BBM requirement on arm64 from James,
though. So not sure if both things will always stay separate.

> 
> As for ARCH_WANT_OPTIMIZE_DAX_VMEMMAP, I plan to remove it
> entirely in the future, because architectures that do not support
> it can simply choose to disable it, as can be seen in patch [3].
> 
> So in my plan, ultimately only one config will remain:
> ARCH_SUPPORTS_VMEMMAP_REMAP.
> 
> I hope this clarifies the plan. Let me know what you think.

Yes, thanks.

-- 
Cheers,

David

  reply	other threads:[~2026-09-29  8:43 UTC|newest]

Thread overview: 39+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-09-27  2:54 [PATCH v5 00/12] mm: Switch device DAX to section-based vmemmap optimization Muchun Song
2026-09-27  2:54 ` [PATCH v5 01/12] mm/sparse-vmemmap: factor out shared vmemmap tail page allocation Muchun Song
2026-09-29  7:16   ` David Hildenbrand (Arm)
2026-09-29  7:55     ` Muchun Song
2026-09-27  2:54 ` [PATCH v5 02/12] mm/sparse-vmemmap: allocate shared tail page array dynamically Muchun Song
2026-09-29  7:21   ` David Hildenbrand (Arm)
2026-09-29  8:00     ` Muchun Song
2026-09-27  2:54 ` [PATCH v5 03/12] mm/sparse-vmemmap: introduce CONFIG_VMEMMAP_OPTIMIZATION Muchun Song
2026-09-29  7:11   ` David Hildenbrand (Arm)
2026-09-29  7:53     ` Muchun Song
2026-09-29  8:43       ` David Hildenbrand (Arm) [this message]
2026-09-27  2:54 ` [PATCH v5 04/12] mm/sparse-vmemmap: open-code init_compound_tail() Muchun Song
2026-09-27  2:54 ` [PATCH v5 05/12] mm/sparse-vmemmap: prepare DAX vmemmap population for compound page orders Muchun Song
2026-09-29  7:24   ` David Hildenbrand (Arm)
2026-09-29  8:04     ` Muchun Song
2026-09-27  2:54 ` [PATCH v5 06/12] mm/sparse-vmemmap: set compound page order for device DAX Muchun Song
2026-09-29  7:30   ` David Hildenbrand (Arm)
2026-09-29  8:22     ` Muchun Song
2026-09-29  8:43       ` David Hildenbrand (Arm)
2026-09-27  2:54 ` [PATCH v5 07/12] mm/sparse-vmemmap: switch device DAX to shared tail vmemmap pages Muchun Song
2026-09-28  4:41   ` [PATCH] fixup! " Muchun Song
2026-09-29  7:36   ` [PATCH v5 07/12] " David Hildenbrand (Arm)
2026-09-29  8:36     ` Muchun Song
2026-09-27  2:54 ` [PATCH v5 08/12] mm/sparse-vmemmap: move vmemmap optimization helpers to a public header Muchun Song
2026-09-29  7:39   ` David Hildenbrand (Arm)
2026-09-29  8:44     ` Muchun Song
2026-09-29 10:03       ` Muchun Song
2026-09-27  2:54 ` [PATCH v5 09/12] powerpc/mm: switch device DAX to shared tail vmemmap pages Muchun Song
2026-09-29  8:44   ` David Hildenbrand (Arm)
2026-09-27  2:54 ` [PATCH v5 10/12] mm/sparse-vmemmap: drop the extra tail page from device DAX reservation Muchun Song
2026-09-29  7:45   ` David Hildenbrand (Arm)
2026-09-27  2:54 ` [PATCH v5 11/12] mm/sparse-vmemmap: drop unused section_nr_vmemmap_pages() arguments Muchun Song
2026-09-29  7:41   ` David Hildenbrand (Arm)
2026-09-27  2:54 ` [PATCH v5 12/12] Documentation/mm: update DAX vmemmap deduplication docs Muchun Song
2026-09-29  7:43   ` David Hildenbrand (Arm)
2026-09-27  5:51 ` [PATCH v5 00/12] mm: Switch device DAX to section-based vmemmap optimization Andrew Morton
2026-09-27 10:51   ` Muchun Song
2026-09-27 19:54     ` Andrew Morton
2026-09-28  4:25       ` Muchun Song

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=73625017-b944-446b-95b6-6c586c304f35@kernel.org \
    --to=david@kernel.org \
    --cc=akpm@linux-foundation.org \
    --cc=chleroy@kernel.org \
    --cc=corbet@lwn.net \
    --cc=lance.yang@linux.dev \
    --cc=linux-doc@vger.kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=linuxppc-dev@lists.ozlabs.org \
    --cc=ljs@kernel.org \
    --cc=maddy@linux.ibm.com \
    --cc=mpe@ellerman.id.au \
    --cc=muchun.song@linux.dev \
    --cc=npiggin@gmail.com \
    --cc=osalvador@suse.de \
    --cc=qi.zheng@linux.dev \
    --cc=rdunlap@infradead.org \
    --cc=rppt@kernel.org \
    --cc=songmuchun@bytedance.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox

all inboxes | Powered by JetHome®