mirror of https://lore.kernel.org/lkml/
 help / color / mirror / Atom feed
From: Luiz Capitulino <luizcap@redhat.com>
To: Usama Arif <usama.arif@linux.dev>
Cc: linux-kernel@vger.kernel.org, linux-mm@kvack.org,
	david@kernel.org, baolin.wang@linux.alibaba.com, ziy@nvidia.com,
	lance.yang@linux.dev, corbet@lwn.net, tsbogend@alpha.franken.de,
	maddy@linux.ibm.com, mpe@ellerman.id.au, agordeev@linux.ibm.com,
	gerald.schaefer@linux.ibm.com, hca@linux.ibm.com,
	gor@linux.ibm.com, x86@kernel.org, tglx@kernel.org,
	mingo@redhat.com, bp@alien8.de, hughd@google.com,
	dave.hansen@linux.intel.com, djbw@kernel.org,
	vishal.l.verma@intel.com, dave.jiang@intel.com,
	akpm@linux-foundation.org, yintirui@huawei.com, dev.jain@arm.com
Subject: Re: [PATCH v8 00/14] mm: thp: always enable mTHP support
Date: Mon, 21 Sep 2026 22:11:44 -0400	[thread overview]
Message-ID: <2e6802a6-9815-4fcd-ad72-136efb599d1d@redhat.com> (raw)
In-Reply-To: <20260921103620.3431087-1-usama.arif@linux.dev>



On 9/21/26 6:36 AM, Usama Arif wrote:
> On Fri, 18 Sep 2026 10:01:35 -0400 Luiz Capitulino <luizcap@redhat.com> wrote:
> 
>>
>>
>> On 9/18/26 6:37 AM, Usama Arif wrote:
>>>
>>>
>>> On 18/09/2026 02:45, Luiz Capitulino wrote:
>>>> Introduction
>>>> ============
>>>>
>>>> Today, if an architecture implements has_transparent_hugepage() and the CPU
>>>> lacks support for PMD-sized pages, the THP code disables all THP, including
>>>> mTHP.
>>>
>>>
>>> Hi Luiz,
>>>
>>> Sorry for asking this so late in the series, but which CPUs lack support for
>>> PMD sized pages?
>>>
>>> Is this series mainly for PowerPC?
>>
>> No :)
>>
>> The architectures that have conditional PMD page support (ie. discovered
>> at run-time via has_transparent_hugepage()) are x86, s390, powerpc and
>> mips.
>>
>> For x86 for example, even on 64-bit there are cases where the PSE bit
>> may not be present (eg. some errata and by hypervisor CPUID masking).
>>
>> That being said, the main goal of the series is that
>> has_transparent_hugepage() is overloaded: it has different semantics on
>> those architectures and is used to gate all THP support (which is not
>> the right thing to do for mTHP).
> 
> Thanks for clearing that and the patches.
> 
> They all look good to me, apart from the the comment in the last patch.
> 
> Feel free to add
> 
> Acked-by: Usama Arif <usama.arif@linux.dev>
> 
> to all of them apart from last.
> 
> One nit: I would put the above goal of clean up at the start of the
> coverletter, instead of starting with adding mTHP support for CPUs
> that lack PMD.

Thanks Usama, I appreciate the review. I'll do this if I need to send a
new version.

> 
> Thanks,
> Usama
> 
>>
>>>
>>> Thanks,
>>> Usama
>>>
>>>>
>>>> This happens because the has_transparent_hugepage() helper is overloaded:
>>>> its name implies it checks whether THP is enabled, but on some architectures
>>>> it actually checks whether the CPU supports PMD-sized pages. In addition,
>>>> the THP and shmem code have a big switch on has_transparent_hugepage().
>>>>
>>>> This series solves this by decoupling THP availability checking from
>>>> querying CPU support for PMD-sized pages. THP availability can be checked
>>>> with IS_ENABLED(CONFIG_TRANSPARENT_HUGEPAGE). For querying PMD-sized page
>>>> support, this series introduces a new helper called pgtable_has_pmd_leaves(),
>>>> which is independent of THP, has well defined semantics and can be used
>>>> in fast paths.
>>>>
>>>> Core THP code and shmem can use pgtable_has_pmd_leaves() to determine
>>>> PMD-sized THP support at page fault time (or folio allocation time for
>>>> shmem), leaving THP and shmem always enabled for other THP sizes. For
>>>> architectures and CPUs that do support PMD-sized pages there's no
>>>> intended change in behavior.
>>>>
>>>> We also convert each user of has_transparent_hugepage(), and the related
>>>> helper thp_disabled_by_hw(), to IS_ENABLED(CONFIG_TRANSPARENT_HUGEPAGE)
>>>> and/or pgtable_has_pmd_leaves() according to the call site's check semantics.
>>>> On s390, powerpc, mips and x86 the arch has_transparent_hugepage()
>>>> implementation is moved out of the CONFIG_TRANSPARENT_HUGEPAGE guard and
>>>> renamed to arch_has_pmd_leaves().
>>>>
>>>> Thanks to David Hildenbrand for suggesting this improvement and for
>>>> providing initial guidance (all bugs and misconceptions are mine).
>>>>
>>>> This applies to mm-new 93f615a22169 ("mm/swap, PM: hibernate: atomically
>>>> replace hibernation pin").
>>>>
>>>> Reporting availability of PMD-sized pages to user-space
>>>> =======================================================
>>>>
>>>> Before this series, not having PMD pages available would shut down THP support
>>>> meaning that /sys/kernel/mm/transparent_hugepage would not be available.
>>>> After this series, /sys/kernel/mm/transparent_hugepage and hpage_pmd_size are
>>>> always available but hugepages-<PMD-size>kB is only available if PMD-sized
>>>> pages are supported.
>>>>
>>>> To me this seems logical, as hugepages-<size>kB is only available if <size>
>>>> is supported. If this is correct, then MM kselftests that depend on PMD-sized
>>>> pages will need to be updated to check for it as they fail with this series
>>>> applied when PMD-sized pages are not available.
>>>>
>>>> The alternative is changing hpage_pmd_size: either don't create the file
>>>> when PMD-sized pages are not available or set hpage_pmd_size=0. My concern
>>>> is that this could be considered an ABI breakage as this file was never
>>>> reported to be optional or report a zero value.
>>>>
>>>> Testing
>>>> =======
>>>>
>>>> - Ran MM kselftests on x86_64 and s390
>>>> - Tested all mTHP sizes allocation on x86_64 (with and without PMD-sized
>>>>     pages available)
>>>> - Tested shmem with within_size w/ mTHP on x86_64 (with and without
>>>>     PMD-sized pages available)
>>>> - Performed defconfig build on x86_64, s390, arm64, powerpc, and mips
>>>>
>>>> NOTES:
>>>>     * I'm forcing arch_has_pmd_leaves() off on x86 to simulate not having
>>>>       PMD-sized pages available
>>>>
>>>>     * Running the MM kselftests when PMD pages are not available causes some
>>>>       tests that depend on PMD-sized THP pages to fail as noted earlier
>>>>
>>>> Changelog
>>>> =========
>>>>
>>>> v8
>>>> --
>>>> - Fixed build breakage on MIPS (Lance)
>>>> - Rebased on top of mm-new (fixed conflicts in include/linux/pgtable.h and
>>>>     mm/shmem.c - dropped a Reviewed-by as a result)
>>>>
>>>> v7
>>>> --
>>>> - Applied on top of latest mm-new
>>>> - Improved various changelogs including cover-letter
>>>> - Changed arch_has_pmd_leaves() default implementation to use IS_ENABLED()
>>>>     instead of IS_BUILTIN()
>>>>
>>>> v6
>>>> --
>>>> - Rebased on top of mm-unstable (required a minor conflict resolution)
>>>> - Added more Reviewed-by and Acked-by tags
>>>>
>>>> v5
>>>> --
>>>> - Moved init_arch_has_pmd_leaves() to mm_core_init() (David)
>>>> - Renamed init_arch_has_pmd_leaves() to pgtable_leaf_support_init() (Lance)
>>>> - Added new patch changing shmem_getattr() to set blksize according to
>>>>     highest supported THP order (Baolin)
>>>> - Added new patches to move has_transparent_hugepage() out of
>>>>     CONFIG_TRANSPARENT_HUGEPAGE guards
>>>> - shmem_allowable_huge_orders(): rename variable and only disable
>>>>     PMD_ORDER (David)
>>>> - Added <linux/jmp_label.h> to include/linux/pgtable.h
>>>> - Added new tags and removed Reviewed-by from changed patches
>>>>
>>>> v4
>>>> --
>>>> - Used static key for pgtable_has_pmd_leaves() API (Lance)
>>>> - Moved shmem pgtable_has_pmd_leaves() check to
>>>>     shmem_allowable_huge_orders() (Baolin)
>>>> - Default pgtable_has_pmd_leaves() implementation to
>>>>     IS_ENABLED(CONFIG_HAVE_ARCH_TRANSPARENT_HUGEPAGE) (Zi)
>>>> - Dropped patch “mm: thp: x86: cleanup PSE feature bit usage” (Dave)
>>>>
>>>> v3
>>>> --
>>>> - Rebased on top of latest Linus tree
>>>> - Removed i915 patch as driver dropped has_transparent_hugepage() usage
>>>> - Moved init_arch_has_pmd_leaves() call in start_kernel() to avoid conflict
>>>>     with early_param handlers clearing CPU feature flags
>>>> - Fixed build error with CONFIG_MMU=n (kernel test robot)
>>>> - Fixed huge_anon_orders_inherit default setting when !pgtable_has_pmd_leaves() (Baolin)
>>>> - Small commit changelog improvements
>>>>
>>>> v2
>>>> --
>>>> - Added support for always enabling mTHPs for shmem (Baolin)
>>>> - Improved commits changelog & added reviewed-by
>>>>
>>>> v1
>>>> --
>>>> - Call init_arch_has_pmd_leaves() from start_kernel()
>>>> - Keep pgtable_has_pmd_leaves() calls tied to CONFIG_TRANSPARENT_HUGEPAGE (David)
>>>> - Clear PUD_ORDER when clearing PMD_ORDER (David)
>>>> - Small changelog improvements (David)
>>>> - Rebased on top of latest mm-new
>>>>
>>>> Luiz Capitulino (14):
>>>>     docs: tmpfs: remove implementation detail reference
>>>>     mm: shmem: shmem_getattr(): set blksize to highest supported THP order
>>>>     mm: introduce pgtable_has_pmd_leaves()
>>>>     drivers: dax: use pgtable_has_pmd_leaves()
>>>>     drivers: nvdimm: use pgtable_has_pmd_leaves()
>>>>     mm: debug_vm_pgtable: use pgtable_has_pmd_leaves()
>>>>     mm: shmem: allow THP support determination at folio allocation time
>>>>     s390: move has_transparent_hugepage() out of THP guard
>>>>     powerpc: move has_transparent_hugepage() out of THP guard
>>>>     mips: move has_transparent_hugepage() out of THP guard
>>>>     x86: move has_transparent_hugepage() out of THP guard
>>>>     treewide: introduce arch_has_pmd_leaves()
>>>>     mm: replace thp_disabled_by_hw() with pgtable_has_pmd_leaves()
>>>>     mm: thp: always enable mTHP support
>>>>
>>>>    Documentation/filesystems/tmpfs.rst           |  5 ++--
>>>>    arch/mips/include/asm/pgtable.h               |  6 ++--
>>>>    arch/mips/mm/pgtable.c                        | 25 ++++++++++++++++
>>>>    arch/mips/mm/tlb-r4k.c                        | 22 --------------
>>>>    arch/powerpc/include/asm/book3s/64/hash-4k.h  |  2 +-
>>>>    arch/powerpc/include/asm/book3s/64/hash-64k.h |  2 +-
>>>>    arch/powerpc/include/asm/book3s/64/pgtable.h  | 18 ++++++------
>>>>    arch/powerpc/include/asm/book3s/64/radix.h    | 14 ++++-----
>>>>    arch/powerpc/mm/book3s64/hash_pgtable.c       |  8 ++---
>>>>    arch/s390/include/asm/pgtable.h               |  6 ++--
>>>>    arch/x86/include/asm/pgtable.h                | 12 ++++----
>>>>    drivers/dax/dax-private.h                     |  2 +-
>>>>    drivers/nvdimm/pfn_devs.c                     |  6 ++--
>>>>    include/linux/huge_mm.h                       |  7 -----
>>>>    include/linux/pgtable.h                       | 21 ++++++++++++--
>>>>    mm/debug_vm_pgtable.c                         | 20 ++++++-------
>>>>    mm/huge_memory.c                              | 27 ++++++++++++-----
>>>>    mm/memory.c                                   | 11 ++++++-
>>>>    mm/mm_init.c                                  |  1 +
>>>>    mm/shmem.c                                    | 29 ++++++++++++-------
>>>>    20 files changed, 144 insertions(+), 100 deletions(-)
>>>>
>>>
>>
>>
> 


      reply	other threads:[~2026-09-22  2:11 UTC|newest]

Thread overview: 29+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-09-18  1:45 Luiz Capitulino
2026-09-18  1:45 ` [PATCH v8 01/14] docs: tmpfs: remove implementation detail reference Luiz Capitulino
2026-09-18  1:45 ` [PATCH v8 02/14] mm: shmem: shmem_getattr(): set blksize to highest supported THP order Luiz Capitulino
2026-09-18  1:45 ` [PATCH v8 03/14] mm: introduce pgtable_has_pmd_leaves() Luiz Capitulino
2026-09-22  2:07   ` Zi Yan
2026-09-18  1:45 ` [PATCH v8 04/14] drivers: dax: use pgtable_has_pmd_leaves() Luiz Capitulino
2026-09-22  2:08   ` Zi Yan
2026-09-18  1:45 ` [PATCH v8 05/14] drivers: nvdimm: " Luiz Capitulino
2026-09-18  1:45 ` [PATCH v8 06/14] mm: debug_vm_pgtable: " Luiz Capitulino
2026-09-18  1:45 ` [PATCH v8 07/14] mm: shmem: allow THP support determination at folio allocation time Luiz Capitulino
2026-09-22  2:20   ` Zi Yan
2026-09-23  1:37     ` Luiz Capitulino
2026-09-18  1:45 ` [PATCH v8 08/14] s390: move has_transparent_hugepage() out of THP guard Luiz Capitulino
2026-09-22  2:21   ` Zi Yan
2026-09-18  1:45 ` [PATCH v8 09/14] powerpc: " Luiz Capitulino
2026-09-18  1:45 ` [PATCH v8 10/14] mips: " Luiz Capitulino
2026-09-18  1:45 ` [PATCH v8 11/14] x86: " Luiz Capitulino
2026-09-18  1:45 ` [PATCH v8 12/14] treewide: introduce arch_has_pmd_leaves() Luiz Capitulino
2026-09-22  2:26   ` Zi Yan
2026-09-18  1:45 ` [PATCH v8 13/14] mm: replace thp_disabled_by_hw() with pgtable_has_pmd_leaves() Luiz Capitulino
2026-09-18  1:45 ` [PATCH v8 14/14] mm: thp: always enable mTHP support Luiz Capitulino
2026-09-18  9:01   ` Baolin Wang
2026-09-21 10:29   ` Usama Arif
2026-09-22  2:06     ` Luiz Capitulino
2026-09-18 10:37 ` [PATCH v8 00/14] " Usama Arif
2026-09-18 14:01   ` Luiz Capitulino
2026-09-18 20:23     ` David Hildenbrand (Arm)
2026-09-21 10:36     ` Usama Arif
2026-09-22  2:11       ` Luiz Capitulino [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=2e6802a6-9815-4fcd-ad72-136efb599d1d@redhat.com \
    --to=luizcap@redhat.com \
    --cc=agordeev@linux.ibm.com \
    --cc=akpm@linux-foundation.org \
    --cc=baolin.wang@linux.alibaba.com \
    --cc=bp@alien8.de \
    --cc=corbet@lwn.net \
    --cc=dave.hansen@linux.intel.com \
    --cc=dave.jiang@intel.com \
    --cc=david@kernel.org \
    --cc=dev.jain@arm.com \
    --cc=djbw@kernel.org \
    --cc=gerald.schaefer@linux.ibm.com \
    --cc=gor@linux.ibm.com \
    --cc=hca@linux.ibm.com \
    --cc=hughd@google.com \
    --cc=lance.yang@linux.dev \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=maddy@linux.ibm.com \
    --cc=mingo@redhat.com \
    --cc=mpe@ellerman.id.au \
    --cc=tglx@kernel.org \
    --cc=tsbogend@alpha.franken.de \
    --cc=usama.arif@linux.dev \
    --cc=vishal.l.verma@intel.com \
    --cc=x86@kernel.org \
    --cc=yintirui@huawei.com \
    --cc=ziy@nvidia.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox

all inboxes | Powered by JetHome®