From: Muchun Song <muchun.song@linux.dev>
To: Qi Zheng <qi.zheng@linux.dev>
Cc: osalvador@suse.de, david@kernel.org, akpm@linux-foundation.org,
linux-mm@kvack.org, linux-kernel@vger.kernel.org,
Qi Zheng <zhengqi.arch@bytedance.com>
Subject: Re: [PATCH 0/5] mm: hugetlb: add CMA support for PMD-sized page
Date: Mon, 19 Oct 2026 14:50:00 +0800 [thread overview]
Message-ID: <FA455F0C-0A46-4B5B-AB50-E9968001D2C9@linux.dev> (raw)
In-Reply-To: <cover.1792136742.git.zhengqi.arch@bytedance.com>
> On Oct 16, 2026, at 18:07, Qi Zheng <qi.zheng@linux.dev> wrote:
>
> From: Qi Zheng <zhengqi.arch@bytedance.com>
>
> Hi all,
>
> Allocating PMD-sized HugeTLB pages at runtime can become slow or fail
> as physical memory becomes fragmented. Reserving HugeTLB pages at boot
> avoids this problem, but keeps unused pages unavailable to ordinary
> allocations.
>
> Live upgrades are one example: they need additional HugeTLB pages only
> during the upgrade. HugeTLB already supports CMA for gigantic pages,
> but reserving a CMA pool for 1 GiB pages can fail when physical KASLR
> and other early reservations leave too few suitable 1 GiB-aligned
> ranges. At runtime, 1 GiB allocations can also fail when pages cannot
> be migrated out of a suitable contiguous range.
Yes, that's our use case at ByteDance. Allocating a 1GB HugeTLB page from
the CMA pool is more prone to failure than allocating a 2MB one. To improve
the probability of successful allocation, we typically configure the CMA
size to be larger than our actual requirement, keeping a certain margin to
handle cases where temporary kernel operations (such as DMA) prevent successful
migration. For 1G HugeTLB pages, since the margin must be an integer multiple
of 1G, the extra memory configured as headroom is also relatively large,
making it less flexible than 2M pages.
>
> Extend CMA support to PMD-sized pages so their backing memory can be
> reserved at boot while remaining usable for movable allocations until
> needed. This relaxes the reservation alignment requirement and reduces
> the contiguous range required per allocation.
>
> The series adds an optional @<page-size> suffix to hugetlb_cma and a
> separate PMD-sized pool. For example, on x86-64:
>
> hugetlb_cma=4G hugetlb_cma=1G@2M
Different sizes of gigantic pages already share a single HugeTLB CMA pool.
Given that, why not let 2M pages also reuse this same pool? Would that make
the overall code implementation simpler? And if it does make things simpler,
should we go ahead and do it first?
Thanks,
Muchun
>
> This reserves 4G for the existing gigantic-page pool and 1G for the
> PMD-sized pool. Existing unsuffixed parameters and gigantic-page pool
> sharing are preserved. The new size follows the architecture's PMD
> size rather than being fixed at 2M.
>
> The preparatory patches introduce per-pool state and prevent recursive
> CMA allocation during migration before enabling PMD-sized allocation.
>
> Thanks,
> Qi
>
> Qi Zheng (5):
> mm: hugetlb: add explicit page size to hugetlb_cma
> mm: hugetlb: group CMA pool and reservation state
> mm: hugetlb: track CMA reservations by page order
> mm: hugetlb: avoid recursive CMA allocation during migration
> mm: hugetlb: enable CMA allocation for PMD-sized pages
>
> .../admin-guide/kernel-parameters.txt | 39 ++-
> include/linux/hugetlb.h | 4 +-
> mm/hugetlb.c | 80 +++--
> mm/hugetlb_cma.c | 328 ++++++++++++------
> mm/hugetlb_cma.h | 11 +-
> mm/mempolicy.c | 2 +-
> mm/migrate.c | 3 +-
> 7 files changed, 306 insertions(+), 161 deletions(-)
>
>
> base-commit: b810335a0699d1810683796b0e3ffe8827ddfe6c
> --
> 2.54.0
>
next prev parent reply other threads:[~2026-10-19 6:50 UTC|newest]
Thread overview: 21+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-10-16 10:07 Qi Zheng
2026-10-16 10:07 ` [PATCH 1/5] mm: hugetlb: add explicit page size to hugetlb_cma Qi Zheng
2026-10-17 17:31 ` Jose A. Perez de Azpillaga
2026-10-16 10:07 ` [PATCH 2/5] mm: hugetlb: group CMA pool and reservation state Qi Zheng
2026-10-17 17:53 ` Jose A. Perez de Azpillaga
2026-10-16 10:07 ` [PATCH 3/5] mm: hugetlb: track CMA reservations by page order Qi Zheng
2026-10-17 18:41 ` Jose A. Perez de Azpillaga
2026-10-19 7:10 ` Qi Zheng
2026-10-16 10:07 ` [PATCH 4/5] mm: hugetlb: avoid recursive CMA allocation during migration Qi Zheng
2026-10-17 18:54 ` Jose A. Perez de Azpillaga
2026-10-19 7:17 ` Qi Zheng
2026-10-16 10:07 ` [PATCH 5/5] mm: hugetlb: enable CMA allocation for PMD-sized pages Qi Zheng
2026-10-17 19:07 ` Jose A. Perez de Azpillaga
2026-10-19 7:32 ` Qi Zheng
2026-10-19 6:50 ` Muchun Song [this message]
2026-10-19 7:37 ` [PATCH 0/5] mm: hugetlb: add CMA support for PMD-sized page Qi Zheng
2026-10-19 7:50 ` Muchun Song
2026-10-19 8:20 ` Jose A. Perez de Azpillaga
2026-10-19 8:43 ` Muchun Song
2026-10-19 9:17 ` Jose A. Perez de Azpillaga
2026-10-19 12:18 ` David Hildenbrand (Arm)
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=FA455F0C-0A46-4B5B-AB50-E9968001D2C9@linux.dev \
--to=muchun.song@linux.dev \
--cc=akpm@linux-foundation.org \
--cc=david@kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=osalvador@suse.de \
--cc=qi.zheng@linux.dev \
--cc=zhengqi.arch@bytedance.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®