From: Kefeng Wang <wangkefeng.wang@huawei.com>
To: Oscar Salvador <osalvador@suse.de>, Usama Arif <usamaarif642@gmail.com>
Cc: <muchun.song@linux.dev>, <david@redhat.com>,
Andrew Morton <akpm@linux-foundation.org>,
<shakeel.butt@linux.dev>, <linux-mm@kvack.org>,
<hannes@cmpxchg.org>, <riel@surriel.com>, <kas@kernel.org>,
<linux-kernel@vger.kernel.org>, <kernel-team@meta.com>
Subject: Re: [PATCH v2 2/2] mm/hugetlb: allow overcommitting gigantic hugepages
Date: Mon, 13 Oct 2025 20:56:07 +0800 [thread overview]
Message-ID: <876040d3-d814-49cd-9829-a36afd320a09@huawei.com> (raw)
In-Reply-To: <aOyxle8OJPMKlVWX@localhost.localdomain>
On 2025/10/13 16:00, Oscar Salvador wrote:
> On Thu, Oct 09, 2025 at 06:24:31PM +0100, Usama Arif wrote:
>> Currently, gigantic hugepages cannot use the overcommit mechanism
>> (nr_overcommit_hugepages), forcing users to permanently reserve memory via
>> nr_hugepages even when pages might not be actively used.
>>
>> The restriction was added in 2011 [1], which was before there was support
>> for reserving 1G hugepages at runtime.
>> Remove this blanket restriction on gigantic hugepage overcommit.
>> This will bring the same benefits to gigantic pages as hugepages:
>>
>> - Memory is only taken out of regular use when actually needed
>> - Unused surplus pages can be returned to the system
>> - Better memory utilization, especially with CMA backing which can
>> significantly increase the changes of hugepage allocation
>>
>> Without this patch:
>> echo 3 > /sys/kernel/mm/hugepages/hugepages-1048576kB/nr_overcommit_hugepages
>> bash: echo: write error: Invalid argument
>>
>> With this patch:
>> echo 3 > /sys/kernel/mm/hugepages/hugepages-1048576kB/nr_overcommit_hugepages
>> ./mmap_hugetlb_test
>> Successfully allocated huge pages at address: 0x7f9d40000000
>>
>> cat mmap_hugetlb_test.c
>> ...
>> unsigned long ALLOC_SIZE = 3 * (unsigned long) HUGE_PAGE_SIZE;
>> addr = mmap(NULL,
>> ALLOC_SIZE, // 3GB
>> PROT_READ | PROT_WRITE,
>> MAP_PRIVATE | MAP_ANONYMOUS | MAP_HUGETLB | MAP_HUGE_1GB,
>> -1,
>> 0);
>>
>> if (addr == MAP_FAILED) {
>> fprintf(stderr, "mmap failed: %s\n", strerror(errno));
>> return 1;
>> }
>> printf("Successfully allocated huge pages at address: %p\n", addr);
>> ...
>>
>> [1] https://git.zx2c4.com/linux-rng/commit/mm/hugetlb.c?id=adbe8726dc2a3805630d517270db17e3af86e526
>>
>> Signed-off-by: Usama Arif <usamaarif642@gmail.com>
Reviewed-by: Kefeng Wang <wangkefeng.wang@huawei.com>
>
> I guess nobody bothered to do this after we added support for 1GB hugepages because
> creating those at runtime is tricky, and in my experience, almost everybody reserves
> those at boot time.
> But I do not have objections to make them behave as normal hugepages:
We do have cases to allocate 1G hugepages at runtime and we enable
migrate 1G hugepages in alloc_migrate_hugetlb_folio() too :)
I will send a patch to enable gigantic pages migration based on this one.
>
> Acked-by: Oscar Salvador <osalvador@suse.de>
>
>
>
next prev parent reply other threads:[~2025-10-13 12:56 UTC|newest]
Thread overview: 12+ messages / expand[flat|nested] mbox.gz Atom feed top
2025-10-09 17:24 [PATCH v2 1/2] mm/hugetlb: create hstate_is_gigantic_no_runtime helper Usama Arif
2025-10-09 17:24 ` [PATCH v2 2/2] mm/hugetlb: allow overcommitting gigantic hugepages Usama Arif
2025-10-10 0:32 ` Shakeel Butt
2025-10-13 8:00 ` Oscar Salvador
2025-10-13 12:56 ` Kefeng Wang [this message]
2025-10-09 19:11 ` [PATCH v2 1/2] mm/hugetlb: create hstate_is_gigantic_no_runtime helper SeongJae Park
2025-10-09 19:24 ` SeongJae Park
2025-10-10 11:53 ` Usama Arif
2025-10-10 0:31 ` Shakeel Butt
2025-10-13 7:56 ` Oscar Salvador
2025-10-13 8:04 ` David Hildenbrand
2025-10-13 12:49 ` Kefeng Wang
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=876040d3-d814-49cd-9829-a36afd320a09@huawei.com \
--to=wangkefeng.wang@huawei.com \
--cc=akpm@linux-foundation.org \
--cc=david@redhat.com \
--cc=hannes@cmpxchg.org \
--cc=kas@kernel.org \
--cc=kernel-team@meta.com \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=muchun.song@linux.dev \
--cc=osalvador@suse.de \
--cc=riel@surriel.com \
--cc=shakeel.butt@linux.dev \
--cc=usamaarif642@gmail.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®