mirror of https://lore.kernel.org/lkml/
 help / color / mirror / Atom feed
From: "David Hildenbrand (Arm)" <david@kernel.org>
To: Kiryl Shutsemau <kas@kernel.org>
Cc: Andrew Morton <akpm@linux-foundation.org>,
	Lorenzo Stoakes <ljs@kernel.org>,
	"Liam R. Howlett" <liam@infradead.org>,
	Vlastimil Babka <vbabka@kernel.org>,
	Mike Rapoport <rppt@kernel.org>,
	Suren Baghdasaryan <surenb@google.com>,
	Michal Hocko <mhocko@suse.com>,
	"Matthew Wilcox (Oracle)" <willy@infradead.org>,
	Jan Kara <jack@suse.cz>, Zi Yan <ziy@nvidia.com>,
	Baolin Wang <baolin.wang@linux.alibaba.com>,
	Nico Pache <nico.pache@linux.dev>,
	Ryan Roberts <ryan.roberts@arm.com>, Dev Jain <dev.jain@arm.com>,
	Barry Song <baohua@kernel.org>, Lance Yang <lance.yang@linux.dev>,
	Usama Arif <usama.arif@linux.dev>,
	Matthew Brost <matthew.brost@intel.com>,
	Joshua Hahn <joshua.hahnjy@gmail.com>,
	Byungchul Park <byungchul@sk.com>,
	Gregory Price <gourry@gourry.net>,
	Ying Huang <ying.huang@linux.alibaba.com>,
	Alistair Popple <apopple@nvidia.com>,
	Peter Xu <peterx@redhat.com>,
	Johannes Weiner <hannes@cmpxchg.org>,
	Song Liu <songliubraving@fb.com>, Rik van Riel <riel@surriel.com>,
	Hugh Dickins <hughd@google.com>, Will Deacon <will@kernel.org>,
	"Aneesh Kumar K.V" <aneesh.kumar@kernel.org>,
	Nick Piggin <npiggin@gmail.com>,
	Peter Zijlstra <peterz@infradead.org>,
	Jason Gunthorpe <jgg@ziepe.ca>, Kevin Tian <kevin.tian@intel.com>,
	"Joerg Roedel (AMD)" <joro@8bytes.org>,
	Robin Murphy <robin.murphy@arm.com>,
	Steve Sistare <steven.sistare@oracle.com>,
	John Hubbard <jhubbard@nvidia.com>,
	linux-mm@kvack.org, linux-kernel@vger.kernel.org,
	linux-fsdevel@vger.kernel.org, linux-arch@vger.kernel.org,
	iommu@lists.linux.dev, Chris Mason <mason@kernel.org>,
	stable@vger.kernel.org
Subject: Re: [PATCH 1/5] mm: limit pagecache folio refcount when mapping pages
Date: Sat, 7 Nov 2026 00:25:03 +0100	[thread overview]
Message-ID: <7948ffce-9062-4362-b191-984368bfbaca@kernel.org> (raw)
In-Reply-To: <323500a7-ffca-4285-929e-f667415589a3@kernel.org>

On 11/6/26 21:54, David Hildenbrand (Arm) wrote:
> On 11/6/26 13:38, Kiryl Shutsemau wrote:
>> On Thu, Nov 05, 2026 at 02:10:10PM +0100, David Hildenbrand (Arm) wrote:
>>> With large file folios, overflowing the folio mapcount and refcount
>>> became possible. For anon folios it is currently not really an issue:
>>> each large anon folio can only be mapped once into a process.
>>>
>>> That's not really big news, but it's about time that we do something
>>> about it because some modern technology might find ways to abuse it :)
>>>
>>> One of the enablers for that was commit ddc58f27f9ee ("mm: drop tail page
>>> refcounting"), however, file thp support was added later.
>>>
>>> File folios can be mapped multiple times into the same process, allowing
>>> for processes to hold many references to the same folio.
>>>
>>> As a short-term solution, let's introduce two folio refcount limits:
>>> one for ordinary consumers and one for admins. Leave some headroom
>>> before the refcount goes negative, which we really don't want (having
>>> the mapcount go negative is also not expected).
>>>
>>> Start reporting SIGBUS if we run into limits. When restoring mappings
>>> from migration entries, instead zap the pte/pmd entry. We allow for
>>> slightly exceeding the limit to keep things simpler.
>>>
>>> This is far from ideal, but better than all easy alternatives we can
>>> backport comfortably. For now it fixes the big problem: letting
>>> the refcount (+mapcount) go negative and cause trouble.
>>>
>>> This is only a temporary fix, we'll follow up with something better.
>>>
>>> While the refcount checks are not required for order 0 folios, let's
>>> just add them for consistency: each folio_add_file_rmap*() and
>>> folio_dup_file_rmap*() needs a prior check.
>>>
>>> Also, just document -EHWPOISON for copy_present_ptes() while at it.
>>>
>>> Reported-by: Chris Mason <mason@kernel.org>
>>> Fixes: 800d8c63b2e9 ("shmem: add huge pages support")
>>> Fixes: 99cb0dbd47a1 ("mm,thp: add read-only THP support for (non-shmem) FS")
>>> Fixes: 793917d997df ("mm/readahead: Add large folio readahead")
>>> Cc: stable@vger.kernel.org
>>> Signed-off-by: David Hildenbrand (Arm) <david@kernel.org>
>>> ---
>>>  include/linux/mm.h | 33 +++++++++++++++++++++++++++++++++
>>>  mm/filemap.c       |  6 ++++++
>>>  mm/huge_memory.c   | 24 ++++++++++++++++++++++--
>>>  mm/memory.c        | 23 ++++++++++++++++++++---
>>>  mm/migrate.c       | 11 +++++++++++
>>>  mm/userfaultfd.c   |  4 ++++
>>>  6 files changed, 96 insertions(+), 5 deletions(-)
>>>
>>> diff --git a/include/linux/mm.h b/include/linux/mm.h
>>> index a2dd76cc5bbfe..79ae8fc0d6bb4 100644
>>> --- a/include/linux/mm.h
>>> +++ b/include/linux/mm.h
>>> @@ -8,6 +8,7 @@
>>>  #include <linux/gfp.h>
>>>  #include <linux/pgalloc_tag.h>
>>>  #include <linux/bug.h>
>>> +#include <linux/capability.h>
>>>  #include <linux/list.h>
>>>  #include <linux/mmzone.h>
>>>  #include <linux/rbtree.h>
>>> @@ -2228,6 +2229,38 @@ vm_fault_t finish_fault(struct vm_fault *vmf);
>>>  #define folio_ref_zero_or_close_to_overflow(folio) \
>>>  	((unsigned int) folio_ref_count(folio) + 127u <= 127u)
>>>  
>>> +/* Leave separate reserves for administrators and concurrent reference gains. */
>>> +#define FOLIO_REF_COUNT_LIMIT		(INT_MAX - (1U << 26))
>>> +#define FOLIO_REF_COUNT_ADMIN_LIMIT	(INT_MAX - (1U << 25))
>>> +
>>> +/**
>>> + * folio_ref_count_over_limit - Check whether to refuse more folio references.
>>> + * @folio: The folio.
>>> + *
>>> + * Relevant for large pagecache folios (!hugetlb). For these, we have to check
>>> + * before adding page table mappings or other significant refcount users whether
>>> + * we are close to our folio ref count limit, to avoid overflows.
>>> + *
>>> + * Checking this for other folios does no harm but is mostly unnecessary.
>>> + *
>>> + * This check is an approximation; we leave some headroom such that concurrent
>>> + * increments, batches and temporary references are not a problem.
>>> + *
>>> + * Return: True if the caller should refuse additional references, false
>>> + * otherwise.
>>> + */
>>> +static inline bool folio_ref_count_over_limit(const struct folio *folio)
>>> +{
>>> +	const unsigned int ref_count = folio_ref_count(folio);
>>> +
>>> +	if (likely(ref_count < FOLIO_REF_COUNT_LIMIT))
>>> +		return false;
>>> +	if (ref_count >= FOLIO_REF_COUNT_ADMIN_LIMIT)
>>> +		return true;
>>> +	/* Background threads must not consume admin reserves. */
>>> +	return (current->flags & PF_KTHREAD) || !capable(CAP_SYS_RESOURCE);
>>> +}
>>> +
>>>  /**
>>>   * folio_get - Increment the reference count on a folio.
>>>   * @folio: The folio.
>>
>> Does the slow path need to be inline at all 15 call sites, GUP-fast
>> among them?
> 
> It's not a lot of code. Do we really care?
> 
> E.g., in gup.c, the compiler is free to not inline into each of the two callsites.
> 

Okay, I ended up splitting it up. A bit nsaty now that fuse will require an
exported symbol.

>>
>> Maybe only leave the likely() check in inline and move the rest into a
>> function call?
>>
>> Something like:
>>
>> static inline bool folio_ref_count_over_limit(const struct folio *folio)
>> {
>>         const unsigned int ref_count = folio_ref_count(folio);
>>
>>         if (likely(ref_count < FOLIO_REF_COUNT_LIMIT))
>>                 return false;
>>         return __folio_ref_count_over_limit(ref_count);
>> }
>>
>> bool __folio_ref_count_over_limit(unsigned int ref_count)
>> {
>>         if (ref_count >= FOLIO_REF_COUNT_ADMIN_LIMIT)
>>                 return true;
>>         /* Background threads must not consume admin reserves */
>>         if (current->flags & PF_KTHREAD)
>>                 return true;
>>         return !capable(CAP_SYS_RESOURCE);
>> }
>>
>> Also, should this be capable_noaudit()? I am not sure a refused
>> reference should leave an audit record. cap_vm_enough_memory() checks
>> the admin reserve with CAP_OPT_NOAUDIT.
>>
> 
> Not an expert, but capable_noaudit() sounds good.
> 
> Not sure if that fully resolves sashiko's complaint in the last commit.

Ok, the noaudit definitely seems to be the right thing. But getting overlayfs +
fuse oddities done "better", I am using has_capability_noaudit(current,
CAP_SYS_RESOURCE) now.

Hoping that is the right thing to use now ... review appreciated.

-- 
Cheers,

David


  reply	other threads:[~2026-11-06 23:25 UTC|newest]

Thread overview: 30+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-11-05 13:10 [PATCH 0/5] mm: limit pagecache folio refcount David Hildenbrand (Arm)
2026-11-05 13:10 ` [PATCH 1/5] mm: limit pagecache folio refcount when mapping pages David Hildenbrand (Arm)
2026-11-06  9:11   ` Lance Yang
2026-11-06  9:42   ` Jose A. Perez de Azpillaga
2026-11-06 10:05     ` David Hildenbrand (Arm)
2026-11-06 10:06     ` Lance Yang
2026-11-06 21:23       ` David Hildenbrand (Arm)
2026-11-06 12:38   ` Kiryl Shutsemau
2026-11-06 20:54     ` David Hildenbrand (Arm)
2026-11-06 23:25       ` David Hildenbrand (Arm) [this message]
2026-11-05 13:10 ` [PATCH 2/5] mm: limit pagecache folio refcount when splicing into pipes David Hildenbrand (Arm)
2026-11-06  9:50   ` Jose A. Perez de Azpillaga
2026-11-06 10:03   ` Lance Yang
2026-11-06 21:57     ` David Hildenbrand (Arm)
2026-11-06 17:58   ` Josef Bacik
2026-11-06 20:09     ` David Hildenbrand (Arm)
2026-11-06 20:43       ` Jason Gunthorpe
2026-11-06 20:45         ` David Hildenbrand (Arm)
2026-11-05 13:10 ` [PATCH 3/5] mm/mmu_gather: flush pending references early before the folio limit David Hildenbrand (Arm)
2026-11-06  9:56   ` Jose A. Perez de Azpillaga
2026-11-06 15:15   ` Lance Yang
2026-11-05 13:10 ` [PATCH 4/5] iommufd: fix cleanup when adding memfd folio pins fails David Hildenbrand (Arm)
2026-11-06 15:39   ` Lance Yang
2026-11-06 20:46   ` Jason Gunthorpe
2026-11-05 13:10 ` [PATCH 5/5] mm/gup: limit pagecache folio refcount when grabbing references David Hildenbrand (Arm)
2026-11-06 10:13   ` Jose A. Perez de Azpillaga
2026-11-06 22:42     ` David Hildenbrand (Arm)
2026-11-05 17:51 ` [PATCH 0/5] mm: limit pagecache folio refcount David Hildenbrand (Arm)
2026-11-06 19:49 ` Josef Bacik
2026-11-06 20:31   ` David Hildenbrand (Arm)

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=7948ffce-9062-4362-b191-984368bfbaca@kernel.org \
    --to=david@kernel.org \
    --cc=akpm@linux-foundation.org \
    --cc=aneesh.kumar@kernel.org \
    --cc=apopple@nvidia.com \
    --cc=baohua@kernel.org \
    --cc=baolin.wang@linux.alibaba.com \
    --cc=byungchul@sk.com \
    --cc=dev.jain@arm.com \
    --cc=gourry@gourry.net \
    --cc=hannes@cmpxchg.org \
    --cc=hughd@google.com \
    --cc=iommu@lists.linux.dev \
    --cc=jack@suse.cz \
    --cc=jgg@ziepe.ca \
    --cc=jhubbard@nvidia.com \
    --cc=joro@8bytes.org \
    --cc=joshua.hahnjy@gmail.com \
    --cc=kas@kernel.org \
    --cc=kevin.tian@intel.com \
    --cc=lance.yang@linux.dev \
    --cc=liam@infradead.org \
    --cc=linux-arch@vger.kernel.org \
    --cc=linux-fsdevel@vger.kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=ljs@kernel.org \
    --cc=mason@kernel.org \
    --cc=matthew.brost@intel.com \
    --cc=mhocko@suse.com \
    --cc=nico.pache@linux.dev \
    --cc=npiggin@gmail.com \
    --cc=peterx@redhat.com \
    --cc=peterz@infradead.org \
    --cc=riel@surriel.com \
    --cc=robin.murphy@arm.com \
    --cc=rppt@kernel.org \
    --cc=ryan.roberts@arm.com \
    --cc=songliubraving@fb.com \
    --cc=stable@vger.kernel.org \
    --cc=steven.sistare@oracle.com \
    --cc=surenb@google.com \
    --cc=usama.arif@linux.dev \
    --cc=vbabka@kernel.org \
    --cc=will@kernel.org \
    --cc=willy@infradead.org \
    --cc=ying.huang@linux.alibaba.com \
    --cc=ziy@nvidia.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox

all inboxes | Powered by JetHome®