mirror of https://lore.kernel.org/lkml/
 help / color / mirror / Atom feed
From: Kiryl Shutsemau <kirill@shutemov.name>
To: Usama Arif <usama.arif@linux.dev>
Cc: akpm@linux-foundation.org,
	 "Matthew Wilcox (Oracle)" <willy@infradead.org>,
	David Hildenbrand <david@kernel.org>,
	 Lorenzo Stoakes <ljs@kernel.org>,
	"Liam R. Howlett" <liam@infradead.org>,
	 Vlastimil Babka <vbabka@kernel.org>,
	Mike Rapoport <rppt@kernel.org>,
	 Suren Baghdasaryan <surenb@google.com>,
	Michal Hocko <mhocko@suse.com>, Jan Kara <jack@suse.cz>,
	 Rik van Riel <riel@surriel.com>, Harry Yoo <harry@kernel.org>,
	Lance Yang <lance.yang@linux.dev>,  Jann Horn <jannh@google.com>,
	Alexander Viro <viro@zeniv.linux.org.uk>,
	 Christian Brauner <brauner@kernel.org>,
	"Darrick J. Wong" <djwong@kernel.org>,
	 Carlos Maiolino <cem@kernel.org>,
	Pedro Falcato <pfalcato@suse.de>,
	linux-mm@kvack.org,  linux-fsdevel@vger.kernel.org,
	linux-xfs@vger.kernel.org, linux-kernel@vger.kernel.org,
	 kernel-team@meta.com
Subject: Re: [RFC PATCH 2/5] mm: add a_ops->dirty_folio_range() and use the mkclean dirty harvest
Date: Thu, 10 Sep 2026 15:54:01 +0100	[thread overview]
Message-ID: <aqLC3Uo6TaZ_3_v1@thinkstation> (raw)
In-Reply-To: <20260909105157.1627242-1-usama.arif@linux.dev>

On Wed, Sep 09, 2026 at 03:51:56AM -0700, Usama Arif wrote:
> On Thu,  3 Sep 2026 19:29:40 +0100 Kiryl Shutsemau <kirill@shutemov.name> wrote:
> 
> > From: "Kiryl Shutsemau (Meta)" <kas@kernel.org>
> > 
> > Every way of dirtying part of a folio through a mapping ends up at
> > folio_mark_dirty(), which has no way to say which part changed, so
> > a_ops->dirty_folio() dirties all of it. A filesystem that tracks dirty
> > state per block then writes back the whole folio for a single stored
> > byte.
> > 
> > Add a_ops->dirty_folio_range() and folio_mark_dirty_range() to pass the
> > range on. The new operation can express everything a_ops->dirty_folio()
> > can, so folio_mark_dirty() goes through it with a range covering the
> > folio and a filesystem needs only one of the two. Filesystems without it
> > dirty the whole folio.
> > 
> > Use it in folio_clear_dirty_for_io(), where the page table dirty bits
> > were being turned into a whole-folio dirty. It now collects them with
> > folio_mkclean_dirtymap() and hands the filesystem the runs that were
> > dirty. A folio that is not already dirty still dirties whole, because
> > the clean to dirty transition needs the accounting in folio_mark_dirty().
> > 
> > Assisted-by: Claude:claude-opus-5
> > Signed-off-by: Kiryl Shutsemau (Meta) <kas@kernel.org>
> > ---
> >  include/linux/fs.h  |  3 ++
> >  include/linux/mm.h  |  1 +
> >  mm/page-writeback.c | 87 +++++++++++++++++++++++++++++++++++++++++----
> >  3 files changed, 85 insertions(+), 6 deletions(-)
> > 
> > diff --git a/include/linux/fs.h b/include/linux/fs.h
> > index 072d8cd09a0b..1d98b6c0b880 100644
> > --- a/include/linux/fs.h
> > +++ b/include/linux/fs.h
> > @@ -406,6 +406,9 @@ struct address_space_operations {
> >  
> >  	/* Mark a folio dirty.  Return true if this dirtied it */
> >  	bool (*dirty_folio)(struct address_space *, struct folio *);
> > +	/* Mark [off, off + len) of a folio dirty */
> > +	bool (*dirty_folio_range)(struct address_space *mapping,
> > +				  struct folio *folio, size_t off, size_t len);
> >  
> >  	void (*readahead)(struct readahead_control *);
> >  
> > diff --git a/include/linux/mm.h b/include/linux/mm.h
> > index 87feaa5a2b78..7628262c17e1 100644
> > --- a/include/linux/mm.h
> > +++ b/include/linux/mm.h
> > @@ -3337,6 +3337,7 @@ struct kvec;
> >  struct page *get_dump_page(unsigned long addr, int *locked);
> >  
> >  bool folio_mark_dirty(struct folio *folio);
> > +bool folio_mark_dirty_range(struct folio *folio, size_t off, size_t len);
> >  bool folio_mark_dirty_lock(struct folio *folio);
> >  bool set_page_dirty(struct page *page);
> >  int set_page_dirty_lock(struct page *page);
> > diff --git a/mm/page-writeback.c b/mm/page-writeback.c
> > index 6c9c7ba89b8a..39b54c25a9fa 100644
> > --- a/mm/page-writeback.c
> > +++ b/mm/page-writeback.c
> > @@ -2751,6 +2751,21 @@ bool folio_redirty_for_writepage(struct writeback_control *wbc,
> >  }
> >  EXPORT_SYMBOL(folio_redirty_for_writepage);
> >  
> > +/*
> > + * Hand a dirtied range of @folio to the filesystem.  ->dirty_folio_range() can
> > + * express everything ->dirty_folio() can, so a filesystem that implements it
> > + * does not need both, and a whole-folio dirty comes through here as a range
> > + * covering the folio.
> > + */
> > +static bool mapping_dirty_range(struct address_space *mapping,
> > +				struct folio *folio, size_t off, size_t len)
> > +{
> > +	if (!mapping->a_ops->dirty_folio_range)
> > +		return mapping->a_ops->dirty_folio(mapping, folio);
> > +
> > +	return mapping->a_ops->dirty_folio_range(mapping, folio, off, len);
> > +}
> > +
> >  /**
> >   * folio_mark_dirty - Mark a folio as being modified.
> >   * @folio: The folio.
> > @@ -2782,13 +2797,39 @@ bool folio_mark_dirty(struct folio *folio)
> >  		 */
> >  		if (folio_test_reclaim(folio))
> >  			folio_clear_reclaim(folio);
> > -		return mapping->a_ops->dirty_folio(mapping, folio);
> > +		return mapping_dirty_range(mapping, folio, 0,
> > +					   folio_size(folio));
> >  	}
> >  
> >  	return noop_dirty_folio(mapping, folio);
> >  }
> >  EXPORT_SYMBOL(folio_mark_dirty);
> >  
> > +/**
> > + * folio_mark_dirty_range - Mark part of a folio as being modified.
> > + * @folio: The folio.
> > + * @off: Offset of the modified range within the folio.
> > + * @len: Length of the modified range.
> > + *
> > + * Like folio_mark_dirty(), but tells a filesystem that tracks dirty state per
> > + * block that only [@off, @off + @len) changed, so writeback can skip the rest
> > + * of the folio.  Filesystems without that tracking dirty the whole folio.
> > + *
> > + * Return: True if the folio was newly dirtied, false if it was already dirty.
> > + */
> > +bool folio_mark_dirty_range(struct folio *folio, size_t off, size_t len)
> > +{
> > +	struct address_space *mapping = folio_mapping(folio);
> > +
> > +	if (likely(mapping)) {
> > +		if (folio_test_reclaim(folio))
> > +			folio_clear_reclaim(folio);
> > +		return mapping_dirty_range(mapping, folio, off, len);
> > +	}
> > +
> > +	return noop_dirty_folio(mapping, folio);
> > +}
> > +
> >  /*
> >   * folio_mark_dirty() is racy if the caller has no reference against
> >   * folio->mapping->host, and if the folio is unlocked.  This is because another
> > @@ -2844,6 +2885,41 @@ void __folio_cancel_dirty(struct folio *folio)
> >  }
> >  EXPORT_SYMBOL(__folio_cancel_dirty);
> >  
> > +/*
> > + * Write-protect every mapping of @folio and hand the filesystem the parts that
> > + * were dirty in a page table.
> > + *
> > + * Without ->dirty_folio_range() there is nowhere to put per-block state, so
> > + * any PTE dirty bit dirties the whole folio.  Same when the folio is not
> > + * already dirty, because then the dirty transition needs the full accounting
> > + * in folio_mark_dirty(), and for a folio too large for the bitmap, which the
> > + * page cache does not make.
> > + */
> > +static void folio_mkclean_for_io(struct folio *folio,
> > +				 struct address_space *mapping)
> > +{
> > +	DECLARE_BITMAP(map, 1UL << MAX_PAGECACHE_ORDER);
> > +	unsigned int nr = folio_nr_pages(folio);
> > +	unsigned int start, end;
> > +
> > +	if (!mapping->a_ops->dirty_folio_range || !folio_test_dirty(folio) ||
> > +	    WARN_ON_ONCE(nr > (1UL << MAX_PAGECACHE_ORDER))) {
> > +		if (folio_mkclean(folio))
> > +			folio_mark_dirty(folio);
> > +		return;
> > +	}
> > +
> > +	bitmap_zero(map, nr);
> > +	if (!folio_mkclean_dirtymap(folio, map))
> > +		return;
> > +
> > +	for_each_set_bitrange(start, end, map, nr) {
> > +		mapping_dirty_range(mapping, folio,
> > +				    (size_t)start << PAGE_SHIFT,
> > +				    (size_t)(end - start) << PAGE_SHIFT);
> 
> folio_mark_dirty() clears PG_reclaim, but mapping_dirty_range() doesnt.
> Do you need to clear PG_reclaim here?

Yes, good catch.

Fixup below moves the clearing into mapping_dirty_range(), which is the
one place that reaches the aops, and drops the copies in
folio_mark_dirty() and folio_mark_dirty_range().

Will be folded into v2.

diff --git a/mm/page-writeback.c b/mm/page-writeback.c
index 39b54c25a9fa..4995219eb8be 100644
--- a/mm/page-writeback.c
+++ b/mm/page-writeback.c
@@ -2760,6 +2760,20 @@ EXPORT_SYMBOL(folio_redirty_for_writepage);
 static bool mapping_dirty_range(struct address_space *mapping,
 				struct folio *folio, size_t off, size_t len)
 {
+	/*
+	 * readahead/folio_deactivate could remain
+	 * PG_readahead/PG_reclaim due to race with folio_end_writeback
+	 * About readahead, if the folio is written, the flags would be
+	 * reset. So no problem.
+	 * About folio_deactivate, if the folio is redirtied,
+	 * the flag will be reset. So no problem. but if the
+	 * folio is used by readahead it will confuse readahead
+	 * and make it restart the size rampup process. But it's
+	 * a trivial problem.
+	 */
+	if (folio_test_reclaim(folio))
+		folio_clear_reclaim(folio);
+
 	if (!mapping->a_ops->dirty_folio_range)
 		return mapping->a_ops->dirty_folio(mapping, folio);
 
@@ -2784,19 +2798,6 @@ bool folio_mark_dirty(struct folio *folio)
 	struct address_space *mapping = folio_mapping(folio);
 
 	if (likely(mapping)) {
-		/*
-		 * readahead/folio_deactivate could remain
-		 * PG_readahead/PG_reclaim due to race with folio_end_writeback
-		 * About readahead, if the folio is written, the flags would be
-		 * reset. So no problem.
-		 * About folio_deactivate, if the folio is redirtied,
-		 * the flag will be reset. So no problem. but if the
-		 * folio is used by readahead it will confuse readahead
-		 * and make it restart the size rampup process. But it's
-		 * a trivial problem.
-		 */
-		if (folio_test_reclaim(folio))
-			folio_clear_reclaim(folio);
 		return mapping_dirty_range(mapping, folio, 0,
 					   folio_size(folio));
 	}
@@ -2821,11 +2822,8 @@ bool folio_mark_dirty_range(struct folio *folio, size_t off, size_t len)
 {
 	struct address_space *mapping = folio_mapping(folio);
 
-	if (likely(mapping)) {
-		if (folio_test_reclaim(folio))
-			folio_clear_reclaim(folio);
+	if (likely(mapping))
 		return mapping_dirty_range(mapping, folio, off, len);
-	}
 
 	return noop_dirty_folio(mapping, folio);
 }
-- 
  Kiryl Shutsemau / Kirill A. Shutemov

  reply	other threads:[~2026-09-10 14:54 UTC|newest]

Thread overview: 15+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-09-03 18:29 [RFC PATCH 0/5] mm: sub-folio dirty tracking for PTE-mapped mmap writes Kiryl Shutsemau
2026-09-03 18:29 ` [RFC PATCH 1/5] mm: let folio_mkclean() report which pages had dirty PTEs Kiryl Shutsemau
2026-09-09 10:12   ` Usama Arif
2026-09-10 13:36     ` Kiryl Shutsemau
2026-09-03 18:29 ` [RFC PATCH 2/5] mm: add a_ops->dirty_folio_range() and use the mkclean dirty harvest Kiryl Shutsemau
2026-09-09 10:51   ` Usama Arif
2026-09-10 14:54     ` Kiryl Shutsemau [this message]
2026-09-03 18:29 ` [RFC PATCH 3/5] mm: keep the mmap dirty range down to the faulting page Kiryl Shutsemau
2026-09-03 18:29 ` [RFC PATCH 4/5] iomap: narrow page_mkwrite() dirtying " Kiryl Shutsemau
2026-09-03 18:29 ` [RFC PATCH 5/5] xfs: track mmap dirty state per block Kiryl Shutsemau
2026-09-03 19:55 ` [RFC PATCH 0/5] mm: sub-folio dirty tracking for PTE-mapped mmap writes Pedro Falcato
2026-09-03 21:18   ` Kiryl Shutsemau
2026-09-07 10:15 ` Kiryl Shutsemau
2026-09-09 10:02 ` Usama Arif
2026-09-09 10:15   ` Kiryl Shutsemau

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=aqLC3Uo6TaZ_3_v1@thinkstation \
    --to=kirill@shutemov.name \
    --cc=akpm@linux-foundation.org \
    --cc=brauner@kernel.org \
    --cc=cem@kernel.org \
    --cc=david@kernel.org \
    --cc=djwong@kernel.org \
    --cc=harry@kernel.org \
    --cc=jack@suse.cz \
    --cc=jannh@google.com \
    --cc=kernel-team@meta.com \
    --cc=lance.yang@linux.dev \
    --cc=liam@infradead.org \
    --cc=linux-fsdevel@vger.kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=linux-xfs@vger.kernel.org \
    --cc=ljs@kernel.org \
    --cc=mhocko@suse.com \
    --cc=pfalcato@suse.de \
    --cc=riel@surriel.com \
    --cc=rppt@kernel.org \
    --cc=surenb@google.com \
    --cc=usama.arif@linux.dev \
    --cc=vbabka@kernel.org \
    --cc=viro@zeniv.linux.org.uk \
    --cc=willy@infradead.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox

all inboxes | Powered by JetHome®