From mboxrd@z Thu Jan 1 00:00:00 1970 Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.remote-ip=100.103.45.18 ARC-Seal: i=1; d=subspace.kernel.org; s=arc20261015; a=rsa-sha256; cv=none; t=1793797315; b=MtY1RG9KyEWDbTn10EtH2fXcwF99VQZ7sFQyuPiuQmeszfw+n+aN5Sf5H99zhG8ROvXw 6Tq+GdJn8cYcW0yTkrFzzM1AhqqDHwXtOyGfQKK3Mck/qJTr6fzpbgyxnjZgplVvPg86l Vdi8+Go+yR+2sgoWnzj+7e2kKCuChbNl39GjtcKT8buf9I7bJqGjr1rG8irim6fyviXWj qLaM62Qm7/+WC2Pi2GUhs/pd5arTw45LXzO8AG9SJZOTRoEU5RgK2RhjUxZwI2gQEbAH3 vo2pi/CfAJsn/J/Qtp+nIm2oNRJtMRNrtpNbr3oToqtYEOmKGLwTguCMZDXrHbpx0fg== ARC-Message-Signature: i=1; d=subspace.kernel.org; s=arc20261015; a=rsa-sha256; c=relaxed/relaxed; t=1793797315; h=Received:DKIM-Signature:Received:Received:X-ME-Sender:X-ME-Received: X-ME-Proxy-Cause:X-ME-Proxy:Feedback-ID:Received:From:To:Cc:Subject: Date:Message-ID:X-Mailer:In-Reply-To:References:MIME-Version: Content-Transfer-Encoding; bh=B0IkSILmEXDD5SZITUdfDPnAIvH/qKn4TnRnHPUh0Ts=; b=kPZOyg/YaPrZuCQLVbkgyMMWpl6wAh+5XFSbWPsIKvdl+YZ75IaKxNmYnS+u42fXt0uS FnEMHIPePK8fDNb4MuZrqTSPHzav9U6B3SDHZIPvvMhJKqhEowCvh0fjn7Bh30uZ4crbU Ta5SSIzJZk6ZEZ1Kq9TueW7slyjzA1XAQgoWPBHsU+1RVGR8rfgdXzZSJgzZrmVp5ZJ+W 7JLidfaxi/5NJsjHoXHOcqmB7si74ihQYfbfFK8ChBzIL2V6x6Jhypxv2OKA7tW5WCtBe hPqMVovD+OL1clH6zLfn+FkCRlKdGt6aXk6hheXBTXXr71aPllzE7cpSxNrQpRKDODw== ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dkim=pass header.d=kernel.org header.i=@kernel.org header.a=rsa-sha256 header.s=k20260515 header.b=Y0479LVW; arc=none smtp.remote-ip=100.103.45.18 Received: from smtp.kernel.org (quasi.space.kernel.org [100.103.45.18]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (prime256v1)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id E6168606A328 for ; Wed, 4 Nov 2026 13:01:54 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key, unprotected) header.d=kernel.org header.i=@kernel.org header.a=rsa-sha256 header.s=k20260515 header.b=Y0479LVW Received: by smtp.kernel.org (Postfix) with ESMTPSA id 3988F1F00A16; Wed, 4 Nov 2026 13:01:52 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kernel.org; s=k20260515; t=1793797314; bh=B0IkSILmEXDD5SZITUdfDPnAIvH/qKn4TnRnHPUh0Ts=; h=From:To:Cc:Subject:Date:In-Reply-To:References; b=Y0479LVWvlu+9+3PzgSZV2uC+ritdufcx9vGHq+lshd7jSJrwnFMQUSbFmv56YLUu zxDh59+EATUG1ivsQ8g43sG/eklybIf9NWqqSFXXshqJEbV7gewbP3OOpT+loRVRAw lIez8+PLglXDFURuNPNWWpSAJLbB/dMnuShr8HGfjeGonV9vI5oo1NzK0ofzxwXHGv RPknIT9HORPceu97Q2j0dZC0yrQnQ9bYjb17VCgrZipldK50qc1Zu/wqJeqS+VxHvY CokeOlcHMUk4AYGTjQaQ0k/6mp2mRWgdWKopUC5lISChV+Dv+cdi14B4ZIZE4gQLHE taM+i6V2sAthA== Received: from phl-compute-01.internal (phl-compute-01.internal [10.202.2.41]) by mailfauth.ams.internal (Postfix) with ESMTP id 09C571980052; Wed, 4 Nov 2026 08:01:46 -0500 (EST) Received: from phl-frontend-03 ([10.202.2.162]) by phl-compute-01.internal (MEProxy); Wed, 04 Nov 2026 08:01:50 -0500 X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: dmFkZTGhPc1Yg5t9Q8eRQaKCLT0heVoXQqf6h4uqMuRtXQYzheOI1jp47nBw26mcWoxz9A DH10HnpPYob7RxaCTf32YkHXSpJmh1hLC1IxxzXB90aJAI2wMnFT+nxhjDMKjWZ9Ablulj X6EGhbUdQWvr3vCsmIbyKlTdtYm8QJi2H9b42DzXiIRq27TGzwIAKeq7xgftm17WrW++J+ RK/ZhBFKi/01LbyIuttpTNhw8T5nzUYT3/gbSIkELTYoQfWYa9TU1xDsUR8Sja7r663Vhq dT9Vb6Q8iqTkFCbamg7ObiOCckNJsrzr7UPmHz2jvO2iFJ92ew01ZxP0mcoMzU2JutwOgh Deo/g8HEwAnSd00+Sk/Osdm3LkGjObnA/8QcZNGNOZB+xfOYdGiUNVUf88aFswCacRCBmh hokiHdjKaDT29DPVI5Gwiwh/q+igH0C/vvAF0DQfDnNNnYvNgvu66w2jS7vOo6qH6K+7yt nAK3PvNPliSxNz0oqqpOCzOQhLaohJNb1Vx14bhmF4ydiadh2RekHpyLnGH/Zwua5u6R6F aDL/oG6RE6eKtnqYtU1aAOsrFBDA4f8uYS5E4pjAfQtiTgIi2w20lgAILHMHHRHj2bJ86f yYuNqEQjBPE6f07SQgmnAFPAvn5ztU/tCIiy0YSmAyRxyx7vxhdWM+6YJTRA X-ME-Proxy: Feedback-ID: i10464835:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA; Wed, 4 Nov 2026 08:01:45 -0500 (EST) From: "Kiryl Shutsemau (Meta)" To: Andrew Morton , Linus Torvalds , David Hildenbrand , Matthew Wilcox , Vlastimil Babka , Lorenzo Stoakes , Jan Kara , Hugh Dickins , Christian Brauner , Alexander Viro , Harry Yoo Cc: "Kiryl Shutsemau (Meta)" , Miklos Szeredi , Miaohe Lin , Naoya Horiguchi , Oscar Salvador , "Liam R. Howlett" , Mike Rapoport , Suren Baghdasaryan , Michal Hocko , Brendan Jackman , Johannes Weiner , Zi Yan , Baolin Wang , Nico Pache , Ryan Roberts , Dev Jain , Barry Song , Lance Yang , Usama Arif , Kairui Song , Qi Zheng , Shakeel Butt , Axel Rasmussen , Yuanchu Xie , Wei Xu , Baoquan He , "Paul E. McKenney" , Pedro Falcato , Luis Chamberlain , Ilya Gladyshev , Jaegeuk Kim , linux-mm@kvack.org, linux-kernel@vger.kernel.org, linux-fsdevel@vger.kernel.org, fuse-devel@lists.linux.dev, kernel-team@meta.com Subject: [RFC PATCH v2 04/18] mm: count the pages waiting for a grace period Date: Wed, 4 Nov 2026 13:01:00 +0000 Message-ID: <20261104130118.2507513-5-kas@kernel.org> X-Mailer: git-send-email 2.54.0 In-Reply-To: <20261104130118.2507513-1-kas@kernel.org> References: <20261104130118.2507513-1-kas@kernel.org> X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Post: List-Help: List-Subscribe: List-Unsubscribe: List-Owner: Precedence: list MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Deferred folios have refcount 0 and are not on the free lists, so no counter shows them. Memory that waits for a grace period is missing from the free count and from every LRU count. Count it per zone in NR_FREE_RCU_PAGES: nr_free_rcu in /proc/vmstat, free_rcu in show_free_areas(). Preparation for freeing the waiting pages sooner when they hold back memory that is needed. Signed-off-by: Kiryl Shutsemau (Meta) --- include/linux/mmzone.h | 1 + mm/page_alloc.c | 4 ++++ mm/show_mem.c | 9 ++++++--- mm/vmstat.c | 2 ++ 4 files changed, 13 insertions(+), 3 deletions(-) diff --git a/include/linux/mmzone.h b/include/linux/mmzone.h index 94f9c3ff5416..3336b9e5ee99 100644 --- a/include/linux/mmzone.h +++ b/include/linux/mmzone.h @@ -228,6 +228,7 @@ enum zone_stat_item { NR_ZSPAGES, /* allocated in zsmalloc */ #endif NR_FREE_CMA_PAGES, + NR_FREE_RCU_PAGES, /* freed, waiting for an RCU grace period */ #ifdef CONFIG_UNACCEPTED_MEMORY NR_UNACCEPTED, #endif diff --git a/mm/page_alloc.c b/mm/page_alloc.c index a371e92da273..15bb66e36304 100644 --- a/mm/page_alloc.c +++ b/mm/page_alloc.c @@ -1348,6 +1348,8 @@ static void rcu_free_pages(struct list_head *list) folio_batch_init(&fbatch); list_for_each_entry_safe(folio, next, list, lru) { + mod_zone_page_state(folio_zone(folio), NR_FREE_RCU_PAGES, + -folio_nr_pages(folio)); if (!folio_batch_add(&fbatch, folio)) { free_unref_folios(&fbatch); cond_resched_tasks_rcu_qs(); @@ -1375,9 +1377,11 @@ static void rcu_free_workfn(struct work_struct *work) static void rcu_free_defer(struct folio *folio) { struct rcu_free_pcpu *r = raw_cpu_ptr(&rcu_free_pcpu); + struct zone *zone = folio_zone(folio); unsigned long flags; spin_lock_irqsave(&r->lock, flags); + __mod_zone_page_state(zone, NR_FREE_RCU_PAGES, folio_nr_pages(folio)); list_add_tail(&folio->lru, &r->pending); rcu_free_start(r); spin_unlock_irqrestore(&r->lock, flags); diff --git a/mm/show_mem.c b/mm/show_mem.c index b938cbcd774a..0d3bddbda108 100644 --- a/mm/show_mem.c +++ b/mm/show_mem.c @@ -204,7 +204,7 @@ static void show_free_areas(unsigned int filter, const nodemask_t *nodemask, " mapped:%lu shmem:%lu pagetables:%lu\n" " sec_pagetables:%lu bounce:%lu\n" " kernel_misc_reclaimable:%lu\n" - " free:%lu free_pcp:%lu free_cma:%lu\n", + " free:%lu free_pcp:%lu free_cma:%lu free_rcu:%lu\n", global_node_page_state(NR_ACTIVE_ANON), global_node_page_state(NR_INACTIVE_ANON), global_node_page_state(NR_ISOLATED_ANON), @@ -224,7 +224,8 @@ static void show_free_areas(unsigned int filter, const nodemask_t *nodemask, global_node_page_state(NR_KERNEL_MISC_RECLAIMABLE), global_zone_page_state(NR_FREE_PAGES), free_pcp, - global_zone_page_state(NR_FREE_CMA_PAGES)); + global_zone_page_state(NR_FREE_CMA_PAGES), + global_zone_page_state(NR_FREE_RCU_PAGES)); for_each_online_pgdat(pgdat) { if (show_mem_node_skip(filter, pgdat->node_id, nodemask)) @@ -325,6 +326,7 @@ static void show_free_areas(unsigned int filter, const nodemask_t *nodemask, " free_pcp:%lukB" " local_pcp:%lukB" " free_cma:%lukB" + " free_rcu:%lukB" "\n", zone->name, K(zone_page_state(zone, NR_FREE_PAGES)), @@ -351,7 +353,8 @@ static void show_free_areas(unsigned int filter, const nodemask_t *nodemask, 0UL, K(free_pcp), K((unsigned long)this_cpu_read(zone->per_cpu_pageset->count)), - K(zone_page_state(zone, NR_FREE_CMA_PAGES))); + K(zone_page_state(zone, NR_FREE_CMA_PAGES)), + K(zone_page_state(zone, NR_FREE_RCU_PAGES))); printk("lowmem_reserve[]:"); for (i = 0; i < MAX_NR_ZONES; i++) printk(KERN_CONT " %ld", zone->lowmem_reserve[i]); diff --git a/mm/vmstat.c b/mm/vmstat.c index 66ed017bde46..64068d73d6d2 100644 --- a/mm/vmstat.c +++ b/mm/vmstat.c @@ -1212,6 +1212,7 @@ const char * const vmstat_text[] = { [I(NR_ZSPAGES)] = "nr_zspages", #endif [I(NR_FREE_CMA_PAGES)] = "nr_free_cma", + [I(NR_FREE_RCU_PAGES)] = "nr_free_rcu", #ifdef CONFIG_UNACCEPTED_MEMORY [I(NR_UNACCEPTED)] = "nr_unaccepted", #endif @@ -2023,6 +2024,7 @@ static int vmstat_refresh(const struct ctl_table *table, int write, switch (i) { case NR_ZONE_WRITE_PENDING: case NR_FREE_CMA_PAGES: + case NR_FREE_RCU_PAGES: continue; } val = atomic_long_read(&vm_zone_stat[i]); -- 2.54.0