From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from smtp.kernel.org (aws-us-west-2-korg-mail-alma10-1.taild15c8.ts.net [100.103.45.18]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 01D8037F732; Fri, 17 Jul 2026 18:23:16 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=100.103.45.18 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1784312600; cv=none; b=dR27kW6I4qwHdgBZleXQoPyMrQV4i/Zw9lO+frkrbsTgWHbylMvchRW7kYLfflp25A1XjBmsrnKxfy4XAk0iY0Q622l1SGDTypGGzUNmhOkWey0dXQPST9udb6z3dLJq0PzMYxOdwUNxd7UDdLhtlWPw5sAl9XywSUdVeN3lAoo= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1784312600; c=relaxed/simple; bh=M2DuEa+QMY+cZQChTlOi3eUq8pPFDxokrv+qbMEdb+c=; h=From:Date:Subject:MIME-Version:Content-Type:Message-Id:References: In-Reply-To:To:Cc; b=EMPvGB/T/zOuDYy68AWeXcZWZ+f+pNogC8BYLWQnTcdV8Zn8PNLqUQSyGpqPugmepniS1yPL1OJ4mAo6Tbyh/MMY6e/7pbniztghqj2NEjaDo+fAa6DKJdKm4Q75Cnin7jekru/o2Yy+IX0a5TmudPeKPhJGCf43aOlPTpS8lQA= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=dU5t7A9x; arc=none smtp.client-ip=100.103.45.18 Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="dU5t7A9x" Received: by smtp.kernel.org (Postfix) with ESMTPSA id DC5601F00A3A; Fri, 17 Jul 2026 18:23:06 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kernel.org; s=k20260515; t=1784312595; bh=K9J65l4/3tAXQjoApUsRo6wpq7Iiti7b+Q54PqfKy2U=; h=From:Date:Subject:References:In-Reply-To:To:Cc; b=dU5t7A9xxE1rqZ1PA5/5f+2Wu21cdQEJUSBHMauC5kMnYT1kDL/cyheogHKuFwzqj nvvku9uzuFSlcxKvF6cMFaQKmuQ+XEQbHDw76+48dB8c6jtLQ6mzA9yFY2jYf9S8Qk RMT42K1WAT+Rd9rPdoqum4UcK1jGG/mognui1GF0gBoawsjVNZlFz+ahHQKymI6PH/ 43xsPxmL5ftrK1PmXmi/TQzpS23MDE5C/fzN+mP39M2jWR0qKWuJ7gqIPvmeB9/JNy i6O/EuYQ7aNMaKns/e8vPC/7Yh18CEFXXoq/Ekqu/sxlQUiqneWIVkyE292QIejW/q dah186Oj1sn/w== From: "Lorenzo Stoakes (ARM)" Date: Fri, 17 Jul 2026 19:19:45 +0100 Subject: [PATCH 07/15] mm/rmap: track whether the page VMA mapped walk is anonymous Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Message-Id: <20260717-b4-scalable-cow-virt-pgoff-v1-7-cf24910ef094@kernel.org> References: <20260717-b4-scalable-cow-virt-pgoff-v1-0-cf24910ef094@kernel.org> In-Reply-To: <20260717-b4-scalable-cow-virt-pgoff-v1-0-cf24910ef094@kernel.org> To: Andrew Morton , David Hildenbrand , "Liam R. Howlett" , Vlastimil Babka , Mike Rapoport , Suren Baghdasaryan , Michal Hocko , Jann Horn , Pedro Falcato , "Matthew Wilcox (Oracle)" , Jan Kara , Miaohe Lin , Naoya Horiguchi , Rik van Riel , Harry Yoo , Lance Yang , Kees Cook , Zi Yan , Baolin Wang , Nico Pache , Ryan Roberts , Dev Jain , Barry Song , Usama Arif , Matthew Brost , Joshua Hahn , Rakie Kim , Byungchul Park , Gregory Price , Ying Huang , Alistair Popple , Peter Xu , Xu Xin , Chengming Zhou , Arnd Bergmann , Greg Kroah-Hartman Cc: "Lorenzo Stoakes (ARM)" , linux-mm@kvack.org, linux-kernel@vger.kernel.org, linux-fsdevel@vger.kernel.org, linux-kselftest@vger.kernel.org X-Mailer: b4 0.15.2 X-Developer-Signature: v=1; a=openpgp-sha256; l=3223; i=ljs@kernel.org; h=from:subject:message-id; bh=M2DuEa+QMY+cZQChTlOi3eUq8pPFDxokrv+qbMEdb+c=; b=owGbwMvMwCV2fu7ZrsZH9SKMp9WSGLKiivblzmr2WeH22/fBFcFjy2Ou3tW+uCCw3bjgQOHjH 0eXX1S06yhlYRDjYpAVU2R5/kV8f5BI2LzOC/5uMHNYmUCGMHBxCsBE/MwZ/opfdj+rxXiu75RM 47b+P7fu5Oz4s/ceV0vY+g871Itau4IZ/sfvNxJQ6JsxdS6DQqDQ/FbW4832Wlw/JYqdVn11E7q txAIA X-Developer-Key: i=ljs@kernel.org; a=openpgp; fpr=E7F417BF5214569E89D04F46CF9DCD8A81E27F14 Update the page_vma_mapped_walk structure to track whether the walk is over an anonymous folio or not. This is necessary in order to determine the correct VMA page offset (virtual or not) in vma_address_end() ready for a subsequent change which adjusts which page offset to use depending on this parameter, and update the comment slightly. No functional change intended. Signed-off-by: Lorenzo Stoakes (ARM) --- include/linux/rmap.h | 2 ++ mm/internal.h | 13 ++++++++----- mm/rmap.c | 3 +++ 3 files changed, 13 insertions(+), 5 deletions(-) diff --git a/include/linux/rmap.h b/include/linux/rmap.h index 8dc0871e5f00..a48ae9575bd2 100644 --- a/include/linux/rmap.h +++ b/include/linux/rmap.h @@ -871,6 +871,7 @@ struct page_vma_mapped_walk { pte_t *pte; spinlock_t *ptl; unsigned int flags; + bool is_anon_walk; }; #define DEFINE_FOLIO_VMA_WALK(name, _folio, _vma, _address, _flags) \ @@ -881,6 +882,7 @@ struct page_vma_mapped_walk { .vma = _vma, \ .address = _address, \ .flags = _flags, \ + .is_anon_walk = folio_test_anon(_folio), \ } static inline void page_vma_mapped_walk_done(struct page_vma_mapped_walk *pvmw) diff --git a/mm/internal.h b/mm/internal.h index 73f90aaa979d..7ed8bde7890d 100644 --- a/mm/internal.h +++ b/mm/internal.h @@ -1079,22 +1079,25 @@ static inline unsigned long vma_anon_address(const struct vm_area_struct *vma, } /* - * Then at what user virtual address will none of the range be found in vma? + * At what user virtual address will none of the range be found in vma? * Assumes that vma_address() already returned a good starting address. */ static inline unsigned long vma_address_end(struct page_vma_mapped_walk *pvmw) { - struct vm_area_struct *vma = pvmw->vma; - pgoff_t pgoff; + const struct vm_area_struct *vma = pvmw->vma; + const pgoff_t pgoff = pvmw->pgoff; + pgoff_t pgoff_vma_start; unsigned long address; + pgoff_t pgoff_end; /* Common case, plus ->pgoff is invalid for KSM */ if (pvmw->nr_pages == 1) return pvmw->address + PAGE_SIZE; - pgoff = pvmw->pgoff + pvmw->nr_pages; + pgoff_vma_start = vma_start_pgoff(vma); + pgoff_end = pgoff + pvmw->nr_pages; address = vma->vm_start + - ((pgoff - vma_start_pgoff(vma)) << PAGE_SHIFT); + ((pgoff_end - pgoff_vma_start) << PAGE_SHIFT); /* Check for address beyond vma (or wrapped through 0?) */ if (address < vma->vm_start || address > vma->vm_end) address = vma->vm_end; diff --git a/mm/rmap.c b/mm/rmap.c index 5798427d007f..cfd4195ff1ae 100644 --- a/mm/rmap.c +++ b/mm/rmap.c @@ -1240,8 +1240,10 @@ static bool mapping_wrprotect_range_one(struct folio *folio, .vma = vma, .address = address, .flags = PVMW_SYNC, + .is_anon_walk = false, }; + VM_WARN_ON_ONCE(folio_test_anon(folio)); state->cleaned += page_vma_mkclean_one(&pvmw); return true; @@ -1317,6 +1319,7 @@ int pfn_mkclean_range(unsigned long pfn, unsigned long nr_pages, pgoff_t pgoff, .pgoff = pgoff, .vma = vma, .flags = PVMW_SYNC, + .is_anon_walk = false, }; if (invalid_mkclean_vma(vma, NULL)) -- 2.55.0