From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.129.124]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 88AA43F0AA8 for ; Fri, 29 May 2026 15:22:51 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=170.10.129.124 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1780068173; cv=none; b=Hom7Xg/1CZ2Jaj7gErjcTH9oy7f2ztykKG5Xi0p3813NFqzadumuip/GBJH43zq+F/rPHGUcJZpErx7roP+1OoqFcDXvE320fZ7NFXAJNnFmbF5XR5Vh4b68h/Fl4A6VFlBcWQI+BN3F4ncJ13sNXJa9Fllp/VB126zgdjCp+dw= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1780068173; c=relaxed/simple; bh=8w0BAdcYEx1DYP7LpA2admc4ftuLWgtvGXP7cauVxpA=; h=Date:From:To:Cc:Subject:Message-ID:References:MIME-Version: Content-Type:Content-Disposition:In-Reply-To; b=uONGCKfvcaQmju6SoIT6rlh2WLQUwZHh0FGwJHdxdSN5xSlvixfLDOt4RVYmDc6e83GNUIN/+i/LY8ysmWxWUIa7vzlG+1YgOt5pf6904zO8B7XqjjBvaSmbKZod/8eNPB09RdCDf6NlevKMTkvkQqqQRRhBpRLG/vke4WmDufE= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=redhat.com; spf=pass smtp.mailfrom=redhat.com; dkim=pass (1024-bit key) header.d=redhat.com header.i=@redhat.com header.b=ErqOQrWV; dkim=pass (2048-bit key) header.d=redhat.com header.i=@redhat.com header.b=Q04WtqBd; arc=none smtp.client-ip=170.10.129.124 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=redhat.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=redhat.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=redhat.com header.i=@redhat.com header.b="ErqOQrWV"; dkim=pass (2048-bit key) header.d=redhat.com header.i=@redhat.com header.b="Q04WtqBd" DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1780068170; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=VBSoYVls/goaUOaeb0ArVPkRixJg6uACMT8ZdsicbY4=; b=ErqOQrWVLJzuVZwWYDc0q1rLvwdOrOxMrbMMDsuZVy+QMsW0NTjdQ1v+VkV09ffsuEUY3D 6JqlWmVKzNK5cfUbM8lTtbetDIalQnVFkUoXqMuWdWYncClZGA5af73vuL10GPSP48X53g uhgcmVs+EbjbtzgWu6T1rqdLQmKFSKo= Received: from mail-wm1-f69.google.com (mail-wm1-f69.google.com [209.85.128.69]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-371-kesy4s9SMfe7tLUIqN7rKw-1; Fri, 29 May 2026 11:22:49 -0400 X-MC-Unique: kesy4s9SMfe7tLUIqN7rKw-1 X-Mimecast-MFC-AGG-ID: kesy4s9SMfe7tLUIqN7rKw_1780068168 Received: by mail-wm1-f69.google.com with SMTP id 5b1f17b1804b1-490261c79fcso55614025e9.0 for ; Fri, 29 May 2026 08:22:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=google; t=1780068168; x=1780672968; darn=vger.kernel.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:from:to:cc:subject:date:message-id:reply-to; bh=VBSoYVls/goaUOaeb0ArVPkRixJg6uACMT8ZdsicbY4=; b=Q04WtqBdVcZQD4UJjwiOsDFmDIgEzOy4SmEDM0RJLilto3Pni1gNPTo8YLR6F4KNmO KustQBvZkmve0gCnoBvIheNXPvvamVDEuAHk7akrXhmfoQANCzfg5G28KmTcfmisxaYT mAkUbH1p52ke7H+6BqIGWiVT1VMUDfFj39ZHgRCeqbG/WxpHzP5NKe6lIKIwtgzQs+rV dQoBTgC63JGYkH0m033GbxpSrKdlAAY4z//n6ZcOnc0L/jn3riLG0xIvrBJzz65KSUAu DnwbagaiDsrcdCjlrQCUiGkTdOXXM6rRnVOK4MB/Jm6oVR9U9SOFY0LimDFOgYtP8qgx g4Hw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1780068168; x=1780672968; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-gg:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=VBSoYVls/goaUOaeb0ArVPkRixJg6uACMT8ZdsicbY4=; b=blQx7qulvieZ+XbPDctXzJhLHNVfKG66pEhdNXyc6whMxUAvEARPM+fGArjQo2jBVM m9MahqhnFT4hmuxrC3ubMHQ+tjWj7HIShWc4UQ5N98iNgbvArDqtWDtws/aXduipQhJP 7q8A3So9z9yNEea31qsjDg8EkwQDz259ZKvE5jFOi3ku7+YrH0byjVgscb/enwckvl/o Ymar9HFL8zH+QNU4ZrD3cmmjhfy54wqf0tLFcUhEqMIpnHCt/QFi+Mxu6XceJS955CAR frBT3Hp0sGdT94Q0voQgbSuDHTbUKCOq2yKelszEuhAlEkRZXzIFStkj9TcbXGFCBCFx VyNw== X-Gm-Message-State: AOJu0YwAzPhtt1GoPhImwjRYc2CJ3MV4JPdI/ePAlU9GOSNCj1aJSXks YpZyiK14giVvKm/OAjUL1x4z/V9cFB2jx07+p2987hi6K2Gk5goxejXUiuV0qYkDGtJsfRATSxv sFyOeBdI0kQgLIVSyltxrRxEq2y5tZO9Hx5ubcmCAhEBVd5JpQkWcDfeVE1iv3tbPIaPTVOekDQ xbwblocls7vJ5b6L7YP1MUxD8K1ra3NwdjifDm3LLx4wY= X-Gm-Gg: Acq92OEYEOmRhky3jfir8SvQlAugePTRr8fOfGs0+BFSL7iWw8XsED6SYiJlq7Ty30E oVEbiTyPO/U9rzO+SWTWjRNREywogrBmUFqbu19KloFHzJu4VqrLOU7CwBYjA4SL9kXZx4ffqbr k4QAFsV/gmxKNGe4SXm9oSN0yy1TuZxyWd83IepLTDEK0oOVtcjo1jsi2vVx5pvlh/Wi4r1wold L8sdKy5ETADF8Sf0O75gXsctfCSej4v/sgY/Zl35p+qOJow2xG9qtnYGkg/zSVHmwrYTbh9i29B U1UJLnAnPgFs1gfJn2usGF1pBHyIiaKN4GJOqH6LA+f9lQ0h7bjbP4cBhtvd0zCwPIADov9uOem OkCo6lNYub/RetCQi6F1O0RDwTzSYhmmZ+8+sDvu/Nubt2j35NFp2tQ== X-Received: by 2002:a05:600c:8207:b0:48f:e044:927d with SMTP id 5b1f17b1804b1-4909c62336fmr43495415e9.10.1780068167609; Fri, 29 May 2026 08:22:47 -0700 (PDT) X-Received: by 2002:a05:600c:8207:b0:48f:e044:927d with SMTP id 5b1f17b1804b1-4909c62336fmr43494295e9.10.1780068166844; Fri, 29 May 2026 08:22:46 -0700 (PDT) Received: from redhat.com (IGLD-80-230-25-45.inter.net.il. [80.230.25.45]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-4909caa7faasm50679705e9.11.2026.05.29.08.22.42 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 29 May 2026 08:22:46 -0700 (PDT) Date: Fri, 29 May 2026 11:22:42 -0400 From: "Michael S. Tsirkin" To: linux-kernel@vger.kernel.org Cc: "David Hildenbrand (Arm)" , Jason Wang , Xuan Zhuo , Eugenio =?utf-8?B?UMOpcmV6?= , Muchun Song , Oscar Salvador , Andrew Morton , Lorenzo Stoakes , "Liam R. Howlett" , Vlastimil Babka , Mike Rapoport , Suren Baghdasaryan , Michal Hocko , Brendan Jackman , Johannes Weiner , Zi Yan , Baolin Wang , Nico Pache , Ryan Roberts , Dev Jain , Barry Song , Lance Yang , Hugh Dickins , Matthew Brost , Joshua Hahn , Rakie Kim , Byungchul Park , Gregory Price , Ying Huang , Alistair Popple , Christoph Lameter , David Rientjes , Roman Gushchin , Harry Yoo , Axel Rasmussen , Yuanchu Xie , Wei Xu , Chris Li , Kairui Song , Kemeng Shi , Nhat Pham , Baoquan He , virtualization@lists.linux.dev, linux-mm@kvack.org, Andrea Arcangeli Subject: [PATCH v9 08/37] mm: add alloc_contig_frozen_pages_user for cache-friendly zeroing Message-ID: References: Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Mailer: git-send-email 2.27.0.106.g8ac3dc51b1 X-Mutt-Fcc: =sent Add a _user variant of alloc_contig_frozen_pages that accepts a user_addr parameter for cache-friendly zeroing of contiguous allocations. No functional change; all existing callers continue to pass USER_ADDR_NONE. Signed-off-by: Michael S. Tsirkin Assisted-by: Claude:claude-opus-4-6 --- include/linux/gfp.h | 6 ++++++ mm/page_alloc.c | 32 +++++++++++++++++++++++++------- 2 files changed, 31 insertions(+), 7 deletions(-) diff --git a/include/linux/gfp.h b/include/linux/gfp.h index ee35c5367abc..73109d4e31a4 100644 --- a/include/linux/gfp.h +++ b/include/linux/gfp.h @@ -453,6 +453,12 @@ struct page *alloc_contig_frozen_pages_noprof(unsigned long nr_pages, #define alloc_contig_frozen_pages(...) \ alloc_hooks(alloc_contig_frozen_pages_noprof(__VA_ARGS__)) +struct page *alloc_contig_frozen_pages_user_noprof(unsigned long nr_pages, + gfp_t gfp_mask, int nid, nodemask_t *nodemask, + unsigned long user_addr); +#define alloc_contig_frozen_pages_user(...) \ + alloc_hooks(alloc_contig_frozen_pages_user_noprof(__VA_ARGS__)) + struct page *alloc_contig_pages_noprof(unsigned long nr_pages, gfp_t gfp_mask, int nid, nodemask_t *nodemask); #define alloc_contig_pages(...) \ diff --git a/mm/page_alloc.c b/mm/page_alloc.c index b96c9892f6c6..b725a3b59835 100644 --- a/mm/page_alloc.c +++ b/mm/page_alloc.c @@ -6999,8 +6999,9 @@ static void __free_contig_frozen_range(unsigned long pfn, unsigned long nr_pages * * Return: zero on success or negative error code. */ -int alloc_contig_frozen_range_noprof(unsigned long start, unsigned long end, - acr_flags_t alloc_flags, gfp_t gfp_mask) +static int __alloc_contig_frozen_range(unsigned long start, unsigned long end, + acr_flags_t alloc_flags, gfp_t gfp_mask, + unsigned long user_addr) { const unsigned int order = ilog2(end - start); unsigned long outer_start, outer_end; @@ -7127,7 +7128,7 @@ int alloc_contig_frozen_range_noprof(unsigned long start, unsigned long end, struct page *head = pfn_to_page(start); check_new_pages(head, order); - prep_new_page(head, order, gfp_mask, 0, USER_ADDR_NONE); + prep_new_page(head, order, gfp_mask, 0, user_addr); } else { ret = -EINVAL; WARN(true, "PFN range: requested [%lu, %lu), allocated [%lu, %lu)\n", @@ -7137,6 +7138,13 @@ int alloc_contig_frozen_range_noprof(unsigned long start, unsigned long end, undo_isolate_page_range(start, end); return ret; } + +int alloc_contig_frozen_range_noprof(unsigned long start, unsigned long end, + acr_flags_t alloc_flags, gfp_t gfp_mask) +{ + return __alloc_contig_frozen_range(start, end, alloc_flags, gfp_mask, + USER_ADDR_NONE); +} EXPORT_SYMBOL(alloc_contig_frozen_range_noprof); /** @@ -7255,8 +7263,9 @@ static bool zone_spans_last_pfn(const struct zone *zone, * * Return: pointer to contiguous frozen pages on success, or NULL if not successful. */ -struct page *alloc_contig_frozen_pages_noprof(unsigned long nr_pages, - gfp_t gfp_mask, int nid, nodemask_t *nodemask) +struct page *alloc_contig_frozen_pages_user_noprof(unsigned long nr_pages, + gfp_t gfp_mask, int nid, nodemask_t *nodemask, + unsigned long user_addr) { unsigned long ret, pfn, flags; struct zonelist *zonelist; @@ -7284,10 +7293,11 @@ struct page *alloc_contig_frozen_pages_noprof(unsigned long nr_pages, * win the race and cause allocation to fail. */ spin_unlock_irqrestore(&zone->lock, flags); - ret = alloc_contig_frozen_range_noprof(pfn, + ret = __alloc_contig_frozen_range(pfn, pfn + nr_pages, ACR_FLAGS_NONE, - gfp_mask); + gfp_mask, + user_addr); if (!ret) return pfn_to_page(pfn); spin_lock_irqsave(&zone->lock, flags); @@ -7309,6 +7319,14 @@ struct page *alloc_contig_frozen_pages_noprof(unsigned long nr_pages, } return NULL; } +EXPORT_SYMBOL(alloc_contig_frozen_pages_user_noprof); + +struct page *alloc_contig_frozen_pages_noprof(unsigned long nr_pages, + gfp_t gfp_mask, int nid, nodemask_t *nodemask) +{ + return alloc_contig_frozen_pages_user_noprof(nr_pages, gfp_mask, nid, + nodemask, USER_ADDR_NONE); +} EXPORT_SYMBOL(alloc_contig_frozen_pages_noprof); /** -- MST