From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 1EEF23BED5C for ; Wed, 20 May 2026 22:21:14 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=170.10.133.124 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1779315676; cv=none; b=enxfRgW2b5AH7AYr4H1HZMfy6BMX0XP0oQ8lKH3nF/4T5hPV+cgJTFumOlZQiaOMKte+WhK1thQ4oBf/8XbRNDbaxAgcDuNHMg4fycAiKozzjvVwJdyLiDNNtudM76UGoqMU3f8U74vkc5Gdd37GMeA3lU0Ze4G4VMuNY/7Iets= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1779315676; c=relaxed/simple; bh=8w0BAdcYEx1DYP7LpA2admc4ftuLWgtvGXP7cauVxpA=; h=Date:From:To:Cc:Subject:Message-ID:References:MIME-Version: Content-Type:Content-Disposition:In-Reply-To; b=X5MFNJh68E+6U2wNIZmciqGayeE5teKEf+5p6Wg0X1MKC/UTKEVWxyUInJwpRVYSTV4besm6NBSBUncoZZXO8ZcswNpOH9OIlo+CWua4gJF55mE9zfTLQUppHH3jKNd2gUUZhj2DFBQVWt7L6UqTuZcuY5Hi+Fe4QUm1N/jd86g= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=redhat.com; spf=pass smtp.mailfrom=redhat.com; dkim=pass (1024-bit key) header.d=redhat.com header.i=@redhat.com header.b=GMXnREsD; dkim=pass (2048-bit key) header.d=redhat.com header.i=@redhat.com header.b=rTkxLCzo; arc=none smtp.client-ip=170.10.133.124 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=redhat.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=redhat.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=redhat.com header.i=@redhat.com header.b="GMXnREsD"; dkim=pass (2048-bit key) header.d=redhat.com header.i=@redhat.com header.b="rTkxLCzo" DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1779315674; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=VBSoYVls/goaUOaeb0ArVPkRixJg6uACMT8ZdsicbY4=; b=GMXnREsDaprFpzAtZfqm8EbgOYMApfAAA4DrgM309W64Mh5JF68LyPr/6lU/7jyy4VNQK8 wQSyudThi18iPolQ978gTPaLvIvqPcBzneol8klXHlZZRYlk5FWrbOzerbqGn02jkQWR5W iSpLjuCcaMM3Vu6J3cS5R2wExZNvB9w= Received: from mail-ed1-f72.google.com (mail-ed1-f72.google.com [209.85.208.72]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-690-woH7FChOMaWyTVZaiZ6FOQ-1; Wed, 20 May 2026 18:21:13 -0400 X-MC-Unique: woH7FChOMaWyTVZaiZ6FOQ-1 X-Mimecast-MFC-AGG-ID: woH7FChOMaWyTVZaiZ6FOQ_1779315672 Received: by mail-ed1-f72.google.com with SMTP id 4fb4d7f45d1cf-67b88d32946so4831012a12.3 for ; Wed, 20 May 2026 15:21:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=google; t=1779315672; x=1779920472; darn=vger.kernel.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:from:to:cc:subject:date:message-id:reply-to; bh=VBSoYVls/goaUOaeb0ArVPkRixJg6uACMT8ZdsicbY4=; b=rTkxLCzoJYWm90uLTi7A17HuUc+HHSpEXelW/d9OI9kjY4v3mNGJpSKckAYEikfcmG SOPUQEg54NaPyUHUxZGB9sBxkpEvt6N6j0drx5VIW4ZTYhBS3xGgfAyP/AI4HRaeMSZq +vFLs2+jPrp1kpfNoILj3j9kXoVlPqDafGxd8te3kn6hy44iEDvUtWhAqIsS/l4mzqNi +FNVYEEhGZ0676nK+bnFWD3jcM/Q4g+F77osxMU+LkNZHXiG7jxzJMk6SGI3jfn/zn4Y R8f9u6kpqDsDqKG77+MFscfUQRKdeEbfG7sHv3SaMWtAfs7kd9v3uLeXr1TdLJrhMD/5 TzgA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1779315672; x=1779920472; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-gg:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=VBSoYVls/goaUOaeb0ArVPkRixJg6uACMT8ZdsicbY4=; b=l+7N6lJMumyA301x2avhvShk7OOTPHlGLAO6qFWF380dguixCgAvMT1jiqlRDj33GW p8/IrpCXylDPIAuDG+QJkVSLB3r7TX+IfWpe9noJOGfqRLUvp0HcPNZvQ1E43VME7ASt /2wgLH/r6w6xhiXyQlPHam/YqCV0iWPTtCUfOWKDyCLojXCAu1wQqAxH1/WaJde95wSU aCFRdjJ+pqG/8Ixq0QgnSDMzuWTm1zEdux1AEOWaDjWO/aL4f0qsusTNZBTHNCd+C8m5 kll7oPAku7ZkD23GF5TyYqAXQ83LsIl7/MEzN+xQWDMZVtM1la4+5YI2CTzJB3X9XLg1 tSfA== X-Gm-Message-State: AOJu0YwiedjanC9oHr5cyH5PxT6UTnDClExM3Qs9TB6JicL6VsxV9vvL /bVqKxec240XLefHa8Y7Ou4RhKS9oy+coo0jGv2Qn+sskBU8uQ1AH/fxYMXNVCE16PC4q+zw1Xd VxHjfloDVlqenohgn9VaR0VKsKiRhvhdMYj6H+XDzHUggqTUA54GNqE4DfflOKIdNmTn3PixW+q 6jtkoE198x2nKYtmHpMKMhk6w8sMGdLKFWPz3vM5uBvjk= X-Gm-Gg: Acq92OFOCBMCyk6G7ZS1ckmSNFNDGV5kqWimYXISNTb9pOyX3Rw1aYFOwuDBIhKpOIR Qa6rg3xyAwpRvucCJRgNkmkmCwHB8FVUvCha2nL+foUYB7jSEkyFQrR3bVrocTsasCA64XODZXI 7ldX/0zExmbrQy2jXEOepubJFXvyle1DibEgU2G4omHEIKBuRjWiBm/+OBm786iVMgqSY+z0h+5 v6zd+nP2X2P3/5X36k2aFRPJCoxj9VrbRxaF+XHlBydx+51TuKrMOOrwcdFr263FURc/0jEsK2g K0v/3H/5b2bSXe2DzNloUcB9KprnOXTqSR6oh+WwTyK6ngIeAe1YkoFyUg/bzHaTajRKCzWAi+9 bo4i6crezQpuI2XfuwurLhRm/7T1435HAGCPMqq5dMnQ= X-Received: by 2002:a05:6402:278b:b0:66a:19bd:5cb8 with SMTP id 4fb4d7f45d1cf-68836ace712mr19650a12.18.1779315671742; Wed, 20 May 2026 15:21:11 -0700 (PDT) X-Received: by 2002:a05:6402:278b:b0:66a:19bd:5cb8 with SMTP id 4fb4d7f45d1cf-68836ace712mr19586a12.18.1779315671078; Wed, 20 May 2026 15:21:11 -0700 (PDT) Received: from redhat.com (IGLD-80-230-25-45.inter.net.il. [80.230.25.45]) by smtp.gmail.com with ESMTPSA id 4fb4d7f45d1cf-68310b3e8e5sm8646938a12.4.2026.05.20.15.21.05 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 20 May 2026 15:21:09 -0700 (PDT) Date: Wed, 20 May 2026 18:21:04 -0400 From: "Michael S. Tsirkin" To: linux-kernel@vger.kernel.org Cc: "David Hildenbrand (Arm)" , Jason Wang , Xuan Zhuo , Eugenio =?utf-8?B?UMOpcmV6?= , Muchun Song , Oscar Salvador , Andrew Morton , Lorenzo Stoakes , "Liam R. Howlett" , Vlastimil Babka , Mike Rapoport , Suren Baghdasaryan , Michal Hocko , Brendan Jackman , Johannes Weiner , Zi Yan , Baolin Wang , Nico Pache , Ryan Roberts , Dev Jain , Barry Song , Lance Yang , Hugh Dickins , Matthew Brost , Joshua Hahn , Rakie Kim , Byungchul Park , Gregory Price , Ying Huang , Alistair Popple , Christoph Lameter , David Rientjes , Roman Gushchin , Harry Yoo , Axel Rasmussen , Yuanchu Xie , Wei Xu , Chris Li , Kairui Song , Kemeng Shi , Nhat Pham , Baoquan He , virtualization@lists.linux.dev, linux-mm@kvack.org, Andrea Arcangeli Subject: [PATCH v8 08/37] mm: add alloc_contig_frozen_pages_user for cache-friendly zeroing Message-ID: <001e0eaa4ea51951e0a78cea5d6a61ddbc6a099a.1779315441.git.mst@redhat.com> References: Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Mailer: git-send-email 2.27.0.106.g8ac3dc51b1 X-Mutt-Fcc: =sent Add a _user variant of alloc_contig_frozen_pages that accepts a user_addr parameter for cache-friendly zeroing of contiguous allocations. No functional change; all existing callers continue to pass USER_ADDR_NONE. Signed-off-by: Michael S. Tsirkin Assisted-by: Claude:claude-opus-4-6 --- include/linux/gfp.h | 6 ++++++ mm/page_alloc.c | 32 +++++++++++++++++++++++++------- 2 files changed, 31 insertions(+), 7 deletions(-) diff --git a/include/linux/gfp.h b/include/linux/gfp.h index ee35c5367abc..73109d4e31a4 100644 --- a/include/linux/gfp.h +++ b/include/linux/gfp.h @@ -453,6 +453,12 @@ struct page *alloc_contig_frozen_pages_noprof(unsigned long nr_pages, #define alloc_contig_frozen_pages(...) \ alloc_hooks(alloc_contig_frozen_pages_noprof(__VA_ARGS__)) +struct page *alloc_contig_frozen_pages_user_noprof(unsigned long nr_pages, + gfp_t gfp_mask, int nid, nodemask_t *nodemask, + unsigned long user_addr); +#define alloc_contig_frozen_pages_user(...) \ + alloc_hooks(alloc_contig_frozen_pages_user_noprof(__VA_ARGS__)) + struct page *alloc_contig_pages_noprof(unsigned long nr_pages, gfp_t gfp_mask, int nid, nodemask_t *nodemask); #define alloc_contig_pages(...) \ diff --git a/mm/page_alloc.c b/mm/page_alloc.c index b96c9892f6c6..b725a3b59835 100644 --- a/mm/page_alloc.c +++ b/mm/page_alloc.c @@ -6999,8 +6999,9 @@ static void __free_contig_frozen_range(unsigned long pfn, unsigned long nr_pages * * Return: zero on success or negative error code. */ -int alloc_contig_frozen_range_noprof(unsigned long start, unsigned long end, - acr_flags_t alloc_flags, gfp_t gfp_mask) +static int __alloc_contig_frozen_range(unsigned long start, unsigned long end, + acr_flags_t alloc_flags, gfp_t gfp_mask, + unsigned long user_addr) { const unsigned int order = ilog2(end - start); unsigned long outer_start, outer_end; @@ -7127,7 +7128,7 @@ int alloc_contig_frozen_range_noprof(unsigned long start, unsigned long end, struct page *head = pfn_to_page(start); check_new_pages(head, order); - prep_new_page(head, order, gfp_mask, 0, USER_ADDR_NONE); + prep_new_page(head, order, gfp_mask, 0, user_addr); } else { ret = -EINVAL; WARN(true, "PFN range: requested [%lu, %lu), allocated [%lu, %lu)\n", @@ -7137,6 +7138,13 @@ int alloc_contig_frozen_range_noprof(unsigned long start, unsigned long end, undo_isolate_page_range(start, end); return ret; } + +int alloc_contig_frozen_range_noprof(unsigned long start, unsigned long end, + acr_flags_t alloc_flags, gfp_t gfp_mask) +{ + return __alloc_contig_frozen_range(start, end, alloc_flags, gfp_mask, + USER_ADDR_NONE); +} EXPORT_SYMBOL(alloc_contig_frozen_range_noprof); /** @@ -7255,8 +7263,9 @@ static bool zone_spans_last_pfn(const struct zone *zone, * * Return: pointer to contiguous frozen pages on success, or NULL if not successful. */ -struct page *alloc_contig_frozen_pages_noprof(unsigned long nr_pages, - gfp_t gfp_mask, int nid, nodemask_t *nodemask) +struct page *alloc_contig_frozen_pages_user_noprof(unsigned long nr_pages, + gfp_t gfp_mask, int nid, nodemask_t *nodemask, + unsigned long user_addr) { unsigned long ret, pfn, flags; struct zonelist *zonelist; @@ -7284,10 +7293,11 @@ struct page *alloc_contig_frozen_pages_noprof(unsigned long nr_pages, * win the race and cause allocation to fail. */ spin_unlock_irqrestore(&zone->lock, flags); - ret = alloc_contig_frozen_range_noprof(pfn, + ret = __alloc_contig_frozen_range(pfn, pfn + nr_pages, ACR_FLAGS_NONE, - gfp_mask); + gfp_mask, + user_addr); if (!ret) return pfn_to_page(pfn); spin_lock_irqsave(&zone->lock, flags); @@ -7309,6 +7319,14 @@ struct page *alloc_contig_frozen_pages_noprof(unsigned long nr_pages, } return NULL; } +EXPORT_SYMBOL(alloc_contig_frozen_pages_user_noprof); + +struct page *alloc_contig_frozen_pages_noprof(unsigned long nr_pages, + gfp_t gfp_mask, int nid, nodemask_t *nodemask) +{ + return alloc_contig_frozen_pages_user_noprof(nr_pages, gfp_mask, nid, + nodemask, USER_ADDR_NONE); +} EXPORT_SYMBOL(alloc_contig_frozen_pages_noprof); /** -- MST