From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from BL0PR03CU003.outbound.protection.outlook.com (mail-eastusazon11012009.outbound.protection.outlook.com [52.101.53.9]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id EF7F13B7B83 for ; Tue, 28 Jul 2026 06:11:36 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=52.101.53.9 ARC-Seal:i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1785219098; cv=fail; b=ZMPmCaGdg6/p88SiOW3f0BTZTCSKtHiCjBgaVvt+jbGE483qhUrYkZOL9JXuXFp6PgTuWk4pv42iG3mb5Uf0d0ikKQY6FFuQlpJLJIzCnEgy/lr95jJ9SQ89Uwa7syJw2xTRfBksVbDTMrrT+EWirK3a/F8GFWFoOJUKGzQGdFg= ARC-Message-Signature:i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1785219098; c=relaxed/simple; bh=PF+QP9xqK7URgNjsHQU1SjXJVBFsGulO4r1GpeQ3igY=; h=Message-ID:Date:MIME-Version:Subject:To:CC:References:From: In-Reply-To:Content-Type; b=QcmAlsTMpB6NpKea3vKUjfBdF9hnPgIGNcLq1WU9kWWHIoyAxSXGItHaFgLi4BfL/uSp14I2REX6D+dnJFor9ZByiKEdn6SA0Enha3oWGI3ADG6qT7RbDaMO3OlGDi4kQi16kkhxB0MfSxh2iegPzBOHY+a4vo400XeaNhQL1jQ= ARC-Authentication-Results:i=2; smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=amd.com; spf=fail smtp.mailfrom=amd.com; dkim=pass (1024-bit key) header.d=amd.com header.i=@amd.com header.b=QDc3HfX2; arc=fail smtp.client-ip=52.101.53.9 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=amd.com Authentication-Results: smtp.subspace.kernel.org; spf=fail smtp.mailfrom=amd.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=amd.com header.i=@amd.com header.b="QDc3HfX2" ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=yVCwGEeKb471RejsYK/X7XeLi2rYW/aVWhJGnbeTlrRuMr87DZfzVYvPBdxhMHG3m5VhPmo22n9r7LUIl/bc4/irfZhJA130mQNk35booRgQJhW0UXMkVGkrFBwhSKs2T3cXJLWdDEG2HIdAFgLg7XaicTn0cQRAEeuhdnj51OqsO1kgTMfmE7QnSgHOahEbAYIiAnZUPAKTd3tWEGRuKS45SurMSzemZAljjJrV0yXYqJ5LxlCwEQD+Tao5Yz19NI7EbRPTBRAZfpiQ5+peF7FmYXWEl3i4kXH+iL+qruL9BvKL+2MSBELgKzOMjXrrLFMSFRneyi8WKXoc4+R1jA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=F+AIk8Ny9rBVVBoVXL/wvITWGficV6GlxY9MycxvnJk=; b=AXQKcajKYDbHDBbi49wPbpr/3e36uMMwP2dCz22hefn358uYWdITXLJADFSjJ8T7OJGOXIhB10Uo86m0Kgm56dpiOuyr8UymemAF+0gjwzMFa1Tb3PFAL8A7cEJ7hI/+hjn1XDgY95Ja1HA7PecDyPgBYn2nTeeAarGRu9/0ULvwmMEOqrH/PzhmLaxrhU+IyR2LWEsCFGoCehs12SLAc6lyMyoBoPYq74qfwt6yKANt7+lapW1BElSWNhjY9kDua5IhNI7IHIsSrgJG4jlU4BN+w7ybV5XSGggjTT+cxQsoCi6xEnAAPU7RnWQffu6Ghf6O3RirZniPIXahE6K2Ng== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 165.204.84.17) smtp.rcpttodomain=vger.kernel.org smtp.mailfrom=amd.com; dmarc=pass (p=quarantine sp=quarantine pct=100) action=none header.from=amd.com; dkim=none (message not signed); arc=none (0) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amd.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=F+AIk8Ny9rBVVBoVXL/wvITWGficV6GlxY9MycxvnJk=; b=QDc3HfX2/P1EvjEMx0YYwJ4hNX1NJ/L2pK7bLk9HEW12gKSk5oCUZ78FWiSvApS12TzWq3s+b7lBeBxIHHTTE4jpNJrhOtNWiI0OJXuHdjSO4vkrsjy711DG6U+gKjYNk8Qjluq1HuLREj/W7MjOwUU6oEHA1DLBK096M+6h3Nk= Received: from MW3PR05CA0025.namprd05.prod.outlook.com (2603:10b6:303:2b::30) by PH7PR12MB5877.namprd12.prod.outlook.com (2603:10b6:510:1d5::17) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.21.245.13; Tue, 28 Jul 2026 06:11:31 +0000 Received: from MW1PEPF00016159.namprd21.prod.outlook.com (2603:10b6:303:2b:cafe::82) by MW3PR05CA0025.outlook.office365.com (2603:10b6:303:2b::30) with Microsoft SMTP Server (version=TLS1_3, cipher=TLS_AES_256_GCM_SHA384) id 15.21.270.12 via Frontend Transport; Tue, 28 Jul 2026 06:11:31 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 165.204.84.17) smtp.mailfrom=amd.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=amd.com; Received-SPF: Pass (protection.outlook.com: domain of amd.com designates 165.204.84.17 as permitted sender) receiver=protection.outlook.com; client-ip=165.204.84.17; helo=satlexmb08.amd.com; pr=C Received: from satlexmb08.amd.com (165.204.84.17) by MW1PEPF00016159.mail.protection.outlook.com (10.167.249.84) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.21.292.1 via Frontend Transport; Tue, 28 Jul 2026 06:11:31 +0000 Received: from satlexmb10.amd.com (10.181.42.219) by satlexmb08.amd.com (10.181.42.217) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.41; Tue, 28 Jul 2026 01:11:21 -0500 Received: from satlexmb08.amd.com (10.181.42.217) by satlexmb10.amd.com (10.181.42.219) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.41; Tue, 28 Jul 2026 01:02:20 -0500 Received: from [10.136.47.225] (10.180.168.240) by satlexmb08.amd.com (10.181.42.217) with Microsoft SMTP Server id 15.2.2562.41 via Frontend Transport; Tue, 28 Jul 2026 01:02:13 -0500 Message-ID: <908ee24c-add2-4518-ac3b-9abc87edcb93@amd.com> Date: Tue, 28 Jul 2026 11:32:12 +0530 Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [PATCH v8 0/8] mm: Hot page tracking and promotion infrastructure - Graph500 To: , CC: , , , , , , , , , , , , , , , , , , , , , , , , , , , References: <20260728054356.291998-1-bharata@amd.com> Content-Language: en-US From: Bharata B Rao In-Reply-To: <20260728054356.291998-1-bharata@amd.com> Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: MW1PEPF00016159:EE_|PH7PR12MB5877:EE_ X-MS-Office365-Filtering-Correlation-Id: 1e51c8e1-5def-4129-163a-08deec6f116b X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|376014|1800799024|82310400026|36860700016|23010399003|7416014|56012099006|11063799006|10067099003|22082099003|18002099003; X-Microsoft-Antispam-Message-Info: 7lHoS7gjiLtjxIy/koX42hXaldAIoUpnToVb2umxzg48Sn/88ucAMMP9dWpJ1YfAHlRDLbMZ9tX0dcGg56sqY/1fAaRhUe7NA/KoKp8PuHqIjXmd8G7ligleM2KU23HtrvbKDycAIvpU66HJae7LcSguPK2kqkQ3QcIPNYorJ/2lZSakZ6+WGZSegVEdBu4VksDZesTf8ECPXA/UuWrjZ+oBqWhyQHvtgT4wl0RAsAjvLIUPFdDkUgs3jUgzjLg4ooWSdo71vMPiENUjsmzr8sC3axUqrl52wxNIA2q35lpeOoRMaZsTUff9ti58q77544zieaORst90q+iMA6TWFUaix1+mXg/B0qq+BixWyVv5O0WxDV0t66SaoJdAwNB7A8j/L2Dk6/imuLT8jPJZzxYPKj/aF6eiBqm0M8Kmyrc+xlqKtAIINdfoZuz//I1KM8EWLT3h3qqau5iMi3S9wS+QbvyH3e6mafDRkrES6vUUmja1cG/64S2AonM+XPRkdqATAx4uSW28e96UAXV5qWDIqmmp9kAsuaUSd2wPDYkNGeLuox108HYUCGjchKFiUVqrpN6MoizKgDC/LBEY7yj5j7FuHyZRPB1J1VJ1UdnmXlamEM6jBEV8soeoiOdYPp0s9hYPjJYQfVv/hv0xUSlwOqtHZiEfDD6PCa9YDVvC9OoeTDg1yHc6pnVVUkIWcpDxTe3GoMOAdf3rK1x4QA== X-Forefront-Antispam-Report: CIP:165.204.84.17;CTRY:US;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:satlexmb08.amd.com;PTR:InfoDomainNonexistent;CAT:NONE;SFS:(13230040)(376014)(1800799024)(82310400026)(36860700016)(23010399003)(7416014)(56012099006)(11063799006)(10067099003)(22082099003)(18002099003);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: CNmm7ky/RoBaruWu96bF0PdW2ldVTUHshB6crR3Bu9q/xto9WYdDYOJ/Bsgj0NkBOROcyanfWz78/NDbPqUgnzEdmI1vD/xx5bcsRqiavaXbWi+9Ga+zEz2FEdYUw7M/vzMbpvg9kR/SxroSniAF5nMhUv0VbSSH4ZoB9DkMkFyxBn7qiAmo2fiT7RFmy0qeHU/gycyyJeni3Gg6oMNAWh98dfjOsZMWX2yZZv/vZSeJioOUgvAwK+iLw+GQ83FSHkZYfe2yX32J+8J7j/lVoEVZfqqlahXTh3757TNdxzGgEOxGUXGlkeXldawvRWjSljVCOlBQHb7fXjNE7ZtVNN+R3Oai4VxHmXyRbVO2EsLz3dQwf/5jMkKHHzJUe7YPblcSKCqs7doSO4FG6RMjvnIf6d3/dochgRiX9QMVlsupGe3XuIlUWy5TJl+k+bAS X-OriginatorOrg: amd.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 28 Jul 2026 06:11:31.0091 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 1e51c8e1-5def-4129-163a-08deec6f116b X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=3dd8961f-e488-4e60-8e11-a82d994e183d;Ip=[165.204.84.17];Helo=[satlexmb08.amd.com] X-MS-Exchange-CrossTenant-AuthSource: MW1PEPF00016159.namprd21.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH7PR12MB5877 Benchmark : Graph500 reference BFS, SCALE=28, edgefactor=16, 128 ranks Topology : top-tier NUMA node=1 (CPUs+DRAM), lower-tier node=2 (mem-only/CXL) Config legend ------------- R1 : base kernel, no tiering (numa_balancing=0) R2 : base kernel, tiering (numa_balancing=2 / NUMAB2) R3 : pghot kernel, hintfaults source (pghot_enabled_sources=1, pghot_freq_threshold=1, numa_balancing=2, promotion=on) R4 : pghot kernel, hwhints source (pghot_enabled_sources=2, pghot_freq_threshold=1, IBS mem-profiler on, numa_balancing=0, promotion=off) Column legend ------------- hmean : harmonic_mean_TEPS (primary Graph500 metric) hstddev : harmonic_stddev_TEPS median : median_TEPS bfs_t : mean BFS time (seconds) spdup : speedup of hmean vs R1 baseline Table 1: Performance -------------------- +--------+------------+----------+------------+---------+--------+ | Config | hmean | hstddev | median | bfs_t | spdup | | | (TEPS) | (TEPS) | (TEPS) | (sec) | | +--------+------------+----------+------------+---------+--------+ | R1 | 5.469e+08 | 4.55e+05 | 5.468e+08 | 7.853 | 1.00x | | R2 | 1.442e+09 | 8.04e+07 | 1.491e+09 | 2.979 | 2.64x | | R3 | 1.362e+09 | 7.92e+07 | 1.515e+09 | 3.153 | 2.49x | | R4 | 1.463e+09 | 1.35e+07 | 1.487e+09 | 2.935 | 2.68x | +--------+------------+----------+------------+---------+--------+ Table 2: Relevant kernel counters (/proc/vmstat deltas over the run) -------------------------------------------------------------------- Values are accumulated deltas (before -> after) for the whole run. +----------------------------+-----------+-----------+-----------+-----------+ | Counter | R1 | R2 | R3 | R4 | +----------------------------+-----------+-----------+-----------+-----------+ | numa_pte_updates | 0 | 26675234 | 28872628 | 0 | | numa_hint_faults | 0 | 13747383 | 15501854 | 0 | | numa_pages_migrated | 0 | 13747376 | 13726437 | 3683579 | | pgpromote_success | 0 | 13747254 | 13726437 | 3683579 | | pghot_recorded_accesses | 0 | 0 | 15501778 | 3682112 | | pghot_recorded_hintfaults | 0 | 0 | 15501854 | 0 | | pghot_recorded_hwhints | 0 | 0 | 0 | 24291151 | | hwhint_total_events | 0 | 0 | 0 | 24291198 | | hwhint_dram_accesses | 0 | 0 | 0 | 19588681 | | hwhint_extmem_accesses | 0 | 0 | 0 | 3663926 | | pgmigrate_success | 26840188 | 40586709 | 40570940 | 30521808 | +----------------------------+-----------+-----------+-----------+-----------+ Key findings ------------ 1. Tiering helps Graph500. 2. pghot-hintfaults is on par with base NUMAB2 tiering. 3. pghot-hwhints (R4) matches NUMAB=2 performance with zero NUMA hint faults.