From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from BN1PR04CU002.outbound.protection.outlook.com (mail-eastus2azon11010057.outbound.protection.outlook.com [52.101.56.57]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 332173EBF3D for ; Wed, 11 Feb 2026 15:30:42 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=52.101.56.57 ARC-Seal:i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1770823844; cv=fail; b=JPHtoNfkX8SgGdPehUGZAuJ2JdQjYjbC2OW6kN7gYvpQtpzsraui5xpWgvB59Ts6cP1LU2HGvhrg7Itiu6ooTM1godf0SiQkcWlicBfm3usGK4y74NSXkyztVmCbHw+9KI8Z7c+rewwl/zvHQcK5Dttfd0VBIQoByECDZVQFZcc= ARC-Message-Signature:i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1770823844; c=relaxed/simple; bh=zK2ZwdH/6vod0BA7culjgRvSo5vjE2QdubFXkrujOvM=; h=Message-ID:Date:MIME-Version:Subject:To:CC:References:From: In-Reply-To:Content-Type; b=FTKGrSNQCDeVHDyoagurWui/BlJz0ckwScUVypiTLF4hCrNQ6Udbjl5VcJEfzk0P9kjCDmXSAN1ba27wBPwHo2Q0zNwtSCJplBuSwxPHLJZbbaiz1If/SYOUV0KlrMMlVqulS5gntwm5iFtk40nyH0ElDTrsc81F07S9OxNyF+0= ARC-Authentication-Results:i=2; smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=amd.com; spf=fail smtp.mailfrom=amd.com; dkim=pass (1024-bit key) header.d=amd.com header.i=@amd.com header.b=apJJ2aDt; arc=fail smtp.client-ip=52.101.56.57 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=amd.com Authentication-Results: smtp.subspace.kernel.org; spf=fail smtp.mailfrom=amd.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=amd.com header.i=@amd.com header.b="apJJ2aDt" ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=MOL2/wx1SADHGFZpo/mpW3QGYs1n2uOQDRWnbDoW+SyMf2kodGjZyXcC3KNj7ICgtuFmdLsX1kpYmukj0kURcr0IHbS4lR0+XNZfqYUR0ZVJWmlMd20B8jnFMLpg9hMhablwA+9lMmiqsQRHDw57ptjj/tv1XRWf2KaLHuD4rhT4tYrvvnqZzjRVCi7bQbycd0+6QIl0BOI8e+Vago4Cwv3bX59swutEvYIZLAH2GisIcWFOteVvQk477+wHTw1G0kEio3PJWSDvRc3DIhucVkf0c9qcIi5tyajh2iskTkstqkFk3xClABPVWrTPtyl+0fjIarCo1wOHUwSb7ZkNxg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=jj8LT77DWJnLhjtsaq7saV8qJlrVKhbZndSD2asYnro=; b=YrfXR9kHvGntZmNNPDddz6AtoqKVYlaLKfOz2JxNZQ3UYmtizcaflwxMTF7qnzRpOgMUxEXCxs1/NEolp7ku+jZlRBN8oKG1g0CBoGevTqV8/22Q6c8l0Vv4MaAIuIzyiPfdJ0LgW2ybKwA2XBVlZ2jYYUdeR42SkWFIbuux4BjeK1G/10Erp6tKU9OyvTwi5j5ZjoCeqnw9JpCkaMZH4pGE+NKH+mDZfMHEUUKEQX12r+AVgU958ClLrX5iU+nfLMYCcf4X5hytLiWavVeDL+T0q93R+N/FOXjmiTE37a1BYtwNt4AJg+7mEdNhJLCDVTuWW58iBjzsw60gHfS0uA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 165.204.84.17) smtp.rcpttodomain=vger.kernel.org smtp.mailfrom=amd.com; dmarc=pass (p=quarantine sp=quarantine pct=100) action=none header.from=amd.com; dkim=none (message not signed); arc=none (0) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amd.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=jj8LT77DWJnLhjtsaq7saV8qJlrVKhbZndSD2asYnro=; b=apJJ2aDtRE/i+n6tDYLCTpQJTaC9zahanvwWh+7z/zfVHySmSh/GHy0ZSnidlkBTOFFq7l6w6qnwEOImBj1dvQQYxLJB8+b1O9oromnQwPLHwqvclwgrEYODotgLMG+hdd+evhTu3z0whS2gY94GA2Ab3DgBdOFGfZ9vEh1Kmhk= Received: from BY5PR20CA0018.namprd20.prod.outlook.com (2603:10b6:a03:1f4::31) by DS4PR12MB9708.namprd12.prod.outlook.com (2603:10b6:8:278::7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.9611.10; Wed, 11 Feb 2026 15:30:37 +0000 Received: from SJ1PEPF00001CE1.namprd05.prod.outlook.com (2603:10b6:a03:1f4:cafe::52) by BY5PR20CA0018.outlook.office365.com (2603:10b6:a03:1f4::31) with Microsoft SMTP Server (version=TLS1_3, cipher=TLS_AES_256_GCM_SHA384) id 15.20.9611.10 via Frontend Transport; Wed, 11 Feb 2026 15:30:34 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 165.204.84.17) smtp.mailfrom=amd.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=amd.com; Received-SPF: Pass (protection.outlook.com: domain of amd.com designates 165.204.84.17 as permitted sender) receiver=protection.outlook.com; client-ip=165.204.84.17; helo=satlexmb08.amd.com; pr=C Received: from satlexmb08.amd.com (165.204.84.17) by SJ1PEPF00001CE1.mail.protection.outlook.com (10.167.242.9) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.9611.8 via Frontend Transport; Wed, 11 Feb 2026 15:30:35 +0000 Received: from satlexmb07.amd.com (10.181.42.216) by satlexmb08.amd.com (10.181.42.217) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.17; Wed, 11 Feb 2026 09:30:33 -0600 Received: from [10.252.192.21] (10.180.168.240) by satlexmb07.amd.com (10.181.42.216) with Microsoft SMTP Server id 15.2.2562.17 via Frontend Transport; Wed, 11 Feb 2026 09:30:26 -0600 Message-ID: <911f316b-87cf-45eb-8d9e-412473d7176a@amd.com> Date: Wed, 11 Feb 2026 21:00:26 +0530 Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [RFC PATCH v5 00/10] mm: Hot page tracking and promotion infrastructure To: , CC: , , , , , , , , , , , , , , , , , , , , , , , , , , References: <20260129144043.231636-1-bharata@amd.com> Content-Language: en-US From: Bharata B Rao In-Reply-To: <20260129144043.231636-1-bharata@amd.com> Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: SJ1PEPF00001CE1:EE_|DS4PR12MB9708:EE_ X-MS-Office365-Filtering-Correlation-Id: b51e1724-982d-4d1e-48c7-08de69828079 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|82310400026|1800799024|376014|36860700013|7416014; X-Microsoft-Antispam-Message-Info: =?utf-8?B?SkRKSCtQcHF4R1p4Q20xQkxQVWRWcU55bW1aMFRWWk45aHVtcGk2OUdLb2h5?= =?utf-8?B?SnpHSlBBcnhxd2tIUklxcXBlVFgwR3UxSVZrUDVQWDU5ZGRZSUR2S0hDM1dq?= =?utf-8?B?bTBGVzhoM3RCYWpyRzRERlNSZk5CdmNhZ0M1TjdHVlZhbUUzU2h2ckxVQjJy?= =?utf-8?B?ZXZHU3hIc1hFZTU4c1YyYmFWaEdya1FjVjRWbDYrVkRlalBoT3liWEIyMWky?= =?utf-8?B?NDdWYktGU0JxdGZQMDg1OXNRZ3Q4MkhqNlcvd3lnY3VFQnFuOTN0dXRmQ2d1?= =?utf-8?B?OVRndmlHd0NFc2k1Z3FzZXNteWpkOS9EcXBxVFgyM0pWa3BpNGsyRjFMSE9w?= =?utf-8?B?em9Gb2EvVGUxZ0JWaXNUS1Z5ay9ORDNIMnpxWWNMNzF2MXZUMmgxU0RscWFB?= =?utf-8?B?OVQzSldyWDJDdHlDcmxncFNzK1JWTWUrY3NkUm82SENLMFFydkFZQU80TFRz?= =?utf-8?B?OENFTHJBVytxYVNrdjFQUzZvZTMzUU4rOUVhTCtlYThxZUFva2tOdjRHa0k1?= =?utf-8?B?MTRSTkhBbnBBWGtnZUlweTBPMCsrWlE4ajVpMlZ6SDN0WjgvMGhRUSt5MWtl?= =?utf-8?B?SG1rMElJdmJLdE1mNm44UnJtUm1LcWRuYUJJL3JXQzJGKzBsN3dqVi9qVTJZ?= =?utf-8?B?aWV3MjNEZ283MlI0Wk14aWxHQjBHRDRFclRNWWcxamp6ekV6cFl2TGU0QW5y?= =?utf-8?B?VVZvMXpmdVhNSnlMdUIrakFVYzhRSTgxRHpXMlNhWTZCK2NZQk9naG1xNzU0?= =?utf-8?B?TGs0K1NKWEx3Y29sZ0JuKzIrWFFuUmhkRjFSbjRuMkJBRXF0dlVsd3J1aHNJ?= =?utf-8?B?bEpwMU9Ic0NxZlY0NGphZEpmUGJJcUJTWEJSRE9Sc1dIMUhHcHphWlVxWDdv?= =?utf-8?B?WTJFRUEyMnpFSm9paHNSN21XVXk4ZDRtSGV0Q1ZMaG81U2F5RERYZ2IrNTUx?= =?utf-8?B?eS9YR1dsbjRDaldWWE1XZDRtTFlGaUVEcXh4eURDaUcxTzI3dGFNOGljbjhE?= =?utf-8?B?c1FQSmw2b0g3aWYyalBaV0pldWJ2ODkxd3ZIWmoxV3huSWNRZXROYTVuaVRo?= =?utf-8?B?UmJWL3R6enRPZytGZU8weWloWUZxd1Q2clZ2VnNhWWJYL2VwaExha1J1RHZj?= =?utf-8?B?dFA2bHBEZUJxaTdGMVJqditIR1ZBMTZGWWpTVkIzWE83QlVxbVBWdkk1Yk84?= =?utf-8?B?NENuNkUyeDJMU0N5eTlobmpNTTZQOE96RHB2VlQvYjJaNmFYcCtESFFqVWdD?= =?utf-8?B?bjBRTTBOajVGMTNPb1gyMWw4RzZKWVdwQ3hIR1p1d3VYMHMvdEs0T3FFUXNu?= =?utf-8?B?YzFGUGczWEVkai9YWXlxeEVkeUlwQlUwdXVhSmUzSFMyaStpaG1CeHBJZnNs?= =?utf-8?B?djBzUkFxYWhMSEpHeXIrTmFyV204SEIvVC9vR1lVN1lScGNmZHNTbjlPOXhv?= =?utf-8?B?K3Z6NE5PREVZbVdydmVJWnlQYWFUOHZSVk81Y0xxK3VhQm5nU2hHbWt6aElT?= =?utf-8?B?WFJaMnFWWVBBTzRrWUd3a08yaERHSWpxdFJUOVNrcVhsUmVJYklOSjRPUzcr?= =?utf-8?B?NVZ5RXNNcFF5eVJHdFpkVkkvMjRaVm40UlZWTjBSd281c2RwRlVHM1lKTm9a?= =?utf-8?B?LzRIVE80TXVBektKbUNkZWt5SkVUN1dsSE5sOWE4S1FNaWp6Sy9MaUdlNlgx?= =?utf-8?B?b09pZXhuQmJaU3Q2UksrbFZqVzQ3TTRKamlrRDU1QXZaNmFobE1tN2orQnVh?= =?utf-8?B?bVgwSGREVWYySmdYS1RxS29scVR1UHBqcmhPdVhPaUgxWjQ2dGZTN3RjZi9m?= =?utf-8?B?SGhwRHhneDhMWVA3OXYySXpya2hnVUhOMTllUzk4Q0R4WC9lRnFsSXZ3YnpZ?= =?utf-8?B?SmNkMnVlZTlubytYZDByWWRFK1loMFY1cGxNRWJTUGJLK1hEOHhlZnNVUFpi?= =?utf-8?B?YnFzMUZQT1N4Mm1OZkU2Y3hCZkhpZGNITkJrL2hDOStiRzlWT2srdnR3QnZP?= =?utf-8?B?MkpLLzhNVXFoRGxITTJiSzd0dmhMd2RqWXo4UkR3MnpvdGJiN2ZBYmdWUUxW?= =?utf-8?B?OEtTTnloeSt1TTZGTzNBVzgxTkVoS1R3a0NONUswWFJ6d3BobXp4Z3R6c3Y3?= =?utf-8?B?SjI2L1RvQXQvcXFKaVkxSFJFcjdFOTNTaDVqS2JYZi9sOS9oVjhnQkFMZmRM?= =?utf-8?B?bThkSjZvSVA4Uk5ER1pnRjFlZGNUU3dMWCtwYTNuUUxKaUN0RnluV1BkZFc2?= =?utf-8?B?dC9reDlWUGtiSkdnbU9CQnBIc0ZnPT0=?= X-Forefront-Antispam-Report: CIP:165.204.84.17;CTRY:US;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:satlexmb08.amd.com;PTR:InfoDomainNonexistent;CAT:NONE;SFS:(13230040)(82310400026)(1800799024)(376014)(36860700013)(7416014);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: 9+sb4A+Oix5HbHcxEQMRktMrUdu7LT766d1YUZypfYfCgjMx4SV0KupD/ixxDmEFEnjeopIbAD5bS15eLmSyfZ70sCVUXGEFghtAkyQQ4FGuwaIAqCQmdXr1BxrfLmynk08UYkqtgLpiN/qkxkla1LLM5JjMH/bt/5E1xqHKXXdJENw962DNmwUaTdqzulbkeLt2WvXWOGms5Dx9n9rqJ30Duga9dENhjR8L3f40WEe0FsbOt/OGTWH/VTkxwcIUWIPaGsXofOXmePucSNYBb9EuTsdy5HTiGTLzEl66Y6bAqZW66ZqiDgQC/EBuwepqIh/+jR82nAg6OKAxqvxUxf6D9uDyPLVNnehWQIX2DvzRZhvwEsb0UjzJWgDnBV7gmhw2aOfGr3H5Rn9w/6EqyYzuMcVib0p821pOPv4xWaPHtBiNjxmh8gzhJ6b1SniX X-OriginatorOrg: amd.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 11 Feb 2026 15:30:35.4198 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: b51e1724-982d-4d1e-48c7-08de69828079 X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=3dd8961f-e488-4e60-8e11-a82d994e183d;Ip=[165.204.84.17];Helo=[satlexmb08.amd.com] X-MS-Exchange-CrossTenant-AuthSource: SJ1PEPF00001CE1.namprd05.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: DS4PR12MB9708 On 29-Jan-26 8:10 PM, Bharata B Rao wrote: > > Results > ======= > TODO: Will post benchmark nubmers as reply to this patchset soon. Here are Graph500 numbers for the hint fault source: Test system details ------------------- 3 node AMD Zen5 system with 2 regular NUMA nodes (0, 1) and a CXL node (2) $ numactl -H available: 3 nodes (0-2) node 0 cpus: 0-95,192-287 node 0 size: 128460 MB node 1 cpus: 96-191,288-383 node 1 size: 128893 MB node 2 cpus: node 2 size: 257993 MB node distances: node 0 1 2 0: 10 32 50 1: 32 10 60 2: 255 255 10 Hotness sources --------------- NUMAB0 - Without NUMA Balancing in base case and with no source enabled in the pghot case. No migrations occur. NUMAB2 - Existing hot page promotion for the base case and use of hint faults as source in the pghot case. Pghot by default promotes after two accesses but for NUMAB2 source, promotion is done after one access to match the base behaviour. (/sys/kernel/debug/pghot/freq_threshold=1) Graph500 details ---------------- Command: mpirun -n 128 --bind-to core --map-by core graph500/src/graph500_reference_bfs 28 16 After the graph creation, the processes are stopped and data is migrated to CXL node 2 before continuing so that BFS phase starts accessing lower tier memory. Total memory usage is slightly over 100GB and will fit within Node 0 and 1. Hence there is no memory pressure to induce demotions. ===================================================================================== Base Base pghot-default pghot-precise NUMAB0 NUMAB2 NUMAB2 NUMAB2 ===================================================================================== harmonic_mean_TEPS 5.10676e+08 7.56804e+08 5.92473e+08 7.47091e+08 mean_time 8.41027 5.67508 7.24915 5.74886 median_TEPS 5.11535e+08 7.24252e+08 5.63155e+08 7.71638e+08 max_TEPS 5.1785e+08 1.06051e+09 7.88018e+08 1.0504e+09 pgpromote_success 0 13557718 13737730 13734469 numa_pte_updates 0 26491591 26848847 26726856 numa_hint_faults 0 13558077 13882743 13798024 ===================================================================================== - The base case shows a good improvement with NUMAB2(48%) in harmonic_mean_TEPS. - The same improvement gets maintained with pghot-precise too (46%). - pghot-default mode doesn't show benefit even when achieving similar page promotion numbers. This mode doesn't track accessing NID and by default promotes to NID=0 which probably isn't all that beneficial as processes are running on both Node 0 and Node 1.