From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from NAM12-DM6-obe.outbound.protection.outlook.com (mail-dm6nam12on2049.outbound.protection.outlook.com [40.107.243.49]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 9E0F5158D8B for ; Mon, 27 Jan 2025 07:12:11 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=40.107.243.49 ARC-Seal:i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1737961933; cv=fail; b=uLF/c5DnMPHb4oE2q04jmqt19EBfE+bXkMCxrWObYgkVH1kqOXrH4x/zObdaNnH40HfzmHGP2wBTKuND9l3OglHyllQYjfUoG7FBf6t++6NH+d9oOOY8qTO90B2zna7VWVn7Eq/6akx/0U2Ol2lWacpa985g94Etcerci6dTVZQ= ARC-Message-Signature:i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1737961933; c=relaxed/simple; bh=h/uqoaBRoKwPNep/BU3v9R7POts8dDkHLH+1t8gMyZM=; h=Message-ID:Date:Subject:To:Cc:References:From:In-Reply-To: Content-Type:MIME-Version; b=RWwP/oiv4+HNCqxqZoKWLtOCcN3tt63a9yfzCOOyQVkohmo/PnRf9WXvm7X6N0FvYd0wjD5axXQ5Y99vdKmkz554+ZoSTzaAkMC9Zx/t5beHD9V4iWvqP7e2AqumC7dtLFTk5827mX8ePMFmH0TfXcTAaHHz82UskhUjho05X0g= ARC-Authentication-Results:i=2; smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=amd.com; spf=fail smtp.mailfrom=amd.com; dkim=pass (1024-bit key) header.d=amd.com header.i=@amd.com header.b=DVyNuKSl; arc=fail smtp.client-ip=40.107.243.49 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=amd.com Authentication-Results: smtp.subspace.kernel.org; spf=fail smtp.mailfrom=amd.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=amd.com header.i=@amd.com header.b="DVyNuKSl" ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=g2DYe9oQTtRGLGuboqUHj9Q+PoCPJtnbXHBSOPgVJFTvR0CmRV39QwdE7ijgiw9ts5ryB/tWpD+LptC13vhd+vWZdYFeZmpht+YrtKKZzLcoqAP+XCUykom2tNkMNVPmH/LQBoCqdzAvsBYNhfqunejgLuPizd1EwKiYLvinmdA/UohaQQXsenNwUxGzOtmyADKjlFtcWP3fSKxSL+G2MjazFQSt45hcOnQVXI6d5wXVqI6DTuY/s+wDZopcwODKoPanyLSqSEO8LY24Oy+w4Ch4rjWxLegNmOlN0HLORTQcN3wUgfrNgtxuYoh9tpEh1W9O3PzLGMfC1OU5ZOACgw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=OAWQVYYzp8X8D0vOt0f82PzfAkLA8K7PqBqAAsWm6Vc=; b=F2xoaq0g/1qpRrBqkE2mIKXkSFO+xuVRpTVa+pv8+AK712XfAvu6lkxNsWhVp7YUKvX8qx6Z4aRfQhfS6nyukcf0hBdHkOiaTgDy0fbhCwisUvfK5WpiOy+AQ9jp3GAt+5JUwPYv/IT4671NlBtF5uslNk9UHKyQKKgY+IWa5i0G0a++Y47ByPqYw0jA09M1w7bFkty2crC5/stm5Aw1bGV6NtHmfakqgmwogVucKpEqOIIDh0Ee7yRV83BYBHbEO6T3V6kWt9/UUIqYk65grQtqeMo2plbt5bWgTq7926QWse3Ie+mclHu0t+2bRzcO8yUW72vCzvCw0paefW2Mfg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=amd.com; dmarc=pass action=none header.from=amd.com; dkim=pass header.d=amd.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amd.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=OAWQVYYzp8X8D0vOt0f82PzfAkLA8K7PqBqAAsWm6Vc=; b=DVyNuKSlL4wkaZBcgyoHbiLNwEutujUGc/uwNEG6GypFBbiXEJwkxntmuQXan9TsuTZpIcw3iQHpcDxEb1P47eMyu2kU9R//x7wSM8v1A9zw/PI1zGvZ9/myATGkSRwYGYY4bW78H8WKgtkiuTxpZuFVIOvq+kPseZVNESM4F9I= Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=amd.com; Received: from PH7PR12MB5805.namprd12.prod.outlook.com (2603:10b6:510:1d1::13) by PH7PR12MB8177.namprd12.prod.outlook.com (2603:10b6:510:2b4::8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8377.22; Mon, 27 Jan 2025 07:12:09 +0000 Received: from PH7PR12MB5805.namprd12.prod.outlook.com ([fe80::11c7:4914:62f4:f4a3]) by PH7PR12MB5805.namprd12.prod.outlook.com ([fe80::11c7:4914:62f4:f4a3%6]) with mapi id 15.20.8377.021; Mon, 27 Jan 2025 07:12:08 +0000 Message-ID: Date: Mon, 27 Jan 2025 12:41:49 +0530 User-Agent: Mozilla Thunderbird Subject: Re: [LSF/MM/BPF TOPIC] Overhauling hot page detection and promotion based on PTE A bit scanning To: David Rientjes Cc: Hyeonggon Yoo , "linux-mm@kvack.org" , "akpm@linux-foundation.org" , "lsf-pc@lists.linux-foundation.org" , "bharata@amd.com" , kernel_team@skhynix.com, 42.hyeyoo@gmail.com, "gourry@gourry.net" , "nehagholkar@meta.com" , "abhishekd@meta.com" , "ying.huang@linux.alibaba.com" , "nphamcs@gmail.com" , "hannes@cmpxchg.org" , "feng.tang@intel.com" , "kbusch@meta.com" , "Hasan.Maruf@amd.com" , "sj@kernel.org" , "david@redhat.com" , "willy@infradead.org" , "k.shutemov@gmail.com" , "mgorman@techsingularity.net" , "vbabka@suse.cz" , "hughd@google.com" , "shy828301@gmail.com" , "liam.howlett@oracle.com" , "peterz@infradead.org" , "mingo@redhat.com" , "nadav.amit@gmail.com" , "shivankg@amd.com" , "ziy@nvidia.com" , "jhubbard@nvidia.com" , "AneeshKumar.KizhakeVeetil@arm.com" , "linux-kernel@vger.kernel.org" , "jon.grimm@amd.com" , "santosh.shukla@amd.com" , "Michael.Day@amd.com" , "riel@surriel.com" , "weixugc@google.com" , "leesuyeon0506@gmail.com" , honggyu.kim@sk.com, "leillc@google.com" , "kmanaouil.dev@gmail.com" , "rppt@kernel.org" , "dave.hansen@intel.com" , yuanchu@google.com References: <20250123105721.424117-1-raghavendra.kt@amd.com> <0a9914f8-bec7-4e58-ab12-a87fe3876187@sk.com> <0571919b-52e1-4981-8d34-bcc781c0561a@amd.com> <4c805e3c-4d5d-6880-7e65-cce1041f7d35@google.com> Content-Language: en-US From: Raghavendra K T In-Reply-To: <4c805e3c-4d5d-6880-7e65-cce1041f7d35@google.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-ClientProxiedBy: PN3PR01CA0062.INDPRD01.PROD.OUTLOOK.COM (2603:1096:c01:99::11) To PH7PR12MB5805.namprd12.prod.outlook.com (2603:10b6:510:1d1::13) Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: PH7PR12MB5805:EE_|PH7PR12MB8177:EE_ X-MS-Office365-Filtering-Correlation-Id: 3b080682-0a97-4713-73c0-08dd3ea1e910 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|7416014|376014|1800799024|366016; X-Microsoft-Antispam-Message-Info: =?utf-8?B?Q1dmQ0FUY0hSazVlWEZuTVNjS2t6TEtUVTN4UllzT0UxZURhTDI5T052VUFn?= =?utf-8?B?RDVoNHNkUlZRdmt1bXp2RE4yVTd1QlRRVm5PWHJ6WHQvT3JLQ1p3ZHNlSU8v?= =?utf-8?B?TUVEMU43VEtqNldNN0NONFM2bEZzd3pJQ21xMFk2ZmlrczBPWGExc0NmMjF6?= =?utf-8?B?NUJyUWdTTUhxeGRWUS9iT3Z4SVB1N1Joc25makZRUzg4M21vY1QydmJaZ2pE?= =?utf-8?B?UEdPTlJENko5MTUxMk12djcxeXdJellPVUExaUI1cXlsVldLWEJUUVJCMU00?= =?utf-8?B?M1VUbkxLMDQ5QTBFS2RUUHg1UEtIMzFjOWs0eGdJS3lVb3d3QzNMQnpjY0NE?= =?utf-8?B?MmVhZXFkZ2luY2ZlOStCSS9SUzhYU2MvZFZ3cmtMN2FqMU5TQ0Y0TFVtbFo4?= =?utf-8?B?ajFMb2NLa1c5WkRIWTFYK1gxOFJVbTR6bmVYcSs2alNXS0lJQ1I2b0NtbDVr?= =?utf-8?B?bFFyVFBJL0tnYmZ1ZXNPQWFrTkZNbGJqVDRZR3p2MTRtWEpHY20xYnA1cGlC?= =?utf-8?B?R1oxcjFkNjE1TkdId1hPbkhvdlhQTURnQ1NRVXd2ZVdsVXJGSVFwTTA0R2hR?= =?utf-8?B?aVJQSmpaV3N1bXZxMXFhc1UvU2RLczY4SnRTa2U5RGZvbkVwKzN3VFRObUdY?= =?utf-8?B?OE5iMFN5STRlM244WDFJQTF5L25TZEs3RFh5bUVjSTBOVVF1Wk9DTXE5ajFR?= =?utf-8?B?VlZic084bHpqNnVPREhNWklpUk5keVdMMU1zUHlEdzMxbkhVNnlrcTJKekRM?= =?utf-8?B?R3lVVEhtMVJJTWFrOVJtRE5lU2Q3TzZ3dXR2UFV4aEhQd1NZN2pQTytQcUhZ?= =?utf-8?B?cTFFZVFaazcvRjBoUWtlUkZKRU9DWmY3SWcrbWtzV24vNnArRDVLbDEzZWR5?= =?utf-8?B?OExLUjhFL29zUmdLT0ZsOGpDZG4wZThOZWV1blNXdjBtMDVJOW9vN1pLanVt?= =?utf-8?B?ZWhrNHc0VVoza2l4NTBaOEJONWp0YXR2NUcvWVRleEtJTFQwUW90UTkwQ01E?= =?utf-8?B?VkRXYjB5cURIL1h6anY0aXc5ZzZsZHpYaUlTdUR2QmVWa3EyekVSUVRwOW1o?= =?utf-8?B?bVdlbGJ4bDBwY1dXOTJ4QmcyR1BEdDA0NkRHR3dhZDBZaVpBSGJoTEpQSHdt?= =?utf-8?B?bk9UM3FWbVV2SFJYeHQxV21ncWV5UE00SzZtRi9VT3RWN2tyNUpnaXozR0h4?= =?utf-8?B?UTR0M1JIbDJRT0wxTldhSTNXcmhvYXAzamNNcW5wY3B1Z3JwN1VkS2xkV3R1?= =?utf-8?B?OUZCbGh5NjV1aU9FUnJKbFhhSFA2aXJjOHpqSlQ5RjVOWUZibWFOVHlxWU5J?= =?utf-8?B?WUZVenRremExODA0TGo3MEhrR01sbEtGWEs4SGZTUm9oZ1piM2F0bGNHc3kw?= =?utf-8?B?VEZ3QlAzbjVIOEJJZ05oTllPV2FuTkQ5KzZOQkU4SGFnTVV5QUVaUjZ6VjRs?= =?utf-8?B?WjRDVlB6elZKZXVSWFNBSTRiLzhsWStPUUdVL3ZTeEN3WWNCYmtWaXdKdTd2?= =?utf-8?B?c0VDMjJlN0NMTEplRHVOOEdmU0h4bElVQmY3TDJkSUFJZzl1Z3ZxNmJ6MjZR?= =?utf-8?B?TWRCYTJHVE1yc3FSYm0xdHlQUDA4cWpVUGZqSVE3TTZsWGpXdWYrYUliM0tK?= =?utf-8?B?ZndVZnVTVW9SdTN3ZUtSK2V1SzhLSmZVZDdjMDB5bVZtMngzUVpDcldGQ0hk?= =?utf-8?B?SHY4TVJ0Mi9hWm45NjBtUFZpVXBCTnc4TnVkclNXNWErS0NuTGlMUzhRUmVz?= =?utf-8?B?alZLUFZVdVZBdFphdnYreTdMd0pWNHdzSXZkK051NjliWnJkWnRmb2pMZmxu?= =?utf-8?B?enFxY0l4VVgzeDlvMWNHYUZDajhxbDhFQ0M5L3pNV1lDZ1NuK3hIenoxNEV3?= =?utf-8?Q?GNpqtuRhQsA7y?= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:PH7PR12MB5805.namprd12.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(7416014)(376014)(1800799024)(366016);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?NkVjZ3pReWU3MVhNM1hVSm5EdzlYdTJzemh1OWUrVkdIV0xUWlZSU1lMWENs?= =?utf-8?B?aEhKUjZOQU5IQmxjUXRPcWFyYnBSVlpwMmhONVFtamtNRk9TaFhRWVlaT0lB?= =?utf-8?B?K1NlTDZnYnczMHlJYi92UW9BY3NCSTlaSG15ZnV3MUtGc2Z3bko5NHdLU2Nx?= =?utf-8?B?a1RKUiszS2ZkYlhJOWx3VS9NMWdTWTI1alc5algxRStLVkdTMXZweUlsT0hk?= =?utf-8?B?WENzdm9LTVFlenZqZVZPVkFSNHRLaGdrNEdLajgwYm4xV3BwclFzR2gxUXhu?= =?utf-8?B?WDBBZ0szUnlpd0FxMzFOdFFrZWZwOVpzTkRvZDJWbnBkTXI0RlJ4d1JkRjNj?= =?utf-8?B?NlFleDZRNDdwcWZlN1JqYWdNTnZWbWlrRUg3S2llY0VpalZPc3gyUjIvaXJU?= =?utf-8?B?WUN0NVdyTDJBWlpreTFVOXFHNWs1d1FuL29QNEVlYzh6cUhaY2FBRlQrR3NL?= =?utf-8?B?SGlQUTNWRERjZGs1UXBpSG9BSkZjME9FbE80STZ5bzFGNnRORFY4dDJwb1lW?= =?utf-8?B?MS9Uek54dnRTcTRDb21rUTJuZGY5cERHS3M0aGVoR0lxeVdrZU03M2ZXQVNV?= =?utf-8?B?cE9qVEcwWUFQYWtnc3pZMTZGZlJXUGkzditZbkJQNS9mRHJRSWh0Rlc0ZTNQ?= =?utf-8?B?WlAvREFEN2Y4TFlFK2dLVzN2TU5kUCtOMnd1UTV3bzhXcGxIU3JMVjZRNTRS?= =?utf-8?B?S1Y1VDc1Q0RGREtBa3ZGYzlqUHdUVVJSNXBvZ0Y3ZHRJaXd4V0JQWmlnRDF4?= =?utf-8?B?dHZrbE4vOS9PU1B0TGhJa3RXYXo2UGdmSjRORThQYzJic21ISGdiOGI5UUQy?= =?utf-8?B?dDFaUUVyRUlSRWYyZFQ5bFlUQ1NpY3N5SUJULzJLeFRhNUppYlpBSGgxODF0?= =?utf-8?B?S0FET3BWbnQ4MGhiTVByRlh2VXVqdEo3RDhBM2o4Q2NhMzl1QnpIK08xOWVs?= =?utf-8?B?d1VKNFVPenVsTEtCZUJDbHM3QmpyMUFCNUtsMnhWRVJwRWhTakdONmxXMG5x?= =?utf-8?B?cXd1TXRqVndCMDdQa3Q3OGRpTWg1WStETWMyaVhQMk9GN2wyd3IvbmVxNG5k?= =?utf-8?B?aEd5YjNxeE9ZcldXbm9KREpIbzYrbmZmQ0tVa0VXL3M4dHo4NmRHaEpYdEtj?= =?utf-8?B?S3NVL2dDbDhZSFh6WFA2MWtnUkoxR2tCN3dyeUdLc2hBSVJjTmpQY3ZwaHgx?= =?utf-8?B?TUpkdzRDK3NxdFllWlRVbTJaL1d4SWU1ZkpzT0dFMlg0NkM2UDkyQkRPbS9J?= =?utf-8?B?QnBZTWVSMXR6S2FuZTlpS2FtODRyai8zdXRoZlZTbUJkVVhqczMxUVRvQ2dw?= =?utf-8?B?eVhOSjQ2akN1OUVZY1JIckhyb1loRFlNNVBZdGE5N3hiVHUxd0pXYmFHejNk?= =?utf-8?B?YkNpTStkbEVsWDB1ZFFkcVVIS1hpV0ZKZjZxMlQxZG1iczl4OXFpQ1cyb3oz?= =?utf-8?B?RFVVVFFKaDZIOVE0NW9oUlM3bGpuL2J0a2xacEYrMC8wbVg5WWxEbjFlcnMv?= =?utf-8?B?em1pdy8rdTZwT1ZHdWJNRjNXR1NERUFzVVBoMWowNTQ5ZzNWL0lQZTJRZjlI?= =?utf-8?B?anZnb3ZzSW4vdE5FNTdKeDVXclVuU2RwekdnYi91SjJVbHVHek4ybVNNbi9X?= =?utf-8?B?V05WVzJUc20xbXdCNFUzNnhlZUs1THlpRHM5dzl5MmdPOXBpbi9UMGtIOWRD?= =?utf-8?B?REtUcEFNaVFUTEVheHQ4cjhVY0JDWjNsY0EwRW03WjBNUGhOWHlMQUl2dVNi?= =?utf-8?B?QUpEWitkSE1uMTVuRmZ3ZDNmcGlIRkQreVNZZkJBalNvZDY3V2pyODZINGNh?= =?utf-8?B?WVl4RHMxY2JpdkhvdUF0dmlRMldTNk9lOFp3RGFYUnhuRWRMZDYxWE81TW5r?= =?utf-8?B?cTBMVmxnMXREQ251ZnhEbDJMK2czY1FEdy9KSTBzSy9YcVlncDlsaXV6b1ZS?= =?utf-8?B?ampQanQ4NWJHanVOMlBVNzlXT0NobEhUN254cVBnT1dBK3ZSblhQTVdiU1lz?= =?utf-8?B?N3VyRzBvR05FamY3NVJ6Y0t1VnpEcENtdkhYcWdaaEM0alNOMjRnSWZOYXpN?= =?utf-8?B?UEJKeElRdWxxTW9xOTllUFB4RWlHZ2ZUZ2sxbWxmVmk5R2tnakNwNkMycXZs?= =?utf-8?Q?aYmrJVCbhA+yCOj6J5e2oZKlx?= X-OriginatorOrg: amd.com X-MS-Exchange-CrossTenant-Network-Message-Id: 3b080682-0a97-4713-73c0-08dd3ea1e910 X-MS-Exchange-CrossTenant-AuthSource: PH7PR12MB5805.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 27 Jan 2025 07:12:08.1497 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: gVP2yFp1KNlpRdUEVMGmbn1X3phpQdULl8VbfIviA/bYut6PJLp5A3+ix5QYyLk4SjU4zmEvjk+fd6WiZ7VRhw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH7PR12MB8177 On 1/27/2025 12:31 PM, David Rientjes wrote: > On Fri, 24 Jan 2025, Raghavendra K T wrote: [...] > >>> By the way, do you have any reason why you'd prefer opt-in prctl >>> over per-memcg control? >>> >> >> opt-in prctl came in the MM alignment discussion, and have added that. > > Are you planning on sending a refresh of that patch series? :) Hello David, Current plan is to send by next week. (Because after measuring the per mm latency and overall latency to do full scan, I was thinking to add parallel scanning in next version itself). > >> per-memcg also definitely makes sense. I am not aware which is the most >> used usecase. But adding provision for both with one having more >> priority over other may be the way to go. >> > > I would suggest leveraging prctl() for this as opposed to memcg. I think > making this part of memcg is beyond the scope for what memcg is intended > to do, limitation of memory resources, similar to the recent discussions > on per-cgroup control for THP. > > Additionally, the current memcg configuration of the system may also not > be convenient for using for this purpose, especially if one process should > be opted out in the memcg hierarchy. Requiring users to change how their > memcg is configured just to opt out would be rather unfortunate. > >> Overall point here is to save time in unnecessary scanning. >> will be adding prctl in the upcoming version to start with. >> > > Fully agreed. > > Thanks very much for proposing this topic, Raghu, I think it will be very > useful to discuss! Looking forward to it! Thank you. - Raghu