From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from SJ2PR03CU001.outbound.protection.outlook.com (mail-westusazon11012065.outbound.protection.outlook.com [52.101.43.65]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 6E04F2BEFE4 for ; Fri, 19 Dec 2025 03:14:27 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=52.101.43.65 ARC-Seal:i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1766114069; cv=fail; b=s9LbnrBOkHnDm27r6BJaQV6v40Hl82cKkql9NjPB1C53Tc6aAqBqeqDRJcLz1lCpiR/WS8EYPgyAkuj4UZPxkz3IyTaM6pKgsk3jLxuS7NBjWlliOKiFUe03HUCvxEt3cXAdeovOC7qQD3u3F33ZctQk92vVILf0b58QPs3cWuA= ARC-Message-Signature:i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1766114069; c=relaxed/simple; bh=v+UGCx28VJx7DTzQMrUQ5eQ5gpZQCuLVjCqpI23IzC8=; h=Message-ID:Date:MIME-Version:Subject:To:CC:References:From: In-Reply-To:Content-Type; b=L6Em49uhQ/PIBv3JejTQhUDbboPbpiogCo0rz8CaF058yW+M+CMnd9H4FtZNXT5ZlaEiPAfsnU53x9vNtMo+M21Zo3Gif0KITcLF4Ls5+fEAbhp37Gd7NnkRBx0mWyexvYeKGhhRDH4MBDw/n+LsvDY6C0pP8d9MV6/F3Q4X73I= ARC-Authentication-Results:i=2; smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=amd.com; spf=fail smtp.mailfrom=amd.com; dkim=pass (1024-bit key) header.d=amd.com header.i=@amd.com header.b=Uc3MwvUB; arc=fail smtp.client-ip=52.101.43.65 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=amd.com Authentication-Results: smtp.subspace.kernel.org; spf=fail smtp.mailfrom=amd.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=amd.com header.i=@amd.com header.b="Uc3MwvUB" ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=VEjEjw7maxHUxt03r/iVE7FicKbcezhK1cwoKhoteh5OiSdFmqIRPKaGfXC8rI8oIIq51AIgJ4SHN7YYpin31wFyepPC62ZcPKZYY7K2MHld3fk6OJEtmB21x2pDnXB4OE+D4cjd59SLBNYGxr0OqQR51TGHKcBBEFp9sTCpF3xx6HkZ6hNmBnXuGPyTrLPtO10ExEXi1pBcB/ARQ7b3Ul/s886g/KVXlsXWjKDoFlZExCzxitIYNaASdQOZEpbQFx2U/RwUfv+337QQjuY9fRNQ+4GtbL29g420wHm4UI+quB9ccXOR3dbm5qjRSo0IjcRnKICJy4e7LCuUkqfETg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=rqHlWva8zoyGQt/SY6b17vrjJL9DGkqAQR6V2DVbGnI=; b=xxiLh0QslZvZxbFk6bdP8poyZSw+smTztDIG5rBKvGjUy8zP0qIHzIgZDPoJS1Wt95sLY9o/LpKP3GOvsTc8G3EOXWbgYsqR87dkPzDuioOf6QoDuJ4zC1Yb6IJ/bxY1+G24ajYY/n8AvMjklsgpkgbFTYQzzlSCVDs8FyLqaDLiS1h9v2gOtBJl96QueDj17CZPNrKHOUu2NAkL7n8iqo+y5VVToU0bhc0hc0GZdGiwPcvEnfub3kt21jJz63pKSGVi+nMvVeoM6zripUhqPyqfQTpQ7EP0vRh3bLopulhuN/y8Or6LO//ODCMV+Ct+JHAhJzAylYpcx2rJpxpSig== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 165.204.84.17) smtp.rcpttodomain=gmail.com smtp.mailfrom=amd.com; dmarc=pass (p=quarantine sp=quarantine pct=100) action=none header.from=amd.com; dkim=none (message not signed); arc=none (0) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amd.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=rqHlWva8zoyGQt/SY6b17vrjJL9DGkqAQR6V2DVbGnI=; b=Uc3MwvUBk7niBvSLzQa6xSv7RvfFU9j8G0yjyGtCqWBH4wZtvdsNjwqsCLuJN0wrklo+CvjezXMhl48xzFpPWwKM7uO1bd29AaMI+ZFkxvKXiPT4ukDpdaKlkR9CdBKUpcLDUNfVHYL6iHdH73EfuUrBRujeksfCN2nSv9Zq3rE= Received: from SJ2PR07CA0004.namprd07.prod.outlook.com (2603:10b6:a03:505::10) by IA0PPF89A593F05.namprd12.prod.outlook.com (2603:10b6:20f:fc04::bd8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.9434.7; Fri, 19 Dec 2025 03:14:23 +0000 Received: from CO1PEPF000044F0.namprd05.prod.outlook.com (2603:10b6:a03:505:cafe::a6) by SJ2PR07CA0004.outlook.office365.com (2603:10b6:a03:505::10) with Microsoft SMTP Server (version=TLS1_3, cipher=TLS_AES_256_GCM_SHA384) id 15.20.9434.9 via Frontend Transport; Fri, 19 Dec 2025 03:14:18 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 165.204.84.17) smtp.mailfrom=amd.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=amd.com; Received-SPF: Pass (protection.outlook.com: domain of amd.com designates 165.204.84.17 as permitted sender) receiver=protection.outlook.com; client-ip=165.204.84.17; helo=satlexmb08.amd.com; pr=C Received: from satlexmb08.amd.com (165.204.84.17) by CO1PEPF000044F0.mail.protection.outlook.com (10.167.241.70) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.9434.6 via Frontend Transport; Fri, 19 Dec 2025 03:14:23 +0000 Received: from Satlexmb09.amd.com (10.181.42.218) by satlexmb08.amd.com (10.181.42.217) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.17; Thu, 18 Dec 2025 21:14:22 -0600 Received: from satlexmb08.amd.com (10.181.42.217) by satlexmb09.amd.com (10.181.42.218) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.17; Thu, 18 Dec 2025 19:14:22 -0800 Received: from [10.136.43.232] (10.180.168.240) by satlexmb08.amd.com (10.181.42.217) with Microsoft SMTP Server id 15.2.2562.17 via Frontend Transport; Thu, 18 Dec 2025 21:14:16 -0600 Message-ID: Date: Fri, 19 Dec 2025 08:44:15 +0530 Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [PATCH v2 19/23] sched/cache: Avoid cache-aware scheduling for memory-heavy processes To: Vern Hao , "Chen, Yu C" CC: Juri Lelli , Dietmar Eggemann , Steven Rostedt , Ben Segall , Mel Gorman , Valentin Schneider , Madadi Vineeth Reddy , "Hillf Danton" , Shrikanth Hegde , Jianyong Wu , Yangyu Chen , Tingyin Duan , Vern Hao , "Len Brown" , Aubrey Li , Zhao Liu , Chen Yu , Adam Li , Aaron Lu , Tim Chen , , Tim Chen , Peter Zijlstra , "Vincent Guittot" , "Gautham R . Shenoy" , Ingo Molnar References: <91a7c325-5093-4417-aa98-34df694b0c39@gmail.com> <61cc2b92-1b5a-4af5-9d88-96097c3b0619@intel.com> <2924fe29-e813-4dc5-8a1b-86890029e372@gmail.com> Content-Language: en-US From: K Prateek Nayak In-Reply-To: <2924fe29-e813-4dc5-8a1b-86890029e372@gmail.com> Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: CO1PEPF000044F0:EE_|IA0PPF89A593F05:EE_ X-MS-Office365-Filtering-Correlation-Id: 0213db58-7cbb-4a40-805e-08de3eacb580 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|82310400026|32650700017|1800799024|36860700013|376014|7416014; X-Microsoft-Antispam-Message-Info: =?utf-8?B?dU5XR0RtckdBOFg2WTRLT1R2bWtZV0ZvRzFjLy9CeklhK0lIQ0dxZ0JFOWxm?= =?utf-8?B?dkhPbkkwWmdEVzBtOVhCZ1ZYRTN5dDBNaTdxQ3I2cHZxanpWNktZaE5pdUxO?= =?utf-8?B?TytCQW9LcXJSaWk2cUVaV09CRko4WXRLM0pMUWtNMDFHR3F5dGpjaWRiUFI1?= =?utf-8?B?VUJjWitLcGR1NFNYUExHMkxDbis2V015UTBVQzE0dkRCZUt0c1BUS3VwVkU1?= =?utf-8?B?SmlvSitDU2cyMFdPY2JTY3ViajR6WVFpeGo5eSsvUmJCUENqN3RrSmNlOVln?= =?utf-8?B?elBKME9xRnBkNlJYc1hMaldua3Fkc2lhK29FUmZ0R1dQanYrNmRFUDVGYmdY?= =?utf-8?B?cWd6U2lmZXd6ZXZNNTcwZUQvYmhZUXZSNFZMWkUrT0kwTWdMQmpLODJ0Y200?= =?utf-8?B?c0JMSU1hdVJwVUR2a3MrT3RpZDFRekp2VjZFci9yRmVockxvc0FzQ2pjMDB5?= =?utf-8?B?Z3JMV2x5QUxzUXpOSW00R3dRSHByaW5iTlZDTzNrZUJ5Mnc4bHFTVDNhR0l0?= =?utf-8?B?QVVQSmVvR0FJUkR6aWFYbXVpQWZwNXVHbnNNTEg5T0hmRmVxZEVRZ04rcmRt?= =?utf-8?B?OVdxL1FDSXhPRUZOZDBzMVFGYmViR1ltWi92eG5TV1hqWnFyNDB2NXNtczk2?= =?utf-8?B?a1dqTmd2SVpVSHo0dXZjc3h6Snpqc1dURDdzc0NVNUJHTDlXdHk2MnBBbUVD?= =?utf-8?B?UUtPbUo2SEJqN3NoSzZxbHhzR3ViamorZzNubmE0eHRNTXNDeWF1VEhRT2FW?= =?utf-8?B?K2xCWUFHcTZDNTV3NmJudm95QTJ6ZisyOSsvTUJ6eFc0MnZDZ2pEQTRXaVZ5?= =?utf-8?B?TDdJV0JDMGFSVFhBRy9OeXExY3E2R3RMdDI0c2hYNUxZZFZ6ZlBnMjZ3YTZY?= =?utf-8?B?QTdYVkJCMUZqQUtkMERDVEkyamJiWmxrUlF5Qmhybyt1NDIrL1RzZWUxeXR2?= =?utf-8?B?SzF2czdKZDQ1Q3ZPbFZiQnFEVDNpQ0dTeFpLTlFhT3gzSS9qVlBNdEphOFhl?= =?utf-8?B?K2NkOFpobHJlR1VIdUtaVW9YRm9DbE5sNGlSU285NlIybWhxZm85YkhBZmpk?= =?utf-8?B?ZFFEWndRR0tHcktvUk1ad0lJQ1M4WEg3aEYvamF1NDdlWGNXa1NUYXlJblY4?= =?utf-8?B?SnR2M2dQTVlUTVpKaFVqZUkxekhEZW9jTDV5b0IvUWVNelZCeXhTZGw0WGpn?= =?utf-8?B?YmErZkJudG5aVW51V2kyck9wY0Z5aVNzalZjU1NycGNUQThGYm5rZ1hTS2Er?= =?utf-8?B?d1VYZHhibDdHWm91R3B3V2N2ZzdtV2FZWUZvUUtpazhEM2t5REJ3VVRkeity?= =?utf-8?B?b1IvNHI3VEpuVHpORFI0QjFxUGhnOEE1Mk9tNUF3K01UdG1LSXBmM3BJbXNI?= =?utf-8?B?QVRKOTFTbUtJQitGNHpVVXJ1Yy9ZZVpqamN6eko1a29xL0ZDZk5yNDdLeGlB?= =?utf-8?B?L1o1RGJwR0dnOEtYVEEwbnlQY2JLZUtSbVpQcVlpRVE4NnVmcC9kMHBpUmVU?= =?utf-8?B?WE82UndMbG84UkVwN0NROEdxa0ZNdFArZlBxV3JyTHVCOXZPNlVpYmxkcTh5?= =?utf-8?B?NlJFWjV0cFJVTHVGOWtPRU10MWt4SWxiOVZ3Z0krRm41bjVpaS9VSDIydzc1?= =?utf-8?B?LzhzSDRQN0pDWDM0REIwVUF4RHJTLzluUjJ0bG5NUkl5VnVjRkoydkZQYUxS?= =?utf-8?B?OXIyOHdMdUxpdjRsdTJOZ3A4NDZUZGM5b2hqTjJ3d1lkS01rd29lVUdCWUhS?= =?utf-8?B?VmgrN2ExTWpxWHUySGZSVm1VNWlEbXJjQTArY0tySlFJT3FyTEtjdGxlTys0?= =?utf-8?B?eVg5Yzl3aFV4MTdjL2k2OStPWG51TGpKTEw2TGx5T0JhNmR2Nm5ITGdOU24z?= =?utf-8?B?b1hnM04vYklvL21GdEo4U0xibTYrV3dMWFRvVUdORkoxRUdrNWI3V3hTOTRh?= =?utf-8?B?WFpBYTEveTE1REZVMFFmMGIybWozQzZtc0x0MXAzanJ3S3BLZE4wRWt4MnVQ?= =?utf-8?B?ZjRXbW41RGVrZE1IRGhhYkVPSFZHK1lTRG5xQXdtcmxNWncwQkxFbS9uMW9O?= =?utf-8?B?R3lUalA1UkpyVkNEbmZsRjkwNDJWNEYyQm5LZ2RFVUw0azlEYTJRR1NaMW9v?= =?utf-8?Q?7rxQ=3D?= X-Forefront-Antispam-Report: CIP:165.204.84.17;CTRY:US;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:satlexmb08.amd.com;PTR:InfoDomainNonexistent;CAT:NONE;SFS:(13230040)(82310400026)(32650700017)(1800799024)(36860700013)(376014)(7416014);DIR:OUT;SFP:1101; X-OriginatorOrg: amd.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 19 Dec 2025 03:14:23.2256 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 0213db58-7cbb-4a40-805e-08de3eacb580 X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=3dd8961f-e488-4e60-8e11-a82d994e183d;Ip=[165.204.84.17];Helo=[satlexmb08.amd.com] X-MS-Exchange-CrossTenant-AuthSource: CO1PEPF000044F0.namprd05.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: IA0PPF89A593F05 Hello Vern, On 12/18/2025 3:12 PM, Vern Hao wrote: > > On 2025/12/18 16:32, Chen, Yu C wrote: >> On 12/18/2025 11:59 AM, Vern Hao wrote: >>> >>> On 2025/12/4 07:07, Tim Chen wrote: >>>> From: Chen Yu >>>> >>>> Prateek and Tingyin reported that memory-intensive workloads (such as >>>> stream) can saturate memory bandwidth and caches on the preferred LLC >>>> when sched_cache aggregates too many threads. >>>> >>>> To mitigate this, estimate a process's memory footprint by comparing >>>> its RSS (anonymous and shared pages) to the size of the LLC. If RSS >>>> exceeds the LLC size, skip cache-aware scheduling. >>> Restricting RSS prevents many applications from benefiting from this optimization. I believe this restriction should be lifted. For memory- intensive workloads, the optimization may simply yield no gains, but it certainly shouldn't make performance worse. We need to further refine this logic. >> >> Memory-intensive workloads may trigger performance regressions when >> memory bandwidth(from L3 cache to memory controller) is saturated due > RSS size and bandwidth saturation are not necessarily linked, In my view, the optimization should be robust enough that it doesn't cause a noticeable drop in performance, no matter how large the RSS is. Easier said than done. I agree RSS size is not a clear indication of bandwidth saturation. With NUMA Balancing enabled, we can use the hinting faults to estimate the working set and make decisions but for systems that do not have NUMA, short of programming some performance counters, there is no real way to estimate the working set. Hinting faults are known to cause overheads so enabling them without NUMA can cause noticeable overheads with no real benefits. > We need to have a more profound discussion on this. What do you have in mind? >From where I stand, having the RSS based bailout for now won't make things worse for these tasks with huge memory reserves and when we can all agree on some generic method to estimate the working set of a task, we can always add it into exceed_llc_capacity(). -- Thanks and Regards, Prateek "Rome wasn't built in a day but they were laying bricks every hour. You don't have to build everything you want today, just lay a brick." - James Clear