From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from SN4PR2101CU001.outbound.protection.outlook.com (mail-southcentralusazon11012064.outbound.protection.outlook.com [40.93.195.64]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 3164341686C for ; Wed, 22 Jul 2026 17:02:41 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=40.93.195.64 ARC-Seal:i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1784739765; cv=fail; b=cOY2erI1YXeKTp9e2k62WiwfCPdE3Rb3/SR256tHSy2C70N5zC6SvPpKKkQRrMTQcSV2roGPEEI22CNausc7CVdPET82QCgz9/trt0Z99pFIVdGXwT+ZByt4mKj2gDqrbJoDl7RRcBXiV5G6sDFSn6X6A+J8OB4rpJmZ1pjdH98= ARC-Message-Signature:i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1784739765; c=relaxed/simple; bh=IA9nEJfrD0+aug/oel7qeHyDP0csyQOpmf4EPo9K3DM=; h=Message-ID:Date:Subject:To:Cc:References:From:In-Reply-To: Content-Type:MIME-Version; b=kmQJUP4hKU+oILagPiex+H3M2oCRG+zgAZ8gn4bPfID9nN4yNZE+ypX/w1Rqo1Pcwv0U/Wu2IUwRPwJfHKl6qwecgGXBudqDaJmfPYPJ2x8/uRsG1NRLat8KeO+KQq76/+5nrNZ9wiNRhnvO9wrRTtMJeghpcAJCMSUpOs+AmJA= ARC-Authentication-Results:i=2; smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=amd.com; spf=fail smtp.mailfrom=amd.com; dkim=pass (1024-bit key) header.d=amd.com header.i=@amd.com header.b=SBbWRWKH; arc=fail smtp.client-ip=40.93.195.64 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=amd.com Authentication-Results: smtp.subspace.kernel.org; spf=fail smtp.mailfrom=amd.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=amd.com header.i=@amd.com header.b="SBbWRWKH" ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=J4YlQn2UdgL8/pniBkeLeQOctWQ6/wvN7t5kNoux9uhFO2gcOtyfWyZI5xcruv/t7S97+382/+Z2JQnFz1q+JQef2Vg+TXQUE9jmfs0ZSc9fS9ivwomMdfSQ2YvShRTgbFibIbC0w0eIIQc9YfENNSaSaupBzOiQYex2iVMOkWbEwq7MN06AUaY6utWnbfy8hvlvNHaNVSlk2dBL4m6WLY+oH43hwVE3C874u9zOct4p8sq8Zj9MzX5744WRE+P7+5HeQlIWo3mmDJDThI1fZao46uaq/7EP+VY8nZuqYYXPGQLecjfotnI60+O0UdndBBuZi2Hwflss3l+JEW0PiA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=z1Q1Tbl3jl96vssmTr0GtBy75YyMWeDSb5esNDjZDpA=; b=e9UeoAXbQDZsRUaxBCS5Zm6IORv1cx9Fq0s1kZSH827UxNhGrBeoYjQRvmIm+/lPYqUPGAbGvTJkNpztqUkZT4Gq4HNEGhjLUJpIF+GqWIqoMfb1yCWzEpQNuNlOXlXw7jsrE5G/BqX0y6BTHDtKJo20WLSVMc27bEjNr7cf8EanqPmX7gWxC+GgxTkqwrWWV9gnAv2+/ceuGlDrMCkgWYcD2hUNcIPvq+A3mWQFNq6zpHRpHw9+QFgSX7ZhubL+n63lx05nZ2M/GmGEH9CnyMrDq1z2M54NOwgJiOvvQvA9cGR1xRh+Mz6aFPdubvl3W2hpj/NkIwmZcccdefoS2w== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=amd.com; dmarc=pass action=none header.from=amd.com; dkim=pass header.d=amd.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amd.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=z1Q1Tbl3jl96vssmTr0GtBy75YyMWeDSb5esNDjZDpA=; b=SBbWRWKHnozFmthYpTVKraiZsG+gS27RxdX50ybfm7jqBI9+H1ZFCskav5jJscij4d0U3t+uD5vXt8qfl8BC/IWzkSlg+TcWV1Qo4U+j9BGxqAvrcH22CYyF/B+Qj5Dm7uICgVFlWzxG02uooyhE8skoXPvGzX2z5LBEQB87iCw= Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=amd.com; Received: from BL1PR12MB5320.namprd12.prod.outlook.com (2603:10b6:208:314::17) by CH1PPFC8B3B7859.namprd12.prod.outlook.com (2603:10b6:61f:fc00::622) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.21.245.10; Wed, 22 Jul 2026 17:02:31 +0000 Received: from BL1PR12MB5320.namprd12.prod.outlook.com ([fe80::1876:4a6d:2cf5:b8d1]) by BL1PR12MB5320.namprd12.prod.outlook.com ([fe80::1876:4a6d:2cf5:b8d1%5]) with mapi id 15.21.0245.009; Wed, 22 Jul 2026 17:02:31 +0000 Message-ID: <653c9a0c-c665-4016-90b2-3f55e06050b3@amd.com> Date: Wed, 22 Jul 2026 12:02:28 -0500 User-Agent: Mozilla Thunderbird Subject: Re: [RFC] mpam,x86,fs/resctrl: Generic schema description Proof of Concept To: Ben Horgan , Reinette Chatre , Fenghua Yu , Tony Luck , James Morse , Dave Martin , Drew Fustini , Chen Yu Cc: Borislav Petkov , Thomas Gleixner , Dave Hansen , Peter Newman , "x86@kernel.org" , "linux-kernel@vger.kernel.org" References: <5ee87762-1898-4b62-94da-85b3e9917ecc@intel.com> <62701203-c4a3-4ec2-a9af-602e1fc15863@nvidia.com> <8f9f78dd-e3f5-4b35-bc72-0eb5dafdcedf@nvidia.com> <36163a81-9737-49e3-93ef-6c392f7272f0@intel.com> <0fc6df54-26c7-43fa-948a-528cd94937f1@arm.com> <9049378c-699a-4155-b1e4-737a1d7265d5@intel.com> <57740b97-80ee-4632-bca3-dc43cd7776c2@arm.com> <44f26cd4-be79-476e-b002-7ccfb7705179@intel.com> <749bd904-523d-4e9d-8493-0e8cfd79949e@arm.com> <9db33feb-cf04-420c-a99a-e31e4b8e4954@arm.com> <8fd6caed-820f-457a-a1ef-a0a006fa52aa@intel.com> <4ef15dde-2fbb-4763-93b6-4333b02d6859@arm.com> <7b751c28-2f04-42b7-b957-af6447e7f824@intel.com> <34b95afb-8b60-4680-9ad1-90c5b24e8fb7@arm.com> <08f016bc-2ba6-439e-bb3e-20061166402c@intel.com> <21e614b8-50fa-49e4-87c3-e6bdb4e83ab1@amd.com> Content-Language: en-US From: Babu Moger In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-ClientProxiedBy: CH2PR10CA0007.namprd10.prod.outlook.com (2603:10b6:610:4c::17) To BL1PR12MB5320.namprd12.prod.outlook.com (2603:10b6:208:314::17) Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: BL1PR12MB5320:EE_|CH1PPFC8B3B7859:EE_ X-MS-Office365-Filtering-Correlation-Id: c2aa4703-d79e-4e78-ccdd-08dee813041f X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|1800799024|23010399003|366016|376014|7416014|3023799007|4143699003|11063799006|5023799004|56012099006|10067099003|6133799003|22082099003|18002099003; X-Microsoft-Antispam-Message-Info: 1RDs+bs3RHWzA9XFM5C8UOtpfOD7m2M+Rp1HX6WgwNW9EgyiH+9vjz+8N8mGZQJ7NCBRk7fvPbqE0oDTHcCReY5paR8xmR83uFRWNpWfqPgV/bLFq/WGrpKvS4kEiJqwgXED25mUTUj3lV3ZekiFQ/yDKjMcscC9eSCgPS6NvyNhVxYMPHjUkiHrJY8a3WvOkZJ+Cxiq8hWaqQTDhFs2L/xGVh0WjU47JQ+qZv4s4DV7WON810eeGEW7kxm2VaPgw8eckdzoxCzAzFzOL3CZgQciGivF+OfllboDRfwZq/QIQvqrUvue4S7N0EEidkEprKUELfk+h8cve+uLMtcpc8p9AIri2qSTZ/ze+ySjdfAk23Vq8wSWYzsHysW+WsA2lt65lqTdYIHtCMIVMX4YqgKbmF1DclD9I8SoEzR88smPAVjRU4ULd5/kB8GNqF2fSiNrNKh5H7g+2Jh+b5JT16Xa5bMyOponihuCqgMWB0cO79lnjzDExPXrObS3EGOSMD+qabchcmvg5hKb3V/z0ZW5EUoobvoz7/NTSliQ0OWTfmcm8mADjmzHpvHQnFLIFUHaSjWVs0ShXGJchl1FRYZBTUVQ9jpOSF7INbeOsag= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:BL1PR12MB5320.namprd12.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(1800799024)(23010399003)(366016)(376014)(7416014)(3023799007)(4143699003)(11063799006)(5023799004)(56012099006)(10067099003)(6133799003)(22082099003)(18002099003);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?NXp6ZERqbGlkNUlNQzBLRnFhbGsyUUJFRUVSb2pjMyttY29qajFrQjEvMHd4?= =?utf-8?B?NDBMZlJYYnZiNFNPdVBOdUpoQlhIKzdOUlgyWUZkMTZ6TGNjQnR6aC9mWW9z?= =?utf-8?B?YXJFNUx3eVRvOCtOYW9RY3hHWTF4ajVzTlpnQ0o5NUxoa3JQWFdmb1VtWGps?= =?utf-8?B?OFE4c2cydmRDeWoxTmZNbTRKeWZaTTIvTFNkbVpNNU5yUkkrY2NXNXZtWEt4?= =?utf-8?B?SktCWmFESUJ4YmdzWkV1MVRlQlZENW9zcXE2aHZUUU5wY2hVemt2RW1uMXhl?= =?utf-8?B?OExHK0ZFY3JvTDhONjE1bjVXUXV3TlVQQ3dGV1pXVzhkUDVaQkxudTB2ZVVj?= =?utf-8?B?Ujc5YTlOU3dBbm5aMWJyQ08rZkNtditPVEI1blZ0NHZZdHQzQlAySUt1NktD?= =?utf-8?B?UzZDck93NzRrKzlVRzVDVDdtUGxJVVAvZnkxWUVPWTlvR0M3SkNMZzdKL2Q1?= =?utf-8?B?dU00ZTZnNVFXbXVxR0YrZ2FQQ1E5bVUvM3Y2MG5jZkZBSlRyRDZlNWlqVGFk?= =?utf-8?B?ZHoyWGNKVEJCcWZyMjdONi93cWw3c1ZyU2VJT2xBanh3NzV2aGdBeEZtNmw4?= =?utf-8?B?dVFMZmRKdFl0QWJ3Q0pSLzhTZlJsNkU2NWJKOHM3SVVGOFl1aWpVaVhnNmhO?= =?utf-8?B?TEtCd0JEdDV4dERrMEIxd21YYXJuUnhFczR6bmpCWWF2SkpnWkkrbGowM2Fp?= =?utf-8?B?eUZvSGd2VW85eFhUWVlOOGdIb1dERmgxTmtJZmdlNW94TmpUU2Nmbmh5VThP?= =?utf-8?B?T2hWVTE0czM0Y1hhTjRrU29XbmF2TmdlOHhONjNRUlFMbTJ0YWtOQXFZTFlq?= =?utf-8?B?cm5USmxKVDc5QlJLV2ZDVlJXbDJTU3pwSERQT2ZudFZNSXhHUHhXZjA2VnBx?= =?utf-8?B?YVQ2SWwyQlk1YTBtSVhSc20xQkJDbDNQRWN2SW9uTlJDVkxQM0p1ZUNFbnV1?= =?utf-8?B?WXRCTXpSWmR4VG1YK0xzck13ZUEzeC9XdDM2L2pIVkpZRVAvajVMQW9BZzc2?= =?utf-8?B?ajNhTHRueHpMdVczMDQ4bCthWjJuRjdqUEdyNkEzOVY2VmlNamtUamtmdm5T?= =?utf-8?B?YWxGSHluOGl0anJ2alFPaHcxclVqMEsybjdWUjRoTWNmYlY3WStZVFo4Q2li?= =?utf-8?B?QlptcEFReFRJYkJQejN5R2M1TXB5SllHamVSZi9PNW9JejFkTFp6UlUxOFF6?= =?utf-8?B?ZFhRSHh2czFacHV4S0JEaE10eHF1TXRNalBzTjIzSzlPY0EyQXlnV3VETWNx?= =?utf-8?B?K0cwSzRTbWxHZEtBSVN2VHdHWFpIdjdlUUxQeWYrRmNsRTc1cFFNc3ZiWHIz?= =?utf-8?B?cjJ2M2V6dVhCL1RnS3BlRGNlSlNvQUZiTHVMTi9RN3FqM0RzZnJjUzJpVHR1?= =?utf-8?B?b3k0bm8vd2lnWnd5SWxjUmdEMW9DNGpRTXNDMUh0eitON251Z0krOVV6Rnhs?= =?utf-8?B?a1hIWUdOMEw2bWpIbnp1bkZDMHJyU05KUzVLaGxuVHZ0M2RzK1hvTnpRUzBQ?= =?utf-8?B?ck8zUEp3SXU5YnJWUU5EVWZ4aG9hcW1sQXlSbjlqZGJBbzhlTVNFQlF5eVBh?= =?utf-8?B?dnp6Zlo5SEdNN1hyOHIxWmpHZDNhNTVaR1NxUnZHYlFmVGlLVVpQakZtUEcv?= =?utf-8?B?dGhsUnJXTC9Gb2hOM3NVdlR2cks4bURHa0xwQVV4RXhwVnpRQi9pSm92anpr?= =?utf-8?B?YmRHTkhiTlZtOENockwzWlZsRkVjT3NUNkI0M2pidWdnR1pXemtsZlgxbmlL?= =?utf-8?B?VTh5ZHJocGRUbU93cVZRb21xR0IzWmRvWEpxZEJVQU95RW1Na0xHbVptZnpN?= =?utf-8?B?ZkFFLzZFRCt1NHJ1eXV2UG13RE1JNWhJbFZxTWdKUmhCdmpMdzNzODVtaENv?= =?utf-8?B?alZ3aHlxRU1uQzVKNU56NTRYQlZtQmp1L3MrNC9QWGdySFhtQ3RVaDdtcSt4?= =?utf-8?B?dU5UODJLK2NNU1E2S2FLMzZ2bVVvY1JROHlzSGxrZ0s1c0owaGM1aDMyNDFk?= =?utf-8?B?VGd1bHZicW83RUM0ZCtGSStZbFN0cHZRak9aRjJIMmd4TytMY1FmZHlkVUlr?= =?utf-8?B?R2FxQU93M2Y5OUttcVdQaUIzWWxENTdrUVYrNGxiNWcyUTVEb0NtbUtBSEVo?= =?utf-8?B?bXR3THNFUXV3MXlHMncxZ3JTS2NvaWdaYUdVdmh5S1RFZFVNNHdwTnFDR3Jv?= =?utf-8?B?R1VxWDd3RWwwVmpLZWtJUzI1L0VmTTY0UCtkdy9XY0FhOWs4d1dZS2lMME1D?= =?utf-8?B?VHc0TCs5aWl0YlJ2R1o3YnZYNWRIbHJrMG9aWnhYQlBwcFdYOHhvVi9UdUc5?= =?utf-8?Q?Yquz3zKA92zR0iSKiw?= X-OriginatorOrg: amd.com X-MS-Exchange-CrossTenant-Network-Message-Id: c2aa4703-d79e-4e78-ccdd-08dee813041f X-MS-Exchange-CrossTenant-AuthSource: BL1PR12MB5320.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 22 Jul 2026 17:02:31.2318 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: utlinPHqB5vfelarsSDD5JFcvLJ7q45f1o3gWIUUUcJg4Psu5jT27ZiSJX4wpWHH X-MS-Exchange-Transport-CrossTenantHeadersStamped: CH1PPFC8B3B7859 Hi Ben, On 7/22/26 05:47, Ben Horgan wrote: > Hi Babu, > > On 7/21/26 21:02, Babu Moger wrote: >> Hi Ben/Reinette, >> >> On 7/21/26 12:30, Reinette Chatre wrote: >>> Hi Ben, >>> >>> On 7/21/26 6:23 AM, Ben Horgan wrote: >>>> On 7/20/26 23:54, Reinette Chatre wrote: >>>>> On 7/20/26 6:30 AM, Ben Horgan wrote: >>> ...> >>>> The former, info/ contains a directory for each allocation scope of each resource. >>>>> >>>>> The other x86 feature to consider is AMD's upcoming "Global" MBA/SMBA that exposes memory >>>>> bandwidth allocation >>>>> in "groups of L3" that I understand could usually be mapped to NODE scope (but it remains >>>>> controlled at L3 scope), >>>>> except for one configuration where it is "SYSTEM"(?) scope. >>>>> Ref.: https://lore.kernel.org/ >>>>> lkml/8f77f498b1c77fa8fd8f5d5687f03ae598068544.1776980182.git.babu.moger@amd.com/ >>>> >>>> Hmmm, I'm not sure that the scope can be considered to be NODE scope for GMBA. To me it seems to be >>>> accidental that it maps to the NUMA node but really the scope is just a grouping of L3 instances. >>>> For a control to NUMA scope I would expect the resctrl domains to go offline and online in sync with >>>> the NUMA nodes. For GMBA it looks like it would just going offline/online based on whether any of >>>> the CPUs and so L3 instances in the group are online. Am I correct here? >>>> >>>> Assuming the domains are on L3 groups rather than NUMA also changes which end of the link the >>>> traffic is regulated and so how cross-NUMA traffic behaves differently. If the domain is an L3 group >>>> then a task running on a CPU affine to that L3 group won't be throttled unless that particular >>>> domain is throttled but with NUMA node domains it may be throttled if it has traffic going to that >>>> domain. >>> >>> I'll defer to Babu for accurate answers about this hardware capability. >>> >> >> To me, Global MBA should be considered a NODE-scoped resource. In some configurations it may appear >> as SYSTEM-scoped, but that is effectively equivalent to a single-node encompassing the entire >> system. In such cases, there is only one schemata entry controlling the whole system. >> >> Yes, multiple L3 instances are grouped together to form a NODE. Internally, programming is still >> performed at the L3 level, but that implementation detail can be hidden from users and does not need >> to be exposed through the interface. > > We seem to have two things that can both, somewhat reasonably, be called NODE scope in the resctrl > user interface but the behaviour required for an MPAM system and an AMD system appears different > from the point of view of lifecycle of the resctrl domain. > > For MPAM NUMA scope the MSC instance (MPAM hardware interface) is at the memory controller and so > goes on and offline based on whether the NUMA node is offline or online. For AMD NUMA scope it looks > to me that the lifecycle of the resctrl domains would be tied to the CPUs associated with the NUMA > node. To me it does seem odd that a control with a domain associated with an offline NUMA node can > continue to throttle (cross-NUMA) traffic. > > Is there any GLBE Control Domain ID or similar that is exposed to the user, e.g. is sysfs, or is > this just implicitly the NUMA id? > Yes, the GLBE Control Domain ID is exposed to the user. It is essentially equivalent to the NUMA ID. Thanks Babu