From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mgamail.intel.com (mgamail.intel.com [198.175.65.15]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id C9B1B239085 for ; Wed, 1 Jul 2026 22:38:43 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=198.175.65.15 ARC-Seal:i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1782945525; cv=fail; b=gL/FtJ2L/n6X8lqljuTq46t5Uyqm6ldEODze53bsGOnfK6kCFVSM3cFVj+IX87f3EoUPJ72+8OwNmCxLYeuSeBCOC5q+TQ1kFwtNPdjh+RCq/qjPiSGOP6qyWhuEqUou9JEK84ptlPkEEQXZ2IBAZK/xGiYhj6La6PGdSrxztmg= ARC-Message-Signature:i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1782945525; c=relaxed/simple; bh=cRl3T5tkxbFQcLtdcX6/cgKv/MeNYqYtdAcDXlPIfCE=; h=Message-ID:Date:Subject:To:CC:References:From:In-Reply-To: Content-Type:MIME-Version; b=td6xLHT88DNPJiyDXTpTv8DFKU4cINVJZenFbi13fxI7p/dqmdxSxbpsusxnAsFZaMNjcOUqUg+BPUHpAn7774LmJNltYb6+xmJrZiNrlnum6SWsJ2xW5bDlZ2YIIWwOSBY+KKKRWCdHaTDg9msLQIuLaO1ZWNLVPO9s+eQt/F0= ARC-Authentication-Results:i=2; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=intel.com; spf=pass smtp.mailfrom=intel.com; dkim=pass (2048-bit key) header.d=intel.com header.i=@intel.com header.b=lWHEtKcz; arc=fail smtp.client-ip=198.175.65.15 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=intel.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=intel.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=intel.com header.i=@intel.com header.b="lWHEtKcz" DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1782945524; x=1814481524; h=message-id:date:subject:to:cc:references:from: in-reply-to:content-transfer-encoding:mime-version; bh=cRl3T5tkxbFQcLtdcX6/cgKv/MeNYqYtdAcDXlPIfCE=; b=lWHEtKczruQuwr5DQ21RsLqXPKRpH8oSJETNwgBAM9trBkXCr/WPWKPV bnNMfkXf8Z/zV9ZiiVV1iSO5jgvXBqSi0njTxy+X5a1fA5euNzptcncxR GOW00JlJIIwO5khTJ9pM5ry0ol0amO0Y+4qwb1naTVkbcrNjEytSpGJqn pCBI8gZlomj1OOXY1jr9mEVZCEUzvVM4MkqvqMk2NUYtFKgl6RaazhNtU 8qI0ULJ7nfEiX/rgWVTbGOmgdrS4v/1Edy09onAR9VPEgnir+nhvmqNW9 3znGAjhqdqdgXKVBoKFW2YLdPALTo2icCRFsEe4QstmhUJ31qnVFcx3Yr Q==; X-CSE-ConnectionGUID: S6wl5CuERiW6tylmd96psA== X-CSE-MsgGUID: foAGwnAURqiT8ice1h9MxA== X-IronPort-AV: E=McAfee;i="6800,10657,11834"; a="87370733" X-IronPort-AV: E=Sophos;i="6.25,142,1779174000"; d="scan'208";a="87370733" Received: from orviesa001.jf.intel.com ([10.64.159.141]) by orvoesa107.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 01 Jul 2026 15:38:42 -0700 X-CSE-ConnectionGUID: 76N7naHiT5is8HsiuJMLKw== X-CSE-MsgGUID: x4kzALH0Rciw4hR7NSFwVA== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="6.25,142,1779174000"; d="scan'208";a="290809166" Received: from orsmsx901.amr.corp.intel.com ([10.22.229.23]) by orviesa001.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 01 Jul 2026 15:38:43 -0700 Received: from ORSMSX901.amr.corp.intel.com (10.22.229.23) by ORSMSX901.amr.corp.intel.com (10.22.229.23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.43; Wed, 1 Jul 2026 15:38:41 -0700 Received: from ORSEDG903.ED.cps.intel.com (10.7.248.13) by ORSMSX901.amr.corp.intel.com (10.22.229.23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.43 via Frontend Transport; Wed, 1 Jul 2026 15:38:41 -0700 Received: from BL0PR03CU003.outbound.protection.outlook.com (52.101.53.31) by edgegateway.intel.com (134.134.137.113) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.43; Wed, 1 Jul 2026 15:38:41 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=TQm6t7wQPXy5ZOf45zdvxSSo1Unix1jjnDFlzCkJY+Bvsfr8dHu2awi0tc2QdcYtIsCJjKezRtTiCm4fwXM70yB9Ivg9ZMt1H/Rc5JProdjsohz9IoSyMzcNTJFAbFL/WoBCoWuAMRq6f62QCs+UavefSeNdd7ZiqEc6B/uTg64NtXVG9gPAVNWjey6BoDjz/C9SwMdasbJkJriBPVaWKHc0lur+lWOJpirzaJ6mwTF05eD6bOCDhKxqj6ETj0pTLSxfzoL4NXNu3i9bScvbHsFTYd5lteN+lTwmRZxwg6Or3u5qtiWRsq6USP9sSsyWlxHLy/p90TwXgePH5Lz+Rw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=dx9Eyv3mEzQX8HvF0MKQR63uFP3BPp/PcHHkKsf1W5k=; b=Q+v8IHt51C+Tu/tSMUJbUsFerAUVyZ6wkOAXmAGZ0CtE4SaR3kd0F/nd6z0rpkJV18hLdhmEHaBjb0EgjHx4sK/UhvlLUVq7lOJ+e7Nvz8JwNqcD/j+RkHegjjFP6EeXOG8JddQYaTVqaAgo52t5o2tg65myhYgkOPdx8RrIf86+m77OO6tO/nMKP+n+/Ol1uOVEHq59gmM/iQKZL/VstL4+EbiplgHAxAAHrhGy31zIo4bxDg2N8ccQZa8toEPtLJa6VOfP7TI2H3X5IozJurX2XiIHDyosouTixGrZgJM04ytUr/AcxSkB7VbviRyNohfoJZE5c/+XpuAOFjKtAw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=intel.com; Received: from SJ2PR11MB8370.namprd11.prod.outlook.com (2603:10b6:a03:540::20) by DS0PR11MB8135.namprd11.prod.outlook.com (2603:10b6:8:155::17) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.21.159.19; Wed, 1 Jul 2026 22:38:35 +0000 Received: from SJ2PR11MB8370.namprd11.prod.outlook.com ([fe80::b6cf:ce77:3cdf:7cc]) by SJ2PR11MB8370.namprd11.prod.outlook.com ([fe80::b6cf:ce77:3cdf:7cc%5]) with mapi id 15.21.0159.018; Wed, 1 Jul 2026 22:38:35 +0000 Message-ID: <4b0552cc-85cc-40b6-ab65-6b7620149f74@intel.com> Date: Wed, 1 Jul 2026 15:38:32 -0700 User-Agent: Mozilla Thunderbird Subject: Re: [PATCH v4 5/5] arm64: mpam: Add memory bandwidth usage (MBWU) documentation To: Ben Horgan CC: , , , , , , , , , , , , , , , , , , , , , , , , References: <20260520212458.1797221-1-ben.horgan@arm.com> <20260520212458.1797221-6-ben.horgan@arm.com> From: Reinette Chatre Content-Language: en-US In-Reply-To: <20260520212458.1797221-6-ben.horgan@arm.com> Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-ClientProxiedBy: MW4PR03CA0343.namprd03.prod.outlook.com (2603:10b6:303:dc::18) To SJ2PR11MB8370.namprd11.prod.outlook.com (2603:10b6:a03:540::20) Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: SJ2PR11MB8370:EE_|DS0PR11MB8135:EE_ X-MS-Office365-Filtering-Correlation-Id: 628e2f07-475e-493b-f5dd-08ded7c17cbf X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|366016|376014|7416014|1800799024|23010399003|4143699003|6133799003|56012099006|11063799006|18002099003|22082099003; X-Microsoft-Antispam-Message-Info: 56wu/xPA5k4UNECR/8N2F4Zl38C6bvYw9kgnh0THZmRWrmPr4B/5SI/KBMAioOG7njFH4YVY6aVpiSqfVvKJFVmFkh5rgGk4N1MUvyuW9TsuV4PQsvciQzqTE1I5AcwjRWWl51GPAL/qR4+luSPYjERcyFZehW+uvsWAbJ7F6agkHJ8mr5COTWmEo1kJfwPaIDGmD6ZzhVoqkXobhyUtQ6QUM5dxUYszS/9yDH+B5KNAjI07jKVIw7fbvZiuB6PgGslPLR4SSmoVfmrX/BU9RxwDs67UhqkLt8dhHq5k6wwpFmMKYKpgbdQj6pqtxaoMzVeRLKtzj+VP2iV9i/FXmdv95gDRPzgzBO+pJfV8+4xTHoQrV21NfSr6EDQrBmbitc1IK6hhzQhbbOAjcsd4SWAbfH+X92A8bzZZxoygiSjsqKLdiYDoK1f48BzDWM9sXFOM82VOap+ENDxEJL1eDwNY8PzcTc3zHJhp2j/0YJhHVIgn4Fef+WEbyhxDjg+017r2mWYTGovyiO1xlovTxfO66N/+/Df34/EUA3ttezay/l7w7XWeCp9pi7D+ImcgB25e0LUSvQUhoD7stxpx51Ofn6YPiCL5JfZ4H5RBICTXY/P34yx/Jyi6vOwBgmBVROtAlZD7jYaM1Y82W53drKId8EaSKIn/sAHIHC8KNRw= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:SJ2PR11MB8370.namprd11.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(366016)(376014)(7416014)(1800799024)(23010399003)(4143699003)(6133799003)(56012099006)(11063799006)(18002099003)(22082099003);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?VWJuS3JWenVJRThKei9GemNxV0hWNHZEelUrTHhmRGdrYkhkc0s5aDFhLzVU?= =?utf-8?B?bzczVnhGNkM3Ti83VjlCaHVPSXZucUU5Q1BMNmd1MVdiYUFJL1dPOVVva2tR?= =?utf-8?B?aDlzWXkwRUU4WnAxWXZWSFZhcTJ4eVFSWEJaYk1EbUpXN085OVQ5VkZjK0Fx?= =?utf-8?B?cUsyWlo3RjNwWFZOajF0OVhMaldjc1NZNFlwYSt5L1UxYlRhZGZHTDc4dms2?= =?utf-8?B?bTRMQTZCT2NPS2VVclErcDVUNFRvRkVySG1DWU5kOTRNUHNoK3RiWVc5UmJN?= =?utf-8?B?Q0tPeUV0S1dsUGtRU0ptQXdUQXdESGcydFYvdkZwNGU5WVdLUk1WeHlFN1RN?= =?utf-8?B?azZvY2hrd1NML1RNalVYbzc0SER6OVIwQ2lRQnVDVGVyOVp1VDYrNnZnb1U4?= =?utf-8?B?eUxrNC92SmhSaWIyRlZwUDFxalNwUURsZ2VBQ2hoSS9DUUd0UHFWV25VaHAz?= =?utf-8?B?R3crcVhjWHZRTFdqR3phN2xkMlJrcXpxN0NqQmd2NVBucG8wYVZoZlk4SWQ3?= =?utf-8?B?VHFtQk41ZE0wSWZ1dkU0VmZvNEozR05SZy8yVlBoZFJiYTRPVDhydTdCNlY5?= =?utf-8?B?NlFFM0tXTC94TEFycU42dUtnN1NIRzFmZWU4RDRGSm8xOXBLMDB4TmNDeDlU?= =?utf-8?B?Q3RaZnd0eitmcnplaC9TSjVLQW0veWQrRUd5ZDBkYTV6clB2L3U1Uzc0MmxB?= =?utf-8?B?TmVvMEhzNHVOK3NxM2pJbEYrNGV0VXA0WXVOVFdRK2NNMXRtTFpkYndWckZ1?= =?utf-8?B?amVWQ3lESjlXVnlMdkxYREROQkFMSENwODBCcFNMQmRzV0hTVytMNVV2eDlN?= =?utf-8?B?dGpiTkdMUWhNb3FVUXQ0REhYeVpwZUlKZmowN2ZEMDZYdCtTVjZrd1diWTZn?= =?utf-8?B?QmFhb094enlYcUlkaWwzNDRRQW1TcDRjOHlaYTM2OHM4dlJvTS9Ja1FZc2hP?= =?utf-8?B?aDhZSmhSQWplSkZHY0t1UWx0QmRMc2hTKytZOTRqSG8ySXY2aW1BUlI2aU45?= =?utf-8?B?YkxoaEQ4dXV0VmxPV1JNcUdVNnJQNiswZFVxWTBaWEViU3BHRCtVOURGejlG?= =?utf-8?B?L0RGMHFTTDF0Rm5JQ1ZoTU5zV1J3NlFCRzJMR3F0c00xMUNMT3ZNc0IzdmND?= =?utf-8?B?RmN4eWhMWDl3Rmg4T0g2KzV4SUFnc3NnSjBnNURDRzRyQkxJTkdlY2xKRFFj?= =?utf-8?B?T1dRZ1ZTOFdOVTVXL2hvdTJkZS9DK2ZwSnBEUTNpZi9DMmZjUTVETWxWOTZp?= =?utf-8?B?OGE1bis4ZThUUWUrZkltZy9kbzROd2ZPK1VtY0VUa01SQmtGVnFWRHBiU3g5?= =?utf-8?B?SUhPOGttSDZxejJINXRHQVY5RTdCUGVHbjM2Um8ySFIrRUoydFYrSE5lbVE4?= =?utf-8?B?MWpvMVFsRWtSRDhmOW5USGM3bWRkWGQ2MWNROFhDaUNRWk9JUTgvWnFVVkZi?= =?utf-8?B?cFFQR0pOV2gwUmdzVWRWTVNqakVTeGczWiszQUFLaG1hSXo5TEdsWmh6KzZ0?= =?utf-8?B?QmJJTm0yMHorOEFPL0sybzAxQ3BCVEdLZ0gwWTRaOHc1ZVlJKzl3Qk5GbzJl?= =?utf-8?B?eXliNHkvR0wvcW1vVzNZNjlDQjhmaVRnRmJBL1VDcy84c3BjKzRIRmRmZGk5?= =?utf-8?B?OGVUbkh3NDF1MmZlZllPbU84akpQc3IxYnJ1RmlTQWRhWThXUitqb0k4WWdF?= =?utf-8?B?REYweWVWL2lQZTlWZndQQUNnQXRRVkw2MDdxSTYxVjdkVXlIcllnbnp3MCtE?= =?utf-8?B?UmtiamlaVkE4eHg4dnpUMm91c2ZKSnJjQ1I0UHE4NXE2cnd1cEo3SnFYTzdw?= =?utf-8?B?RTkvVEpoWGVIOGtQeTFMdm40TythdFFhNE94b09VOVpZbk5JQTNpUkNuY2Jh?= =?utf-8?B?OWc0MTNZalc3azBBaEJvRlhwa1pjN2JtSFNVRW5VUlV5OWRjT3ZhT25qckFs?= =?utf-8?B?Vmc4ZC94MVJUMWhjZG1pZWxXbUwzaGpqbFN5SmZlaUFobVdSK01WRnFLODcw?= =?utf-8?B?RytDQjU0ZkVMRnQwQjVCNHdDQWR1RWJ4cUEzdjFTUzFXMFV6K0E2d08vR21D?= =?utf-8?B?YytQb0hZaVZuaEQ5c2tQU2lhdEJQRFNLYi9IazFQa1dqamdRS0lhcjVXVnRH?= =?utf-8?B?WnM2ZmkzV2FiMk5qWUUwQ1VqOWVNTVRKT0hXNHFOTHM5RjkycDRpeXpRcXhJ?= =?utf-8?B?L0pkZFFOS1c3WXFJTFRxbk5GU0FCd3lnQVRWb2lyVi9HRlF3ZEl4L1ZzVUJF?= =?utf-8?B?bnJMQ21aNnFTSWFTOUFDY09uSktXdGs3WktpNm5KeVFhT0tOK25YMk0wL2hS?= =?utf-8?B?T2xSdjhQS3RrclRPVitNOFVCck1JdVhtL0lzR1FSa3I1U0UvYmZJMnp3ZGVZ?= =?utf-8?Q?/KfSa0ovbBKH9iPE=3D?= X-Exchange-RoutingPolicyChecked: M3NscZ42vfbEO+80QO/g9XABiNYotTXsaEf5LvB3u9pbQ+FZQNGraW2PdHH1Jj2fSyz4LRfChmdaM3vlxaVReXi6PuRZ7bxM/uDQsJatmeoex90zuxlUbtMhp6atXzAnjSGfYQNlb4DviQVp/aBUG+Zm69LxgWqeb568cu1R1+vHny46S3eOX5W8OGiHsVWdAnpyiHFbLrHGui7P9qetNVyUTGFcXoE4io1gaxiYJoWoAnNY5m0zjzR1tT6nPI7/rPlOkwzyMfI55xZ3EkGfL7CsC2PX/YfhAHOWZ/db7Agylzy3xMp+29sZK+gJbdlWoFYlG1E2EnQ3pyo7j30KqA== X-MS-Exchange-CrossTenant-Network-Message-Id: 628e2f07-475e-493b-f5dd-08ded7c17cbf X-MS-Exchange-CrossTenant-AuthSource: SJ2PR11MB8370.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 01 Jul 2026 22:38:35.6468 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: Ep9txykCx789/RE3trt1iwu3LQWfMj5RBaGRjapagkhiMoHvkMti7Cs3n74teAT/bbncW62T0rZh/GpcgBm6qn3dP3HoaGBTEvQQuclbCQ8= X-MS-Exchange-Transport-CrossTenantHeadersStamped: DS0PR11MB8135 X-OriginatorOrg: intel.com Hi Ben, On 5/20/26 2:24 PM, Ben Horgan wrote: > Memory bandwidth monitoring make uses of MBWU monitors and is now exposed > to the user via resctrl. Add some documentation so the user knows what to > expect. > > Co-developed-by: James Morse > Signed-off-by: James Morse > Signed-off-by: Ben Horgan > --- > Documentation/arch/arm64/mpam.rst | 17 +++++++++++++++++ > 1 file changed, 17 insertions(+) > > diff --git a/Documentation/arch/arm64/mpam.rst b/Documentation/arch/arm64/mpam.rst > index 570f51a8d4eb..208ff17068c4 100644 > --- a/Documentation/arch/arm64/mpam.rst > +++ b/Documentation/arch/arm64/mpam.rst > @@ -65,6 +65,23 @@ The supported features are: > there is at least one CSU monitor on each MSC that makes up the L3 group. > Exposing CSU counters from other caches or devices is not supported. > > +* Memory Bandwidth Usage (MBWU) on or after the L3 cache. resctrl uses the > + L3 cache-id to identify where the memory bandwidth is measured. For this > + reason the platform must have an L3 cache with cache-id's supplied by > + firmware. (It doesn't need to support MPAM.) > + > + Memory bandwidth monitoring makes use of MBWU monitors in each MSC that > + makes up the L3 group. If the memory bandwidth monitoring is on the memory > + rather than the L3 then there must be a single global L3 as otherwise it > + is unknown which L3 the traffic came from. > + > + To expose 'mbm_total_bytes', the topology of the group of MSC chosen must > + match the topology of the L3 cache so that the cache-id's can be > + repainted. For example: Platforms with Memory bandwidth monitors on > + CPU-less NUMA nodes cannot expose 'mbm_total_bytes' as these nodes do not > + have a corresponding L3 cache. 'mbm_local_bytes' is not exposed as MPAM > + cannot distinguish local traffic from global traffic. Hopefully we can get to a point where memory bandwidth monitoring data from CPU-less NUMA nodes can be exposed via resctrl. When considering such possible future I think it may make this work easier to build on if the documentation focuses on what the current implementation supports and leave room for future enhancements by not constraining user space expectation with an absolute like "CPU-less NUMA nodes cannot expose 'mbm_total_bytes'". Reinette