mirror of https://lore.kernel.org/lkml/
 help / color / mirror / Atom feed
From: Babu Moger <babu.moger@amd.com>
To: "Moger, Babu" <bmoger@amd.com>,
	Reinette Chatre <reinette.chatre@intel.com>,
	tony.luck@intel.com, bp@alien8.de
Cc: x86@kernel.org, Dave.Martin@arm.com, james.morse@arm.com,
	corbet@lwn.net, skhan@linuxfoundation.org, tglx@kernel.org,
	mingo@redhat.com, dave.hansen@linux.intel.com, hpa@zytor.com,
	linux-kernel@vger.kernel.org, linux-doc@vger.kernel.org,
	eranian@google.com, peternewman@google.com
Subject: Re: [PATCH v2 3/3] x86/resctrl: Keep mbm_assign_mode in default mode at boot
Date: Tue, 15 Sep 2026 14:59:32 -0500	[thread overview]
Message-ID: <2b2c5fed-0a4e-4549-977a-4eb9b6f27b70@amd.com> (raw)
In-Reply-To: <02254e94-35de-406e-a40f-f2a566d1c4ec@amd.com>

Hi Reinette,

On 9/14/26 20:11, Moger, Babu wrote:
> Hi Reinette,
> 
> On 9/14/2026 4:31 PM, Reinette Chatre wrote:
>> Hi Babu,
>>
>> On 9/14/26 1:45 PM, Babu Moger wrote:
>>> On 9/11/26 17:25, Reinette Chatre wrote:
>>>> On 9/4/26 11:06 AM, Babu Moger wrote:
>>
>> ...>>> systems with limited MBM counters and breaks existing userspace 
>> that
>>>>> assumes the historical default mode, including the pqos tool from
>>>>> intel-cmt-cat [1].
>>>>
>>>> There is no record of this breaking pqos. *you* created [1] *after* you
>>>> submitted v1. What a strategy! I mentioned a couple of times that 
>>>> this is
>>>
>>> Agreed.
>>>
>>>> misleading. Since you insist on proclaiming "we cannot break pqos!" as
>>>> motivation for this change you have to also disclose the consequence of
>>>> this change on pqos followed by motivation why that is acceptable. 
>>>> Specifically:
>>>>
>>>>      https://lore.kernel.org/lkml/77f77d02-fae7-401d-9bb5- 
>>>> c62b244d23cd@intel.com/
>>>
>>> I can provide output that demonstrates the issue, where the event 
>>> counters report zeros. However, we won't observe the large counter 
>>> values because the hardware resets the counters after reallocation.
>>>
>>> Will that be ok?
>>
>> No. This is not about hardware resetting the counters. This is about 
>> pqos not handling
>> text return values, for example "Unavailable" and "Unassigned". This 
>> patch only
>> focuses on pqos treating "Unassigned" as 0, but in "default" mode 
>> "Unavailable" will
>> be encountered and pqos treating it as 0 is more severe.
>>
>> Consider a scenario where a counter is re-assigned. When user space 
>> reads the event
>> value then it may see:
>>
>> <return A>, <return "Unavailable">, <return B (larger than A)>, 
>> <return "Unavailable">, ...
>>
>> "B" is computed by adding the new hardware counter value to A. As you 
>> indicate, hardware
>> did reset the counter after re-allocation but that only means that "B" 
>> is no longer
>> accurate. "B" is still returned and it is still larger than "A".
>>
>> Based on above, pqos sees:
>> A, 0, B, 0, ...
>>
>> These jumps between bandwidth counts and zero is what pqos perceives 
>> as wraparound that is
>> presented in the example:
>>
>>     https://lore.kernel.org/lkml/77f77d02-fae7-401d-9bb5- 
>> c62b244d23cd@intel.com/
> 
> Got it. I can add the output of the issue. Something like this.
> 
> TIME 2026-09-15 00:53:46
> CORE     IPC      MISSES     LLC[KB]   MBL[MB/s]   MBR[MB/s]
> 0        0.76         60k        32.0         0.0         0.0
> 1        0.45          1k        32.0         0.0         0.0
> 2        1.57        107k        64.0         0.0 17592186044184.9
> 3        1.62        276k      4928.0         3.2         0.5
> 4        0.53          1k       160.0         0.0         0.0
> 5        0.63         39k      1664.0         0.2         0.0
> 6        0.44          6k       128.0         0.0         0.0
> 7        0.50          1k       320.0         0.0         0.0
> 
> 
>>
>>>>> For example, pqos mounts resctrl and creates 16 or more monitoring 
>>>>> groups,
>>>>> using two counters per group (mbm_local_bytes and mbm_total_bytes). On
>>>>> platforms that provide 32 MBM counters per domain, this consumes 
>>>>> the entire
>>>>> counter pool. Additional groups cannot be assigned counters and pqos
>>>>> reports zero bandwidth for them.
>>>>>
>>>>> Leave mbm_assign_mode in "default" mode during initialization. 
>>>>> Default mode
>>>>> can support more monitoring groups (up to 64) than mbm_event mode, 
>>>>> which is
>>>>
>>>> "up to 64" - so it may be fewer than 64? What is guidance to users 
>>>> about
>>>> how many monitoring groups in "default" mode are "safe"?
>>>
>>> It is 64. It be more on newer h/w (don't know exact count).
>>
>> Should it then read "64 or more" instead of "up to 64"?
> 
> Sure.
> 
>>
>> ...
>>
>>>>
>>>> Although, the earlier text is "up to 64" so above attempt at 
>>>> guidance may not
>>>> be correct and there is no knowing how many monitoring groups are 
>>>> guaranteed
>>>> to receive accurate counts?
>>>
>>> That is correct. We can get this count by assigning counters
>>> iteratively until an "unavailable" response is returned. However,
>>> the specification does not mention this behavior.
>>
>> This is about determining the "magic" number of RMIDs, not about 
>> counter assignment.
>> User space does not do any counter assignment here. In this case user 
>> space can create
>> monitoring groups up to the maximum number of RMIDs supported.
> 
> Little bit confused here. How about we revisit this text again in v3?
> 
>>
>> ...
>>
>>>
>>>>
>>>>> +    remain accurate. Creating more groups than that pool (for 
>>>>> example 64 or
>>>>
>>>> "64" -> "65"?
>>>
>>> Sure.
>>
>> This would only be useful if all hardware support the same number of 
>> magic RMID though.
> 
> It

Sorry. Response cut short.

How about we revisit in v3?

Thanks
Babu


      reply	other threads:[~2026-09-15 19:59 UTC|newest]

Thread overview: 17+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-09-04 18:06 [PATCH v2 0/3] x86/resctrl: Keep default MBM mode at boot and fix ABMC Babu Moger
2026-09-04 18:06 ` [PATCH v2 1/3] x86/resctrl: Fix ABMC counter programming for extended counter ranges Babu Moger
2026-09-11 22:03   ` Reinette Chatre
2026-09-14 17:17     ` Babu Moger
2026-09-14 21:30       ` Reinette Chatre
2026-09-14 21:50         ` Reinette Chatre
2026-09-15  0:18           ` Moger, Babu
2026-09-15  0:20         ` Moger, Babu
2026-09-04 18:06 ` [PATCH v2 2/3] fs/resctrl: Assign counters to existing groups when enabling mbm_event Babu Moger
2026-09-11 22:12   ` Reinette Chatre
2026-09-14 18:54     ` Babu Moger
2026-09-04 18:06 ` [PATCH v2 3/3] x86/resctrl: Keep mbm_assign_mode in default mode at boot Babu Moger
2026-09-11 22:25   ` Reinette Chatre
2026-09-14 20:45     ` Babu Moger
2026-09-14 21:31       ` Reinette Chatre
2026-09-15  1:11         ` Moger, Babu
2026-09-15 19:59           ` Babu Moger [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=2b2c5fed-0a4e-4549-977a-4eb9b6f27b70@amd.com \
    --to=babu.moger@amd.com \
    --cc=Dave.Martin@arm.com \
    --cc=bmoger@amd.com \
    --cc=bp@alien8.de \
    --cc=corbet@lwn.net \
    --cc=dave.hansen@linux.intel.com \
    --cc=eranian@google.com \
    --cc=hpa@zytor.com \
    --cc=james.morse@arm.com \
    --cc=linux-doc@vger.kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=mingo@redhat.com \
    --cc=peternewman@google.com \
    --cc=reinette.chatre@intel.com \
    --cc=skhan@linuxfoundation.org \
    --cc=tglx@kernel.org \
    --cc=tony.luck@intel.com \
    --cc=x86@kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox

all inboxes | Powered by JetHome®