From: Ben Horgan <ben.horgan@arm.com>
To: Jinjie Ruan <ruanjinjie@huawei.com>,
tony.luck@intel.com, reinette.chatre@intel.com,
Dave.Martin@arm.com, james.morse@arm.com, babu.moger@amd.com,
tglx@kernel.org, mingo@redhat.com, bp@alien8.de,
dave.hansen@linux.intel.com, hpa@zytor.com, fenghuay@nvidia.com,
tan.shaopeng@fujitsu.com, zengheng4@huawei.com, jic23@kernel.org,
gshan@redhat.com, catalin.marinas@arm.com, x86@kernel.org,
linux-kernel@vger.kernel.org
Subject: Re: [PATCH v10 RESEND 05/15] arm_mpam: Don't stall MPAM enable when an MSC fails to probe
Date: Fri, 30 Oct 2026 15:29:54 +0000 [thread overview]
Message-ID: <9c14a9c8-0ab6-4160-95e9-4242cfaa2a4b@arm.com> (raw)
In-Reply-To: <feb50fb6-b165-4fd2-95d9-c67cf3412ff8@huawei.com>
Hi Jinjie,
On 27/10/2026 01:47, Jinjie Ruan wrote:
>
>
> 在 2026/10/26 22:49, Ben Horgan 写道:
>> Hi Jinjie,
>>
>>
>>
>> On 20/10/2026 14:42, Jinjie Ruan wrote:
>>> mpam_msc_drv_probe() registers the discovery cpuhp callbacks only when
>>> the number of successfully probed MSCs reaches fw_num_msc. Every failure
>>> path returns before the counter is incremented, and a failed probe is
>>> final - the driver core does not retry. One failing MSC therefore leaves
>>> the counter below fw_num_msc forever: the discovery callbacks are never
>>> registered, mpam_enable() is never scheduled, and MPAM stays dead
>>> system-wide - the resctrl filesystem is never registered, and no error
>>> message hints at the cause.
>>>
>>> An MSC can legitimately fail to probe on an otherwise working system:
>>> firmware may describe MSCs that are not accessible from any possible
>>> CPU, e.g. when the possible CPUs are restricted with nr_cpus=. The MSCs
>>> of the clipped CPUs then fail with "MSC is not accessible from any
>>> CPU!", or their cache resources become unresolvable from PPTT.
>>
>> As the MPAM resources are system wide we need to query the support from each of the MSC to know what
>> resources will end up. I do appreciate that if you have full control of your system then you can
>> know this in advance but then you can also adjust your acpi tables to mark the non-accessible MSC as
>> disabled. As such, I don't think changes such as this should be in the driver. Here is a previous
>> explanation for a similar patch [1]
>
> Hi Ben,
>
> Does this mean that "nr_cpus=" and the MPAM enabling are mutually exclusive?
>
> I was previously doing experiments related to MB nodes and ran into a
> failure of topology_matches_l3(). I therefore tried to reduce the number
> of system CPUs from two clusters to one cluster using "nr_cpus=", but as
> a result I ran into this problem, which prevented MPAM from being
> enabled properly.
Yes, unfortunately this is expected behaviour.
Thanks,
Ben
>
>>
>> Thanks,
>>
>> Ben
>>
>> [1] https://lore.kernel.org/lkml/59c21340-4e3d-4c48-9d9f-c0f78a023bac@arm.com/
>>
>>>
>>> Count every completed probe, successful or not. Failed MSCs are not on
>>> mpam_all_msc (either never added, or removed by mpam_msc_drv_remove()),
>>> so the discovery path skips them naturally, and MPAM is enabled for the
>>> surviving devices.
>>>
>>> Cc: stable@vger.kernel.org
>>> Cc: Ben Horgan <ben.horgan@arm.com>
>>> Cc: Reinette Chatre <reinette.chatre@intel.com>
>>> Cc: Fenghua Yu <fenghuay@nvidia.com>
>>> Cc: Shaopeng Tan <tan.shaopeng@jp.fujitsu.com>
>>> Cc: Catalin Marinas <catalin.marinas@arm.com>
>>> Fixes: f04046f2577a5 ("arm_mpam: Add probe/remove for mpam msc driver and kbuild boiler plate")
>>> Signed-off-by: Jinjie Ruan <ruanjinjie@huawei.com>
>>> ---
>>> drivers/resctrl/mpam_devices.c | 26 ++++++++++++++++++--------
>>> 1 file changed, 18 insertions(+), 8 deletions(-)
>>>
>>> diff --git a/drivers/resctrl/mpam_devices.c b/drivers/resctrl/mpam_devices.c
>>> index 61cbc75625fa..a44d66a5733d 100644
>>> --- a/drivers/resctrl/mpam_devices.c
>>> +++ b/drivers/resctrl/mpam_devices.c
>>> @@ -2120,21 +2120,31 @@ static int mpam_msc_drv_probe(struct platform_device *pdev)
>>> msc = do_mpam_msc_drv_probe(pdev);
>>> mutex_unlock(&mpam_list_lock);
>>>
>>> - if (IS_ERR(msc))
>>> - return PTR_ERR(msc);
>>> + if (IS_ERR(msc)) {
>>> + err = PTR_ERR(msc);
>>> + goto out;
>>> + }
>>>
>>> /* Create RIS entries described by firmware */
>>> err = acpi_mpam_parse_resources(msc, plat_data);
>>> - if (err) {
>>> + if (err)
>>> mpam_msc_drv_remove(pdev);
>>> - return err;
>>> - }
>>> -
>>> - if (atomic_add_return(1, &mpam_num_msc) == fw_num_msc)
>>> +out:
>>> + /*
>>> + * A failed MSC must not prevent MPAM being enabled for the
>>> + * surviving devices. Firmware may describe MSCs that are not
>>> + * accessible from any possible CPU, e.g. when the possible CPUs
>>> + * were restricted by nr_cpus=. The failed device is not
>>> + * re-probed, so count it here too: otherwise the counter never
>>> + * reaches fw_num_msc, the discovery cpuhp callbacks are never
>>> + * registered and mpam_enable() is never scheduled - MPAM stays
>>> + * dead system-wide, without any error message.
>>> + */
>>> + if (atomic_inc_return(&mpam_num_msc) == fw_num_msc)
>>> mpam_register_cpuhp_callbacks(mpam_discovery_cpu_online, NULL,
>>> "mpam:drv_probe");
>>>
>>> - return 0;
>>> + return err;
>>> }
>>>
>>> static struct platform_driver mpam_msc_driver = {
>>
>
next prev parent reply other threads:[~2026-10-30 15:29 UTC|newest]
Thread overview: 30+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-10-20 13:42 [PATCH v10 RESEND 00/15] arm_mpam: Introduce Narrow-PARTID feature Jinjie Ruan
2026-10-20 13:42 ` [PATCH v10 RESEND 01/15] fs/resctrl: Return -EBUSY when per-CLOSID RMIDs are in limbo Jinjie Ruan
2026-10-26 14:05 ` Ben Horgan
2026-10-28 21:28 ` Reinette Chatre
2026-10-29 3:51 ` Jinjie Ruan
2026-10-20 13:42 ` [PATCH v10 RESEND 02/15] fs/resctrl: Skip monitor context allocation when force-freeing RMIDs Jinjie Ruan
2026-10-26 14:08 ` Ben Horgan
2026-10-26 14:11 ` Ben Horgan
2026-10-27 1:33 ` Jinjie Ruan
2026-10-28 21:29 ` Reinette Chatre
2026-10-29 4:05 ` Jinjie Ruan
2026-10-20 13:42 ` [PATCH v10 RESEND 03/15] arm_mpam: Fix error return in resctrl_arch_mon_ctx_alloc() Jinjie Ruan
2026-10-26 14:40 ` Ben Horgan
2026-10-27 1:25 ` Jinjie Ruan
2026-10-20 13:42 ` [PATCH v10 RESEND 04/15] arm_mpam: Fix infinite PARTID reset loop when 65536 PARTIDs are supported Jinjie Ruan
2026-10-20 13:42 ` [PATCH v10 RESEND 05/15] arm_mpam: Don't stall MPAM enable when an MSC fails to probe Jinjie Ruan
2026-10-26 14:49 ` Ben Horgan
2026-10-27 1:47 ` Jinjie Ruan
2026-10-30 15:29 ` Ben Horgan [this message]
2026-10-20 13:42 ` [PATCH v10 RESEND 06/15] fs/resctrl: Unmount resctrl with the CDP state it was mounted with Jinjie Ruan
2026-10-26 15:08 ` Ben Horgan
2026-10-20 13:42 ` [PATCH v10 RESEND 07/15] fs/resctrl: Add resctrl_arch_rmid_idx_match() helper Jinjie Ruan
2026-10-20 13:42 ` [PATCH v10 RESEND 08/15] arm_mpam: resctrl: Add resctrl_closid_rmid_to_partid_pmg() helper Jinjie Ruan
2026-10-20 13:42 ` [PATCH v10 RESEND 09/15] arm_mpam: Add a helper to check a PARTID is in a CLOSID Jinjie Ruan
2026-10-20 13:42 ` [PATCH v10 RESEND 10/15] arm_mpam: Track the PARTID and internal PARTID limits per class Jinjie Ruan
2026-10-20 13:42 ` [PATCH v10 RESEND 11/15] arm_mpam: Divide the PARTIDs between the control groups Jinjie Ruan
2026-10-20 13:42 ` [PATCH v10 RESEND 12/15] arm_mpam: Map resctrl RMIDs onto the request PARTIDs Jinjie Ruan
2026-10-20 13:42 ` [PATCH v10 RESEND 13/15] arm_mpam: Identify the non-aliasing controls Jinjie Ruan
2026-10-20 13:42 ` [PATCH v10 RESEND 14/15] arm_mpam: Use the request PARTIDs beyond the internal range Jinjie Ruan
2026-10-20 13:42 ` [PATCH v10 RESEND 15/15] arm_mpam: resctrl: Add kunit tests for narrow PARTID helpers Jinjie Ruan
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=9c14a9c8-0ab6-4160-95e9-4242cfaa2a4b@arm.com \
--to=ben.horgan@arm.com \
--cc=Dave.Martin@arm.com \
--cc=babu.moger@amd.com \
--cc=bp@alien8.de \
--cc=catalin.marinas@arm.com \
--cc=dave.hansen@linux.intel.com \
--cc=fenghuay@nvidia.com \
--cc=gshan@redhat.com \
--cc=hpa@zytor.com \
--cc=james.morse@arm.com \
--cc=jic23@kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=mingo@redhat.com \
--cc=reinette.chatre@intel.com \
--cc=ruanjinjie@huawei.com \
--cc=tan.shaopeng@fujitsu.com \
--cc=tglx@kernel.org \
--cc=tony.luck@intel.com \
--cc=x86@kernel.org \
--cc=zengheng4@huawei.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®