mirror of https://lore.kernel.org/lkml/
 help / color / mirror / Atom feed
From: Jinjie Ruan <ruanjinjie@huawei.com>
To: Ben Horgan <ben.horgan@arm.com>, <tony.luck@intel.com>,
	<reinette.chatre@intel.com>, <Dave.Martin@arm.com>,
	<james.morse@arm.com>, <babu.moger@amd.com>, <tglx@kernel.org>,
	<mingo@redhat.com>, <bp@alien8.de>, <dave.hansen@linux.intel.com>,
	<hpa@zytor.com>, <fenghuay@nvidia.com>,
	<tan.shaopeng@fujitsu.com>, <zengheng4@huawei.com>,
	<jic23@kernel.org>, <gshan@redhat.com>, <catalin.marinas@arm.com>,
	<x86@kernel.org>, <linux-kernel@vger.kernel.org>
Subject: Re: [PATCH v10 RESEND 05/15] arm_mpam: Don't stall MPAM enable when an MSC fails to probe
Date: Sat, 31 Oct 2026 09:23:33 +0800	[thread overview]
Message-ID: <96a7b9ca-a5da-449e-b4d7-c34299692012@huawei.com> (raw)
In-Reply-To: <9c14a9c8-0ab6-4160-95e9-4242cfaa2a4b@arm.com>



在 2026/10/30 23:29, Ben Horgan 写道:
> Hi Jinjie,
> 
> On 27/10/2026 01:47, Jinjie Ruan wrote:
>>
>>
>> 在 2026/10/26 22:49, Ben Horgan 写道:
>>> Hi Jinjie,
>>>
>>>
>>>
>>> On 20/10/2026 14:42, Jinjie Ruan wrote:
>>>> mpam_msc_drv_probe() registers the discovery cpuhp callbacks only when
>>>> the number of successfully probed MSCs reaches fw_num_msc. Every failure
>>>> path returns before the counter is incremented, and a failed probe is
>>>> final - the driver core does not retry. One failing MSC therefore leaves
>>>> the counter below fw_num_msc forever: the discovery callbacks are never
>>>> registered, mpam_enable() is never scheduled, and MPAM stays dead
>>>> system-wide - the resctrl filesystem is never registered, and no error
>>>> message hints at the cause.
>>>>
>>>> An MSC can legitimately fail to probe on an otherwise working system:
>>>> firmware may describe MSCs that are not accessible from any possible
>>>> CPU, e.g. when the possible CPUs are restricted with nr_cpus=. The MSCs
>>>> of the clipped CPUs then fail with "MSC is not accessible from any
>>>> CPU!", or their cache resources become unresolvable from PPTT.
>>>
>>> As the MPAM resources are system wide we need to query the support from each of the MSC to know what
>>> resources will end up. I do appreciate that if you have full control of your system then you can
>>> know this in advance but then you can also adjust your acpi tables to mark the non-accessible MSC as
>>> disabled. As such, I don't think changes such as this should be in the driver. Here is a previous
>>> explanation for a similar patch [1]
>>
>> Hi Ben,
>>
>> Does this mean that "nr_cpus=" and the MPAM enabling are mutually exclusive?
>>
>> I was previously doing experiments related to MB nodes and ran into a
>> failure of topology_matches_l3(). I therefore tried to reduce the number
>> of system CPUs from two clusters to one cluster using "nr_cpus=", but as
>> a result I ran into this problem, which prevented MPAM from being
>> enabled properly.
> 
> Yes, unfortunately this is expected behaviour.

Hi Ben,

Thanks for the explanation.

Perhaps we could add a comment in mpam_msc_drv_probe(), or clarify this
somewhere in the documentation—otherwise it can be quite confusing.

Thanks,
Jinjie

> 
> Thanks,
> 
> Ben
> 
>>
>>>
>>> Thanks,
>>>
>>> Ben
>>>
>>> [1] https://lore.kernel.org/lkml/59c21340-4e3d-4c48-9d9f-c0f78a023bac@arm.com/
>>>
>>>>
>>>> Count every completed probe, successful or not. Failed MSCs are not on
>>>> mpam_all_msc (either never added, or removed by mpam_msc_drv_remove()),
>>>> so the discovery path skips them naturally, and MPAM is enabled for the
>>>> surviving devices.
>>>>
>>>> Cc: stable@vger.kernel.org
>>>> Cc: Ben Horgan <ben.horgan@arm.com>
>>>> Cc: Reinette Chatre <reinette.chatre@intel.com>
>>>> Cc: Fenghua Yu <fenghuay@nvidia.com>
>>>> Cc: Shaopeng Tan <tan.shaopeng@jp.fujitsu.com>
>>>> Cc: Catalin Marinas <catalin.marinas@arm.com>
>>>> Fixes: f04046f2577a5 ("arm_mpam: Add probe/remove for mpam msc driver and kbuild boiler plate")
>>>> Signed-off-by: Jinjie Ruan <ruanjinjie@huawei.com>
>>>> ---
>>>>  drivers/resctrl/mpam_devices.c | 26 ++++++++++++++++++--------
>>>>  1 file changed, 18 insertions(+), 8 deletions(-)
>>>>
>>>> diff --git a/drivers/resctrl/mpam_devices.c b/drivers/resctrl/mpam_devices.c
>>>> index 61cbc75625fa..a44d66a5733d 100644
>>>> --- a/drivers/resctrl/mpam_devices.c
>>>> +++ b/drivers/resctrl/mpam_devices.c
>>>> @@ -2120,21 +2120,31 @@ static int mpam_msc_drv_probe(struct platform_device *pdev)
>>>>  	msc = do_mpam_msc_drv_probe(pdev);
>>>>  	mutex_unlock(&mpam_list_lock);
>>>>  
>>>> -	if (IS_ERR(msc))
>>>> -		return PTR_ERR(msc);
>>>> +	if (IS_ERR(msc)) {
>>>> +		err = PTR_ERR(msc);
>>>> +		goto out;
>>>> +	}
>>>>  
>>>>  	/* Create RIS entries described by firmware */
>>>>  	err = acpi_mpam_parse_resources(msc, plat_data);
>>>> -	if (err) {
>>>> +	if (err)
>>>>  		mpam_msc_drv_remove(pdev);
>>>> -		return err;
>>>> -	}
>>>> -
>>>> -	if (atomic_add_return(1, &mpam_num_msc) == fw_num_msc)
>>>> +out:
>>>> +	/*
>>>> +	 * A failed MSC must not prevent MPAM being enabled for the
>>>> +	 * surviving devices. Firmware may describe MSCs that are not
>>>> +	 * accessible from any possible CPU, e.g. when the possible CPUs
>>>> +	 * were restricted by nr_cpus=. The failed device is not
>>>> +	 * re-probed, so count it here too: otherwise the counter never
>>>> +	 * reaches fw_num_msc, the discovery cpuhp callbacks are never
>>>> +	 * registered and mpam_enable() is never scheduled - MPAM stays
>>>> +	 * dead system-wide, without any error message.
>>>> +	 */
>>>> +	if (atomic_inc_return(&mpam_num_msc) == fw_num_msc)
>>>>  		mpam_register_cpuhp_callbacks(mpam_discovery_cpu_online, NULL,
>>>>  					      "mpam:drv_probe");
>>>>  
>>>> -	return 0;
>>>> +	return err;
>>>>  }
>>>>  
>>>>  static struct platform_driver mpam_msc_driver = {
>>>
>>
> 

-- 
Best regards,
Jinjie


  reply	other threads:[~2026-10-31  1:23 UTC|newest]

Thread overview: 32+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-10-20 13:42 [PATCH v10 RESEND 00/15] arm_mpam: Introduce Narrow-PARTID feature Jinjie Ruan
2026-10-20 13:42 ` [PATCH v10 RESEND 01/15] fs/resctrl: Return -EBUSY when per-CLOSID RMIDs are in limbo Jinjie Ruan
2026-10-26 14:05   ` Ben Horgan
2026-10-28 21:28   ` Reinette Chatre
2026-10-29  3:51     ` Jinjie Ruan
2026-10-20 13:42 ` [PATCH v10 RESEND 02/15] fs/resctrl: Skip monitor context allocation when force-freeing RMIDs Jinjie Ruan
2026-10-26 14:08   ` Ben Horgan
2026-10-26 14:11     ` Ben Horgan
2026-10-27  1:33       ` Jinjie Ruan
2026-10-28 21:29         ` Reinette Chatre
2026-10-29  4:05           ` Jinjie Ruan
2026-10-20 13:42 ` [PATCH v10 RESEND 03/15] arm_mpam: Fix error return in resctrl_arch_mon_ctx_alloc() Jinjie Ruan
2026-10-26 14:40   ` Ben Horgan
2026-10-27  1:25     ` Jinjie Ruan
2026-10-20 13:42 ` [PATCH v10 RESEND 04/15] arm_mpam: Fix infinite PARTID reset loop when 65536 PARTIDs are supported Jinjie Ruan
2026-10-20 13:42 ` [PATCH v10 RESEND 05/15] arm_mpam: Don't stall MPAM enable when an MSC fails to probe Jinjie Ruan
2026-10-26 14:49   ` Ben Horgan
2026-10-27  1:47     ` Jinjie Ruan
2026-10-30 15:29       ` Ben Horgan
2026-10-31  1:23         ` Jinjie Ruan [this message]
2026-10-20 13:42 ` [PATCH v10 RESEND 06/15] fs/resctrl: Unmount resctrl with the CDP state it was mounted with Jinjie Ruan
2026-10-26 15:08   ` Ben Horgan
2026-10-31  2:00     ` Jinjie Ruan
2026-10-20 13:42 ` [PATCH v10 RESEND 07/15] fs/resctrl: Add resctrl_arch_rmid_idx_match() helper Jinjie Ruan
2026-10-20 13:42 ` [PATCH v10 RESEND 08/15] arm_mpam: resctrl: Add resctrl_closid_rmid_to_partid_pmg() helper Jinjie Ruan
2026-10-20 13:42 ` [PATCH v10 RESEND 09/15] arm_mpam: Add a helper to check a PARTID is in a CLOSID Jinjie Ruan
2026-10-20 13:42 ` [PATCH v10 RESEND 10/15] arm_mpam: Track the PARTID and internal PARTID limits per class Jinjie Ruan
2026-10-20 13:42 ` [PATCH v10 RESEND 11/15] arm_mpam: Divide the PARTIDs between the control groups Jinjie Ruan
2026-10-20 13:42 ` [PATCH v10 RESEND 12/15] arm_mpam: Map resctrl RMIDs onto the request PARTIDs Jinjie Ruan
2026-10-20 13:42 ` [PATCH v10 RESEND 13/15] arm_mpam: Identify the non-aliasing controls Jinjie Ruan
2026-10-20 13:42 ` [PATCH v10 RESEND 14/15] arm_mpam: Use the request PARTIDs beyond the internal range Jinjie Ruan
2026-10-20 13:42 ` [PATCH v10 RESEND 15/15] arm_mpam: resctrl: Add kunit tests for narrow PARTID helpers Jinjie Ruan

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=96a7b9ca-a5da-449e-b4d7-c34299692012@huawei.com \
    --to=ruanjinjie@huawei.com \
    --cc=Dave.Martin@arm.com \
    --cc=babu.moger@amd.com \
    --cc=ben.horgan@arm.com \
    --cc=bp@alien8.de \
    --cc=catalin.marinas@arm.com \
    --cc=dave.hansen@linux.intel.com \
    --cc=fenghuay@nvidia.com \
    --cc=gshan@redhat.com \
    --cc=hpa@zytor.com \
    --cc=james.morse@arm.com \
    --cc=jic23@kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=mingo@redhat.com \
    --cc=reinette.chatre@intel.com \
    --cc=tan.shaopeng@fujitsu.com \
    --cc=tglx@kernel.org \
    --cc=tony.luck@intel.com \
    --cc=x86@kernel.org \
    --cc=zengheng4@huawei.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox

all inboxes | Powered by JetHome®