mirror of https://lore.kernel.org/lkml/
 help / color / mirror / Atom feed
From: "Moger, Babu" <bmoger@amd.com>
To: "Luck, Tony" <tony.luck@intel.com>, Babu Moger <babu.moger@amd.com>
Cc: Fenghua Yu <fenghuay@nvidia.com>,
	Reinette Chatre <reinette.chatre@intel.com>,
	Maciej Wieczor-Retman <maciej.wieczor-retman@intel.com>,
	Peter Newman <peternewman@google.com>,
	James Morse <james.morse@arm.com>,
	Drew Fustini <dfustini@baylibre.com>,
	Dave Martin <Dave.Martin@arm.com>, Chen Yu <yu.c.chen@intel.com>,
	David E Box <david.e.box@intel.com>,
	x86@kernel.org, Christoph Hellwig <hch@infradead.org>,
	linux-kernel@vger.kernel.org, patches@lists.linux.dev
Subject: Re: [PATCH v12 14/25] fs/resctrl: Rebuild free RMID list on each mount
Date: Tue, 22 Sep 2026 17:58:06 -0500	[thread overview]
Message-ID: <a6a2e7a1-9b07-40f1-971b-9e9866bee048@amd.com> (raw)
In-Reply-To: <arLlcFYZiu7OcBFc@agluck-desk3>

Hi Tony,

On 9/22/2026 3:30 PM, Luck, Tony wrote:
> On Mon, Sep 21, 2026 at 12:45:56PM -0500, Babu Moger wrote:
>> Hi Tony,
> 
> Hi Babu,
> 
> Thanks for running tests to make sure that I didn't break any AMD
> functionality, and for reviewing these patches.
> 
>>
>>>    int setup_rmid_lru_list(void)
>>>    {
>>> -	struct rmid_entry *entry = NULL;
>>> -	u32 idx_limit;
>>> -	u32 idx;
>>> +	struct rmid_entry *entry;
>>> +	u32 cur_idx_limit;
>>> +	u32 rsvd_idx;
>>>    	int i;
>>>    	if (!resctrl_mon_capable())
>>>    		return 0;
>>>    	/*
>>> -	 * Called on every mount, but the number of RMIDs cannot change
>>> -	 * after the first mount, so keep using the same set of rmid_ptrs[]
>>> -	 * until resctrl_exit(). Note that the limbo handler continues to
>>> -	 * access rmid_ptrs[] after resctrl is unmounted.
>>> +	 * Allocate the largest number of RMIDs that this system will ever
>>> +	 * need. These cannot be freed until resctrl_exit() because the limbo
>>> +	 * handler continues to access rmid_ptrs[] after resctrl is unmounted.
>>>    	 */
>>> -	if (rmid_ptrs)
>>> -		return 0;
>>> +	if (!rmid_ptrs) {
>>> +		num_rmid_ptrs = resctrl_arch_system_max_rmid_idx();
>>> +		rmid_ptrs = kzalloc_objs(struct rmid_entry, num_rmid_ptrs);
>>> +		if (!rmid_ptrs) {
>>> +			num_rmid_ptrs = 0;
>>> +			return -ENOMEM;
>>> +		}
>>> -	idx_limit = resctrl_arch_system_max_rmid_idx();
>>> -	rmid_ptrs = kzalloc_objs(struct rmid_entry, idx_limit);
>>> -	if (!rmid_ptrs)
>>> -		return -ENOMEM;
>>> +		for (i = 0; i < num_rmid_ptrs; i++) {
>>> +			entry = &rmid_ptrs[i];
>>> +			INIT_LIST_HEAD(&entry->list);
>>> -	for (i = 0; i < idx_limit; i++) {
>>> -		entry = &rmid_ptrs[i];
>>> -		INIT_LIST_HEAD(&entry->list);
>>> +			resctrl_arch_rmid_idx_decode(i, &entry->closid, &entry->rmid);
>>> +		}
>>> +	}
>>> -		resctrl_arch_rmid_idx_decode(i, &entry->closid, &entry->rmid);
>>> -		list_add_tail(&entry->list, &rmid_free_lru);
>>> +	/* Find how many RMIDs are available for this mount */
>>> +	cur_idx_limit = resctrl_arch_system_num_rmid_idx();
>>> +	if (cur_idx_limit > num_rmid_ptrs) {
>>> +		pr_warn_once("RMID count %u exceeds allocated %u; capping\n",
>>> +			     cur_idx_limit, num_rmid_ptrs);
>>> +		cur_idx_limit = num_rmid_ptrs;
>>>    	}
>>> +	INIT_LIST_HEAD(&rmid_free_lru);
>>
>> It is possible the list is not empty at this point with difference in
>> numbers from one mount to another?  Should you check if the list is empty
>> and clean it up?
> 
> After a clean unmount the free list will likely be mostly full as
> resctrl_fs_teardown() calls rmdir_all_sub() which is going to free
> up RMIDs as directories are removed. The only RMIDs missing will be
> the ones in limbo waiting for LLC occupancy counts to decay.
> 
> But the free list may contain some RMIDs that are out of range for the
> new mount. Simply rebuilding the free list from scratch is one option
> to resolve this. Another would be to walk the list add remove any
> RMIDs out of range for the new mount.

Either is fine.

Will something like this work?

list_for_each_entry_safe(entry, tmp, &rmid_free_lru, list)
              list_del(&entry->list);
INIT_LIST_HEAD(&rmid_free_lru);

Thanks
Babu

  reply	other threads:[~2026-09-22 22:58 UTC|newest]

Thread overview: 40+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-09-16 23:12 [PATCH v12 00/25] Allow AET to use PMT as loadable module Tony Luck
2026-09-16 23:12 ` [PATCH v12 01/25] x86/cpufeatures: Add missing CQM feature dependency Tony Luck
2026-09-16 23:12 ` [PATCH v12 02/25] x86/resctrl: Check if monitoring features are supported Tony Luck
2026-09-16 23:12 ` [PATCH v12 03/25] x86/resctrl: Enumerate monitor features in rdt_get_l3_mon_config() Tony Luck
2026-09-16 23:12 ` [PATCH v12 04/25] x86/resctrl: Apply Intel MBM quirk from rdt_get_l3_mon_config() Tony Luck
2026-09-21 17:45   ` Babu Moger
2026-09-22 20:46     ` Luck, Tony
2026-09-16 23:13 ` [PATCH v12 05/25] x86/resctrl: Delete resctrl_cpu_detect() Tony Luck
2026-09-16 23:13 ` [PATCH v12 06/25] arm,x86,fs/resctrl: Replace architecture resctrl_arch_{alloc,mon}_capable() Tony Luck
2026-09-16 23:13 ` [PATCH v12 07/25] x86/resctrl: Update special case for Intel Haswell enumeration Tony Luck
2026-09-16 23:13 ` [PATCH v12 08/25] x86/resctrl: Delete rdt_alloc_capable and rdt_mon_capable Tony Luck
2026-09-16 23:13 ` [PATCH v12 09/25] fs/resctrl: Remove redundant calls to resctrl_{alloc,mon}_capable() Tony Luck
2026-09-21 17:45   ` Babu Moger
2026-09-22 20:33     ` Luck, Tony
2026-09-16 23:13 ` [PATCH v12 10/25] x86/resctrl: Honor rdt=perf option to force enable AET perf events Tony Luck
2026-09-16 23:13 ` [PATCH v12 11/25] fs/resctrl: Add interface to disable a monitor event Tony Luck
2026-09-16 23:13 ` [PATCH v12 12/25] arm,x86,fs/resctrl: Allocate maximum needed rmid_ptrs[] Tony Luck
2026-09-21 17:45   ` Babu Moger
2026-09-22  0:30     ` Reinette Chatre
2026-09-22 13:09       ` Babu Moger
2026-09-16 23:13 ` [PATCH v12 13/25] arm,x86,fs/resctrl: Allocate right size for L3 monitor arrays Tony Luck
2026-09-16 23:13 ` [PATCH v12 14/25] fs/resctrl: Rebuild free RMID list on each mount Tony Luck
2026-09-21 17:45   ` Babu Moger
2026-09-22 20:30     ` Luck, Tony
2026-09-22 22:58       ` Moger, Babu [this message]
2026-09-22 23:07         ` Luck, Tony
2026-09-16 23:13 ` [PATCH v12 15/25] x86,fs/resctrl: Handle systems where AET is the only resource Tony Luck
2026-09-16 23:13 ` [PATCH v12 16/25] x86/resctrl: Add PMT registration API for AET enumeration callbacks Tony Luck
2026-09-16 23:13 ` [PATCH v12 17/25] platform/x86/intel/pmt: Register enumeration functions with resctrl Tony Luck
2026-09-16 23:13 ` [PATCH v12 18/25] x86/resctrl: Use registered function pointers for AET enumeration Tony Luck
2026-09-16 23:13 ` [PATCH v12 19/25] arm,x86,fs/resctrl: Enumerate AET on every resctrl mount Tony Luck
2026-09-16 23:13 ` [PATCH v12 20/25] x86/resctrl: Enforce system RMID limit on AET Tony Luck
2026-09-16 23:13 ` [PATCH v12 21/25] x86/resctrl: Export interface to report telemetry unbind/remove Tony Luck
2026-09-16 23:13 ` [PATCH v12 22/25] platform/x86/intel/pmt: Inform resctrl when MMIO maps are being removed Tony Luck
2026-09-18 16:29   ` [PATCH 12 22/25 UPDATED] " Tony Luck
2026-09-16 23:13 ` [PATCH v12 23/25] x86/resctrl: Require 64-bit x86 for resctrl support Tony Luck
2026-09-16 23:13 ` [PATCH v12 24/25] x86/resctrl: Simplify Kconfig options for resctrl Tony Luck
2026-09-16 23:13 ` [PATCH v12 25/25] x86,fs/resctrl: Document telemetry mount timing caveat Tony Luck
2026-09-17 16:32 ` [PATCH v12 00/25] Allow AET to use PMT as loadable module Luck, Tony
2026-09-17 21:23   ` Luck, Tony

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=a6a2e7a1-9b07-40f1-971b-9e9866bee048@amd.com \
    --to=bmoger@amd.com \
    --cc=Dave.Martin@arm.com \
    --cc=babu.moger@amd.com \
    --cc=david.e.box@intel.com \
    --cc=dfustini@baylibre.com \
    --cc=fenghuay@nvidia.com \
    --cc=hch@infradead.org \
    --cc=james.morse@arm.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=maciej.wieczor-retman@intel.com \
    --cc=patches@lists.linux.dev \
    --cc=peternewman@google.com \
    --cc=reinette.chatre@intel.com \
    --cc=tony.luck@intel.com \
    --cc=x86@kernel.org \
    --cc=yu.c.chen@intel.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox

all inboxes | Powered by JetHome®