From: "Moger, Babu" <bmoger@amd.com>
To: "Luck, Tony" <tony.luck@intel.com>, Babu Moger <babu.moger@amd.com>
Cc: Fenghua Yu <fenghuay@nvidia.com>,
Reinette Chatre <reinette.chatre@intel.com>,
Maciej Wieczor-Retman <maciej.wieczor-retman@intel.com>,
Peter Newman <peternewman@google.com>,
James Morse <james.morse@arm.com>,
Drew Fustini <dfustini@baylibre.com>,
Dave Martin <Dave.Martin@arm.com>, Chen Yu <yu.c.chen@intel.com>,
David E Box <david.e.box@intel.com>,
x86@kernel.org, Christoph Hellwig <hch@infradead.org>,
linux-kernel@vger.kernel.org, patches@lists.linux.dev
Subject: Re: [PATCH v12 14/25] fs/resctrl: Rebuild free RMID list on each mount
Date: Tue, 22 Sep 2026 17:58:06 -0500 [thread overview]
Message-ID: <a6a2e7a1-9b07-40f1-971b-9e9866bee048@amd.com> (raw)
In-Reply-To: <arLlcFYZiu7OcBFc@agluck-desk3>
Hi Tony,
On 9/22/2026 3:30 PM, Luck, Tony wrote:
> On Mon, Sep 21, 2026 at 12:45:56PM -0500, Babu Moger wrote:
>> Hi Tony,
>
> Hi Babu,
>
> Thanks for running tests to make sure that I didn't break any AMD
> functionality, and for reviewing these patches.
>
>>
>>> int setup_rmid_lru_list(void)
>>> {
>>> - struct rmid_entry *entry = NULL;
>>> - u32 idx_limit;
>>> - u32 idx;
>>> + struct rmid_entry *entry;
>>> + u32 cur_idx_limit;
>>> + u32 rsvd_idx;
>>> int i;
>>> if (!resctrl_mon_capable())
>>> return 0;
>>> /*
>>> - * Called on every mount, but the number of RMIDs cannot change
>>> - * after the first mount, so keep using the same set of rmid_ptrs[]
>>> - * until resctrl_exit(). Note that the limbo handler continues to
>>> - * access rmid_ptrs[] after resctrl is unmounted.
>>> + * Allocate the largest number of RMIDs that this system will ever
>>> + * need. These cannot be freed until resctrl_exit() because the limbo
>>> + * handler continues to access rmid_ptrs[] after resctrl is unmounted.
>>> */
>>> - if (rmid_ptrs)
>>> - return 0;
>>> + if (!rmid_ptrs) {
>>> + num_rmid_ptrs = resctrl_arch_system_max_rmid_idx();
>>> + rmid_ptrs = kzalloc_objs(struct rmid_entry, num_rmid_ptrs);
>>> + if (!rmid_ptrs) {
>>> + num_rmid_ptrs = 0;
>>> + return -ENOMEM;
>>> + }
>>> - idx_limit = resctrl_arch_system_max_rmid_idx();
>>> - rmid_ptrs = kzalloc_objs(struct rmid_entry, idx_limit);
>>> - if (!rmid_ptrs)
>>> - return -ENOMEM;
>>> + for (i = 0; i < num_rmid_ptrs; i++) {
>>> + entry = &rmid_ptrs[i];
>>> + INIT_LIST_HEAD(&entry->list);
>>> - for (i = 0; i < idx_limit; i++) {
>>> - entry = &rmid_ptrs[i];
>>> - INIT_LIST_HEAD(&entry->list);
>>> + resctrl_arch_rmid_idx_decode(i, &entry->closid, &entry->rmid);
>>> + }
>>> + }
>>> - resctrl_arch_rmid_idx_decode(i, &entry->closid, &entry->rmid);
>>> - list_add_tail(&entry->list, &rmid_free_lru);
>>> + /* Find how many RMIDs are available for this mount */
>>> + cur_idx_limit = resctrl_arch_system_num_rmid_idx();
>>> + if (cur_idx_limit > num_rmid_ptrs) {
>>> + pr_warn_once("RMID count %u exceeds allocated %u; capping\n",
>>> + cur_idx_limit, num_rmid_ptrs);
>>> + cur_idx_limit = num_rmid_ptrs;
>>> }
>>> + INIT_LIST_HEAD(&rmid_free_lru);
>>
>> It is possible the list is not empty at this point with difference in
>> numbers from one mount to another? Should you check if the list is empty
>> and clean it up?
>
> After a clean unmount the free list will likely be mostly full as
> resctrl_fs_teardown() calls rmdir_all_sub() which is going to free
> up RMIDs as directories are removed. The only RMIDs missing will be
> the ones in limbo waiting for LLC occupancy counts to decay.
>
> But the free list may contain some RMIDs that are out of range for the
> new mount. Simply rebuilding the free list from scratch is one option
> to resolve this. Another would be to walk the list add remove any
> RMIDs out of range for the new mount.
Either is fine.
Will something like this work?
list_for_each_entry_safe(entry, tmp, &rmid_free_lru, list)
list_del(&entry->list);
INIT_LIST_HEAD(&rmid_free_lru);
Thanks
Babu
next prev parent reply other threads:[~2026-09-22 22:58 UTC|newest]
Thread overview: 40+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-09-16 23:12 [PATCH v12 00/25] Allow AET to use PMT as loadable module Tony Luck
2026-09-16 23:12 ` [PATCH v12 01/25] x86/cpufeatures: Add missing CQM feature dependency Tony Luck
2026-09-16 23:12 ` [PATCH v12 02/25] x86/resctrl: Check if monitoring features are supported Tony Luck
2026-09-16 23:12 ` [PATCH v12 03/25] x86/resctrl: Enumerate monitor features in rdt_get_l3_mon_config() Tony Luck
2026-09-16 23:12 ` [PATCH v12 04/25] x86/resctrl: Apply Intel MBM quirk from rdt_get_l3_mon_config() Tony Luck
2026-09-21 17:45 ` Babu Moger
2026-09-22 20:46 ` Luck, Tony
2026-09-16 23:13 ` [PATCH v12 05/25] x86/resctrl: Delete resctrl_cpu_detect() Tony Luck
2026-09-16 23:13 ` [PATCH v12 06/25] arm,x86,fs/resctrl: Replace architecture resctrl_arch_{alloc,mon}_capable() Tony Luck
2026-09-16 23:13 ` [PATCH v12 07/25] x86/resctrl: Update special case for Intel Haswell enumeration Tony Luck
2026-09-16 23:13 ` [PATCH v12 08/25] x86/resctrl: Delete rdt_alloc_capable and rdt_mon_capable Tony Luck
2026-09-16 23:13 ` [PATCH v12 09/25] fs/resctrl: Remove redundant calls to resctrl_{alloc,mon}_capable() Tony Luck
2026-09-21 17:45 ` Babu Moger
2026-09-22 20:33 ` Luck, Tony
2026-09-16 23:13 ` [PATCH v12 10/25] x86/resctrl: Honor rdt=perf option to force enable AET perf events Tony Luck
2026-09-16 23:13 ` [PATCH v12 11/25] fs/resctrl: Add interface to disable a monitor event Tony Luck
2026-09-16 23:13 ` [PATCH v12 12/25] arm,x86,fs/resctrl: Allocate maximum needed rmid_ptrs[] Tony Luck
2026-09-21 17:45 ` Babu Moger
2026-09-22 0:30 ` Reinette Chatre
2026-09-22 13:09 ` Babu Moger
2026-09-16 23:13 ` [PATCH v12 13/25] arm,x86,fs/resctrl: Allocate right size for L3 monitor arrays Tony Luck
2026-09-16 23:13 ` [PATCH v12 14/25] fs/resctrl: Rebuild free RMID list on each mount Tony Luck
2026-09-21 17:45 ` Babu Moger
2026-09-22 20:30 ` Luck, Tony
2026-09-22 22:58 ` Moger, Babu [this message]
2026-09-22 23:07 ` Luck, Tony
2026-09-16 23:13 ` [PATCH v12 15/25] x86,fs/resctrl: Handle systems where AET is the only resource Tony Luck
2026-09-16 23:13 ` [PATCH v12 16/25] x86/resctrl: Add PMT registration API for AET enumeration callbacks Tony Luck
2026-09-16 23:13 ` [PATCH v12 17/25] platform/x86/intel/pmt: Register enumeration functions with resctrl Tony Luck
2026-09-16 23:13 ` [PATCH v12 18/25] x86/resctrl: Use registered function pointers for AET enumeration Tony Luck
2026-09-16 23:13 ` [PATCH v12 19/25] arm,x86,fs/resctrl: Enumerate AET on every resctrl mount Tony Luck
2026-09-16 23:13 ` [PATCH v12 20/25] x86/resctrl: Enforce system RMID limit on AET Tony Luck
2026-09-16 23:13 ` [PATCH v12 21/25] x86/resctrl: Export interface to report telemetry unbind/remove Tony Luck
2026-09-16 23:13 ` [PATCH v12 22/25] platform/x86/intel/pmt: Inform resctrl when MMIO maps are being removed Tony Luck
2026-09-18 16:29 ` [PATCH 12 22/25 UPDATED] " Tony Luck
2026-09-16 23:13 ` [PATCH v12 23/25] x86/resctrl: Require 64-bit x86 for resctrl support Tony Luck
2026-09-16 23:13 ` [PATCH v12 24/25] x86/resctrl: Simplify Kconfig options for resctrl Tony Luck
2026-09-16 23:13 ` [PATCH v12 25/25] x86,fs/resctrl: Document telemetry mount timing caveat Tony Luck
2026-09-17 16:32 ` [PATCH v12 00/25] Allow AET to use PMT as loadable module Luck, Tony
2026-09-17 21:23 ` Luck, Tony
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=a6a2e7a1-9b07-40f1-971b-9e9866bee048@amd.com \
--to=bmoger@amd.com \
--cc=Dave.Martin@arm.com \
--cc=babu.moger@amd.com \
--cc=david.e.box@intel.com \
--cc=dfustini@baylibre.com \
--cc=fenghuay@nvidia.com \
--cc=hch@infradead.org \
--cc=james.morse@arm.com \
--cc=linux-kernel@vger.kernel.org \
--cc=maciej.wieczor-retman@intel.com \
--cc=patches@lists.linux.dev \
--cc=peternewman@google.com \
--cc=reinette.chatre@intel.com \
--cc=tony.luck@intel.com \
--cc=x86@kernel.org \
--cc=yu.c.chen@intel.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®