From: "M K, Muralidhara" <muralimk@amd.com>
To: "Ilpo Järvinen" <ilpo.jarvinen@linux.intel.com>,
"Muralidhara M K" <muralidhara.mk@amd.com>
Cc: platform-driver-x86@vger.kernel.org,
LKML <linux-kernel@vger.kernel.org>,
muthusamy.ramalingam@amd.com
Subject: Re: [PATCH v5 5/6] platform/x86/amd/hsmp: ACPI HSMP refcounted sockets and coordinated release
Date: Sun, 12 Jul 2026 08:43:10 +0530 [thread overview]
Message-ID: <f91696fb-bbfd-42c8-b637-41c50ce621c0@amd.com> (raw)
In-Reply-To: <9469db87-7c63-aa00-1d0e-161df55fd180@linux.intel.com>
On 7/10/2026 11:21 PM, Ilpo Järvinen wrote:
> Caution: This message originated from an External Source. Use proper caution when opening attachments, clicking links, or responding.
>
>
> On Fri, 10 Jul 2026, Muralidhara M K wrote:
>
>> The ACPI driver binds one platform device per socket but shares a single
>> socket array and a single /dev/hsmp misc device across them. Replace the
>> is_probed flag with state that tracks this shared ownership:
>>
>> - miscdevice.this_device tells whether /dev/hsmp is registered, so the
>> misc device is registered on the first socket and torn down last. A
>> preceding change clears mdev.this_device on deregister so this gate
>> stays reliable across a re-probe.
>>
>> - hsmp_acpi_sock_refs counts the sockets that have probed successfully.
>> It is guarded by hsmp_sock_rwsem, which probe and remove already hold
>> for write, so a plain counter is enough and no atomic refcount is
>> needed. The shared socket array is allocated with kcalloc() on the first
>> probe and freed by hsmp_acpi_sock_release() when the count drops back to
>> zero.
>>
>> hsmp_acpi_sock_release() is the single teardown helper: it deregisters
>> /dev/hsmp if registered, unmaps any metric-table DRAM, destroys the
>> per-socket mutexes and frees the array. The remove path and the
>> probe-failure path each call it once they are the last owner, so the
>> teardown lives in one place.
>>
>> Both paths also clear this socket's dev, so a message issued after a
>> non-final unbind (or to a socket that failed to probe on a multi-socket
>> system, whose array stays alive and whose remove() is never called) cannot
>> reach the mailbox that devres is about to unmap.
>>
>> Two lifetime fixes fall out of the array persisting across a non-final
>> unbind:
>>
>> - hsmp_get_tbl_dram_base() iounmap()s any stale metric_tbl_addr before
>> remapping, so a rebind does not leak one mapping per cycle. It runs
>> during (re)probe before the metric sysfs attribute is exposed, so no
>> reader can be using the old mapping.
>>
>> - The ACPI path registers /dev/hsmp unparented by passing NULL to
>> hsmp_misc_register(). Its per-socket devices can be unbound individually
>> and out of order and the misc device outlives all but the last of them,
>> so parenting it to one socket's device would leave a dangling parent.
>> hsmp_misc_register() now takes the parent from its caller, so the
>> platform driver keeps parenting /dev/hsmp to its single device.
>>
>> hsmp_sock_rwsem is held for write across probe and remove, so the release
>> and probe-failure cleanup run with it already held; an upcoming change adds
>> its read side so the same lock also drains the lock-free data plane.
>>
>> Signed-off-by: Muralidhara M K <muralidhara.mk@amd.com>
>> ---
>> drivers/platform/x86/amd/hsmp/acpi.c | 122 ++++++++++++++++++++++-----
>> drivers/platform/x86/amd/hsmp/hsmp.c | 20 +++++
>> drivers/platform/x86/amd/hsmp/hsmp.h | 1 -
>> 3 files changed, 123 insertions(+), 20 deletions(-)
>>
>> diff --git a/drivers/platform/x86/amd/hsmp/acpi.c b/drivers/platform/x86/amd/hsmp/acpi.c
>> index a092d7589bcb..8339af1624f4 100644
>> --- a/drivers/platform/x86/amd/hsmp/acpi.c
>> +++ b/drivers/platform/x86/amd/hsmp/acpi.c
>> @@ -24,6 +24,7 @@
>> #include <linux/module.h>
>> #include <linux/platform_device.h>
>> #include <linux/rwsem.h>
>> +#include <linux/slab.h>
>> #include <linux/string.h>
>> #include <linux/sysfs.h>
>> #include <linux/topology.h>
>> @@ -42,6 +43,14 @@
>>
>> static struct hsmp_plat_device *hsmp_pdev;
>>
>> +/*
>> + * Number of ACPI socket platform devices that have probed successfully.
>> + * Guarded by hsmp_sock_rwsem, which probe and remove hold for write, so a
>> + * plain counter is enough; no atomic is needed. The shared socket array is
>> + * allocated on the first probe and freed once this drops back to zero.
>> + */
>> +static unsigned int hsmp_acpi_sock_refs;
>> +
>> struct hsmp_sys_attr {
>> struct device_attribute dattr;
>> u32 msg_id;
>> @@ -611,6 +620,60 @@ static const struct acpi_device_id amd_hsmp_acpi_ids[] = {
>> };
>> MODULE_DEVICE_TABLE(acpi, amd_hsmp_acpi_ids);
>>
>> +/*
>> + * Tear down the shared ACPI socket state once the last socket is gone:
>> + * deregister /dev/hsmp if it was registered, unmap any metric-table DRAM,
>> + * destroy the per-socket mutexes and free the socket array.
>> + *
>> + * Called with hsmp_sock_rwsem held for write by the remove and probe-failure
>> + * paths. The write lock has drained any in-flight hsmp_send_message(), so
>> + * unmapping the mailbox and freeing the array cannot race the lock-free data
>> + * plane.
>> + */
>> +static void hsmp_acpi_sock_release(void)
>> +{
>> + lockdep_assert_held_write(&hsmp_sock_rwsem);
>> +
>> + if (!IS_ERR_OR_NULL(hsmp_pdev->mdev.this_device))
>> + hsmp_misc_deregister();
>> + hsmp_unmap_metric_tbls(hsmp_pdev);
>> + hsmp_destroy_metric_read_locks(hsmp_pdev);
>> + kfree(hsmp_pdev->sock);
>> + hsmp_pdev->sock = NULL;
>> + hsmp_pdev->num_sockets = 0;
>> + hsmp_pdev->proto_ver = 0;
>> +}
>> +
>> +/**
>> + * hsmp_acpi_probe_failure_cleanup() - Undo a failed ACPI socket probe.
>> + * @dev: ACPI companion device whose probe failed.
>> + *
>> + * This device never incremented hsmp_acpi_sock_refs, so clear its sock->dev
>> + * and, if it was the only socket in play, release the shared state.
>> + *
>> + * Clearing sock->dev matters on multi-socket systems: when a non-first socket
>> + * fails, the array stays alive (owned by an already-probed socket) and
>> + * remove() is never called for this device, yet devres unmaps its mailbox once
>> + * probe() returns. Without clearing dev, a later message to this index would
>> + * pass every gate in hsmp_send_message() and reach the unmapped mailbox.
>> + *
>> + * sock is NULL if probe failed before hsmp_parse_acpi_table() set the drvdata.
>> + *
>> + * Called from hsmp_acpi_probe(), which already holds hsmp_sock_rwsem for write.
>> + */
>> +static void hsmp_acpi_probe_failure_cleanup(struct device *dev)
>> +{
>> + struct hsmp_socket *sock = dev_get_drvdata(dev);
>> +
>> + lockdep_assert_held_write(&hsmp_sock_rwsem);
>> +
>> + if (sock)
>> + sock->dev = NULL;
>> +
>> + if (!hsmp_acpi_sock_refs)
>> + hsmp_acpi_sock_release();
>> +}
>> +
>> static int hsmp_acpi_probe(struct platform_device *pdev)
>> {
>> int ret;
>> @@ -620,23 +683,24 @@ static int hsmp_acpi_probe(struct platform_device *pdev)
>> return -ENOMEM;
>>
>> /*
>> - * Multiple ACPI socket devices probe in parallel, but the is_probed
>> - * handshake and the one-time socket-array allocation below must run
>> - * exactly once. Serialize the whole bring-up against concurrent
>> - * probe/remove by holding the socket rwsem for write.
>> + * Multiple ACPI socket devices probe in parallel, but the one-time
>> + * socket-array allocation and /dev/hsmp registration below must run
>> + * exactly once. Hold the socket rwsem for write across the whole
>> + * bring-up so it cannot race a concurrent probe or remove, and so the
>> + * probe-failure teardown drains the lock-free data plane.
>> */
>> guard(rwsem_write)(&hsmp_sock_rwsem);
>>
>> - if (!hsmp_pdev->is_probed) {
>> + if (!hsmp_pdev->sock) {
>> hsmp_pdev->num_sockets = topology_max_packages();
>> if (!hsmp_pdev->num_sockets) {
>> dev_err(&pdev->dev, "No CPU sockets detected\n");
>> return -ENODEV;
>> }
>>
>> - hsmp_pdev->sock = devm_kcalloc(&pdev->dev, hsmp_pdev->num_sockets,
>> - sizeof(*hsmp_pdev->sock),
>> - GFP_KERNEL);
>> + hsmp_pdev->sock = kcalloc(hsmp_pdev->num_sockets,
>> + sizeof(*hsmp_pdev->sock),
>> + GFP_KERNEL);
>> if (!hsmp_pdev->sock)
>> return -ENOMEM;
>>
>> @@ -646,35 +710,55 @@ static int hsmp_acpi_probe(struct platform_device *pdev)
>> ret = init_acpi(&pdev->dev);
>> if (ret) {
>> dev_err(&pdev->dev, "Failed to initialize HSMP interface.\n");
>> + hsmp_acpi_probe_failure_cleanup(&pdev->dev);
>> return ret;
>> }
>>
>> - if (!hsmp_pdev->is_probed) {
>> - ret = hsmp_misc_register(&pdev->dev);
>> + if (IS_ERR_OR_NULL(hsmp_pdev->mdev.this_device)) {
>> + /*
>> + * Register /dev/hsmp unparented. It is a singleton shared by all
>> + * ACPI sockets and outlives all but the last of them, so
>> + * parenting it to this socket's device would leave a dangling
>> + * parent once that socket is unbound.
>> + */
>> + ret = hsmp_misc_register(NULL);
>> if (ret) {
>> dev_err(&pdev->dev, "Failed to register misc device\n");
>> + hsmp_acpi_probe_failure_cleanup(&pdev->dev);
>> return ret;
>> }
>> - hsmp_pdev->is_probed = true;
>> - dev_dbg(&pdev->dev, "AMD HSMP ACPI is probed successfully\n");
>> + dev_dbg(&pdev->dev, "AMD HSMP ACPI misc device registered\n");
>> }
>>
>> + hsmp_acpi_sock_refs++;
>> +
>> return 0;
>> }
>>
>> static void hsmp_acpi_remove(struct platform_device *pdev)
>> {
>> + struct hsmp_socket *sock = dev_get_drvdata(&pdev->dev);
>> +
>> + /*
>> + * Serialize the decrement and any release it triggers against a
>> + * concurrent probe, and drain the lock-free data plane for the whole
>> + * teardown: this covers the per-socket unbind, whose mailbox devres
>> + * unmaps once we return, and the last unbind that frees the socket
>> + * array in hsmp_acpi_sock_release().
>> + */
>> guard(rwsem_write)(&hsmp_sock_rwsem);
>>
>> /*
>> - * We register only one misc_device even on multi-socket system.
>> - * So, deregister should happen only once.
>> + * Clear this socket's dev so hsmp_send_message() rejects it before
>> + * devres unmaps the mailbox. On a non-final unbind the socket array
>> + * stays alive, so without this a later message to this index would
>> + * reach an unmapped iomem region.
>> */
>> - if (hsmp_pdev->is_probed) {
>> - hsmp_misc_deregister();
>> - hsmp_destroy_metric_read_locks(hsmp_pdev);
>> - hsmp_pdev->is_probed = false;
>> - }
>> + sock->dev = NULL;
>> +
>> + hsmp_acpi_sock_refs--;
>> + if (!hsmp_acpi_sock_refs)
>
> Now that I can actually follow the series this far (pretty easily
> actually, so good work so far!), I again started to wonder why this has
> moved back away from kref to manually handling the reference counting?
>
> I understand you don't strictly need the atomic part of refcount_t because
> you're under another lock but it would still be cleaner interface with
> kref_get/put().
>
> It might even be possible to use kref_get_unless_zero() instead of the
> read side of hsmp_sock_rwsem to ensure datastructures won't vanish
> underneath a data place call.
>
Thanks for your input. I will adress the above suggestion and send next
series.
>> + hsmp_acpi_sock_release();
>> }
>>
>> static struct platform_driver amd_hsmp_driver = {
>> diff --git a/drivers/platform/x86/amd/hsmp/hsmp.c b/drivers/platform/x86/amd/hsmp/hsmp.c
>> index 584fd9b1d31f..967307abe641 100644
>> --- a/drivers/platform/x86/amd/hsmp/hsmp.c
>> +++ b/drivers/platform/x86/amd/hsmp/hsmp.c
>> @@ -491,6 +491,18 @@ int hsmp_get_tbl_dram_base(u16 sock_ind)
>> dev_err(sock->dev, "Invalid DRAM address for metric table\n");
>> return -ENOMEM;
>> }
>> + /*
>> + * The ACPI socket array is shared across sockets and outlives a
>> + * per-socket unbind, so metric_tbl_addr may hold a mapping from an
>> + * earlier bind of this socket. Unmap it before remapping so an
>> + * unbind/rebind cycle does not leak a metric-table mapping. This runs
>> + * during probe before the metric sysfs attribute is exposed, so no
>> + * reader can be using it.
>> + */
>> + if (sock->metric_tbl_addr) {
>> + iounmap(sock->metric_tbl_addr);
>> + sock->metric_tbl_addr = NULL;
>> + }
>> sock->metric_tbl_addr = ioremap(dram_addr, sizeof(struct hsmp_metric_table));
>> if (!sock->metric_tbl_addr) {
>> dev_err(sock->dev, "Failed to ioremap metric table addr\n");
>> @@ -528,6 +540,14 @@ int hsmp_misc_register(struct device *dev)
>> hsmp_pdev.mdev.name = HSMP_CDEV_NAME;
>> hsmp_pdev.mdev.minor = MISC_DYNAMIC_MINOR;
>> hsmp_pdev.mdev.fops = &hsmp_fops;
>> + /*
>> + * The caller chooses the parent. The platform driver has a single
>> + * device whose lifetime matches /dev/hsmp and parents it there. The
>> + * ACPI driver passes NULL: its /dev/hsmp is a singleton shared by
>> + * per-socket devices that can be unbound individually and out of order,
>> + * so parenting it to one would leave it attached to an already-removed
>> + * device.
>> + */
>> hsmp_pdev.mdev.parent = dev;
>> hsmp_pdev.mdev.nodename = HSMP_DEVNODE_NAME;
>> hsmp_pdev.mdev.mode = 0644;
>> diff --git a/drivers/platform/x86/amd/hsmp/hsmp.h b/drivers/platform/x86/amd/hsmp/hsmp.h
>> index ec92c2a429bb..45dab9253c13 100644
>> --- a/drivers/platform/x86/amd/hsmp/hsmp.h
>> +++ b/drivers/platform/x86/amd/hsmp/hsmp.h
>> @@ -58,7 +58,6 @@ struct hsmp_plat_device {
>> struct hsmp_socket *sock;
>> u32 proto_ver;
>> u16 num_sockets;
>> - bool is_probed;
>> };
>>
>> int hsmp_cache_proto_ver(u16 sock_ind);
>>
>
> --
> i.
>
next prev parent reply other threads:[~2026-07-12 3:13 UTC|newest]
Thread overview: 9+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-07-10 14:46 [PATCH v5 0/6] platform/x86/amd/hsmp: Serialize the data plane against socket teardown Muralidhara M K
2026-07-10 14:46 ` [PATCH v5 1/6] platform/x86/amd/hsmp: Serialize ACPI HSMP probe and remove with an rwsem Muralidhara M K
2026-07-10 14:46 ` [PATCH v5 2/6] platform/x86/amd/hsmp: Map the metric table with ioremap() and unmap it explicitly Muralidhara M K
2026-07-10 14:46 ` [PATCH v5 3/6] platform/x86/amd/hsmp: Serialize per-socket metric table reads with a mutex Muralidhara M K
2026-07-10 14:46 ` [PATCH v5 4/6] platform/x86/amd/hsmp: Clear mdev.this_device on deregister Muralidhara M K
2026-07-10 14:46 ` [PATCH v5 5/6] platform/x86/amd/hsmp: ACPI HSMP refcounted sockets and coordinated release Muralidhara M K
2026-07-10 17:51 ` Ilpo Järvinen
2026-07-12 3:13 ` M K, Muralidhara [this message]
2026-07-10 14:46 ` [PATCH v5 6/6] platform/x86/amd/hsmp: Serialize the data plane against socket teardown Muralidhara M K
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=f91696fb-bbfd-42c8-b637-41c50ce621c0@amd.com \
--to=muralimk@amd.com \
--cc=ilpo.jarvinen@linux.intel.com \
--cc=linux-kernel@vger.kernel.org \
--cc=muralidhara.mk@amd.com \
--cc=muthusamy.ramalingam@amd.com \
--cc=platform-driver-x86@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox