mirror of https://lore.kernel.org/lkml/
 help / color / mirror / Atom feed
From: Alexey Kardashevskiy <aik@amd.com>
To: "Aneesh Kumar K.V (Arm)" <aneesh.kumar@kernel.org>,
	iommu@lists.linux.dev
Cc: Alex Williamson <alex@shazbot.org>,
	Bjorn Helgaas <bhelgaas@google.com>,
	Catalin Marinas <catalin.marinas@arm.com>,
	Jacob Pan <jacob.pan@linux.microsoft.com>,
	Jason Gunthorpe <jgg@ziepe.ca>, Joerg Roedel <joro@8bytes.org>,
	Jonathan Cameron <jic23@kernel.org>,
	Jonathan Hunter <jonathanh@nvidia.com>,
	Kevin Tian <kevin.tian@intel.com>,
	Krishna Reddy <vdumpa@nvidia.com>, Lukas Wunner <lukas@wunner.de>,
	Nicolin Chen <nicolinc@nvidia.com>,
	Robin Murphy <robin.murphy@arm.com>,
	Samuel Ortiz <sameo@rivosinc.com>,
	Shameer Kolothum <shameerali.kolothum.thodi@huawei.com>,
	Steven Price <steven.price@arm.com>,
	Suravee Suthikulpanit <suravee.suthikulpanit@amd.com>,
	Suzuki K Poulose <suzuki.poulose@arm.com>,
	Thierry Reding <thierry.reding@kernel.org>,
	Vasant Hegde <vasant.hegde@amd.com>,
	Will Deacon <will@kernel.org>,
	Xu Yilun <yilun.xu@linux.intel.com>,
	kvm@vger.kernel.org, linux-arm-kernel@lists.infradead.org,
	linux-coco@lists.linux.dev, linux-kernel@vger.kernel.org,
	linux-pci@vger.kernel.org, linux-tegra@vger.kernel.org
Subject: Re: [PATCH v8 03/15] virt: coco: tsm: Complete PCI registration before publishing the device
Date: Thu, 12 Nov 2026 22:41:53 +1100	[thread overview]
Message-ID: <9773f2fa-f80a-449c-9e9e-722d1c71f989@amd.com> (raw)
In-Reply-To: <20261104161632.3547423-4-aneesh.kumar@kernel.org>

On 5/11/26 03:16, Aneesh Kumar K.V (Arm) wrote:
> tsm_register() calls device_add() before initializing and validating the
> PCI operations. This makes the new TSM discoverable through the class
> lookup while PCI registration can still fail. This ordering was introduced
> by commit 3225f52cde56 ("PCI/TSM: Establish Secure Sessions and Link
> Encryption").
> 
> An existing link TSM can keep the PCI connect attribute visible during
> registration of another TSM. A concurrent write naming the new TSM can
> therefore reach it through:
> 
>    connect_store()
>      find_tsm_dev()
>        class_find_device()
>      is_link_tsm()
>      pci_tsm_connect()
> 
> If the new backend supplies both link and device security operations,
> pci_tsm_register() rejects it before taking pci_tsm_rwsem. The registration
> thread then follows:
> 
>    tsm_register()
>      tsm_register_pci()
>        pci_tsm_register() -> -EINVAL
>        tsm_dev->pci_ops = NULL
>      device_del()
>      put_tsm_dev() [cleanup guard]
> 
> If connect has already attached a PCI context, its temporary device
> reference does not protect the stored tsm_dev pointer after the call
> returns. Registration cleanup can then free a TSM still referenced by
> that context. The original tsm_register_pci_or_reset() error path also
> had this problem: device_unregister() removed the class device and dropped
> its reference without tearing down an attached PCI context.
> 
> Commit 37a73b0448ad ("tsm: Remove the device from lookup before PCI
> teardown") subsequently added the unlocked pci_ops reset shown above.
> That reset can also race with the connect path's accesses to pci_ops.
> 
> Complete PCI registration before device_add() publishes the class device.
> On PCI registration failure, the TSM remains undiscoverable. If
> device_add() fails instead, unregister the PCI operations to roll back
> the counters and PCI sysfs visibility before releasing the device.
> 
> With pci_ops initialized before device_add(), the class PCI attributes
> are created with the correct visibility, so remove the subsequent sysfs
> group update. Keep the PCI change notification after successful device
> publication.
> 
> Fixes: 3225f52cde56 ("PCI/TSM: Establish Secure Sessions and Link Encryption")
> Signed-off-by: Aneesh Kumar K.V (Arm) <aneesh.kumar@kernel.org>
> ---
>   drivers/virt/coco/tsm-core.c | 16 ++++++++++------
>   1 file changed, 10 insertions(+), 6 deletions(-)
> 
> diff --git a/drivers/virt/coco/tsm-core.c b/drivers/virt/coco/tsm-core.c
> index f79135986102..e370806d8436 100644
> --- a/drivers/virt/coco/tsm-core.c
> +++ b/drivers/virt/coco/tsm-core.c
> @@ -71,9 +71,6 @@ static int tsm_register_pci(struct tsm_dev *tsm_dev, struct pci_tsm_ops *pci_ops
>   			"PCI/TSM registration failure: %d\n", rc);
>   		return rc;
>   	}
> -
> -	/* Notify TSM userspace that PCI/TSM operations are now possible */
> -	kobject_uevent(&tsm_dev->dev.kobj, KOBJ_CHANGE);
>   	return 0;
>   }
>   
> @@ -91,15 +88,22 @@ struct tsm_dev *tsm_register(struct device *parent, struct pci_tsm_ops *pci_ops)
>   	if (rc)
>   		return ERR_PTR(rc);
>   
> -	rc = device_add(dev);
> +	/* Complete PCI registration before exposing the TSM to class lookup. */
> +	rc = tsm_register_pci(tsm_dev, pci_ops);

I'd move the !pci_ops check from tsm_register_pci() here, to match the pci_tsm_unregister() below. Or just open code it.

>   	if (rc)
>   		return ERR_PTR(rc);
>   
> -	rc = tsm_register_pci(tsm_dev, pci_ops);

ah that's why a pointer became an int...


> +	rc = device_add(dev);
>   	if (rc) {
> -		device_del(dev);
> +		if (pci_ops)
> +			pci_tsm_unregister(tsm_dev);
>   		return ERR_PTR(rc);
>   	}
> +
> +	/* Notify TSM userspace that PCI/TSM operations are now possible. */
> +	if (pci_ops)
> +		kobject_uevent(&dev->kobj, KOBJ_CHANGE);

Why do we do this only when pci_ops!=NULL? Also, why do we even allow pci_ops==NULL?
[a minute later] ah 04/15 does just that. Make it first in the series so following patches get simpler?

01..04 can go first really.

Thanks,


> +
>   	return no_free_ptr(tsm_dev);
>   }
>   EXPORT_SYMBOL_GPL(tsm_register);

-- 
Alexey


  reply	other threads:[~2026-11-12 11:42 UTC|newest]

Thread overview: 45+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-11-04 16:16 [PATCH v8 00/15] iommufd: TSM-backed virtual IOMMUs for confidential guests Aneesh Kumar K.V (Arm)
2026-11-04 16:16 ` [PATCH v8 01/15] PCI/TSM: Move core code into its own directory Aneesh Kumar K.V (Arm)
2026-11-05 12:24   ` kernel test robot
2026-11-04 16:16 ` [PATCH v8 02/15] virt: coco: tsm: Remove the device from lookup before PCI teardown Aneesh Kumar K.V (Arm)
2026-11-06  7:04   ` Tian, Kevin
2026-11-12 11:14   ` Alexey Kardashevskiy
2026-11-04 16:16 ` [PATCH v8 03/15] virt: coco: tsm: Complete PCI registration before publishing the device Aneesh Kumar K.V (Arm)
2026-11-12 11:41   ` Alexey Kardashevskiy [this message]
2026-11-04 16:16 ` [PATCH v8 04/15] virt: coco: tsm: Require PCI operations when registering a TSM Aneesh Kumar K.V (Arm)
2026-11-04 16:16 ` [PATCH v8 05/15] iommufd/device: Associate KVM file pointer with iommufd_device Aneesh Kumar K.V (Arm)
2026-11-06  7:09   ` Tian, Kevin
2026-11-04 16:16 ` [PATCH v8 06/15] iommufd/device: Hold a KVM file reference for the device lifetime Aneesh Kumar K.V (Arm)
2026-11-06  7:16   ` Tian, Kevin
2026-11-04 16:16 ` [PATCH v8 07/15] iommufd/viommu: Keep a reference to the KVM file Aneesh Kumar K.V (Arm)
2026-11-04 16:35   ` Jacob Pan
2026-11-06  7:17   ` Tian, Kevin
2026-11-04 16:16 ` [PATCH v8 08/15] iommufd: Add a vDEVICE operation ioctl framework Aneesh Kumar K.V (Arm)
2026-11-06  7:24   ` Tian, Kevin
2026-11-04 16:16 ` [PATCH v8 09/15] PCI/TSM: Remove the legacy guest request interface Aneesh Kumar K.V (Arm)
2026-11-04 16:16 ` [PATCH v8 10/15] PCI/TSM: Add vIOMMU-bound device contexts Aneesh Kumar K.V (Arm)
2026-11-06  7:33   ` Tian, Kevin
2026-11-11 16:24     ` Aneesh Kumar K.V
2026-11-04 16:16 ` [PATCH v8 11/15] iommufd/viommu: Select vIOMMU operations before allocation Aneesh Kumar K.V (Arm)
2026-11-05  9:10   ` kernel test robot
2026-11-05 14:49   ` kernel test robot
2026-11-06  7:47   ` Tian, Kevin
2026-11-12 10:31     ` Aneesh Kumar K.V
2026-11-04 16:16 ` [PATCH v8 12/15] iommufd/viommu: Allow PCI TSM backends to provide vIOMMU operations Aneesh Kumar K.V (Arm)
2026-11-04 23:23   ` Jacob Pan
2026-11-05  0:49     ` Jason Gunthorpe
2026-11-05 17:16       ` Jacob Pan
2026-11-06  8:03         ` Tian, Kevin
2026-11-09 18:49           ` Jason Gunthorpe
2026-11-06  7:56   ` Tian, Kevin
2026-11-12 10:51     ` Aneesh Kumar K.V
2026-11-04 16:16 ` [PATCH v8 13/15] iommufd/viommu: Allow vIOMMUs without a parent HWPT Aneesh Kumar K.V (Arm)
2026-11-04 19:03   ` Nicolin Chen
2026-11-04 19:31     ` Jason Gunthorpe
2026-11-05  5:28       ` Aneesh Kumar K.V
2026-11-05 17:44         ` Nicolin Chen
2026-11-05 18:21           ` Jason Gunthorpe
2026-11-05 18:40             ` Nicolin Chen
2026-11-05 20:07               ` Jason Gunthorpe
2026-11-04 16:16 ` [PATCH v8 14/15] PCI/TSM: Wait for device contexts before removing a DSM Aneesh Kumar K.V (Arm)
2026-11-04 16:16 ` [PATCH v8 15/15] PCI/TSM: Wait for users during unregister Aneesh Kumar K.V (Arm)

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=9773f2fa-f80a-449c-9e9e-722d1c71f989@amd.com \
    --to=aik@amd.com \
    --cc=alex@shazbot.org \
    --cc=aneesh.kumar@kernel.org \
    --cc=bhelgaas@google.com \
    --cc=catalin.marinas@arm.com \
    --cc=iommu@lists.linux.dev \
    --cc=jacob.pan@linux.microsoft.com \
    --cc=jgg@ziepe.ca \
    --cc=jic23@kernel.org \
    --cc=jonathanh@nvidia.com \
    --cc=joro@8bytes.org \
    --cc=kevin.tian@intel.com \
    --cc=kvm@vger.kernel.org \
    --cc=linux-arm-kernel@lists.infradead.org \
    --cc=linux-coco@lists.linux.dev \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-pci@vger.kernel.org \
    --cc=linux-tegra@vger.kernel.org \
    --cc=lukas@wunner.de \
    --cc=nicolinc@nvidia.com \
    --cc=robin.murphy@arm.com \
    --cc=sameo@rivosinc.com \
    --cc=shameerali.kolothum.thodi@huawei.com \
    --cc=steven.price@arm.com \
    --cc=suravee.suthikulpanit@amd.com \
    --cc=suzuki.poulose@arm.com \
    --cc=thierry.reding@kernel.org \
    --cc=vasant.hegde@amd.com \
    --cc=vdumpa@nvidia.com \
    --cc=will@kernel.org \
    --cc=yilun.xu@linux.intel.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox

all inboxes | Powered by JetHome®