From: Samiullah Khawaja <skhawaja@google.com>
To: Baolu Lu <baolu.lu@linux.intel.com>
Cc: Joerg Roedel <joro@8bytes.org>, Will Deacon <will@kernel.org>,
Jason Gunthorpe <jgg@ziepe.ca>,
David Woodhouse <dwmw2@infradead.org>,
Pranjal Shrivastava <praan@google.com>,
Robin Murphy <robin.murphy@arm.com>,
Kevin Tian <kevin.tian@intel.com>,
Alex Williamson <alex@shazbot.org>,
Shuah Khan <shuah@kernel.org>,
iommu@lists.linux.dev, linux-kernel@vger.kernel.org,
kvm@vger.kernel.org, Pratyush Yadav <pratyush@kernel.org>,
Pasha Tatashin <pasha.tatashin@soleen.com>,
David Matlack <dmatlack@google.com>,
Andrew Morton <akpm@linux-foundation.org>,
Vipin Sharma <vipinsh@google.com>,
Ankit Soni <Ankit.Soni@amd.com>,
Nicolin Chen <nicolinc@nvidia.com>,
John Starks <dev@jstarks.net>
Subject: Re: [PATCH v6 08/18] iommu: Add APIs to get iommu and device preserved state
Date: Sat, 31 Oct 2026 01:55:29 +0000 [thread overview]
Message-ID: <auVJWkRz7C_Cs78m@google.com> (raw)
In-Reply-To: <7e73da77-3cd2-491a-9ea2-68263f2b5d71@linux.intel.com>
On Fri, Oct 30, 2026 at 02:03:01PM +0800, Baolu Lu wrote:
>On 10/25/2026 10:19 AM, Samiullah Khawaja wrote:
>>The preserved state of the device and IOMMU needs to be fetched during
>>shutdown and boot in the next kernel. Add APIs that can be used to fetch
>>the preserved state of a device and IOMMU. The APIs will only be used
>>during shutdown and after liveupdate so no locking needed.
>>
>>Reviewed-by: Pranjal Shrivastava <praan@google.com>
>>Signed-off-by: Samiullah Khawaja <skhawaja@google.com>
>>---
>> drivers/iommu/liveupdate.c | 88 ++++++++++++++++++++++++++++++++
>> include/linux/iommu-liveupdate.h | 70 +++++++++++++++++++++++++
>> 2 files changed, 158 insertions(+)
>>
>
>[...]
>
>>+
>>+/**
>>+ * iommu_get_preserved_data() - Get preserved data for an IOMMU HW
>>+ * @token: Token used to preserve this IOMMU HW
>>+ * @type: IOMMU type in preserved state
>>+ *
>>+ * Gets the preserved state of an IOMMU HW using token and the IOMMU type.
>>+ *
>>+ * Return: struct iommu_hw_ser on success, NULL if no preserved state found.
>>+ */
>>+struct iommu_hw_ser *iommu_get_preserved_data(u64 token, enum iommu_type_ser type)
>>+{
>>+ struct iommu_hw_ser *iommu_ser;
>>+ struct iommu_flb_obj *flb_obj;
>>+ struct kho_block_set_it it;
>>+ int ret;
>>+
>>+ ret = iommu_liveupdate_flb_get_incoming(&flb_obj);
>
>iommu_get_preserved_data() returns the incoming state, while
>iommu_preserved_state() returns the outgoing state. The naming is
>confusing.
>
>How about using "preserved" for the old kernel before kexec and
>"restored" for the new kernel after kexec? For example,
>iommu_get_restored_state() would be consistent with
>dev_iommu_restored_state() and iommu_domain_restored_state().
Agreed. This makes it consistent. I will update this, and rename
iommu_for_each_preserved_device() the same way since it also walks the
restored state.
>
>>+ if (ret)
>>+ return NULL;
>>+
>>+ iommu_ser_set_for_each(&flb_obj->iommu_set, it, iommu_ser) {
>>+ if (iommu_ser->token == token && iommu_ser->type == type)
>>+ break;
>>+ }
>>+
>>+ liveupdate_flb_put_incoming(&iommu_flb);
>>+ return iommu_ser;
>>+}
>>+EXPORT_SYMBOL(iommu_get_preserved_data);
>
>Why are different export macros used in the same file?
>
> EXPORT_SYMBOL(iommu_get_preserved_data);
> EXPORT_SYMBOL_GPL(iommu_preserve_domain);
>
>Should these all be EXPORT_SYMBOL_GPL?
Agreed. Will update.
>
>>+
>> /**
>> * iommu_preserve_domain() - Preserve an IOMMU domain across live update
>> * @domain: Domain to preserve
>>diff --git a/include/linux/iommu-liveupdate.h b/include/linux/iommu-liveupdate.h
>>index cdf8a82b7f1d..10fcdd41c7a1 100644
>>--- a/include/linux/iommu-liveupdate.h
>>+++ b/include/linux/iommu-liveupdate.h
>>@@ -13,6 +13,16 @@
>> #include <linux/liveupdate.h>
>> #include <linux/kho/abi/iommu.h>
>>+/**
>>+ * iommu_preserved_device_iter_fn - Callback for iterating preserved devices
>>+ * @ser: Pointer to serialized device state
>>+ * @arg: User-defined context argument
>>+ *
>>+ * Return: 0 to continue iteration, or a negative error code to abort.
>>+ */
>>+typedef int (*iommu_preserved_device_iter_fn)(struct iommu_device_ser *ser,
>>+ void *arg);
>>+
>> #ifdef CONFIG_IOMMU_LIVEUPDATE
>> int iommu_liveupdate_register_flb(struct liveupdate_file_handler *handler);
>> void iommu_liveupdate_unregister_flb(struct liveupdate_file_handler *handler);
>>@@ -52,6 +62,46 @@ static inline void *dev_iommu_preserved_state(struct device *dev)
>> return NULL;
>> }
>>+/**
>>+ * iommu_domain_restored_state() - Get restored state of an IOMMU domain
>>+ * @domain: Pointer to struct iommu_domain to get restored state of.
>>+ *
>>+ * Return: Pointer to restored state on success, NULL on error.
>>+ */
>>+static inline void *iommu_domain_restored_state(struct iommu_domain *domain)
>>+{
>>+ struct iommu_domain_ser *ser;
>>+
>>+ ser = domain->domain_ser;
>>+ if (ser && (ser->hdr.flags & IOMMU_SER_FLAG_INCOMING))
>>+ return ser;
>>+
>>+ return NULL;
>>+}
>>+
>>+/**
>>+ * dev_iommu_restored_state() - Get restored state of a device
>>+ * @dev: Target device
>>+ *
>>+ * Return: Restored state pointer or NULL.
>>+ */
>>+static inline void *dev_iommu_restored_state(struct device *dev)
>>+{
>>+ struct iommu_device_ser *ser;
>>+
>>+ if (!dev->iommu)
>>+ return NULL;
>>+
>>+ ser = READ_ONCE(dev->iommu->device_ser);
>>+ if (ser && (ser->hdr.flags & IOMMU_SER_FLAG_INCOMING))
>>+ return ser;
>>+
>>+ return NULL;
>>+}
>>+
>>+int iommu_for_each_preserved_device(iommu_preserved_device_iter_fn fn,
>>+ void *arg);
>>+struct iommu_hw_ser *iommu_get_preserved_data(u64 token, enum iommu_type_ser type);
>> int iommu_preserve_domain(struct iommu_domain *domain, struct iommu_domain_ser **ser);
>> void iommu_unpreserve_domain(struct iommu_domain *domain);
>> int iommu_preserve_device(struct iommu_domain *domain,
>>@@ -88,6 +138,26 @@ static inline void *dev_iommu_preserved_state(struct device *dev)
>> return NULL;
>> }
>>+static inline void *dev_iommu_restored_state(struct device *dev)
>>+{
>>+ return NULL;
>>+}
>>+
>>+static inline void *iommu_domain_restored_state(struct iommu_domain *domain)
>>+{
>>+ return NULL;
>>+}
>>+
>>+static inline int iommu_for_each_preserved_device(iommu_preserved_device_iter_fn fn, void *arg)
>>+{
>>+ return -EOPNOTSUPP;
>>+}
>>+
>>+static inline struct iommu_hw_ser *iommu_get_preserved_data(u64 token, enum iommu_type_ser type)
>>+{
>>+ return NULL;
>>+}
>>+
>> static inline int iommu_preserve_domain(struct iommu_domain *domain, struct iommu_domain_ser **ser)
>> {
>> return -EOPNOTSUPP;
>
>Thanks,
>baolu
Thanks,
Sami
next prev parent reply other threads:[~2026-10-31 1:55 UTC|newest]
Thread overview: 54+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-10-25 2:19 [PATCH v6 00/18] iommu: Add live update state preservation Samiullah Khawaja
2026-10-25 2:19 ` [PATCH v6 01/18] iommu: Implement IOMMU Live update FLB callbacks Samiullah Khawaja
2026-10-25 2:19 ` [PATCH v6 02/18] iommu/pages: Add APIs to preserve/unpreserve/restore iommu pages Samiullah Khawaja
2026-10-30 1:26 ` Baolu Lu
2026-10-30 19:41 ` Samiullah Khawaja
2026-10-25 2:19 ` [PATCH v6 03/18] iommupt: Implement preserve/unpreserve/restore callbacks Samiullah Khawaja
2026-10-30 3:07 ` Baolu Lu
2026-10-30 19:42 ` Samiullah Khawaja
2026-10-25 2:19 ` [PATCH v6 04/18] iommu: Implement IOMMU domain preservation Samiullah Khawaja
2026-10-30 4:24 ` Baolu Lu
2026-10-25 2:19 ` [PATCH v6 05/18] iommu: Implement device and IOMMU HW preservation Samiullah Khawaja
2026-10-30 5:12 ` Baolu Lu
2026-10-31 1:45 ` Samiullah Khawaja
2026-10-31 3:04 ` Baolu Lu
2026-10-31 3:39 ` Samiullah Khawaja
2026-10-31 5:27 ` Baolu Lu
2026-10-31 5:34 ` Baolu Lu
2026-10-25 2:19 ` [PATCH v6 06/18] iommu/vt-d: Implement device and iommu preserve/unpreserve ops Samiullah Khawaja
2026-10-28 1:51 ` Baolu Lu
2026-10-28 3:10 ` Samiullah Khawaja
2026-10-25 2:19 ` [PATCH v6 07/18] iommu/vt-d: Clear unpreserved context entries during shutdown Samiullah Khawaja
2026-10-28 3:18 ` Baolu Lu
2026-10-29 0:34 ` Samiullah Khawaja
2026-10-29 3:18 ` Baolu Lu
2026-10-29 22:00 ` Samiullah Khawaja
2026-10-25 2:19 ` [PATCH v6 08/18] iommu: Add APIs to get iommu and device preserved state Samiullah Khawaja
2026-10-30 6:03 ` Baolu Lu
2026-10-31 1:55 ` Samiullah Khawaja [this message]
2026-10-25 2:19 ` [PATCH v6 09/18] iommu/vt-d: Combine disable_dmar_iommu() and free_dmar_iommu() Samiullah Khawaja
2026-10-28 6:01 ` Baolu Lu
2026-10-29 0:33 ` Samiullah Khawaja
2026-10-25 2:19 ` [PATCH v6 10/18] iommu/vt-d: Restore IOMMU state and reclaimed domain ids Samiullah Khawaja
2026-10-28 7:14 ` Baolu Lu
2026-10-29 0:32 ` Samiullah Khawaja
2026-10-25 2:19 ` [PATCH v6 11/18] iommu/vt-d: Preserve PASID table of preserved device Samiullah Khawaja
2026-10-29 7:42 ` Baolu Lu
2026-10-25 2:19 ` [PATCH v6 12/18] iommu: Restore and reattach preserved domains to devices Samiullah Khawaja
2026-10-25 2:19 ` [PATCH v6 13/18] iommu/vt-d: Handle reattach of the restored domain Samiullah Khawaja
2026-10-29 8:28 ` Baolu Lu
2026-10-29 22:34 ` Samiullah Khawaja
2026-10-29 23:38 ` Baolu Lu
2026-10-30 19:39 ` Samiullah Khawaja
2026-10-25 2:19 ` [PATCH v6 14/18] iommufd: Implement ioctl to mark HWPT for preservation Samiullah Khawaja
2026-10-30 7:20 ` Baolu Lu
2026-10-31 1:48 ` Samiullah Khawaja
2026-10-25 2:19 ` [PATCH v6 15/18] iommufd: Persist iommu hardware pagetables for live update Samiullah Khawaja
2026-10-31 2:46 ` Baolu Lu
2026-10-31 3:24 ` Samiullah Khawaja
2026-10-25 2:19 ` [PATCH v6 16/18] iommufd: Add APIs to preserve/unpreserve a vfio cdev Samiullah Khawaja
2026-10-31 3:31 ` Baolu Lu
2026-10-31 3:57 ` Samiullah Khawaja
2026-10-25 2:19 ` [PATCH v6 17/18] vfio/pci: Preserve the iommufd state of the " Samiullah Khawaja
2026-10-31 5:56 ` Baolu Lu
2026-10-25 2:19 ` [PATCH v6 18/18] iommufd/selftest: Add test to verify iommufd preservation Samiullah Khawaja
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=auVJWkRz7C_Cs78m@google.com \
--to=skhawaja@google.com \
--cc=Ankit.Soni@amd.com \
--cc=akpm@linux-foundation.org \
--cc=alex@shazbot.org \
--cc=baolu.lu@linux.intel.com \
--cc=dev@jstarks.net \
--cc=dmatlack@google.com \
--cc=dwmw2@infradead.org \
--cc=iommu@lists.linux.dev \
--cc=jgg@ziepe.ca \
--cc=joro@8bytes.org \
--cc=kevin.tian@intel.com \
--cc=kvm@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=nicolinc@nvidia.com \
--cc=pasha.tatashin@soleen.com \
--cc=praan@google.com \
--cc=pratyush@kernel.org \
--cc=robin.murphy@arm.com \
--cc=shuah@kernel.org \
--cc=vipinsh@google.com \
--cc=will@kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®