From: David Woodhouse <dwmw2@infradead.org>
To: "Jörg Rödel" <joro@8bytes.org>
Cc: Paolo Bonzini <pbonzini@redhat.com>,
Sean Christopherson <seanjc@google.com>,
Tom Lendacky <thomas.lendacky@amd.com>,
ashish.kalra@amd.com, michael.roth@amd.com, nsaenz@amazon.com,
anelkz@amazon.de, James.Bottomley@HansenPartnership.com,
Melody Wang <huibo.wang@amd.com>,
kvm@vger.kernel.org, linux-kernel@vger.kernel.org,
kvmarm@lists.linux.dev, loongarch@lists.linux.dev,
linux-mips@vger.kernel.org, linuxppc-dev@lists.ozlabs.org,
kvm-riscv@lists.infradead.org, x86@kernel.org,
coconut-svsm@lists.linux.dev, joerg.roedel@amd.com,
Mushahid Hussain <hmushi@amazon.co.uk>,
Sriram Nambakam <snambakam@linux.microsoft.com>,
David Woodhouse <dwmw@amazon.co.uk>
Subject: [PATCH 00/16] KVM: Fixes for the Planes + SEV-SNP series
Date: Wed, 11 Nov 2026 14:28:55 -0800 [thread overview]
Message-ID: <20261111222911.477-1-dwmw2@infradead.org> (raw)
In-Reply-To: <20260608144252.351443-1-joro@8bytes.org>
From: David Woodhouse <dwmw@amazon.co.uk>
I rebased Jörg's KVM Planes + SEV-SNP series¹ to 7.4-rc2² and used it
to add VSM support³. Here's a batch of fixes.
Thirteen of the sixteen apply in order, without conflicts, to the
kvm-planes-v7.1 branch. The other three need what has landed upstream
since v7.1: patch 1 fixes the s390 arm64 KVM module, which only
arrived in 7.4; patch 12 touches the PID-table clearing in
vmx_vcpu_free() from b41f2ca6c060; and patch 16 extends the VMSA
invalidation from d1a3c2162334.
The ones that matter:
- 01 s390: arm64: Pass plane_level to the kvm_set_routing_entry() stub
The arm64 KVM module on s390 kept the old prototype; the kernel
test robot caught it on the rebased tree.
- 05 Initialise Hyper-V state on every plane vCPU
kvm_set_cpuid() passed the plane 0 vCPU to kvm_hv_vcpu_init() for
every plane, and a twin created late got vp_index -1.
- 08 Publish a new plane only once KVM_CREATE_PLANE cannot fail
A failed create left a freed plane in kvm->planes[], where the SNP
VMPL switch could still find it, and VM teardown freed it again.
- 10 Keep current_vcpu in sync in vcpu_load()
A reschedule inside an ioctl on a plane fd put and loaded the wrong
twin, and a failed twin create left current_vcpu dangling.
- 11 Load each plane twin while updating it after KVM_SET_CPUID
On VMX the vendor callback wrote the twins' controls into the
caller's VMCS.
- 12 Leave the IPIv PID-table entry to the plane 0 vCPU
A twin has the same vCPU ID as plane 0, so creating or freeing one
repointed or cleared plane 0's entry. Latent for now, since planes
inhibit APICv.
- 13 Leave TSC matching to the plane 0 vCPUs
Each twin counted as another vCPU with a matching TSC, so the master
clock could never come back on.
- 14 Derive runtime CPUID bits from the executing plane
OSXSAVE, OSPKE, APIC, MWAIT and the XSAVE sizes follow per-plane
registers, but the table they live in is shared.
Three things I've noticed and *not* fixed here:
- The AVIC physical ID table is indexed by vCPU ID too, so it has the
same collision as the IPIv PID table in patch 12. It's masked while
APICv is inhibited for planes, as it is today.
- A host-side TSC write on plane 0 (or KVM_SET_TSC_KHZ) after the
twins exist doesn't reach them. Fixing that means loading each twin,
and I'd rather agree how before doing it.
- For Jörg and Tom: the SNP VMPL switch stops the current plane with
kvm_vcpu_set_plane_stopped() and no latch, so KVM_GET_PLANE_RUN_STATE
reports it as STOPPED, and a VMM that saves and restores that value
turns it into a userspace stop. Does VMPL want a notion of
KVM-initiated suspension of its own, or is that the intended
contract?
¹ https://lore.kernel.org/all/20260608144252.351443-1-joro@8bytes.org/
² https://git.infradead.org/?p=users/dwmw2/linux.git;a=shortlog;h=refs/heads/vsm2/planes-fixes
³ https://lore.kernel.org/kvm/20261017122501.610248-1-dwmw2@infradead.org/
David Woodhouse (14):
KVM: s390: arm64: Pass plane_level to the kvm_set_routing_entry() stub
KVM: SVM: Derive the plane limit from the immutable VM type
KVM: planes: Report KVM_MAX_PLANES from the system fd
KVM: Guard the per-plane KVM_SIGNAL_MSI cases with __KVM_HAVE_MSI
KVM: x86: Initialise Hyper-V state on every plane vCPU
KVM: x86: Widen the plane vCPU fd ioctl allowlist
KVM: x86/mmu: Free obsolete roots of all planes
KVM: planes: Publish a new plane only once KVM_CREATE_PLANE cannot
fail
KVM: planes: Kick the running twin's pCPU, not the request target's
KVM: planes: Keep current_vcpu in sync in vcpu_load()
KVM: x86: Load each plane twin while updating it after KVM_SET_CPUID
KVM: VMX: Leave the IPIv PID-table entry to the plane 0 vCPU
KVM: planes: Annotate the lockless twin-publication protocol
KVM: SVM: Make KVM_REQ_VMSA_PAGE_RELOAD per plane
Mushahid Hussain (2):
KVM: x86: Leave TSC matching to the plane 0 vCPUs
KVM: x86: Derive runtime CPUID bits from the executing plane
Documentation/virt/kvm/api.rst | 21 ++++--
arch/s390/kvm/arm64/arm.c | 3 +-
arch/x86/include/asm/kvm_host.h | 3 +-
arch/x86/kvm/cpuid.c | 128 +++++++++++++++++++++++---------
arch/x86/kvm/cpuid.h | 6 +-
arch/x86/kvm/hyperv.c | 7 +-
arch/x86/kvm/irq.c | 5 +-
arch/x86/kvm/mmu/mmu.c | 16 +++-
arch/x86/kvm/svm/sev.c | 29 ++++++--
arch/x86/kvm/svm/svm.c | 10 ++-
arch/x86/kvm/svm/svm.h | 2 -
arch/x86/kvm/vmx/vmx.c | 10 ++-
arch/x86/kvm/x86.c | 87 ++++++++++++++++++++--
include/linux/kvm_host.h | 7 +-
virt/kvm/kvm_main.c | 115 +++++++++++++++++++++++-----
15 files changed, 365 insertions(+), 84 deletions(-)
--
2.50.1
next prev parent reply other threads:[~2026-11-11 22:29 UTC|newest]
Thread overview: 97+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-06-08 14:41 [PATCH 00/60] KVM Planes + SEV-SNP Support Jörg Rödel
2026-06-08 14:41 ` [PATCH 01/60] x86/sev: Define the #HV doorbell page structure Jörg Rödel
2026-06-08 14:41 ` [PATCH 02/60] KVM: SVM: Add support for the SEV-SNP #HV doorbell page NAE event Jörg Rödel
2026-06-10 13:28 ` Tom Lendacky
2026-06-10 15:05 ` Tom Lendacky
2026-06-08 14:41 ` [PATCH 03/60] KVM: SVM: Inject #HV when Restricted Injection is active Jörg Rödel
2026-06-08 14:41 ` [PATCH 04/60] KVM: SVM: Inject NMIs " Jörg Rödel
2026-06-08 14:41 ` [PATCH 05/60] KVM: SVM: Inject MCEs " Jörg Rödel
2026-06-08 14:41 ` [PATCH 06/60] KVM: SVM: Enable Restricted Injection for an SEV-SNP guest Jörg Rödel
2026-06-08 14:41 ` [PATCH 07/60] KVM: SVM: Add support for the SEV-SNP #HV IPI NAE event Jörg Rödel
2026-06-10 13:45 ` Tom Lendacky
2026-06-08 14:42 ` [PATCH 08/60] Documentation: kvm: introduce "VM plane" concept Jörg Rödel
2026-06-08 14:42 ` [PATCH 09/60] kvm: Introduce struct kvm_plane Jörg Rödel
2026-06-08 14:42 ` [PATCH 10/60] kvm: Move vcpu_array to " Jörg Rödel
2026-06-08 14:42 ` [PATCH 11/60] kvm: Introduce struct kvm_vcpu_common Jörg Rödel
2026-06-08 14:42 ` [PATCH 12/60] kvm: Move vcpu accounting to " Jörg Rödel
2026-06-08 14:42 ` [PATCH 13/60] kvm: Add read accessors for kvm_vcpu scheduling state Jörg Rödel
2026-06-08 14:42 ` [PATCH 14/60] kvm: Make kvm_running_vcpus point to struct kvm_vcpu_common Jörg Rödel
2026-06-08 14:42 ` [PATCH 15/60] kvm: Move VCPU scheduling state " Jörg Rödel
2026-06-08 14:42 ` [PATCH 16/60] kvm: Add accessors for kvm_vcpu->mutex Jörg Rödel
2026-06-08 14:42 ` [PATCH 17/60] kvm: Move VCPU locking to struct kvm_vcpu_common Jörg Rödel
2026-06-08 14:42 ` [PATCH 18/60] kvm: Move kvm_vcpu->rcuwait " Jörg Rödel
2026-06-08 14:42 ` [PATCH 19/60] kvm: Introduce accessors for kvm_vcpu->mode Jörg Rödel
2026-06-08 14:42 ` [PATCH 20/60] kvm: Move kvm_vcpu mode and requests field to struct kvm_vcpu_common Jörg Rödel
2026-06-08 14:42 ` [PATCH 21/60] kvm: Introduce per-plane VCPU requests Jörg Rödel
2026-06-08 14:42 ` [PATCH 22/60] kvm: Move kvm_vcpu pid members to struct kvm_vcpu_common Jörg Rödel
2026-06-08 14:42 ` [PATCH 23/60] kvm: Move kvm_vcpu sigset " Jörg Rödel
2026-06-08 14:42 ` [PATCH 24/60] kvm: Move kvm_vcpu spinloop " Jörg Rödel
2026-06-08 14:42 ` [PATCH 25/60] kvm: Move kvm_vcpu->dirty_ring " Jörg Rödel
2026-06-08 14:42 ` [PATCH 26/60] kvm: Introduce arch-specific plane state Jörg Rödel
2026-06-08 14:42 ` [PATCH 27/60] kvm: Introduce arch-specific part of struct kvm_vcpu_common Jörg Rödel
2026-06-08 14:42 ` [PATCH 28/60] kvm: Implement KVM_CAP_PLANES Jörg Rödel
2026-06-08 14:42 ` [PATCH 29/60] kvm: Implement KVM_CREATE_PLANE ioctl Jörg Rödel
2026-09-11 17:54 ` Serge Hallyn
2026-06-08 14:42 ` [PATCH 30/60] kvm: Add KVM_EXIT_PLANE_EVENT Jörg Rödel
2026-06-08 14:42 ` [PATCH 31/60] kvm: Allocate struct kvm_plane in architecture code Jörg Rödel
2026-06-08 14:42 ` [PATCH 32/60] kvm: Allocate struct kvm_run only for struct kvm_vcpu_common Jörg Rödel
2026-06-08 14:42 ` [PATCH 33/60] KVM: Implement KVM_CREATE_VCPU ioctl for planes Jörg Rödel
2026-06-08 14:42 ` [PATCH 34/60] kvm: Keep track of plane VCPUs in struct kvm_vcpu_common Jörg Rödel
2026-06-08 14:42 ` [PATCH 35/60] kvm: Add VCPU plane-scheduling state and helpers Jörg Rödel
2026-06-08 16:47 ` Paolo Bonzini
2026-06-08 17:52 ` Jörg Rödel
2026-06-08 17:58 ` Paolo Bonzini
2026-06-09 12:37 ` Jörg Rödel
2026-06-09 12:59 ` James Bottomley
2026-06-09 14:27 ` Jörg Rödel
2026-06-09 15:06 ` James Bottomley
2026-07-17 13:48 ` Saenz Julienne, Nicolas
2026-07-17 15:56 ` James Bottomley
2026-07-17 17:33 ` Saenz Julienne, Nicolas
2026-07-17 18:26 ` James Bottomley
2026-07-17 14:35 ` James Bottomley
2026-09-24 14:10 ` Jörg Rödel
2026-06-08 14:42 ` [PATCH 36/60] kvm: Add plane_level to kvm_kernel_irq_routing_entry Jörg Rödel
2026-06-08 14:42 ` [PATCH 37/60] kvm: Pass plane_level to kvm_set_routing_entry() Jörg Rödel
2026-06-08 14:42 ` [PATCH 38/60] kvm: Make KVM_SIGNAL_MSI per plane Jörg Rödel
2026-06-08 14:42 ` [PATCH 39/60] kvm: Make KVM_SET_GSI_ROUTING " Jörg Rödel
2026-06-08 14:42 ` [PATCH 40/60] kvm: x86: Handle IOAPIC EOIs " Jörg Rödel
2026-06-08 14:42 ` [PATCH 41/60] kvm: x86: Make apic_map " Jörg Rödel
2026-06-08 14:42 ` [PATCH 42/60] kvm: x86: Make local APIC code aware of planes Jörg Rödel
2026-06-08 14:42 ` [PATCH 43/60] kvm: x86: Move CPUID state to struct kvm_vcpu_arch_common Jörg Rödel
2026-06-08 14:42 ` [PATCH 44/60] kvm: x86: Move cpu_caps " Jörg Rödel
2026-06-08 14:42 ` [PATCH 45/60] kvm: x86: Update state for all plane VCPUs after CPUID update Jörg Rödel
2026-06-08 14:42 ` [PATCH 46/60] kvm: x86: Share MTRR state across planes Jörg Rödel
2026-06-08 14:42 ` [PATCH 47/60] kvm: x86: Select a plane to run Jörg Rödel
2026-06-08 14:42 ` [PATCH 48/60] kvm: x86: Make event injection VCPU requests per-plane Jörg Rödel
2026-06-08 14:42 ` [PATCH 49/60] kvm: x86: Allow hardware backend to overwrite struct kvm_plane allocation Jörg Rödel
2026-06-08 14:42 ` [PATCH 50/60] kvm: x86: Make KVM_REQ_UPDATE_PROTECTED_GUEST_STATE per plane Jörg Rödel
2026-06-08 14:42 ` [PATCH 51/60] kvm: x86: Share pio_data across planes Jörg Rödel
2026-06-08 14:42 ` [PATCH 52/60] kvm: x86: Switch to plane0 if it has events Jörg Rödel
2026-06-08 14:42 ` [PATCH 53/60] kvm: x86: Introduce max_planes x86-op Jörg Rödel
2026-06-08 14:42 ` [PATCH 54/60] kvm: x86: Restrict KVM planes support to KVM_IRQCHIP_SPLIT Jörg Rödel
2026-06-08 14:42 ` [PATCH 55/60] kvm: svm: Track vmsa_features per plane Jörg Rödel
2026-06-08 14:42 ` [PATCH 56/60] kvm: svm: Implement GET_AP_APIC_IDS NAE event Jörg Rödel
2026-06-08 14:42 ` [PATCH 57/60] kvm: sev: Allow for VMPL level specification in AP create Jörg Rödel
2026-06-08 14:42 ` [PATCH 58/60] kvm: svm: Invoke a specified VMPL level VMSA for the vCPU Jörg Rödel
2026-06-08 14:42 ` [PATCH 59/60] kvm: svm: Implement max_planes x86 operation Jörg Rödel
2026-06-08 14:42 ` [PATCH 60/60] kvm: svm: Advertise full multi-VMPL support to the SNP guest Jörg Rödel
2026-06-09 9:29 ` [syzbot ci] Re: KVM Planes + SEV-SNP Support syzbot ci
2026-06-10 18:13 ` [PATCH 00/60] " Melody Wang
2026-11-11 22:28 ` David Woodhouse [this message]
2026-11-11 22:28 ` [PATCH 01/16] KVM: s390: arm64: Pass plane_level to the kvm_set_routing_entry() stub David Woodhouse
2026-11-11 22:28 ` [PATCH 02/16] KVM: SVM: Derive the plane limit from the immutable VM type David Woodhouse
2026-11-11 22:28 ` [PATCH 03/16] KVM: planes: Report KVM_MAX_PLANES from the system fd David Woodhouse
2026-11-11 22:28 ` [PATCH 04/16] KVM: Guard the per-plane KVM_SIGNAL_MSI cases with __KVM_HAVE_MSI David Woodhouse
2026-11-11 22:29 ` [PATCH 05/16] KVM: x86: Initialise Hyper-V state on every plane vCPU David Woodhouse
2026-11-11 22:29 ` [PATCH 06/16] KVM: x86: Widen the plane vCPU fd ioctl allowlist David Woodhouse
2026-11-11 22:29 ` [PATCH 07/16] KVM: x86/mmu: Free obsolete roots of all planes David Woodhouse
2026-11-11 22:29 ` [PATCH 08/16] KVM: planes: Publish a new plane only once KVM_CREATE_PLANE cannot fail David Woodhouse
2026-11-11 22:29 ` [PATCH 09/16] KVM: planes: Kick the running twin's pCPU, not the request target's David Woodhouse
2026-11-11 22:29 ` [PATCH 10/16] KVM: planes: Keep current_vcpu in sync in vcpu_load() David Woodhouse
2026-11-11 22:29 ` [PATCH 11/16] KVM: x86: Load each plane twin while updating it after KVM_SET_CPUID David Woodhouse
2026-11-11 22:29 ` [PATCH 12/16] KVM: VMX: Leave the IPIv PID-table entry to the plane 0 vCPU David Woodhouse
2026-11-11 22:29 ` [PATCH 13/16] KVM: x86: Leave TSC matching to the plane 0 vCPUs David Woodhouse
2026-11-11 22:29 ` [PATCH 14/16] KVM: x86: Derive runtime CPUID bits from the executing plane David Woodhouse
2026-11-11 22:29 ` [PATCH 15/16] KVM: planes: Annotate the lockless twin-publication protocol David Woodhouse
2026-11-11 22:29 ` [PATCH 16/16] KVM: SVM: Make KVM_REQ_VMSA_PAGE_RELOAD per plane David Woodhouse
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20261111222911.477-1-dwmw2@infradead.org \
--to=dwmw2@infradead.org \
--cc=James.Bottomley@HansenPartnership.com \
--cc=anelkz@amazon.de \
--cc=ashish.kalra@amd.com \
--cc=coconut-svsm@lists.linux.dev \
--cc=dwmw@amazon.co.uk \
--cc=hmushi@amazon.co.uk \
--cc=huibo.wang@amd.com \
--cc=joerg.roedel@amd.com \
--cc=joro@8bytes.org \
--cc=kvm-riscv@lists.infradead.org \
--cc=kvm@vger.kernel.org \
--cc=kvmarm@lists.linux.dev \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mips@vger.kernel.org \
--cc=linuxppc-dev@lists.ozlabs.org \
--cc=loongarch@lists.linux.dev \
--cc=michael.roth@amd.com \
--cc=nsaenz@amazon.com \
--cc=pbonzini@redhat.com \
--cc=seanjc@google.com \
--cc=snambakam@linux.microsoft.com \
--cc=thomas.lendacky@amd.com \
--cc=x86@kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®