mirror of https://lore.kernel.org/lkml/
 help / color / mirror / Atom feed
From: Sean Christopherson <seanjc@google.com>
To: Yosry Ahmed <yosry@kernel.org>
Cc: Jim Mattson <jmattson@google.com>,
	Paolo Bonzini <pbonzini@redhat.com>,
	 Maxim Levitsky <mlevitsk@redhat.com>,
	Vitaly Kuznetsov <vkuznets@redhat.com>,
	 Tom Lendacky <thomas.lendacky@amd.com>,
	kvm@vger.kernel.org, linux-kernel@vger.kernel.org,
	 David Woodhouse <dwmw@amazon.co.uk>
Subject: Re: [PATCH v3 26/27] KVM: nSVM: Use different ASIDs for L1 and L2
Date: Mon, 26 Oct 2026 10:33:12 -0700	[thread overview]
Message-ID: <at-O2HiN-y5M4R_D@google.com> (raw)
In-Reply-To: <CAO9r8zMdu+YyPb3RhdTDzYteRAE9dBqxTQZKSajm4eYZCp9Y9Q@mail.gmail.com>

On Mon, Oct 19, 2026, Yosry Ahmed wrote:
> On Mon, Oct 19, 2026 at 11:50 AM Jim Mattson <jmattson@google.com> wrote:
> >
> > On Fri, Oct 16, 2026 at 5:25 PM Yosry Ahmed <yosry@kernel.org> wrote:
> > >
> > > On Fri, Oct 16, 2026 at 02:17:30PM -0700, Jim Mattson wrote:
> > > > On Mon, Oct 12, 2026 at 4:37 PM Yosry Ahmed <yosry@kernel.org> wrote:
> > > > >
> > [ ... ]
> > > > Per the APM, volume 2, Section 15.16.1, "TLB Flush":
> > > >
> > > > > All TLB entries belonging to all ASIDs are flushed by SMI, RSM, MTRR modifications, IORR modifications, and access to other system MSRs that affect address translation.
> > > >
> > > > With two separate ASIDs and the unconditional flush removed, do we
> > > > flush both ASIDs in the above instances?
> > >
> > > SMI and RSM, yeah I think so. kvm_smm_changed() ->
> > > kvm_mmu_reset_context() deletes all roots, and kvm_mmu_load() will flush

s/deletes/unloads, because the roots themselves are almost always still reachable
through the hashed list of shadow pages.

> > > the current ASID when a new root is loaded.
> >
> > Okay. Is this mechanism obvious to those who are versed in the ways of
> > the KVM MMU?
> 
> I don't consider myself versed in the ways of the KVM MMU, it took me
> a few minutes to track this done, so I think it's okay.

No, it's not ok, though it's also not something that needs to be addressed in
this series.  Historically, KVM relied on kvm_mmu_reset_context() to perform TLB
flushes basically everywhere, e.g. on CR0 and CR4 writes.  It was a nightmare
on multiple fronts, e.g. it was suboptimal when toggling bits that needed a TLB
flush but not a full MMU rebuild, and understanding whether KVM was deliberately
doing TLB flushes or not was difficult, which in turn made trying to optimize
any of that code very painful because it meant disentangling years of KVM code
*and* pouring over the SDM and APM to make sure we got the TLB flushes right.

In short, the fact that kvm_mmu_reset_context() happens to guarantee a TLB flush
of the new/current root is a side effect and an implementation detail.  If a TLB
flush (for the guest) is architecturally required, then KVM should emulate that
exact requirement, even if it means queueing up what will be redundant flushes.
That makes it easier for newcomers to follow the code, and gives us more freedom
to tweak and optimize MMU context changes/resets.

Concretely:

  Author:     Paolo Bonzini <pbonzini@redhat.com>
  AuthorDate: Mon Feb 14 11:50:36 2022 -0500
  Commit:     Paolo Bonzini <pbonzini@redhat.com>
  CommitDate: Tue Mar 1 08:50:42 2022 -0500

    KVM: x86: flush TLB separately from MMU reset
    
    For both CR0 and CR4, disassociate the TLB flush logic from the
    MMU role logic.  Instead  of relying on kvm_mmu_reset_context() being
    a superset of various TLB flushes (which is not necessarily going to
    be the case in the future), always call it if the role changes
    but also set the various TLB flush requests according to what is
    in the manual.

For SVM, the redundant flushes are a complete non-issue.  It's basically an extra
memory write.

For VMX, the INVVPID isn't free, but for emulated SMM I can't imagine it's a
meaningful performance issue.  And FWIW, the only reason not doing
KVM_REQ_TLB_FLUSH_GUEST isn't a bug is because hardware isn't allowed to cache
linear mappings when EPT is in used (and INVEPT invalidates both guest-physical
and combined mappings).

  reply	other threads:[~2026-10-26 17:33 UTC|newest]

Thread overview: 89+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-10-12 23:36 [PATCH v3 00/27] KVM: nSVM: Optimize nSVM TLB flushes Yosry Ahmed
2026-10-12 23:36 ` [PATCH v3 01/27] KVM: nSVM: Flush the TLB after forcefully leaving nested Yosry Ahmed
2026-10-14 15:02   ` Jim Mattson
2026-10-14 15:18     ` Yosry Ahmed
2026-10-16 19:32       ` Jim Mattson
2026-10-12 23:36 ` [PATCH v3 02/27] KVM: SVM: Document number of ASIDs CPUID setting Yosry Ahmed
2026-10-14 15:07   ` Jim Mattson
2026-10-12 23:36 ` [PATCH v3 03/27] KVM: VMX: Generalize VPID allocation to be vendor-neutral Yosry Ahmed
2026-10-14 18:22   ` Jim Mattson
2026-10-14 20:38     ` Yosry Ahmed
2026-10-16 19:34       ` Jim Mattson
2026-10-12 23:36 ` [PATCH v3 04/27] KVM: x86/mmu: Support specifying reserved TLB tags Yosry Ahmed
2026-10-14 21:49   ` Jim Mattson
2026-10-14 22:07     ` Yosry Ahmed
2026-10-12 23:36 ` [PATCH v3 05/27] KVM: SVM: Add helpers to set/clear ASID flush in VMCB Yosry Ahmed
2026-10-14 22:00   ` Jim Mattson
2026-10-14 22:03     ` Yosry Ahmed
2026-10-14 22:22       ` Jim Mattson
2026-10-14 22:25         ` Yosry Ahmed
2026-10-14 22:32           ` Jim Mattson
2026-10-12 23:36 ` [PATCH v3 06/27] KVM: SVM: Fallback to flush everything if FLUSHBYASID is not available Yosry Ahmed
2026-10-14 22:45   ` Jim Mattson
2026-10-14 22:50     ` Yosry Ahmed
2026-10-14 23:27       ` Jim Mattson
2026-10-12 23:36 ` [PATCH v3 07/27] KVM: SEV: Do ASID initialization at VMCB initialization Yosry Ahmed
2026-10-14 23:31   ` Jim Mattson
2026-10-12 23:36 ` [PATCH v3 08/27] KVM: SEV: Expose sev_get_asid() outside of sev.c Yosry Ahmed
2026-10-14 23:33   ` Jim Mattson
2026-10-12 23:36 ` [PATCH v3 09/27] KVM: SEV: Explicitly initialize the per vCPU ASID on SEV VM migration Yosry Ahmed
2026-10-14 23:35   ` Jim Mattson
2026-10-12 23:36 ` [PATCH v3 10/27] KVM: SVM: Use a static ASID per vCPU Yosry Ahmed
2026-10-12 23:36 ` [PATCH v3 11/27] KVM: SVM: Only flush the fallback ASID when used by a different vCPU Yosry Ahmed
2026-10-15 21:44   ` Jim Mattson
2026-10-15 22:03     ` Yosry Ahmed
2026-10-16 19:36       ` Jim Mattson
2026-10-12 23:36 ` [PATCH v3 12/27] KVM: nSVM: Drop svm->nested.initialized Yosry Ahmed
2026-10-15 21:48   ` Jim Mattson
2026-10-12 23:36 ` [PATCH v3 13/27] KVM: nSVM: Add a placeholder ASID for L2 Yosry Ahmed
2026-10-15 21:55   ` Jim Mattson
2026-10-15 22:10     ` Yosry Ahmed
2026-10-15 22:21       ` Jim Mattson
2026-10-15 22:27         ` Yosry Ahmed
2026-10-12 23:36 ` [PATCH v3 14/27] KVM: x86: hyper-v: Rename kvm_hv_vcpu_purge_flush_tlb() Yosry Ahmed
2026-10-15 21:58   ` Jim Mattson
2026-10-12 23:36 ` [PATCH v3 15/27] KVM: x86: hyper-v: Allow purging all TLB flush FIFOs Yosry Ahmed
2026-10-15 22:02   ` Jim Mattson
2026-10-12 23:36 ` [PATCH v3 16/27] KVM: nSVM: Flush both L1 and L2 ASIDs on KVM_REQ_TLB_FLUSH Yosry Ahmed
2026-10-15 22:05   ` Jim Mattson
2026-10-12 23:36 ` [PATCH v3 17/27] KVM: nSVM: Always switch VMCB before leaving guest mode Yosry Ahmed
2026-10-15 22:08   ` Jim Mattson
2026-10-12 23:36 ` [PATCH v3 18/27] KVM: nSVM: Split nested_svm_transition_tlb_flush() into entry/exit fns Yosry Ahmed
2026-10-15 22:10   ` Jim Mattson
2026-10-12 23:36 ` [PATCH v3 19/27] KVM: nSVM: Service local TLB flushes before nested transitions Yosry Ahmed
2026-10-15 22:19   ` Jim Mattson
2026-10-15 22:34     ` Yosry Ahmed
2026-10-16 19:39       ` Jim Mattson
2026-10-12 23:36 ` [PATCH v3 20/27] KVM: x86: Add KVM_REQ_MMU_SYNC_ALL_ROOTS Yosry Ahmed
2026-10-15 22:24   ` Jim Mattson
2026-10-12 23:36 ` [PATCH v3 21/27] KVM: nSVM: Handle nested TLB flush requests through TLB_CONTROL Yosry Ahmed
2026-10-15 22:33   ` Jim Mattson
2026-10-12 23:36 ` [PATCH v3 22/27] KVM: nSVM: Flush the TLB if L1 changes L2's ASID in vmcb12 Yosry Ahmed
2026-10-15 23:09   ` Jim Mattson
2026-10-15 23:20     ` Yosry Ahmed
2026-10-15 23:50       ` Jim Mattson
2026-10-15 23:56         ` Yosry Ahmed
2026-10-16 19:24           ` Jim Mattson
2026-10-12 23:36 ` [PATCH v3 23/27] KVM: nSVM: Do not reset TLB_CONTROL in vmcb02 on nested VM-Enter Yosry Ahmed
2026-10-15 23:16   ` Jim Mattson
2026-10-15 23:22     ` Yosry Ahmed
2026-10-12 23:36 ` [PATCH v3 24/27] KVM: nSVM: Flush L2's ASID when emulating INVLPGA Yosry Ahmed
2026-10-15 23:37   ` Jim Mattson
2026-10-15 23:42     ` Yosry Ahmed
2026-10-16  0:53       ` Sean Christopherson
2026-10-16 19:41         ` Jim Mattson
2026-10-12 23:36 ` [PATCH v3 25/27] KVM: nSVM: Flush the ASID on nested transitions if shared by L1 and L2 Yosry Ahmed
2026-10-15 23:42   ` Jim Mattson
2026-10-12 23:36 ` [PATCH v3 26/27] KVM: nSVM: Use different ASIDs for " Yosry Ahmed
2026-10-16 21:17   ` Jim Mattson
2026-10-17  0:25     ` Yosry Ahmed
2026-10-19 18:49       ` Jim Mattson
2026-10-19 19:51         ` Yosry Ahmed
2026-10-26 17:33           ` Sean Christopherson [this message]
2026-10-22 22:44     ` Sean Christopherson
2026-10-22 22:45       ` Yosry Ahmed
2026-10-26 17:33         ` Sean Christopherson
2026-10-26 18:06           ` Yosry Ahmed
2026-10-12 23:36 ` [PATCH v3 27/27] KVM: selftests: Add a test for nested TLB flushes Yosry Ahmed
2026-10-14 13:23 ` [PATCH v3 00/27] KVM: nSVM: Optimize nSVM " Jim Mattson
2026-10-14 14:37   ` Yosry Ahmed

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=at-O2HiN-y5M4R_D@google.com \
    --to=seanjc@google.com \
    --cc=dwmw@amazon.co.uk \
    --cc=jmattson@google.com \
    --cc=kvm@vger.kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=mlevitsk@redhat.com \
    --cc=pbonzini@redhat.com \
    --cc=thomas.lendacky@amd.com \
    --cc=vkuznets@redhat.com \
    --cc=yosry@kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox

all inboxes | Powered by JetHome®