From: Wanpeng Li <kernellwp@gmail.com>
To: linux-kernel@vger.kernel.org, kvm@vger.kernel.org
Cc: "Paolo Bonzini" <pbonzini@redhat.com>,
"Radim Krčmář" <rkrcmar@redhat.com>,
"Peter Zijlstra" <peterz@infradead.org>,
"Wanpeng Li" <wanpeng.li@hotmail.com>
Subject: [PATCH v3 0/4] KVM: Paravirt remote TLB flush
Date: Fri, 10 Nov 2017 01:49:43 -0800 [thread overview]
Message-ID: <1510307387-14812-1-git-send-email-wanpeng.li@hotmail.com> (raw)
Remote flushing api's does a busy wait which is fine in bare-metal
scenario. But with-in the guest, the vcpus might have been pre-empted
or blocked. In this scenario, the initator vcpu would end up
busy-waiting for a long amount of time.
This patch set implements para-virt flush tlbs making sure that it
does not wait for vcpus that are sleeping. And all the sleeping vcpus
flush the tlb on guest enter. Idea was discussed here:
https://lkml.org/lkml/2012/2/20/157
The best result is achieved when we're overcommiting the host by running
multiple vCPUs on each pCPU. In this case PV tlb flush avoids touching
vCPUs which are not scheduled and avoid the wait on the main CPU.
In addition, thanks for commit 9e52fc2b50d ("x86/mm: Enable RCU based
page table freeing (CONFIG_HAVE_RCU_TABLE_FREE=y)")
Test on a Haswell i7 desktop 4 cores (2HT), so 8 pCPUs, running ebizzy in
one linux guest.
ebizzy -M
vanilla optimized boost
8 vCPUs 10152 10083 -0.68%
16 vCPUs 1224 4866 297.5%
24 vCPUs 1109 3871 249%
32 vCPUs 1025 3375 229.3%
Note: The patchset is rebased against "locking/qspinlock/x86: Avoid
test-and-set when PV_DEDICATED is set" v3
v2 -> v3:
* percpu cpumask
v1 -> v2:
* a new CPUID feature bit
* fix cmpxchg check
* use kvm_vcpu_flush_tlb() to get the statistics right
* just OR the KVM_VCPU_PREEMPTED in kvm_steal_time_set_preempted
* add a new bool argument to kvm_x86_ops->tlb_flush
* __cpumask_clear_cpu() instead of cpumask_clear_cpu()
* not put cpumask_t on stack
* rebase the patchset against "locking/qspinlock/x86: Avoid
test-and-set when PV_DEDICATED is set" v3
Wanpeng Li (4):
KVM: Add vCPU running/preempted state
KVM: Add paravirt remote TLB flush
KVM: X86: introduce invalidate_gpa argument to tlb flush
KVM: Add flush_on_enter before guest enter
Documentation/virtual/kvm/cpuid.txt | 10 +++++++++
arch/x86/include/asm/kvm_host.h | 2 +-
arch/x86/include/uapi/asm/kvm_para.h | 6 +++++
arch/x86/kernel/kvm.c | 43 ++++++++++++++++++++++++++++++++++--
arch/x86/kvm/cpuid.c | 3 ++-
arch/x86/kvm/svm.c | 14 ++++++------
arch/x86/kvm/vmx.c | 21 +++++++++---------
arch/x86/kvm/x86.c | 24 ++++++++++++--------
8 files changed, 93 insertions(+), 30 deletions(-)
--
2.7.4
next reply other threads:[~2017-11-10 9:50 UTC|newest]
Thread overview: 13+ messages / expand[flat|nested] mbox.gz Atom feed top
2017-11-10 9:49 Wanpeng Li [this message]
2017-11-10 9:49 ` [PATCH v3 1/4] KVM: Add vCPU running/preempted state Wanpeng Li
2017-11-10 9:49 ` [PATCH v3 2/4] KVM: Add paravirt remote TLB flush Wanpeng Li
2017-11-10 10:06 ` Peter Zijlstra
2017-11-10 9:49 ` [PATCH v3 3/4] KVM: X86: introduce invalidate_gpa argument to tlb flush Wanpeng Li
2017-11-10 9:49 ` [PATCH v3 4/4] KVM: Add flush_on_enter before guest enter Wanpeng Li
2017-11-10 10:07 ` Peter Zijlstra
2017-11-13 0:38 ` Wanpeng Li
2017-11-10 10:08 ` Peter Zijlstra
2017-11-10 10:15 ` Paolo Bonzini
2017-11-10 10:31 ` Peter Zijlstra
2017-11-10 16:49 ` Paolo Bonzini
2017-11-10 12:43 ` [PATCH v3 0/4] KVM: Paravirt remote TLB flush David Hildenbrand
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1510307387-14812-1-git-send-email-wanpeng.li@hotmail.com \
--to=kernellwp@gmail.com \
--cc=kvm@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=pbonzini@redhat.com \
--cc=peterz@infradead.org \
--cc=rkrcmar@redhat.com \
--cc=wanpeng.li@hotmail.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®