mirror of https://lore.kernel.org/lkml/
 help / color / mirror / Atom feed
From: Masami Hiramatsu (Google) <mhiramat@kernel.org>
To: Sean Christopherson <seanjc@google.com>
Cc: Steven Rostedt <rostedt@goodmis.org>,
	Peter Zijlstra <peterz@infradead.org>,
	Ingo Molnar <mingo@kernel.org>,
	x86@kernel.org, Jinchao Wang <wangjinchao600@gmail.com>,
	Mathieu Desnoyers <mathieu.desnoyers@efficios.com>,
	Thomas Gleixner <tglx@linutronix.de>,
	Borislav Petkov <bp@alien8.de>,
	Dave Hansen <dave.hansen@linux.intel.com>,
	"H . Peter Anvin" <hpa@zytor.com>,
	Alexander Shishkin <alexander.shishkin@linux.intel.com>,
	Ian Rogers <irogers@google.com>,
	linux-kernel@vger.kernel.org, linux-trace-kernel@vger.kernel.org,
	linux-doc@vger.kernel.org, linux-perf-users@vger.kernel.org,
	Paolo Bonzini <pbonzini@redhat.com>,
	kvm@vger.kernel.org
Subject: Re: [PATCH v16 02/13] KVM: x86: Prevent host DR7 debug register leak into guest OS on NMI
Date: Thu, 17 Sep 2026 08:45:26 +0900	[thread overview]
Message-ID: <20260917084526.18128cef47424990d42bb6ce@kernel.org> (raw)
In-Reply-To: <aqgGRKOE138ePqmX@google.com>

Hi Sean,

Thanks for your review!

On Mon, 14 Sep 2026 07:35:48 -0700
Sean Christopherson <seanjc@google.com> wrote:

> On Mon, Sep 14, 2026, Masami Hiramatsu (Google) wrote:
> > From: Masami Hiramatsu (Google) <mhiramat@kernel.org>
> > 
> > When KVM enters a guest OS, host hardware breakpoints are disabled
> > before running the guest. However, an NMI can occur during guest
> > execution, where local_db_save() or arch_install_hw_breakpoint()
> > can be invoked.
> > 
> > In particular, if local_db_save() or arch_install_hw_breakpoint()
> > is executed from NMI, hardware DR7 can be modified or restored with
> > host breakpoint settings, leaking host breakpoints into the guest OS
> > or clobbering the guest's debug registers.
> 
> Not for local_db_save(), at least not AFAICT.  On VM-Exit, both Intel and AMD
> purge DR7, i.e. load 0x400, so local_db_save() => local_db_restore() is more or
> less a nop.  Even if that weren't the case, actually saving/restoring DR7 would
> be the right thing to do, in any context.

OK.

> 
> > Introduce a per-CPU flag, cpu_dr_in_guest, to indicate that the CPU
> > is executing in guest mode. Set this flag in vcpu_enter_guest()
> > during entering the guest with disabling host breakpoints.
> > If this flag is set, local_db_save() and local_db_restore() return
> > immediately, and arch_install_hw_breakpoint() returns an error.
> > In addition, protect cpu_dr_in_guest in within_cpu_entry() to
> > prevent recursive #DB exceptions.
> > 
> > Fixes: f85d40160691 ("KVM: X86: Disable hardware breakpoints unconditionally before kvm_x86->run()")
> > Assisted-by: Antigravity:gemini-3.8-flash
> > Signed-off-by: Masami Hiramatsu (Google) <mhiramat@kernel.org>
> > ---
> > Changes in v16:
> >  - Newly added.
> > ---
> >  arch/x86/include/asm/debugreg.h |    6 ++++++
> >  arch/x86/kernel/hw_breakpoint.c |   10 ++++++++++
> >  arch/x86/kvm/x86.c              |    7 +++++++
> >  3 files changed, 23 insertions(+)
> > 
> > diff --git a/arch/x86/include/asm/debugreg.h b/arch/x86/include/asm/debugreg.h
> > index 854d82b88ff4..50f830972698 100644
> > --- a/arch/x86/include/asm/debugreg.h
> > +++ b/arch/x86/include/asm/debugreg.h
> > @@ -18,6 +18,7 @@
> >  #define DR7_FIXED_1	0x00000400
> >  
> >  DECLARE_PER_CPU(unsigned long, cpu_dr7);
> > +DECLARE_PER_CPU(bool, cpu_dr_in_guest);
> >  
> >  #ifndef CONFIG_PARAVIRT_XXL
> >  /*
> > @@ -129,6 +130,9 @@ static __always_inline unsigned long local_db_save(void)
> >  {
> >  	unsigned long dr7;
> >  
> > +	if (this_cpu_read(cpu_dr_in_guest))
> > +		return 0;
> 
> This is broken.  If an NMI hits between KVM writing cpu_dr_in_guest and clearing
> DR7, and there are active breakpoints, then local_db_save() won't disable breakpoints
> as it should, and the relevant code in exc_nmi() will run with breakpoints enabled.
> 
> 	kvm_load_xfeatures(vcpu, true);
> 
> 	this_cpu_write(cpu_dr_in_guest, true);
> 	barrier();
> 
>   <NMI here is problematic>
> 
> 	if (unlikely(vcpu->arch.switch_db_regs &&
> 		     !(vcpu->arch.switch_db_regs & KVM_DEBUGREG_AUTO_SWITCH))) {
> 		set_debugreg(DR7_FIXED_1, 7);
> 		set_debugreg(vcpu->arch.eff_db[0], 0);

Oops, indeed! OK, so local_db_save/restore will just work as it is,
but modifying DR7 should directly be prohibited.

> 
> > +
> >  	if (cpu_feature_enabled(X86_FEATURE_HYPERVISOR) && !hw_breakpoint_active())
> >  		return 0;
> >  
> > @@ -157,6 +161,8 @@ static __always_inline void local_db_restore(unsigned long dr7)
> >  	 * not be good.
> >  	 */
> >  	barrier();
> > +	if (this_cpu_read(cpu_dr_in_guest))
> > +		return;
> >  	if (dr7)
> >  		set_debugreg(dr7, 7);
> >  }
> > diff --git a/arch/x86/kernel/hw_breakpoint.c b/arch/x86/kernel/hw_breakpoint.c
> > index f846c15f21ca..68de7ed79d88 100644
> > --- a/arch/x86/kernel/hw_breakpoint.c
> > +++ b/arch/x86/kernel/hw_breakpoint.c
> > @@ -40,6 +40,9 @@
> >  DEFINE_PER_CPU(unsigned long, cpu_dr7);
> >  EXPORT_PER_CPU_SYMBOL(cpu_dr7);
> >  
> > +DEFINE_PER_CPU(bool, cpu_dr_in_guest);
> > +EXPORT_PER_CPU_SYMBOL_GPL(cpu_dr_in_guest);
> > +
> >  /* Per cpu debug address registers values */
> >  static DEFINE_PER_CPU(unsigned long, cpu_debugreg[HBP_NUM]);
> >  
> > @@ -102,6 +105,9 @@ int arch_install_hw_breakpoint(struct perf_event *bp)
> >  
> >  	lockdep_assert_irqs_disabled();
> >  
> > +	if (this_cpu_read(cpu_dr_in_guest))
> > +		return -EBUSY;
> 
> If we decide this is how to fix arch_install_hw_breakpoint() clobbering DRs from
> NMI context, I would rather have more generic flag to tell perf that KVM is about
> to enter the guest, e.g. so that we don't have to separately solve the same problem
> for other perf events:
> 
> https://lore.kernel.org/all/3585d823-00f3-46ae-a799-b62a95743e76@linux.intel.com

OK, so introducing a new (someting like) cpu_in_trans_guest flag and check it
from all affected places?

Thank you,

-- 
Masami Hiramatsu (Google) <mhiramat@kernel.org>

  reply	other threads:[~2026-09-16 23:45 UTC|newest]

Thread overview: 16+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-09-14 12:49 [PATCH v16 00/13] tracing: wprobe: x86: Add wprobe for watchpoint Masami Hiramatsu (Google)
2026-09-14 12:49 ` [PATCH v16 01/13] x86/mce: Fix hardware debug register corruption on task migration Masami Hiramatsu (Google)
2026-09-14 12:49 ` [PATCH v16 02/13] KVM: x86: Prevent host DR7 debug register leak into guest OS on NMI Masami Hiramatsu (Google)
2026-09-14 14:35   ` Sean Christopherson
2026-09-16 23:45     ` Masami Hiramatsu [this message]
2026-09-14 12:50 ` [PATCH v16 03/13] x86/hw_breakpoints: Make DR7 updates NMI safe Masami Hiramatsu (Google)
2026-09-14 12:50 ` [PATCH v16 04/13] x86/hw_breakpoints: Add arch_modify_local_hw_breakpoint_addr() API Masami Hiramatsu (Google)
2026-09-14 12:50 ` [PATCH v16 05/13] HWBP: Add modify_local_hw_breakpoint_addr() API Masami Hiramatsu (Google)
2026-09-14 12:50 ` [PATCH v16 06/13] tracing/wprobe: Add wprobe (watchpoint probe) trace event support Masami Hiramatsu (Google)
2026-09-14 12:50 ` [PATCH v16 07/13] x86: hw_breakpoint: Add a kconfig to clarify when a breakpoint fires Masami Hiramatsu (Google)
2026-09-14 12:51 ` [PATCH v16 08/13] selftests: tracing: Add a basic testcase for wprobe Masami Hiramatsu (Google)
2026-09-14 12:51 ` [PATCH v16 09/13] selftests: tracing: Add syntax " Masami Hiramatsu (Google)
2026-09-14 12:51 ` [PATCH v16 10/13] tracing/wprobe: Add set_wprobe and clear_wprobe event triggers Masami Hiramatsu (Google)
2026-09-14 12:51 ` [PATCH v16 11/13] selftests: tracing: Add wprobe trigger testcase Masami Hiramatsu (Google)
2026-09-14 12:51 ` [PATCH v16 12/13] tracing/wprobe: Support BTF typecast in fetchargs Masami Hiramatsu (Google)
2026-09-14 12:52 ` [PATCH v16 13/13] tracing/wprobe: Support BTF struct offset resolution in set_wprobe trigger Masami Hiramatsu (Google)

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20260917084526.18128cef47424990d42bb6ce@kernel.org \
    --to=mhiramat@kernel.org \
    --cc=alexander.shishkin@linux.intel.com \
    --cc=bp@alien8.de \
    --cc=dave.hansen@linux.intel.com \
    --cc=hpa@zytor.com \
    --cc=irogers@google.com \
    --cc=kvm@vger.kernel.org \
    --cc=linux-doc@vger.kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-perf-users@vger.kernel.org \
    --cc=linux-trace-kernel@vger.kernel.org \
    --cc=mathieu.desnoyers@efficios.com \
    --cc=mingo@kernel.org \
    --cc=pbonzini@redhat.com \
    --cc=peterz@infradead.org \
    --cc=rostedt@goodmis.org \
    --cc=seanjc@google.com \
    --cc=tglx@linutronix.de \
    --cc=wangjinchao600@gmail.com \
    --cc=x86@kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox

all inboxes | Powered by JetHome®