From: Jan Kiszka <jan.kiszka@siemens.com>
To: "Bezdeka,
Florian (FT RPD CED OES-DE)" <florian.bezdeka@siemens.com>,
"kys@microsoft.com" <kys@microsoft.com>,
"decui@microsoft.com" <decui@microsoft.com>,
"bp@alien8.de" <bp@alien8.de>,
"longli@microsoft.com" <longli@microsoft.com>,
"dave.hansen@linux.intel.com" <dave.hansen@linux.intel.com>,
"mingo@redhat.com" <mingo@redhat.com>,
"wei.liu@kernel.org" <wei.liu@kernel.org>,
"tglx@kernel.org" <tglx@kernel.org>,
"haiyangz@microsoft.com" <haiyangz@microsoft.com>,
"x86@kernel.org" <x86@kernel.org>
Cc: "linux-rt-users@vger.kernel.org" <linux-rt-users@vger.kernel.org>,
"namjain@linux.microsoft.com" <namjain@linux.microsoft.com>,
"linux-hyperv@vger.kernel.org" <linux-hyperv@vger.kernel.org>,
"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
"levymitchell0@gmail.com" <levymitchell0@gmail.com>,
"mhklinux@outlook.com" <mhklinux@outlook.com>,
"ssengar@linux.microsoft.com" <ssengar@linux.microsoft.com>
Subject: Re: [PATCH v3] drivers: hv: vmbus: Use kthread for vmbus interrupts on PREEMPT_RT
Date: Wed, 18 Feb 2026 07:48:00 +0100 [thread overview]
Message-ID: <1e431e0b-3e53-45c0-b097-c7bcb7d677d2@siemens.com> (raw)
In-Reply-To: <033ecfefc85bdb7c508d488c5004913d87057142.camel@siemens.com>
On 18.02.26 00:03, Bezdeka, Florian (FT RPD CED OES-DE) wrote:
> On Mon, 2026-02-16 at 17:24 +0100, Jan Kiszka wrote:
>> From: Jan Kiszka <jan.kiszka@siemens.com>
>>
>> Resolves the following lockdep report when booting PREEMPT_RT on Hyper-V
>> with related guest support enabled:
>>
>> [ 1.127941] hv_vmbus: registering driver hyperv_drm
>>
>> [ 1.132518] =============================
>> [ 1.132519] [ BUG: Invalid wait context ]
>> [ 1.132521] 6.19.0-rc8+ #9 Not tainted
>> [ 1.132524] -----------------------------
>> [ 1.132525] swapper/0/0 is trying to lock:
>> [ 1.132526] ffff8b9381bb3c90 (&channel->sched_lock){....}-{3:3}, at: vmbus_chan_sched+0xc4/0x2b0
>> [ 1.132543] other info that might help us debug this:
>> [ 1.132544] context-{2:2}
>> [ 1.132545] 1 lock held by swapper/0/0:
>> [ 1.132547] #0: ffffffffa010c4c0 (rcu_read_lock){....}-{1:3}, at: vmbus_chan_sched+0x31/0x2b0
>> [ 1.132557] stack backtrace:
>> [ 1.132560] CPU: 0 UID: 0 PID: 0 Comm: swapper/0 Not tainted 6.19.0-rc8+ #9 PREEMPT_{RT,(lazy)}
>> [ 1.132565] Hardware name: Microsoft Corporation Virtual Machine/Virtual Machine, BIOS Hyper-V UEFI Release v4.1 09/25/2025
>> [ 1.132567] Call Trace:
>> [ 1.132570] <IRQ>
>> [ 1.132573] dump_stack_lvl+0x6e/0xa0
>> [ 1.132581] __lock_acquire+0xee0/0x21b0
>> [ 1.132592] lock_acquire+0xd5/0x2d0
>> [ 1.132598] ? vmbus_chan_sched+0xc4/0x2b0
>> [ 1.132606] ? lock_acquire+0xd5/0x2d0
>> [ 1.132613] ? vmbus_chan_sched+0x31/0x2b0
>> [ 1.132619] rt_spin_lock+0x3f/0x1f0
>> [ 1.132623] ? vmbus_chan_sched+0xc4/0x2b0
>> [ 1.132629] ? vmbus_chan_sched+0x31/0x2b0
>> [ 1.132634] vmbus_chan_sched+0xc4/0x2b0
>> [ 1.132641] vmbus_isr+0x2c/0x150
>> [ 1.132648] __sysvec_hyperv_callback+0x5f/0xa0
>> [ 1.132654] sysvec_hyperv_callback+0x88/0xb0
>> [ 1.132658] </IRQ>
>> [ 1.132659] <TASK>
>> [ 1.132660] asm_sysvec_hyperv_callback+0x1a/0x20
>>
>> As code paths that handle vmbus IRQs use sleepy locks under PREEMPT_RT,
>> the vmbus_isr execution needs to be moved into thread context. Open-
>> coding this allows to skip the IPI that irq_work would additionally
>> bring and which we do not need, being an IRQ, never an NMI.
>>
>> This affects both x86 and arm64, therefore hook into the common driver
>> logic.
>
> I tested this patch in combination with the related SCSI driver patch.
> The tests were done on x86 with both VM generations provided by Hyper-v.
>
> Lockdep was enabled and there were no splat reports within 24 hours of
> massive load produced by stress-ng.
>
> With that:
>
> Reviewed-by: Florian Bezdeka <florian.bezdeka@siemens.com>
> Tested-by: Florian Bezdeka <florian.bezdeka@siemens.com>
>
>
> Side note: We did some backports down to 6.1 already, just in case
> someone is interested. We recognized a massive network performance drop
> in 6.1. The root cause has been identified and is not related to this
> patch. It's simply another RT regression caused by a missing stable-rt
> backport. Upstreaming in progress...
>
Submitted:
https://lore.kernel.org/stable/05ae6b87-0b53-4948-a1ed-2a3235a5f82b@siemens.com/T/#u
Jan
--
Siemens AG, Foundational Technologies
Linux Expert Center
next prev parent reply other threads:[~2026-02-18 6:48 UTC|newest]
Thread overview: 20+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-02-16 16:24 Jan Kiszka
2026-02-17 6:42 ` Michael Kelley
2026-02-17 23:03 ` Bezdeka, Florian
2026-02-18 6:48 ` Jan Kiszka [this message]
2026-02-18 7:05 ` Wei Liu
2026-02-18 7:19 ` Saurabh Singh Sengar
2026-03-12 17:07 ` Sebastian Andrzej Siewior
2026-03-17 7:49 ` Jan Kiszka
2026-03-17 11:01 ` Sebastian Andrzej Siewior
2026-03-17 11:55 ` Jan Kiszka
2026-03-18 9:08 ` Sebastian Andrzej Siewior
2026-03-18 11:02 ` Jan Kiszka
2026-03-17 17:25 ` Michael Kelley
2026-03-18 5:52 ` Jan Kiszka
2026-03-18 10:01 ` Sebastian Andrzej Siewior
2026-03-18 11:03 ` Jan Kiszka
2026-03-18 11:21 ` Sebastian Andrzej Siewior
2026-03-18 12:12 ` Jan Kiszka
2026-03-19 3:43 ` Michael Kelley
2026-03-19 10:14 ` Sebastian Andrzej Siewior
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1e431e0b-3e53-45c0-b097-c7bcb7d677d2@siemens.com \
--to=jan.kiszka@siemens.com \
--cc=bp@alien8.de \
--cc=dave.hansen@linux.intel.com \
--cc=decui@microsoft.com \
--cc=florian.bezdeka@siemens.com \
--cc=haiyangz@microsoft.com \
--cc=kys@microsoft.com \
--cc=levymitchell0@gmail.com \
--cc=linux-hyperv@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-rt-users@vger.kernel.org \
--cc=longli@microsoft.com \
--cc=mhklinux@outlook.com \
--cc=mingo@redhat.com \
--cc=namjain@linux.microsoft.com \
--cc=ssengar@linux.microsoft.com \
--cc=tglx@kernel.org \
--cc=wei.liu@kernel.org \
--cc=x86@kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®