From: Joel Fernandes <joelagnelf@nvidia.com>
To: paulmck@kernel.org
Cc: linux-kernel@vger.kernel.org,
Frederic Weisbecker <frederic@kernel.org>,
Neeraj Upadhyay <neeraj.upadhyay@kernel.org>,
Josh Triplett <josh@joshtriplett.org>,
Boqun Feng <boqun@kernel.org>,
Uladzislau Rezki <urezki@gmail.com>,
Steven Rostedt <rostedt@goodmis.org>,
Mathieu Desnoyers <mathieu.desnoyers@efficios.com>,
Lai Jiangshan <jiangshanlai@gmail.com>,
Zqiang <qiang.zhang@linux.dev>,
Davidlohr Bueso <dave@stgolabs.net>,
rcu@vger.kernel.org
Subject: Re: [PATCH v4 2/8] rcu: clear defer_qs_pending when notifying GP changes
Date: Mon, 20 Jul 2026 16:09:32 -0400 [thread overview]
Message-ID: <92bc2631-35d4-4307-87c7-15922b60c21e@nvidia.com> (raw)
In-Reply-To: <b4a72949-d816-447f-9c9e-93b33ddf6aae@paulmck-laptop>
Hi Paul,
On 7/15/2026 4:45 PM, Paul E. McKenney wrote:
> On Thu, Jun 25, 2026 at 08:42:55PM -0400, Joel Fernandes wrote:
>> Prior to this commit, defer_qs_pending was an unbalanced flag:
>> rcu_read_unlock_special() set it to PENDING whenever a deferred-QS
>> mechanism was scheduled, but the clear paths did not cover every
>> up-tree quiescent-state reporting site. In those cases the flag stays
>> PENDING after the QS is reported, and rcu_read_unlock_special()'s
>> pending-gate then silently rejects all future arming attempts.
>>
>> A test patch confirms TREE03 can have get into the problematic stuck
>> state very quickly (< 5 minutes).
>>
>> Clear the flag in __note_gp_changes(), right after the nothing-to-do
>> early return. This is the natural per-CPU "GP transitioned, sync local
>> state" hook, called from the GP-kthread's rcu_gp_init()/rcu_gp_cleanup()
>> paths, and other GP advancement paths.
>>
>> For dynticks-idle CPUs, they do not call __note_gp_changes(), but they
>> also do not arm new PENDING work (no readers running), and on wake-up,
>> note_gp_changes() is called before any new reader runs.
>>
>> Signed-off-by: Joel Fernandes <joelagnelf@nvidia.com>
>
> This looks plausible, but suppose we have the following:
>
> rcu_read_lock();
> // expedited GP plus preemption.
> preempt_disable();
> rcu_read_unlock(); // Sets ->defer_qs_pending
> // CPU takes unrelated interrupt, softirq handled, kicks
> // scheduler, and clears ->defer_qs_pending. Note that preemption
> // is disabled, so rcu_core() does set_need_resched_current()
> local_irq_disable();
> preempt_enable(); // Cannot reschedule here.
> local_irq_enable();
>
> When do quiescent states get reported?
In the regular paths? That is eventually a scheduling clock interrupt,
transition to idle, or context switch. This patch doesn't handle the above
scenario, that would be done by the timer patch.
This patch handles the case where if the ->defer_qs_pending flag was not
cleared, then it remains stuck forever.
In this patch series, we avoid clearing it once the deferred work runs,
since we don't want to re-run it to reduce/eliminate recursion risk. The
only case where we'd allow to re-run in the same GP (by clearing this flag)
it, is if it ran but did not do any work. So the idea of this patch is,
making __note_gp_changes() as the single point of clearing.
That's why "rcu: drop redundant defer_qs_pending clear in irqrestore
handler" is subsequently added later (it depends on this patch).
Thanks.
next prev parent reply other threads:[~2026-07-20 20:09 UTC|newest]
Thread overview: 26+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-06-26 0:42 [PATCH v4 0/8] rcu: fix stuck defer_qs_pending state and add rescue timer Joel Fernandes
2026-06-26 0:42 ` [PATCH v4 1/8] rcu: introduce rcu_defer_qs_clear() helper Joel Fernandes
2026-07-15 20:43 ` Paul E. McKenney
2026-06-26 0:42 ` [PATCH v4 2/8] rcu: clear defer_qs_pending when notifying GP changes Joel Fernandes
2026-07-15 20:45 ` Paul E. McKenney
2026-07-20 20:09 ` Joel Fernandes [this message]
2026-06-26 0:42 ` [PATCH v4 3/8] rcu: clear defer_qs_pending in handler for compounded sections Joel Fernandes
2026-07-15 20:50 ` Paul E. McKenney
2026-07-20 20:32 ` Joel Fernandes
2026-06-26 0:42 ` [PATCH v4 4/8] rcu: drop redundant defer_qs_pending clear in irqrestore handler Joel Fernandes
2026-07-15 20:58 ` Paul E. McKenney
2026-07-20 21:06 ` Joel Fernandes
2026-06-26 0:42 ` [PATCH v4 5/8] rcu: clear defer_qs_pending at expedited IPI entry Joel Fernandes
2026-07-15 21:01 ` Paul E. McKenney
2026-07-21 15:55 ` Joel Fernandes
2026-06-26 0:42 ` [PATCH v4 6/8] rcu: set need_resched on softirq deferred-QS arming path Joel Fernandes
2026-07-15 21:12 ` Paul E. McKenney
2026-07-21 16:18 ` Joel Fernandes
2026-06-26 0:43 ` [PATCH v4 7/8] rcu: clear defer_qs_pending in deferred-QS bail when nesting > 0 Joel Fernandes
2026-07-15 21:30 ` Paul E. McKenney
2026-07-21 16:58 ` Joel Fernandes
2026-06-26 0:43 ` [PATCH v4 8/8] rcu: add per-CPU rescue hrtimer for deferred-QS reporting Joel Fernandes
2026-07-15 21:35 ` Paul E. McKenney
2026-07-22 14:59 ` Joel Fernandes
2026-06-26 0:44 ` [PATCH v4 0/8] rcu: fix stuck defer_qs_pending state and add rescue timer Joel Fernandes
2026-06-26 14:56 ` Joel Fernandes
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=92bc2631-35d4-4307-87c7-15922b60c21e@nvidia.com \
--to=joelagnelf@nvidia.com \
--cc=boqun@kernel.org \
--cc=dave@stgolabs.net \
--cc=frederic@kernel.org \
--cc=jiangshanlai@gmail.com \
--cc=josh@joshtriplett.org \
--cc=linux-kernel@vger.kernel.org \
--cc=mathieu.desnoyers@efficios.com \
--cc=neeraj.upadhyay@kernel.org \
--cc=paulmck@kernel.org \
--cc=qiang.zhang@linux.dev \
--cc=rcu@vger.kernel.org \
--cc=rostedt@goodmis.org \
--cc=urezki@gmail.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®