From: K Prateek Nayak <kprateek.nayak@amd.com>
To: Juri Lelli <juri.lelli@redhat.com>
Cc: Andrea Righi <arighi@nvidia.com>,
John Stultz <jstultz@google.com>,
Peter Zijlstra <peterz@infradead.org>,
LKML <linux-kernel@vger.kernel.org>,
Valentin Schneider <valentin.schneider@arm.com>,
Connor O'Brien <connoro@google.com>,
Ingo Molnar <mingo@redhat.com>,
Thomas Gleixner <tglx@linutronix.de>,
Vincent Guittot <vincent.guittot@linaro.org>,
Valentin Schneider <vschneid@redhat.com>,
Suleiman Souhlal <suleiman@google.com>,
Metin Kaya <Metin.Kaya@arm.com>,
Dietmar Eggemann <dietmar.eggemann@arm.com>,
Steven Rostedt <rostedt@goodmis.org>,
Zimuzo Ezeozue <zezeozue@google.com>,
Waiman Long <longman@redhat.com>,
Boqun Feng <boqun.feng@gmail.com>,
"Paul E. McKenney" <paulmck@kernel.org>,
Joel Fernandes <joelagnelf@nvidia.com>,
Qais Yousef <qyousef@layalina.io>,
Xuewen Yan <xuewen.yan94@gmail.com>,
kuyo chang <kuyo.chang@mediatek.com>, hupu <hupu.gm@gmail.com>,
Zhan Xusheng <zhanxusheng@xiaomi.com>,
"zhidao su (Xiaomi)" <soolaugust@gmail.com>,
Hui Su <sh_def@163.com>,
"Shubhang Kaushik (Ampere)" <sh@gentwo.org>,
<kernel-team@android.com>
Subject: Re: [PATCH v33 7/7] sched/proxy: Add deactivated (sleeping) owner handling to find_proxy_task()
Date: Wed, 28 Oct 2026 09:06:40 +0530 [thread overview]
Message-ID: <a3bb6028-52f9-4545-a5f1-08f56fa6ac2a@amd.com> (raw)
In-Reply-To: <auDPxCTyGbStTWJD@jlelli-thinkpadt14gen4.remote.csb>
Hello Juri,
On 10/27/2026 9:52 PM, Juri Lelli wrote:
> Hello!
>
> On 26/10/26 09:56, K Prateek Nayak wrote:
>> On 10/24/2026 2:37 PM, Andrea Righi wrote:
>>>> +static void do_activate_blocked_waiter(struct rq *target_rq, struct task_struct *p, int en_flags)
>>>> +{
>
> ...
>
>>>> + if (task_cpu(p) != target_cpu) {
>>>> + en_flags |= ENQUEUE_MIGRATED;
>>>> + psi_ttwu_dequeue(p);
>>>> + proxy_set_task_cpu(p, target_cpu);
>>>> + }
>>>
>>> Can this break SCHED_DEADLINE bw accounting?
>>>
>>> p is sleeping here (not TASK_WAKING, not TASK_ON_RQ_MIGRATING), so
>>> __set_task_cpu() skips migrate_task_rq_dl(): the old rq never does
>>> sub_rq_bw(), while ENQUEUE_MIGRATED makes the new rq do add_rq_bw(), so
>>> this_bw is leaked on the old rq. And if p is still dl_non_contending,
>>> task_contending() on the new rq just cancels the inactive timer, leaving
>>> running_bw on the old rq forever and making it underflow on the new rq
>>> the next time p blocks.
>>>
>>> set_task_cpu() doesn't help, because migrate_task_rq_dl() bails out
>>> unless TASK_WAKING, so I'm not sure how to fix this case...
>>
>> I wonder why "p->dl.dl_non_contending" is not sufficient to know if
>> there exists residual bandwidth on prev CPU. Seems to have been like
>> that since commit 209a0cbda7a0 ("sched/deadline: Improve the tracking
>> of active utilization").
>>
>> Only time task is non-contending is if it goes away with DEQUEUE_SLEEP
>> or switched_from_dl() with dl_runtime.
>>
>> The latter doesn't need migrating the timer as the timer will either
>> be cancelled if the task switches back to deadline, or will expire
>> where it was queued - set_task_cpu() has no effect in this case.
>>
>> Only other case that marks "dl_non_contending" is sleep + wakeup and
>> for that "p->dl.non_contending" should be sufficient. I don't think
>> we ever do a set_task_cpu() for a blocked task other than wakeup do
>> we?
>>
>> Juri, Peter, are we missing something subtle here?
>
> I think Andrea's concern is valid, but I'm not sure I follow what you
> propose Prateek (apologies!) or are you saying you don't see an issue
> here?
Sorry for the confusion! I do see the problem and my question was why
can't the bailout in migrate_task_rq_dl() be something like:
(Lightly tested)
diff --git a/kernel/sched/deadline.c b/kernel/sched/deadline.c
index c0ebdcde5fe5..6a081c2b7191 100644
--- a/kernel/sched/deadline.c
+++ b/kernel/sched/deadline.c
@@ -2654,19 +2654,23 @@ select_task_rq_dl(struct task_struct *p, int cpu, int flags)
static void migrate_task_rq_dl(struct task_struct *p, int new_cpu __maybe_unused)
{
- struct rq_flags rf;
struct rq *rq;
- if (READ_ONCE(p->__state) != TASK_WAKING)
+ /* Inactive timer is not armed. Nothing to migrate! */
+ if (task_on_rq_migrating(p) || !p->dl.dl_non_contending)
return;
- rq = task_rq(p);
+ /* Task must be fully blocked if we reach here. */
+ WARN_ON_ONCE(!p->is_blocked);
+
/*
- * Since p->state == TASK_WAKING, set_task_cpu() has been called
- * from try_to_wake_up(). Hence, p->pi_lock is locked, but
- * rq->lock is not... So, lock it
+ * set_task_cpu() has been called from try_to_wake_up().
+ * Hence, p->pi_lock is locked, but rq->lock is not...
+ * So, lock it
*/
- rq_lock(rq, &rf);
+ rq = task_rq(p);
+ guard(rq_lock)(rq);
+
if (p->dl.dl_non_contending) {
update_rq_clock(rq);
sub_running_bw(&p->dl, &rq->dl);
@@ -2681,7 +2685,6 @@ static void migrate_task_rq_dl(struct task_struct *p, int new_cpu __maybe_unused
cancel_inactive_timer(&p->dl);
}
sub_rq_bw(&p->dl, &rq->dl);
- rq_unlock(rq, &rf);
}
static void check_preempt_equal_dl(struct rq *rq, struct task_struct *p)
---
Isn't task_on_rq_migrating() || !p->dl.dl_non_contending sufficient
bail out checks given the inactive timer is only armed for fully
blocked (DEQUEUE_SLEEP) tasks?
deactivate_task() + activate_task() will not leave an inactive timer
so task_on_rq_migrating() should be enough to capture that and if we
are doing set_task_rq() on a blocked task, it must be during wakeup.
>
> If the issue is confirmed, I wonder if relaxing the first check in
> migrate_task_rq_dl() to something like
>
> if (READ_ONCE(p->__state) != TASK_WAKING && !p->is_blocked)
> return;
So, the problem is we we are doing an block_task() + activate_task()
for proxy donors and they do not see TASK_WAKING state - the task is
fully blocked (say TASK_UNINTERRUPTIBLE) for this whole duration.
block_task() can arm and inactive timer that needs cancelling before
the activate on a different rq but since we don't do TASK_WAKING,
migrate_task_rq_dl() will bail early and the timer is left on the
old CPU.
> might fix things, but then it's ugly to call it from do_activate_
> blocked_waiter(). We could teach set_task_cpu() about blocked waiters
> (otherwise it warns) and then call it instead of __set_task_cpu(), but
> I'm not sure it's any prettier.
If something like the suggested diff is alright, then proxy can
simply use set_task_cpu() (followed by correcting p->wake_cpu) and
everything should be alright.
--
Thanks and Regards,
Prateek
next prev parent reply other threads:[~2026-10-28 3:37 UTC|newest]
Thread overview: 28+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-10-23 22:04 [PATCH v33 0/7] Sleeping Owner Handling for Proxy Execution (v33) John Stultz
2026-10-23 22:04 ` [PATCH v33 1/7] sched/psi: Preserve sleep-persistent PSI flags on off-CPU sleeping dequeues John Stultz
2026-10-24 11:44 ` Peter Zijlstra
2026-10-26 5:00 ` K Prateek Nayak
2026-10-26 4:32 ` K Prateek Nayak
2026-10-26 5:16 ` Zhan Xusheng
2026-10-23 22:04 ` [PATCH v33 2/7] sched/core: Use the scheduling context for remote ticks John Stultz
2026-10-24 13:44 ` Kayra Cizmeci
2026-10-23 22:04 ` [PATCH v33 3/7] sched/core: Activate blocked donor when no owner is found John Stultz
2026-10-24 8:33 ` Andrea Righi
2026-10-26 3:02 ` K Prateek Nayak
2026-10-23 22:04 ` [PATCH v33 4/7] sched/proxy: Set TASK_RUNNING when shortcuting return migration John Stultz
2026-10-24 8:36 ` Andrea Righi
2026-10-26 3:09 ` K Prateek Nayak
2026-10-23 22:04 ` [PATCH v33 5/7] sched/proxy: Break cyclic proxy chains by deactivating blocked tasks John Stultz
2026-10-24 21:19 ` Kayra Cizmeci
2026-10-23 22:04 ` [PATCH v33 6/7] sched/proxy: Detect cycles in proxy walks earlier John Stultz
2026-10-24 15:34 ` Kayra Cizmeci
2026-10-23 22:04 ` [PATCH v33 7/7] sched/proxy: Add deactivated (sleeping) owner handling to find_proxy_task() John Stultz
2026-10-24 9:07 ` Andrea Righi
2026-10-26 4:26 ` K Prateek Nayak
2026-10-27 16:22 ` Juri Lelli
2026-10-28 3:36 ` K Prateek Nayak [this message]
2026-10-28 10:01 ` Juri Lelli
2026-10-28 10:11 ` K Prateek Nayak
2026-10-28 10:36 ` Juri Lelli
2026-10-26 7:40 ` K Prateek Nayak
2026-10-26 19:59 ` Kayra Cizmeci
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=a3bb6028-52f9-4545-a5f1-08f56fa6ac2a@amd.com \
--to=kprateek.nayak@amd.com \
--cc=Metin.Kaya@arm.com \
--cc=arighi@nvidia.com \
--cc=boqun.feng@gmail.com \
--cc=connoro@google.com \
--cc=dietmar.eggemann@arm.com \
--cc=hupu.gm@gmail.com \
--cc=joelagnelf@nvidia.com \
--cc=jstultz@google.com \
--cc=juri.lelli@redhat.com \
--cc=kernel-team@android.com \
--cc=kuyo.chang@mediatek.com \
--cc=linux-kernel@vger.kernel.org \
--cc=longman@redhat.com \
--cc=mingo@redhat.com \
--cc=paulmck@kernel.org \
--cc=peterz@infradead.org \
--cc=qyousef@layalina.io \
--cc=rostedt@goodmis.org \
--cc=sh@gentwo.org \
--cc=sh_def@163.com \
--cc=soolaugust@gmail.com \
--cc=suleiman@google.com \
--cc=tglx@linutronix.de \
--cc=valentin.schneider@arm.com \
--cc=vincent.guittot@linaro.org \
--cc=vschneid@redhat.com \
--cc=xuewen.yan94@gmail.com \
--cc=zezeozue@google.com \
--cc=zhanxusheng@xiaomi.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®