mirror of https://lore.kernel.org/lkml/
 help / color / mirror / Atom feed
From: Andrea Righi <arighi@nvidia.com>
To: Peter Zijlstra <peterz@infradead.org>
Cc: Tejun Heo <tj@kernel.org>, David Vernet <void@manifault.com>,
	Changwoo Min <changwoo@igalia.com>,
	John Stultz <jstultz@google.com>, Ingo Molnar <mingo@redhat.com>,
	Juri Lelli <juri.lelli@redhat.com>,
	Vincent Guittot <vincent.guittot@linaro.org>,
	Dietmar Eggemann <dietmar.eggemann@arm.com>,
	Steven Rostedt <rostedt@goodmis.org>,
	Ben Segall <bsegall@google.com>, Mel Gorman <mgorman@suse.de>,
	Valentin Schneider <vschneid@redhat.com>,
	K Prateek Nayak <kprateek.nayak@amd.com>,
	Christian Loehle <christian.loehle@arm.com>,
	David Dai <david.dai@linux.dev>, Koba Ko <kobak@nvidia.com>,
	Aiqun Yu <aiqun.yu@oss.qualcomm.com>,
	Shuah Khan <shuah@kernel.org>,
	sched-ext@lists.linux.dev, linux-kernel@vger.kernel.org
Subject: Re: [PATCHSET v14 sched_ext/for-7.4] sched: Make proxy execution compatible with sched_ext
Date: Fri, 25 Sep 2026 09:46:40 +0200	[thread overview]
Message-ID: <arYm4PPMhevWQWsK@gpd4> (raw)
In-Reply-To: <20260924075237.GH2009045@noisy.programming.kicks-ass.net>

Hi Peter,

On Thu, Sep 24, 2026 at 09:52:37AM +0200, Peter Zijlstra wrote:
> On Tue, Sep 22, 2026 at 06:51:39PM +0200, Andrea Righi wrote:
> 
> > Andrea Righi (16):
> >       sched/core: Drop mutex locks before proxy rescheduling
> >       sched/core: Dequeue waking proxy donors before reset
> >       sched/core: Mark wakeups completed through ttwu_runnable()
> >       sched: Add helper to block retained proxy donors
> >       sched: Add sched_ext hooks for proxy execution
> 
> Right, so these add:
> 
> WF_TTWU_RQ:
> 
>   Used like ENQUEUE_DELAYED; could be fixed by generalizing that to cover all
>   of p->is_blocked.
> 
> scx_allow_proxy_exec():
> 
>   Hook to kill proxy exec for scx
> 
> scx_proxy_reenqueue_retry():
> 
>   Like put_prev_task(), but for current. Ensures current gets put back on a DSQ
>   once its done running.
> 
> scx_proxy_donor_start():
> 
>   Delayed set_next_task(), confirms donor will be used.
> 
> sched_proxy_block_task():
> 
>   Almost like switching_to_scx(), except it needs to change ctx->queued in case
>   of p->is_blocked. Hence a new callback ran before sched_change_begin().

Yes, that matches the intent, with one small clarification:
scx_proxy_reenqueue_retry() doesn't directly put current back on a DSQ, a task
that couldn't be reenqueued remains on the reject DSQ and the hook schedules a
deferred retry after proxy resolution.

> 
> 
> 
> Now, I have:
> 
>   https://patch.msgid.link/20260917-sched-fair-hrtick-restart-v4-1-4dd1414da81a@gentwo.org,
> 
> pending, would something like the below on top of both this work?
> 
> (although I'm not convinced SC_CONFIRM is actually making it better)

Yes, this works.

I applied Shubhang's v4 hrtick patch as a preliminary commit, then added the
SNT_CONFIRM callback and reworked the proxy-exec series to use it. sched_ext now
confirms the donor in set_next_task_scx() and scx_proxy_donor_start() is gone.

I tested the updated series and it passed all my scx proxy exec tests. The
branch is available here:

 git://git.kernel.org/pub/scm/linux/kernel/git/arighi/linux.git scx-proxy-exec-next

It's not an obvious simplification, but if we want to go this way, we can
express both the provisional pick and donor confirmation through the sched class
callback.

Thanks,
-Andrea

> 
> --- a/kernel/sched/core.c
> +++ b/kernel/sched/core.c
> @@ -1876,7 +1876,7 @@ static inline void uclamp_rq_inc(struct
>  	if (!uclamp_is_used())
>  		return;
>  
> -	if (unlikely(!p->sched_class->uclamp_enabled))
> +	if (unlikely(!(p->sched_class->flags & SC_UCLAMP)))
>  		return;
>  
>  	/* Only inc the delayed task which being woken up. */
> @@ -1904,7 +1904,7 @@ static inline void uclamp_rq_dec(struct
>  	if (!uclamp_is_used())
>  		return;
>  
> -	if (unlikely(!p->sched_class->uclamp_enabled))
> +	if (unlikely(!(p->sched_class->flags & SC_UCLAMP)))
>  		return;
>  
>  	if (p->se.sched_delayed)
> @@ -7268,9 +7268,10 @@ static void __sched notrace __schedule(i
>  	rq->next_class = next->sched_class;
>  	if (sched_proxy_exec()) {
>  		struct task_struct *prev_donor = rq->donor;
> +		struct task_struct *donor = next;
>  
> -		rq_set_donor(rq, next);
> -		next->blocked_donor = NULL;
> +		rq_set_donor(rq, donor);
> +		donor->blocked_donor = NULL;
>  		if (unlikely(next->is_blocked)) {
>  			next = find_proxy_task(rq, next, &rf);
>  			if (!next) {
> @@ -7283,8 +7284,7 @@ static void __sched notrace __schedule(i
>  				goto keep_resched;
>  			}
>  		}
> -		if (rq->donor == prev_donor && prev != next) {
> -			struct task_struct *donor = rq->donor;
> +		if (donor == prev_donor && prev != next) {
>  			/*
>  			 * When transitioning like:
>  			 *
> @@ -7298,9 +7298,10 @@ static void __sched notrace __schedule(i
>  			 * on_cpu.
>  			 */
>  			donor->sched_class->put_prev_task(rq, donor, donor);
> -			donor->sched_class->set_next_task(rq, donor, true);
> +			donor->sched_class->set_next_task(rq, donor, SNT_PICK);
>  		}
> -		scx_proxy_donor_start(rq);
> +		if (donor->sched_class->flags & SC_CONFIRM)
> +			donor->sched_class->set_next_task(rq, donor, SNT_CONFIRM);
>  		scx_proxy_reenqueue_retry(rq, next);
>  	} else {
>  		rq_set_donor(rq, next);
> --- a/kernel/sched/ext/ext.c
> +++ b/kernel/sched/ext/ext.c
> @@ -5069,8 +5069,12 @@ DEFINE_SCHED_CLASS(ext) = {
>  
>  	.update_curr		= update_curr_scx,
>  
> +	.flags			= 0
>  #ifdef CONFIG_UCLAMP_TASK
> -	.uclamp_enabled		= 1,
> +				| SC_UCLAMP
> +#endif
> +#ifdef CONFIG_SCHED_PROXY_EXEC
> +				| SC_CONFIRM
>  #endif
>  };
>  
> --- a/kernel/sched/fair.c
> +++ b/kernel/sched/fair.c
> @@ -15887,7 +15887,7 @@ DEFINE_SCHED_CLASS(fair) = {
>  #endif
>  
>  #ifdef CONFIG_UCLAMP_TASK
> -	.uclamp_enabled		= 1,
> +	.flags			= SC_UCLAMP,
>  #endif
>  };
>  
> --- a/kernel/sched/rt.c
> +++ b/kernel/sched/rt.c
> @@ -2636,7 +2636,7 @@ DEFINE_SCHED_CLASS(rt) = {
>  #endif
>  
>  #ifdef CONFIG_UCLAMP_TASK
> -	.uclamp_enabled		= 1,
> +	.flags			= SC_UCLAMP,
>  #endif
>  };
>  
> --- a/kernel/sched/sched.h
> +++ b/kernel/sched/sched.h
> @@ -2641,13 +2641,17 @@ enum snt_e {
>  	SNT_NORMAL,	/* set_next_task() */
>  	SNT_PICK,	/* put_prev_set_next_task(): prev != next */
>  	SNT_REPICK,	/* put_prev_set_next_task(): prev == next */
> +	SNT_CONFIRM,	/* confirm pick */
> +};
> +
> +enum {
> +	SC_UCLAMP	= 1<<0,
> +	SC_CONFIRM	= 1<<1,
>  };
>  
>  struct sched_class {
>  
> -#ifdef CONFIG_UCLAMP_TASK
> -	int uclamp_enabled;
> -#endif
> +	unsigned int flags;
>  
>  	/*
>  	 * move_queued_task/activate_task/enqueue_task: rq->lock

  parent reply	other threads:[~2026-09-25  7:46 UTC|newest]

Thread overview: 25+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-09-22 16:51 Andrea Righi
2026-09-22 16:51 ` [PATCH 01/16] sched/core: Drop mutex locks before proxy rescheduling Andrea Righi
2026-09-22 16:51 ` [PATCH 02/16] sched/core: Dequeue waking proxy donors before reset Andrea Righi
2026-09-22 16:51 ` [PATCH 03/16] sched/core: Mark wakeups completed through ttwu_runnable() Andrea Righi
2026-09-22 16:51 ` [PATCH 04/16] sched: Add helper to block retained proxy donors Andrea Righi
2026-09-22 16:51 ` [PATCH 05/16] sched: Add sched_ext hooks for proxy execution Andrea Righi
2026-09-24  7:51   ` Peter Zijlstra
2026-09-25  8:23     ` Andrea Righi
2026-09-22 16:51 ` [PATCH 06/16] sched_ext: Block proxy donors before taking control Andrea Righi
2026-09-22 16:51 ` [PATCH 07/16] sched_ext: Fix ops.running/stopping() pairing for proxy-exec donors Andrea Righi
2026-09-22 16:51 ` [PATCH 08/16] sched_ext: Move reject DSQ draining into core Andrea Righi
2026-09-22 16:51 ` [PATCH 09/16] sched_ext: Generalize the reject DSQ reenqueue path Andrea Righi
2026-09-22 16:51 ` [PATCH 10/16] sched_ext: Handle proxy-exec races in remote DSQ transfers Andrea Righi
2026-09-22 16:51 ` [PATCH 11/16] sched_ext: Split curr|donor references properly Andrea Righi
2026-09-22 16:51 ` [PATCH 12/16] sched_ext: Track proxy execution for NOHZ_FULL Andrea Righi
2026-09-22 16:51 ` [PATCH 13/16] sched_ext: Delegate proxy donor admission to BPF schedulers Andrea Righi
2026-09-22 16:51 ` [PATCH 14/16] sched_ext: Add selftest for blocked donor admission Andrea Righi
2026-09-22 16:51 ` [PATCH 15/16] sched_ext: scx_qmap: Add proxy execution support Andrea Righi
2026-09-22 16:51 ` [PATCH 16/16] sched: Allow enabling proxy exec with sched_ext Andrea Righi
2026-09-24  7:52 ` [PATCHSET v14 sched_ext/for-7.4] sched: Make proxy execution compatible " Peter Zijlstra
2026-09-24  7:59   ` Peter Zijlstra
2026-09-24  8:10     ` K Prateek Nayak
2026-09-24  9:09       ` Peter Zijlstra
2026-09-25  7:46   ` Andrea Righi [this message]
2026-09-25  7:56     ` Peter Zijlstra

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=arYm4PPMhevWQWsK@gpd4 \
    --to=arighi@nvidia.com \
    --cc=aiqun.yu@oss.qualcomm.com \
    --cc=bsegall@google.com \
    --cc=changwoo@igalia.com \
    --cc=christian.loehle@arm.com \
    --cc=david.dai@linux.dev \
    --cc=dietmar.eggemann@arm.com \
    --cc=jstultz@google.com \
    --cc=juri.lelli@redhat.com \
    --cc=kobak@nvidia.com \
    --cc=kprateek.nayak@amd.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=mgorman@suse.de \
    --cc=mingo@redhat.com \
    --cc=peterz@infradead.org \
    --cc=rostedt@goodmis.org \
    --cc=sched-ext@lists.linux.dev \
    --cc=shuah@kernel.org \
    --cc=tj@kernel.org \
    --cc=vincent.guittot@linaro.org \
    --cc=void@manifault.com \
    --cc=vschneid@redhat.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox

all inboxes | Powered by JetHome®