mirror of https://lore.kernel.org/lkml/
 help / color / mirror / Atom feed
From: "Alex Hoh (賀振坤)" <Alex.Hoh@mediatek.com>
To: "vincent.guittot@linaro.org" <vincent.guittot@linaro.org>,
	"wusamuel@google.com" <wusamuel@google.com>
Cc: "bsegall@google.com" <bsegall@google.com>,
	"vschneid@redhat.com" <vschneid@redhat.com>,
	"dietmar.eggemann@arm.com" <dietmar.eggemann@arm.com>,
	"peterz@infradead.org" <peterz@infradead.org>,
	"rostedt@goodmis.org" <rostedt@goodmis.org>,
	"mingo@redhat.com" <mingo@redhat.com>,
	"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
	"mgorman@suse.de" <mgorman@suse.de>,
	"juri.lelli@redhat.com" <juri.lelli@redhat.com>,
	"kernel-team@android.com" <kernel-team@android.com>
Subject: Re: [PATCH] sched/fair: Fix pelt lost idle time detection
Date: Fri, 16 Jan 2026 06:51:03 +0000	[thread overview]
Message-ID: <8cf19bf0e0054dcfed70e9935029201694f1bb5a.camel@mediatek.com> (raw)
In-Reply-To: <CAKfTPtCUVcSZbFDLswaT25xjKuqx9fD57Kz_Di8ZDMsEhmnjWw@mail.gmail.com>

On Sat, 2025-12-13 at 04:54 +0100, Vincent Guittot wrote:
> Hi Samuel,
> 
> 
> On Sat, 6 Dec 2025 at 02:20, Samuel Wu <wusamuel@google.com> wrote:
> > 
> > On Fri, Dec 5, 2025 at 4:54 PM Samuel Wu <wusamuel@google.com>
> > wrote:
> > > 
> > > On Fri, Dec 5, 2025 at 7:08 AM Vincent Guittot
> > > <vincent.guittot@linaro.org> wrote:
> > > > 
> > > > On Tue, 2 Dec 2025 at 01:24, Samuel Wu <wusamuel@google.com>
> > > > wrote:
> > > > > 
> > > > > On Wed, Oct 8, 2025 at 6:12 AM Vincent Guittot
> > > > > <vincent.guittot@linaro.org> wrote:
> 
> [...]
> 
> > > > > > 
> > > > > 
> > > > > Hi all,
> > > > > 
> > > > > I am seeing a power regression I've observed with this patch.
> > > > > This
> > > > 
> > > > The problem is that this patch is about fixing a wrong load
> > > > tracking
> > > > which can be underestimated on systems that become loaded.
> > > > 
> > > 
> > > I feel the patch is doing the proper thing, which is the
> > > appropriate
> > > bookkeeping when idle is the next task. I just wasn't 100% sure
> > > if
> > > there were some other indirect impact that was unintentional, so
> > > thought it would be good to send a report out and have another
> > > set of
> > > eyes look over it.
> > > 
> > > > > test was performed on Pixel 6 running android-mainline
> > > > > (6.18.0-rc7
> > > > > based); all scheduling vendor hooks are disabled, and I'm not
> > > > > seeing
> > > > > any obvious sched code differences compared to the vanilla
> > > > > upstream
> > > > > kernel. I am still actively working to see if I can find a
> > > > > simpler
> > > > > sequence to reproduce this on mainline Linux.
> > > > > 
> > > > > The Wattson tool is reporting an increased average power
> > > > > (~30-40%)
> > > > > with the patch vs baseline (patch reverted). This regression
> > > > 
> > > > For a use case in particular ?
> > > 
> > > This was for BouncyBall apk, which is a bouncing ball animation.
> > > I'm
> > > still trying to find a method to reproduce this on Linux, but
> > > still
> > > haven't been able to. Also we've been checking internally to root
> > > cause this, but nothing definitive yet.
> > > 
> > > > 
> > > > > correlates with two other metrics:
> > > > > 1. Increased residency at higher CPU frequencies
> > > > > 2. A significant increase in sugov invocations (at least 10x)
> > > > > 
> > > > > Data in the tables below are collected from a 10s run of a
> > > > > bouncing
> > > > > ball animation, with and without the patch.
> > > > > +-----------------------------------+--------------+---------
> > > > > ----------+
> > > > > >                                           | with patch | 
> > > > > > without patch |
> > > > > +-----------------------------------+-------------+----------
> > > > > ----------+
> > > > > > sugov invocation rate (Hz) |       133.5
> > > > > > |                   3.7 |
> > > > > +-----------------------------------+-------------+----------
> > > > > ----------+
> > > > > 
> > > > > +--------------+----------------------+----------------------
> > > > > +
> > > > > >                   |         with patch: |    without patch:
> > > > > > |
> > > > > > Freq (kHz) | time spent (ms) |  time spent (ms) |
> > > > > +--------------+----------------------+----------------------
> > > > > +
> > > > > >     738000 |                   4869 |                  9869
> > > > > > |
> > > > > >   1803000 |                   2936 |                     
> > > > > > 68 |
> > > > > >   1598000 |                   1072 |                       
> > > > > > 0 |
> > > > > >   1704000 |                     674
> > > > > > |                        0 |
> > > > > >              ... |                        ...
> > > > > > |                       ... |
> > > > > +--------------+----------------------+---------------------+
> > > > > 
> > > > > Thanks!
> > > > > Sam
> > 
> > For completeness, here are some Perfetto traces that show threads
> > running, CPU frequency, and PELT related stats. I've pinned the
> > util_avg track for a CPU on the little cluster, as the util_avg
> > metric
> > shows an obvious increase (~66 vs ~3 for with patch and without
> > patch
> > respectively).
> 
> I was focusing on the update of rq->lost_idle_time but It can't be
> related because the CPUs are often idle in your trace. But it also
> updates the rq->clock_idle and rq->clock_pelt_idle which are used to
> sync cfs task util_avg at wakeup when it is about to migrate and prev
> cpu is idle.
> 
> before the patch we could have old clock_pelt_idle and clock_idle
> that
> were used to decay the util_avg of cfs task before migrating them
> which would ends up with decaying too much util_avg
> 
> But I noticed that you put the util_avg_rt which doesn't use the 2
> fields above in mainline. Does android kernel make some changes for
> rt
> util_avg tracking ?


I believe this change can indeed account for the observed increase in
RT util.

When prev is the last RT task on the rq, the scheduler proceeds through
the CFS pick-next flow. With this patch, that path advances
rq_clock_pelt to the current time. However, updating rq_clock_pelt at
this stage does not seem correct, as RT util has not yet been updated.

The RT util update actually occurs later in put_prev_set_next_task(),
and it relies on the original value of rq_clock_pelt as input. Since
rq_clock_pelt has already been overwritten by the time the RT util
update takes place, the original timestamp is lost.

As a result, the intended CPU/frequency capacity scaling behavior is
disrupted, causing RT util to increase more rapidly than expected. This
appears to be an unintended consequence introduced by the patch.

> 
> > 
> > - with patch:
> > https://ui.perfetto.dev/#!/?s=964594d07a5a5ba51a159ba6c90bb7ab48e09326
> > - without patch:
> > https://ui.perfetto.dev/#!/?s=6ff6854c87ea187e4ca488acd2e6501b90ec9f6f

  parent reply	other threads:[~2026-01-16  6:51 UTC|newest]

Thread overview: 24+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2025-10-08 13:12 Vincent Guittot
2025-10-08 14:08 ` Peter Zijlstra
2025-10-14 11:47 ` [tip: sched/urgent] " tip-bot2 for Vincent Guittot
2025-12-02  0:23 ` [PATCH] " Samuel Wu
2025-12-05 15:08   ` Vincent Guittot
2025-12-06  0:54     ` Samuel Wu
2025-12-06  1:20       ` Samuel Wu
2025-12-13  3:54         ` Vincent Guittot
2025-12-23 17:27           ` Qais Yousef
2025-12-23 18:49             ` Qais Yousef
2026-01-05 20:08               ` Samuel Wu
2026-01-12 15:11                 ` Qais Yousef
2026-01-15 23:27                   ` Samuel Wu
2026-01-07  7:54               ` Vincent Guittot
2026-01-07  7:50             ` Vincent Guittot
2026-01-12 15:10               ` Qais Yousef
2026-01-16 14:02                 ` Vincent Guittot
2026-01-16  6:51           ` Alex Hoh (賀振坤) [this message]
2026-01-16 14:21             ` Vincent Guittot
2026-01-16 16:13               ` Vincent Guittot
2026-01-20  5:46                 ` Alex Hoh (賀振坤)
2026-01-20  8:36                   ` Vincent Guittot
2026-01-21  1:19                     ` Samuel Wu
2026-01-21 10:14                       ` Vincent Guittot

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=8cf19bf0e0054dcfed70e9935029201694f1bb5a.camel@mediatek.com \
    --to=alex.hoh@mediatek.com \
    --cc=bsegall@google.com \
    --cc=dietmar.eggemann@arm.com \
    --cc=juri.lelli@redhat.com \
    --cc=kernel-team@android.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=mgorman@suse.de \
    --cc=mingo@redhat.com \
    --cc=peterz@infradead.org \
    --cc=rostedt@goodmis.org \
    --cc=vincent.guittot@linaro.org \
    --cc=vschneid@redhat.com \
    --cc=wusamuel@google.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox

all inboxes | Powered by JetHome®