From: Joseph Salisbury <joseph.salisbury@oracle.com>
To: Christian Loehle <christian.loehle@arm.com>,
"Rafael J. Wysocki (Intel)" <rafael@kernel.org>
Cc: rafael.j.wysocki@intel.com, Ingo Molnar <mingo@redhat.com>,
Peter Zijlstra <peterz@infradead.org>,
Juri Lelli <juri.lelli@redhat.com>,
Vincent Guittot <vincent.guittot@linaro.org>,
Dietmar Eggemann <dietmar.eggemann@arm.com>,
frederic@kernel.org, linux-pm@vger.kernel.org,
LKML <linux-kernel@vger.kernel.org>,
regressions@lists.linux.dev
Subject: Re: [REGRESSION] sched/idle: Sysbench threads regression after f4c31b07b136
Date: Wed, 8 Jul 2026 11:25:02 -0400 [thread overview]
Message-ID: <523a095d-8c30-4e25-9a1b-88cdf438041f@oracle.com> (raw)
In-Reply-To: <5f5cb821-92ae-4539-ae81-a43e33a7ded5@arm.com>
On 7/6/26 10:29 AM, Christian Loehle wrote:
> On 7/2/26 19:47, Rafael J. Wysocki (Intel) wrote:
>> Hi,
>>
>> On Thu, Jul 2, 2026 at 6:30 PM Joseph Salisbury
>> <joseph.salisbury@oracle.com> wrote:
>>> Hi Rafael,
>>>
>>> We are seeing a reproducible MySQL Sysbench threads regression. A
>>> bisect indicated the following commit as the first bad commit:
>>> f4c31b07b136 ("sched: idle: Consolidate the handling of two special cases")
>>>
>>> The regression was found in Oracle kernel performance testing on OCI VM
>>> shapes:
>>>
>>> VM Details:
>>> * VM.Standard2.1:
>>> x86 OCI VM shape, 1 OCPU / 2 hardware threads, about 14.5 GB RAM
>>>
>>> * VM.Standard.A1.Flex.2:
>>> Arm/Ampere A1 flexible VM shape, 2 vCPU threads, about 10.9 GB RAM
>>>
>>>
>>> The ResultsDB runs show the regression in the Sysbench threads metric:
>>>
>>> - VM.Standard2.1: 333 -> 236 (-29.1%)
>>> - VM.Standard.A1.Flex.2: 1286 -> 1152 (-10.4%)
>>>
>>> A test kernel was built with f4c31b07b136 reverted and the performance
>>> regression was recovered.
>>>
>>> From the code, it is possible the regression is due to the new
>>> previous-wakeup heuristic in the special idle cases. Before the commit:
>>>
>>> - no cpuidle driver:
>>> tick_nohz_idle_stop_tick()
>>> default_idle_call()
>>>
>>> - one idle state:
>>> tick_nohz_idle_retain_tick()
>>> cpuidle state 0
>> I think that this is your case and the tick stops for you sometimes
>> now while it had never stopped before.
>>
>> Can you confirm?
>>
>> Overall, it would be good to know the idle state lists for both the VM
>> and the host.
>>
> +1, but also which HZ are you using?
> Both systems reported have 2 logical CPUs then? Were higher core counts also
> tested and how does it affect them?
Hi Rafael, Christian,
Thanks for the feedback!
We will collect the requested runtime data from the affected systems
before testing the proposed one-line change.
For Christian’s HZ question, I can answer from the UEK kernel configs.
The relevant configs for the affected kernel are:
- x86_64 / VM.Standard2.1:
- CONFIG_HZ=1000
- CONFIG_HZ_1000=y
- CONFIG_NO_HZ_FULL=y
- CONFIG_NO_HZ=y
- CONFIG_CPU_IDLE=y
- CONFIG_INTEL_IDLE=y
- CONFIG_ACPI_PROCESSOR_IDLE=y
- arm64 / VM.Standard.A1.Flex.2:
- CONFIG_HZ=250
- CONFIG_HZ_250=y
- CONFIG_NO_HZ_FULL=y
- CONFIG_NO_HZ=y
- CONFIG_CPU_IDLE=y
- CONFIG_ACPI_PROCESSOR_IDLE=y
- CONFIG_ARM_PSCI_CPUIDLE is not set
The ResultsDB metadata for the two reported systems shows both had 2
logical CPUs:
- VM.Standard2.1: 1 OCPU / 2 hardware threads
- VM.Standard.A1.Flex.2: 2 vCPU threads
I do not yet have higher-core-count results for this same comparison. I
will check whether those runs exist, and if not, whether we can schedule
them.
Thanks,
Joe
next prev parent reply other threads:[~2026-07-08 15:25 UTC|newest]
Thread overview: 12+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-07-02 16:25 Joseph Salisbury
2026-07-02 18:47 ` Rafael J. Wysocki (Intel)
2026-07-06 14:29 ` Christian Loehle
2026-07-08 15:25 ` Joseph Salisbury [this message]
2026-07-24 17:20 ` Joseph Salisbury
2026-07-28 8:30 ` Christian Loehle
2026-07-28 16:37 ` [PATCH] sched/idle: Stop the tick when no cpuidle driver is available Christian Loehle
2026-11-05 23:59 ` Florian Fainelli
2026-07-29 2:36 ` [REGRESSION] sched/idle: Sysbench threads regression after f4c31b07b136 Zhan Xusheng
2026-07-29 18:03 ` Rafael J. Wysocki (Intel)
2026-07-29 18:25 ` Rafael J. Wysocki (Intel)
2026-07-30 9:27 ` Christian Loehle
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=523a095d-8c30-4e25-9a1b-88cdf438041f@oracle.com \
--to=joseph.salisbury@oracle.com \
--cc=christian.loehle@arm.com \
--cc=dietmar.eggemann@arm.com \
--cc=frederic@kernel.org \
--cc=juri.lelli@redhat.com \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-pm@vger.kernel.org \
--cc=mingo@redhat.com \
--cc=peterz@infradead.org \
--cc=rafael.j.wysocki@intel.com \
--cc=rafael@kernel.org \
--cc=regressions@lists.linux.dev \
--cc=vincent.guittot@linaro.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®