From: K Prateek Nayak <kprateek.nayak@amd.com>
To: Shrikanth Hegde <sshegde@linux.ibm.com>,
"Guo, Wangyang" <wangyang.guo@intel.com>
Cc: <linux-kernel@vger.kernel.org>,
Benjamin Lei <benjamin.lei@intel.com>,
"Tim Chen" <tim.c.chen@linux.intel.com>,
Tianyou Li <tianyou.li@intel.com>,
"Ingo Molnar" <mingo@redhat.com>,
Peter Zijlstra <peterz@infradead.org>,
Juri Lelli <juri.lelli@redhat.com>,
Vincent Guittot <vincent.guittot@linaro.org>,
Dietmar Eggemann <dietmar.eggemann@arm.com>,
Steven Rostedt <rostedt@goodmis.org>,
Ben Segall <bsegall@google.com>, Mel Gorman <mgorman@suse.de>,
Valentin Schneider <vschneid@redhat.com>
Subject: Re: [PATCH v7] sched/clock: Avoid false sharing for sched_clock_irqtime
Date: Wed, 28 Jan 2026 13:20:44 +0530 [thread overview]
Message-ID: <c22ed156-b9d7-487c-93e7-685577e7f12c@amd.com> (raw)
In-Reply-To: <2a7521d9-e4d8-4dc6-8e5a-122796f0d1ab@linux.ibm.com>
On 1/28/2026 1:02 PM, Shrikanth Hegde wrote:
>
>
> On 1/28/26 12:48 PM, K Prateek Nayak wrote:
>> On 1/28/2026 11:56 AM, Shrikanth Hegde wrote:
>>>
>>>
>>> On 1/28/26 8:35 AM, K Prateek Nayak wrote:
>>>> On 1/28/2026 7:49 AM, Guo, Wangyang wrote:
>>>>> Yes, when clock mark unstable through tsc_.*mark_unstable() with non-native_sched_clock, clear_sched_clock_stable won't be called, thus sched_clock_irqtime still keep enabled.
>>>>>
>>>>> Maybe the dedicated workqueue for sched_clock_irqtime is still needed considering this case.
>>>>
>>>> In that case, shouldn't tsc_init() only enable irqtime when
>>>> using_native_sched_clock()? How can tsc_init() make a call on irqtime if
>>>> TSC isn't being used as the sched_clock() ultimately?
>>>>
>>>> For kvmclock, if PVCLOCK_TSC_STABLE_BIT is not set, it'll call
>>>> clear_sched_clock_stable() at kvm_sched_clock_init() but none of the
>>>> other clocksources do so we can assume once we override the sched_clock()
>>>> it is up to the sched_clock() provider to deal with the clock stability.
>>>>
>>>
>>> I think this would depend if mark_tsc_unstable happens after system boot,
>>> specially while running kvm guest?
>>
>> I don't see anything on the guest side that would mark the kvmclock as
>> unstable if host's TSC turns unstable post init and since kvmclock
>> doesn't set CLOCK_SOURCE_MUST_VERIFY, I doubt if a watchdog runs to
>> verify it in the guest.
>>
>> I have the following in the guest:
>>
>> $ sudo dmesg | grep -i clock
>> [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00
>> [ 0.000000] kvm-clock: using sched offset of 423259259 cycles
>
> This means pv_sched_clock is kvm_sched_clock_read from now. and
> irqtime is enabled in the guest. right?
So within the guest today ...
$ sudo dmesg | grep -i "clock\|tsc"
[ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00
[ 0.000000] kvm-clock: using sched offset of 504626078 cycles
# kvm_sched_clock_init() happens here so it can potentially do
# clear_sched_clock_stable() here if !PVCLOCK_TSC_STABLE_BIT.
[ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns
[ 0.000004] tsc: Detected 1996.251 MHz processor
# We enable irqtime here once TSC frequency has been determined
# without considering using_native_sched_clock()
After that TSC is never selected so we don't care if it is stable
or not since it is not the clocksource - the guest continues on
with unstable sched_clock() but also irqtime enabled since TSC
was calibrated successfully.
>
>> [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns
>> [ 0.071675] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
>> [ 0.378467] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns
>> [ 0.388678] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x398cb1e4d56, max_idle_ns: 881590790753 ns
>> [ 0.679262] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
>> [ 0.903121] PTP clock support registered
>> [ 0.927243] clocksource: Switched to clocksource kvm-clock
>> [ 0.944986] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
>> [ 0.993198] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x398cb1e4d56, max_idle_ns: 881590790753 ns
>> [ 1.123796] rtc_cmos 00:05: setting system clock to 2026-01-28T07:03:45 UTC (1769583825)
>> [ 1.155755] sched_clock: Marking stable (940009972, 212965288)->(1171254846, -18279586)
>> [ 1.712598] clk: Disabling unused clocks
>>
>> Then I mark TSC unstable on the host
>>
>> tsc: Marking TSC unstable due to Faking unreliable TSC!
>> TSC found unstable after boot, most likely due to broken BIOS. Use 'tsc=unstable'.
>> clocksource: Checking clocksource tsc synchronization from CPU 93 to CPUs 0,2,26,75,101,114,118,195.
>> sched_clock: Marking unstable (945948313746, 69389667)<-(947618130068, -1600430832)
>> clocksource: CPU 93 check durations 3436ns - 25277ns for clocksource tsc.
>> clocksource: Switched to clocksource hpet
>>
>
> so now, using_native_sched_clock should fail in guest? If so, with the patch,
> irqtime won't be disabled no?
Ideally yes, but the guest continues using kvmclock without any hitch.
I think the x86 KVM layer has something to ensure stability but I'm
not 100% sure.
Since I don't see "tsc: Marking TSC unstable ..." or "sched_clock:
Marking unstable ..." in the guest, we don't hit the mark_tsc_unstable()
path within the guest which would disable irqtime today so essentially
host's TSC turning changing doesn't seem to affect the guest.
>
>> And nothing happens in the guest.
>>
>> cat /sys/devices/system/clocksource/clocksource0/current_clocksource
>> kvm-clock
>>
>>
>> If I launch the guest after marking host TSC unstable, I see:
>>
>> Unstable clock detected, switching default tracing clock to "global"
>>
>> and I don't get any "sched_clock: Marking stable" messages.
>>
>
> Maybe kvm_para_has_feature(KVM_FEATURE_CLOCKSOURCE_STABLE_BIT) won't be set.
True but that is only for new guests launches past marking TSC unstable
on the host.
--
Thanks and Regards,
Prateek
next prev parent reply other threads:[~2026-01-28 7:50 UTC|newest]
Thread overview: 11+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-01-27 7:25 Wangyang Guo
2026-01-27 11:04 ` Shrikanth Hegde
2026-01-28 2:19 ` Guo, Wangyang
2026-01-28 3:05 ` K Prateek Nayak
2026-01-28 6:26 ` Shrikanth Hegde
2026-01-28 7:18 ` K Prateek Nayak
2026-01-28 7:32 ` Shrikanth Hegde
2026-01-28 7:50 ` K Prateek Nayak [this message]
2026-01-28 7:56 ` Shrikanth Hegde
2026-02-03 9:55 ` Vincent Guittot
2026-02-03 11:18 ` [tip: sched/core] " tip-bot2 for Wangyang Guo
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=c22ed156-b9d7-487c-93e7-685577e7f12c@amd.com \
--to=kprateek.nayak@amd.com \
--cc=benjamin.lei@intel.com \
--cc=bsegall@google.com \
--cc=dietmar.eggemann@arm.com \
--cc=juri.lelli@redhat.com \
--cc=linux-kernel@vger.kernel.org \
--cc=mgorman@suse.de \
--cc=mingo@redhat.com \
--cc=peterz@infradead.org \
--cc=rostedt@goodmis.org \
--cc=sshegde@linux.ibm.com \
--cc=tianyou.li@intel.com \
--cc=tim.c.chen@linux.intel.com \
--cc=vincent.guittot@linaro.org \
--cc=vschneid@redhat.com \
--cc=wangyang.guo@intel.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®