From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mail-pl1-f199.google.com (mail-pl1-f199.google.com [209.85.214.199]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 0A7F13B7B71 for ; Mon, 10 Aug 2026 22:55:26 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.214.199 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1786402528; cv=none; b=jB3jL3zULk+CGIsi6panor5K/5jzj0Im6q4VZyVwaXX7iHI9BB/Lp/RzbTTtdErANriBlrCU4opqMV60HsXRuj9C+sx8zLhLMijeHpk/hYv6ExIPJhy6QuPBvorw1w+1i1QrdPOss5kxEbo6TWB+gciVnzp5yt76Z7BfV8dUGRo= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1786402528; c=relaxed/simple; bh=UvWnP8rThQ0I2iu6au3IwSGq/W2BJVM9E1d48NUSteQ=; h=Date:In-Reply-To:Mime-Version:References:Message-ID:Subject:From: To:Cc:Content-Type; b=ax2GR9gSciP9FGmExd6qtulsNi9Rkb+Wpwvqwuaa6erybeeDKsqDjYOuD31+0qYqThzRxrtwfYT4jcHanoNEJWe2u3pnGasiXkUEsqZnnfthOC3gJeISjdMLuiawhNwbwvoOwjdi9Gm5kplLKWZt19FpdrnJBzyIkFiwgEQqbFI= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=google.com; spf=pass smtp.mailfrom=flex--seanjc.bounces.google.com; dkim=pass (2048-bit key) header.d=google.com header.i=@google.com header.b=IaRYzKW3; arc=none smtp.client-ip=209.85.214.199 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=google.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=flex--seanjc.bounces.google.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=google.com header.i=@google.com header.b="IaRYzKW3" Received: by mail-pl1-f199.google.com with SMTP id d9443c01a7336-2cf6acd760cso31909395ad.3 for ; Mon, 10 Aug 2026 15:55:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20251104; t=1786402526; x=1787007326; darn=vger.kernel.org; h=content-type:cc:to:from:subject:message-id:references:mime-version :in-reply-to:date:reply-to:from:to:cc:subject:date:message-id :reply-to:content-type; bh=57aBPOihCrGWuqYYWudkiYYcx3GP5FARz7fTh3Mm/5c=; b=IaRYzKW3AZ+vr7omLIP6hsuC5mZVFBNRwls4uZMkBXMPH2I0E0BtlPpu2y+/XWDqpB pmRFkCXZvWc0dQi/yuo8/RuCF+hoh3+kNPKSr3B28PrBFYBf/WF5H3w25yELTcgUjiF1 /bInh1egzb6quKATsYrBxeTitO4omykEV5dhvrf4eQRP/y+LblmO2ljbnxkZer1/4PJz 0tCqsZ8sQktLeBEG4ICqt+szqfJ0YGlWWvzv7v5I1SndQdPhAu8ypcpFP+hUkA+8Vm6f 55PGN78Ea46kZARhkeqvzqvj+UlPWNgjgGVK1Aje1eGfbGqIMcrOREsq5JF/TeJicbva hYIw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1786402526; x=1787007326; h=content-type:cc:to:from:subject:message-id:references:mime-version :in-reply-to:date:reply-to:x-gm-message-state:from:to:cc:subject :date:message-id:reply-to:content-type; bh=57aBPOihCrGWuqYYWudkiYYcx3GP5FARz7fTh3Mm/5c=; b=OvmeksqFT/BVsHc0KGUsAaWhuYZfHXZYjsKkX3ZRjadVR0v4/I6k6dRBhTVUUkBtl3 UUAPMjTIdN0nSQ7p/8b/3+Oc9iYz2ys7RX1GCaGp9dap30C/KuisD1IpcP6Ea0hx03TC sCSMyaBNzwgQBhs+1EisDj96aAZ0GDETa/0ESboFkLibP84IrWZAv9xEwNWUIR7LmNN2 Lwwn8Oqs8lVJbZjVASeZsGdxm+N2Z2UzX12GTeg1v0pT0+DagKqpulK/I0M00HBrkcko qdLfotfoXP9LgIGxVANjQvtvEHtosjnBEK7nFyCAGpt1Dp0nx6DE/h4UNcG4d647Nl25 pIjA== X-Forwarded-Encrypted: i=1; AHgh+Rq/XtyDR1328mL0+JzuyE41c+O02z74A+AZaWylfbwhpeweEvMeDnNtOh22CjxKsgJzDVWykz2VDTauYJg=@vger.kernel.org X-Gm-Message-State: AOJu0YwjVm4pfUyMTe8Qb27fgvoZqNX/i9tH4LvmHEoXUIANaYbdnR3P EG+OZd5h+urB7iVYgj4gXIvWu80ZJarG1eJxjJcXcrp1F7BxOtmMsBJ3D2sq2Nw2hBtt6j4ZfGt 6uiIU/w== X-Received: from plsk18.prod.google.com ([2002:a17:902:ba92:b0:2ca:cdc4:8da]) (user=seanjc job=prod-delivery.src-stubby-dispatcher) by 2002:a17:903:2bcc:b0:2c9:a5e9:c26e with SMTP id d9443c01a7336-2d3001e6ebcmr57931765ad.13.1786402526184; Mon, 10 Aug 2026 15:55:26 -0700 (PDT) Reply-To: Sean Christopherson Date: Mon, 10 Aug 2026 15:54:57 -0700 In-Reply-To: <20260810225500.869288-1-seanjc@google.com> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: Mime-Version: 1.0 References: <20260810225500.869288-1-seanjc@google.com> X-Mailer: git-send-email 2.55.0.679.g6767b8d81c-goog Message-ID: <20260810225500.869288-20-seanjc@google.com> Subject: [PATCH v9 19/21] KVM: x86: Use kernel timekeeping snapshots for getting kvmclock time since boot From: Sean Christopherson To: Sean Christopherson , Paolo Bonzini Cc: kvm@vger.kernel.org, linux-kernel@vger.kernel.org, Paul Durrant , David Woodhouse , Dongli Zhang Content-Type: text/plain; charset="UTF-8" From: David Woodhouse Replace the KVM-private vgettsc()+do_kvmclock_base() timekeeping reimplementation with calls to the recently crafted, generic ktime_get_snapshot_id() interface. This is the first step towards dropping KVM's homebrewed implementation entirely (do_monotonic() and do_realtime() will be converted in the near future). As with KVM's implementation, the snapshot provides both the system time and the raw_cycles (TSC), atomically paired using a sequence counter. The equivalents to vgettsc()'s TSC and HVCLOCK modes respectively are if the clocksource itself is TSC (cs_id == CSID_X86_TSC) and if the underlying hardware clocksource is TSC (hw_csid == CSID_X86_TSC). In the Hyper-V case, i.e. hw_csid == CSID_X86_TSC, if the clocksource couldn't provide a raw hardware counter value, treat the clock not being based on TSC, which which is equivalent to vgettsc() returning VDSO_CLOCKMODE_NONE. Unlike KVM's current implementation, don't include offs_boot in the atomically-acquired tuple as there's simply no need to do so: the time since boot only changes at boot (duh) and at suspend/resume boundaries. Unless processes aren't being frozen/thawed before/after suspend/resume, which would completely break suspend/resume, TK_OFFS_BOOT can't change while kvm_get_time_and_clockread() is running. And if KVM does somehow try to take a snapshot during suspend, timekeeping core will WARN and refuse to provide the snapshot. This is a step towards eliminating the pvclock_gtod_data private copy of timekeeping state and the associated notifier callback. Signed-off-by: David Woodhouse [sean: separate from other conversions, massage changelog accordingly] Signed-off-by: Sean Christopherson --- arch/x86/kvm/x86.c | 57 ++++++++++++++++++++++++---------------------- 1 file changed, 30 insertions(+), 27 deletions(-) diff --git a/arch/x86/kvm/x86.c b/arch/x86/kvm/x86.c index aa39a423694c..85c456dd29d5 100644 --- a/arch/x86/kvm/x86.c +++ b/arch/x86/kvm/x86.c @@ -35,6 +35,7 @@ #include "smm.h" #include +#include #include #include #include @@ -1435,29 +1436,6 @@ static inline u64 vgettsc(struct pvclock_clock *clock, u64 *tsc_timestamp, return v * clock->mult; } -/* - * As with get_kvmclock_base_ns(), this counts from boot time, at the - * frequency of CLOCK_MONOTONIC_RAW (hence adding gtos->offs_boot). - */ -static int do_kvmclock_base(s64 *t, u64 *tsc_timestamp) -{ - struct pvclock_gtod_data *gtod = &pvclock_gtod_data; - unsigned long seq; - int mode; - u64 ns; - - do { - seq = read_seqcount_begin(>od->seq); - ns = gtod->raw_clock.base_cycles; - ns += vgettsc(>od->raw_clock, tsc_timestamp, &mode); - ns >>= gtod->raw_clock.shift; - ns += ktime_to_ns(ktime_add(gtod->raw_clock.offset, gtod->offs_boot)); - } while (unlikely(read_seqcount_retry(>od->seq, seq))); - *t = ns; - - return mode; -} - /* * This calculates CLOCK_MONOTONIC at the time of the TSC snapshot, with * no boot time offset. @@ -1502,6 +1480,29 @@ static int do_realtime(struct timespec64 *ts, u64 *tsc_timestamp) return mode; } +static bool kvm_snapshot_has_tsc(struct system_time_snapshot *snap, + u64 *tsc_timestamp) +{ + /* + * ktime_get_snapshot_id() cannot fail for standard clock IDs + * (only for invalid/aux clocks or during suspend, with a WARN). + */ + if (!snap->valid) + return false; + + if (snap->cs_id == CSID_X86_TSC) { + *tsc_timestamp = snap->cycles; + return true; + } + + if (snap->hw_csid == CSID_X86_TSC && snap->hw_cycles) { + *tsc_timestamp = snap->hw_cycles; + return true; + } + + return false; +} + /* * Calculates the kvmclock_base_ns (CLOCK_MONOTONIC_RAW + boot time) and * reports the TSC value from which it do so. Returns true if host is @@ -1509,12 +1510,14 @@ static int do_realtime(struct timespec64 *ts, u64 *tsc_timestamp) */ static bool kvm_get_time_and_clockread(s64 *kernel_ns, u64 *tsc_timestamp) { - /* checked again under seqlock below */ - if (!gtod_is_based_on_tsc(pvclock_gtod_data.clock.vclock_mode)) + struct system_time_snapshot snap = {}; + + ktime_get_snapshot_id(CLOCK_MONOTONIC_RAW, &snap); + if (!kvm_snapshot_has_tsc(&snap, tsc_timestamp)) return false; - return gtod_is_based_on_tsc(do_kvmclock_base(kernel_ns, - tsc_timestamp)); + *kernel_ns = ktime_to_ns(ktime_mono_to_any(snap.systime, TK_OFFS_BOOT)); + return true; } /* -- 2.55.0.679.g6767b8d81c-goog