From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mail-pj1-f46.google.com (mail-pj1-f46.google.com [209.85.216.46]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id F212E84A5B for ; Mon, 13 Jan 2025 16:01:21 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.216.46 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1736784083; cv=none; b=MF5JOdD4HEVrh88mnjVxwR/UmT2DE3iOVqcHyZWzNx9JDXwaZ0XVe6PCBmrVEoOLtLOcyrVbeBiCJObOSGNp0lLCXglX73/m25XM8Ny1HsNdXq5edpz1lGNlCTR9WkrqPIr9tnH213MLt74FzczCvpiVvne5lriGHGePNbUaXqE= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1736784083; c=relaxed/simple; bh=cuP8CPdPbl6aGMxPxcpVuPTCFvjlSwPLAbbHE/yn+0E=; h=From:To:Cc:References:In-Reply-To:Subject:Date:Message-ID: MIME-Version:Content-Type; b=MPnD7zhPewdlS68fEVBOijBIK/7rbxY5/2zKHwLVLoX7flSNmMbkP3H+JM7nR0KcQG+l2wAHajAbVRAKIDq73kZlsjEIjHgSIeffqZ4jMQLYfKCxXrXDKQ6/YGGWhW248ea7cGN7cEnpxFNO9WUc+ut0IZx7RaUE8mnL1KL6d1Y= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=telus.net; spf=pass smtp.mailfrom=telus.net; dkim=pass (2048-bit key) header.d=telus.net header.i=@telus.net header.b=EFtfmRa6; arc=none smtp.client-ip=209.85.216.46 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=telus.net Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=telus.net Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=telus.net header.i=@telus.net header.b="EFtfmRa6" Received: by mail-pj1-f46.google.com with SMTP id 98e67ed59e1d1-2f4448bf96fso5649830a91.0 for ; Mon, 13 Jan 2025 08:01:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=telus.net; s=google; t=1736784081; x=1737388881; darn=vger.kernel.org; h=thread-index:content-language:content-transfer-encoding :mime-version:message-id:date:subject:in-reply-to:references:cc:to :from:from:to:cc:subject:date:message-id:reply-to; bh=VN9smRK6gmJjFsIKpc6fLO5+F6RdmqH1gHa89tpR1Ac=; b=EFtfmRa6jqlxrVD0xuMTnVKMyca/tp4gLrBs698xIhRlcf8qHG8PWEcH+qZ/qVRKgr Eeuxoua5l5ZFG9N3n5nsOhoMbNogGPf6FOlcFHkY+Nd/OiiaPj+ULlX6cccO4/fsBHmv kZbgakfJ8py4d2A8E32RGJPqfeSiyhgpONm2CQREp+yFp+QL1CEDRS4r+dvFDd83/51L 7HDrRw0CpChTJGXjKykNpmNeehwlS081BQX11CMfXslNHu/M2QrxFu42qaPiHrANAbea t53GzYCeHW9HOW1dN757MSBk+872g4MJ++bTtlgPO8CNUJMTAm5s9ztjiZ5VaQTiJuCc aYwg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1736784081; x=1737388881; h=thread-index:content-language:content-transfer-encoding :mime-version:message-id:date:subject:in-reply-to:references:cc:to :from:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=VN9smRK6gmJjFsIKpc6fLO5+F6RdmqH1gHa89tpR1Ac=; b=n6JA5C4ijxadDD9wWhKrUbSUPe8Z/3e0b5jYIYOwwFhnVz9SSWOdqGYaESIMlwFVGt /HxN9YseXMaKk5x6NtELyYXAK27EKE0KvyLCzQ6vMsH7pcAvl0XDTnypfXSxQ9/j8fVf CRQBfeRZCCxJGley8acxm5L9TvBn7g6SiKCiCvGBY1jNmuoD/ahfTrgrqLRDwhHJAJSW amV9ImNqnxpMi5F/RdcNzp6p6BRNYpLwej6ctZaETIFkjw7RyHNXMXOaYdF6H28olojr MIDP5L0CfkeFQRzLIKL0kbF4EZcPvq5PYc6Fjs+K151eYjUqS2AEpXkWYqgT/8J152Xr zBkA== X-Gm-Message-State: AOJu0YyRSODaTs9SGQWJsur1m4vwlhQ7UawyKkFxmsTFGvh/xt7N3Otk apELsDINTV185yxGAxn7qBykOKoyHKI8v+ar+6zyAArY758wecMmxZbaeHlkB4M= X-Gm-Gg: ASbGncs4Fj/dnETFfoHRR2n9Cg4V1wSBLaMSXPBxjXp/+jqlZICvF0xn6y7bqSrxrdv CysrT7BnQld3NrbFfvD/GdVFjjyVacFkxaqrU4NCAjV2j64oGmFd6QvrLhb/y16JQq/WqBlaUyO Uco2M0neA6pzdQvkfjwfywkq83CeFS0ZrWPMSFyvWPU8B75K1rBw5drJoClwa8bzq4geljXRz63 yLV7s8IYd7WPoH2ATylj9clfepJlmybxPJuVxhRPCz6nPru4zDjfGjtj2OqgJofY8pRAiQhGEBu pbRPfNrRyx8KKBwCRhuWFw== X-Google-Smtp-Source: AGHT+IG4uIqbHv5mForgQpV+xAyjjPW2HZSPKnU8KY8YUcVMOrVlxErIs19J6VG+fkyqBjH4kYj6DA== X-Received: by 2002:a17:90a:c2c7:b0:2ea:2a8d:dd2a with SMTP id 98e67ed59e1d1-2f548f1ecebmr30095924a91.27.1736784081174; Mon, 13 Jan 2025 08:01:21 -0800 (PST) Received: from DougS18 (s66-183-142-209.bc.hsia.telus.net. [66.183.142.209]) by smtp.gmail.com with ESMTPSA id 98e67ed59e1d1-2f54a2ad36asm10396458a91.30.2025.01.13.08.01.20 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Mon, 13 Jan 2025 08:01:20 -0800 (PST) From: "Doug Smythies" To: "'Peter Zijlstra'" Cc: , , "'Ingo Molnar'" , , "Doug Smythies" References: <001b01db608a$56d3dc40$047b94c0$@telus.net> <20250107112606.GN20870@noisy.programming.kicks-ass.net> <20250107192340.GB36003@noisy.programming.kicks-ass.net> <001501db618c$67bd8170$37388450$@telus.net> <20250108131205.GO20870@noisy.programming.kicks-ass.net> <001b01db61e4$c3ce5a40$4b6b0ec0$@telus.net> <20250109105959.GA2981@noisy.programming.kicks-ass.net> <002f01db631d$d265a600$7730f200$@telus.net> <20250110115720.GA17405@noisy.programming.kicks-ass.net> <00c201db6547$b43b9a50$1cb2cef0$@telus.net> <20250113110546.GE5388@noisy.programming.kicks-ass.net> In-Reply-To: <20250113110546.GE5388@noisy.programming.kicks-ass.net> Subject: RE: [REGRESSION] Re: [PATCH 00/24] Complete EEVDF Date: Mon, 13 Jan 2025 08:01:20 -0800 Message-ID: <000d01db65d4$642acbc0$2c806340$@telus.net> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Outlook 16.0 Content-Language: en-ca Thread-Index: AQICrP0foC7hvB9QNFmGgYTzjXqgOgFlSYB1Ae1LAnYDJbHCPAGeOm19AXo0kegAUxmAyAJrFAqmAU/iX/kBJCftawLLyNjvsjnRrnA= On 2025.01.13 03:06 Peter Zijlstra wrote: > On Sun, Jan 12, 2025 at 03:14:17PM -0800, Doug Smythies wrote: > >> The test I have been running to create some of the graphs I have been >> attaching is a little different, using turbostat with different options: >> >> turbostat --quiet --Summary --show Busy%,Bzy_MHz,IRQ,PkgWatt,PkgTmp,TSC_MHz,Time_Of_Day_Seconds --interval 1 >> >> And with this test I get intervals over 1 second by over 10 milliseconds. > >> First the b12 kernel (the last good one in the kernel bisection): >> >> Time Occurrences >> 1.000000, 3282 >> 1.001000, 1826 >> 1.002000, 227 >> 1.003000, 1852 >> 1.004000, 1036 >> 1.005000, 731 >> 1.006000, 75 >> 1.007000, 30 >> 1.008000, 9 >> 1.009000, 2 >> 1.010000, 1 >> 1.011000, 1 > > You're creating these Time values from the consecutive > Time_Of_Day_Seconds data using a script? Let me go check the turbostat > code to see if my hackery is still invoked, even if not displayed. Yes, sort of. I put the output into a spreadsheet and add a column calculating the time difference between samples. The histogram is created by a simple c program run against that extracted column. Anyway, I finally did get some useful information. Examples: Samp uSec Time of day Delta T Freq TSC IRQ TMP PWR 4086 4548 1736734595.017487 1.007149935 4800 4104 12128 73 107.52 6222 4059 1736736736.520998 1.009660006 4800 4098 12124 74 106.73 6263 400 1736736777.699340 1.023000002 4800 4104 12345 73 106.51 The summary histogram line for that capture is: Total: 9079 : Total >= 10 mSec: 128 ( 1.41 percent) The maximum uSec was 4548 and there are only about 20 (counted manually) greater than 1 millisecond (i.e. all good) The command used was: turbostat --quiet --Summary --show Busy%,Bzy_MHz,IRQ,PkgWatt,PkgTmp,TSC_MHz,Time_Of_Day_Seconds,usec --interval 1 Anyway, there never is any long time within the turbostat per interval execution. Any extra time seems to be outside of the main loop.