From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mail-pl1-f170.google.com (mail-pl1-f170.google.com [209.85.214.170]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 40992137C35 for ; Mon, 20 Jan 2025 03:55:55 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.214.170 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1737345357; cv=none; b=SQ9GVjP8f/5VvU25LRupb1if2b71UZ+DBAakO0eAVKfmSJTq6Fdy3boqykN2DCIScR9bg0xcBQkAjVrkP2TRpoqmoppw4/kKBtghuRFdnOW6nb1hpt4zAxXoMpehC1eRLEdaYfalA/xKa+O6HUODRbrlUFiS2df2lwuCKxtWjKo= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1737345357; c=relaxed/simple; bh=u1yf1x5hzXIX4tODzDTXivrs1QDYM06ElFppcX/S304=; h=From:To:Cc:References:In-Reply-To:Subject:Date:Message-ID: MIME-Version:Content-Type; b=h6NN15PkO93iIcBSJS0nC/jSVKvaGpOooeU0H73rFbLJxYWOUHlxUXdl6l2XuzKfhB65y4i3OQJC/ov7IrtHB/v949IUAGI9hcWHSbil1/ov/1yccYSBooiWN3FIe5PhROEeOKthHo5KvOEwKBjun4973ZWNdPlLthZDYoKLk3Q= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=telus.net; spf=pass smtp.mailfrom=telus.net; dkim=pass (2048-bit key) header.d=telus.net header.i=@telus.net header.b=gh5SINeH; arc=none smtp.client-ip=209.85.214.170 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=telus.net Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=telus.net Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=telus.net header.i=@telus.net header.b="gh5SINeH" Received: by mail-pl1-f170.google.com with SMTP id d9443c01a7336-2161eb95317so72779785ad.1 for ; Sun, 19 Jan 2025 19:55:55 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=telus.net; s=google; t=1737345355; x=1737950155; darn=vger.kernel.org; h=thread-index:content-language:content-transfer-encoding :mime-version:message-id:date:subject:in-reply-to:references:cc:to :from:from:to:cc:subject:date:message-id:reply-to; bh=1KFnWyanZNYjHein9v2caGhdQCNPGhQlYqM8hZYALPc=; b=gh5SINeHj4iuKQU+MBi2wW9k1eXPbV7AgitOXIVYrikibBYOVvF6UjB4merMkVGdax t7lMIiGFuLTwzEScta0jJpG3g74DMpkzWlaAswsgbB0YjUKRp6ozl0Z+//h6bsHLLj7J aSAapoa/3mUatLu04i1CmTv+9IVqp7ZUtDb8+ctClE6J0aaBbxqMRrWshwuT2IFCUUAO GqFK9HL3jhmsQLObrp1518vV8uPK0TJQTh98qsWz/hH7glgwSD5R/grUBjl03shDuNDI SYy/Q/oBmYBoR92xxg59SHe5tHqU+J1eDIPVhSkTGZys+MTz4tEMCMl6QIcY6TdmRtsr exkg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1737345355; x=1737950155; h=thread-index:content-language:content-transfer-encoding :mime-version:message-id:date:subject:in-reply-to:references:cc:to :from:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=1KFnWyanZNYjHein9v2caGhdQCNPGhQlYqM8hZYALPc=; b=Z4M48gFlK52uCk8Rq8q8WXpzsMi5u6pj96wzJUarUl5MioWAWe+f5fMcJH7X3sR7rw ZXiGZbAukKoQY2fVMLkLmSe7oFkLE0sXwqSjRXDffi/Ph5znWPX1h0nLKokoSehgtPWT s8ONf0bhMh8AEXqEiX3R7tasJes4nG1PTanHWcxtbRSZSl8O8q02hyKQNjotjg8S1ggs HwQv4WzaTtUMiwqY5DVdZ05tn5uEwItG0mwftYq4f5l6OmIeeW39teFlgXrBJ8Sq/TRV EMRjbsIrjIZuJXPIjKnuJye1NgU4x3xOuDjDae+b9L6eYo86OSewfnIwKs6/WrL4YmlS O9SQ== X-Gm-Message-State: AOJu0Yx92aHVbeTjE9lnAJLO+GsK/kuBZH0xHd4o/zASh8pkAEr+vS8L rCEuonWOjUpm8uaX698Q13l+eQD+gkghZ0bLdC4VcFODHXUle9tNkzgdeDtdJnw= X-Gm-Gg: ASbGnctABMqVglRhLxOE9xK4Nssv1gxq4TsUz5XQOKoTd5eSIBE5h3sppPmYI2EBa8H vHwmdzCOsfmh3NfQ+qy4QOW1N/E3o7chL5FrvVNuS/sgzYdMEqi3BTHoVWnS4SDEb2/Ji0MG/sV 1/vIUICB6B/OADIqexFx4j79CkiJb5zf1DQboJBIFZfJdZxDFn8HVw/2r8EfC6PDLWbNWBqEdEx 5bYebYzGJRZlCvBFVDdEQ0iih717U+GaOIQ6qvgu2oefyTxemjWxvBBMLKfJzbqIFE5+FNBiNlg 7Owq97a78/THL3KggkQrHgpyTw/Z+p99TMI= X-Google-Smtp-Source: AGHT+IEKEcCnLstjqFe+c0yP5QyMKhTWHyq3WNom/QqrQbp0wgXuCz+xyQI8bF1CbcR5FvAL4U8ahQ== X-Received: by 2002:a17:902:d48f:b0:216:282d:c697 with SMTP id d9443c01a7336-21c35544097mr146746545ad.27.1737345355467; Sun, 19 Jan 2025 19:55:55 -0800 (PST) Received: from DougS18 (s66-183-142-209.bc.hsia.telus.net. [66.183.142.209]) by smtp.gmail.com with ESMTPSA id d9443c01a7336-21c2d426a3asm51509655ad.249.2025.01.19.19.55.54 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Sun, 19 Jan 2025 19:55:54 -0800 (PST) From: "Doug Smythies" To: "'Peter Zijlstra'" Cc: , , "'Ingo Molnar'" , , "Doug Smythies" References: <20250107112606.GN20870@noisy.programming.kicks-ass.net> <20250107192340.GB36003@noisy.programming.kicks-ass.net> <001501db618c$67bd8170$37388450$@telus.net> <20250108131205.GO20870@noisy.programming.kicks-ass.net> <001b01db61e4$c3ce5a40$4b6b0ec0$@telus.net> <20250109105959.GA2981@noisy.programming.kicks-ass.net> <002f01db631d$d265a600$7730f200$@telus.net> <20250110115720.GA17405@noisy.programming.kicks-ass.net> <00c201db6547$b43b9a50$1cb2cef0$@telus.net> <20250113110312.GD5388@noisy.programming.kicks-ass.net> <20250114105847.GC8385@noisy.programming.kicks-ass.net> <004901db6a06$59b12050$0d1360f0$@telus.net> In-Reply-To: <004901db6a06$59b12050$0d1360f0$@telus.net> Subject: RE: [REGRESSION] Re: [PATCH 00/24] Complete EEVDF Date: Sun, 19 Jan 2025 19:55:56 -0800 Message-ID: <001301db6aef$35aa1ab0$a0fe5010$@telus.net> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Outlook 16.0 Content-Language: en-ca Thread-Index: AQFlSYB1PWVBqj20pPXP7hZ0SBLYDgHtSwJ2AyWxwjwBnjptfQF6NJHoAFMZgMgCaxQKpgFP4l/5ASQn7WsCDo0DYQJ+LAk1ATBDaPKzcnJvEA== Hi Peter, I now know that the 2nd issue I mentioned yesterday is a completely separate issue. I would have to do a new kernel bisection to isolate it and then start a new thread with whomever about it. On 2025.01.18 16:09 Doug Smythies wrote: > Hi Peter, > > An update. > > On 2025.01.14 02:59 Peter Zijlstra wrote: >> On Mon, Jan 13, 2025 at 12:03:12PM +0100, Peter Zijlstra wrote: >>> On Sun, Jan 12, 2025 at 03:14:17PM -0800, Doug Smythies wrote: > >>>> means that there were 19 occurrences of turbostat interval times >>>> between 1.016 and 1.016999 seconds. >>> >>> OK, let me lower my threshold to 10ms and change the turbostat >>> invocation -- see if I can catch me some wabbits :-) >> >> I've had it run overnight and have not caught a single >10ms event :-( > > Okay, so both you and I have many many hours of testing and > never see >= 10ms in that area of the turbostat code anymore. > > The lingering >= 10ms (but I have never seen more than 25 ms) > is outside of that timing. ... snip ... > I am saying there were 2 different issues. The 2nd was hidden by the 1st > because its magnitude was about 260 times less. The first issue was solved by your two commits of this thread and now in Kernel 6.13: 66951e4860d3 sched/fair: Fix update_cfs_group() vs DELAY_DEQUEUE 6d71a9c61604 sched/fair: Fix EEVDF entity placement bug causing scheduling lag The second issue is not present in my original kernel bisection for the first bad kernel and must have been introduced later on.