From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mx0b-001b2d01.pphosted.com (mx0b-001b2d01.pphosted.com [148.163.158.5]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 1879B204C3B for ; Wed, 8 Apr 2026 09:16:37 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=148.163.158.5 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1775639799; cv=none; b=PUM/yU91snnQbNPa+7cyvr/izXV1JNvTcYckYZQASTPQyXblst2xM+5AdLob1dxFFyMoe+BVeLLL3P0Aq0GsoP9Tja6WXAvB92bCn4lVy5pKbb19aUsnG+Wc493U9oSbzu/8P9E01BaMqTGIjVxy+Lviytr8qJ0Sk3+qIL7S9No= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1775639799; c=relaxed/simple; bh=kWpmEZDYBYgDZLzZ2815qYDd5uI6ZgMkoyp24SvS4jM=; h=Message-ID:Date:MIME-Version:Subject:To:Cc:References:From: In-Reply-To:Content-Type; b=o4ubiXBUnLT8a0u40S5XcT2msd47OmCRToI5uj2y06MnLNgxcA4Hl8H9WOXgJzUHyUAHQuygEXJEU2p1ld9h9T2+jicui6BwLTLPBwcsPf8K4ka1jBlp0Sw13k48qmNjl+2nnLHK8QD/Yc1SBbbRN7eK09XcBl3WOcRvz9X8k6A= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linux.ibm.com; spf=pass smtp.mailfrom=linux.ibm.com; dkim=pass (2048-bit key) header.d=ibm.com header.i=@ibm.com header.b=G8QaGzin; arc=none smtp.client-ip=148.163.158.5 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linux.ibm.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=linux.ibm.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=ibm.com header.i=@ibm.com header.b="G8QaGzin" Received: from pps.filterd (m0360072.ppops.net [127.0.0.1]) by mx0a-001b2d01.pphosted.com (8.18.1.11/8.18.1.11) with ESMTP id 6385E6Aa2304658; Wed, 8 Apr 2026 09:16:15 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ibm.com; h=cc :content-transfer-encoding:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to; s=pp1; bh=Gjp7lH BznC2XOpsv18gceixg4wzrYqCKWQ4G9enlKAM=; b=G8QaGzin3rGSO4iJWArQDK aRMadDLy3M8Q++A1gSD5vmVW1aSxmIsJanlf6iY4/2yFp6wGNmIfrPughpbOT2Gm 4rHwlLyMUbC7HvCJIBJCOYoaIXlmfDaOkSQSoNH2moW+Qa48x1biAUel+r5yJBc7 6BLBtDT1LfQN1arcamx0bXjtKndPflvN9gaGGhrLpiCsc5goqzSK0Q1OKZxzCdtq 4+ZVSzxYS7nav+pDyyRySN9XnAeNYgocEojeHOiuHPkCAIhFGpsTTuQBss2i8xo6 akCX/l8lMq2kyORwxtHmubUWz/ko7WGCQuJ+Ot27KtH9XwJlhW45SVIsmKgEopSQ == Received: from ppma12.dal12v.mail.ibm.com (dc.9e.1632.ip4.static.sl-reverse.com [50.22.158.220]) by mx0a-001b2d01.pphosted.com (PPS) with ESMTPS id 4dcn2fxnmg-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Wed, 08 Apr 2026 09:16:14 +0000 (GMT) Received: from pps.filterd (ppma12.dal12v.mail.ibm.com [127.0.0.1]) by ppma12.dal12v.mail.ibm.com (8.18.1.2/8.18.1.2) with ESMTP id 6386TZlI026665; Wed, 8 Apr 2026 09:16:13 GMT Received: from smtprelay06.fra02v.mail.ibm.com ([9.218.2.230]) by ppma12.dal12v.mail.ibm.com (PPS) with ESMTPS id 4dcmg7xr66-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Wed, 08 Apr 2026 09:16:13 +0000 Received: from smtpav02.fra02v.mail.ibm.com (smtpav02.fra02v.mail.ibm.com [10.20.54.101]) by smtprelay06.fra02v.mail.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id 6389G96711010416 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Wed, 8 Apr 2026 09:16:09 GMT Received: from smtpav02.fra02v.mail.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 9E5C520043; Wed, 8 Apr 2026 09:16:09 +0000 (GMT) Received: from smtpav02.fra02v.mail.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 91FCD20040; Wed, 8 Apr 2026 09:16:04 +0000 (GMT) Received: from [9.124.212.125] (unknown [9.124.212.125]) by smtpav02.fra02v.mail.ibm.com (Postfix) with ESMTP; Wed, 8 Apr 2026 09:16:04 +0000 (GMT) Message-ID: <0d8412de-e18a-476f-9eb6-9a977f4474a3@linux.ibm.com> Date: Wed, 8 Apr 2026 14:46:03 +0530 Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [PATCH v2 03/17] cpumask: Introduce cpu_preferred_mask To: Yury Norov Cc: linux-kernel@vger.kernel.org, mingo@kernel.org, peterz@infradead.org, juri.lelli@redhat.com, vincent.guittot@linaro.org, tglx@linutronix.de, yury.norov@gmail.com, gregkh@linuxfoundation.org, pbonzini@redhat.com, seanjc@google.com, kprateek.nayak@amd.com, vschneid@redhat.com, iii@linux.ibm.com, huschle@linux.ibm.com, rostedt@goodmis.org, dietmar.eggemann@arm.com, mgorman@suse.de, bsegall@google.com, maddy@linux.ibm.com, srikar@linux.ibm.com, hdanton@sina.com, chleroy@kernel.org, vineeth@bitbyteword.org, joelagnelf@nvidia.com References: <20260407191950.643549-1-sshegde@linux.ibm.com> <20260407191950.643549-4-sshegde@linux.ibm.com> Content-Language: en-US From: Shrikanth Hegde In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-TM-AS-GCONF: 00 X-Proofpoint-Reinject: loops=2 maxloops=12 X-Authority-Analysis: v=2.4 cv=KeridwYD c=1 sm=1 tr=0 ts=69d61cde cx=c_pps a=bLidbwmWQ0KltjZqbj+ezA==:117 a=bLidbwmWQ0KltjZqbj+ezA==:17 a=IkcTkHD0fZMA:10 a=A5OVakUREuEA:10 a=VkNPw1HP01LnGYTKEx00:22 a=RnoormkPH1_aCDwRdu11:22 a=RzCfie-kr_QcCd8fBx8p:22 a=VnNF1IyMAAAA:8 a=kywLCQ0KjtNOTlIS5SEA:9 a=QEXdDO2ut3YA:10 X-Proofpoint-ORIG-GUID: ux5jnI3z7JHTQTKp30BGKtRQ9LhP7JWq X-Proofpoint-GUID: jasUKFyP9N-7Fb3-uPc2bL7W5q3tNEOj X-Proofpoint-Spam-Details-Enc: AW1haW4tMjYwNDA4MDA3OSBTYWx0ZWRfXyWALREBOX9qH hosFd8p7OSL5dy1uq13yzMz9gM4AQQTsZtDlia+NjyZaOkIy4MWhfREapRR0cPOr1mpFA6vomCy OctAarPmQz7QHxLtGKfVmG+Vpan0+Xq2NEMSyIqgG5I6Q35rqIVHZSkVqA0hbP0x3FiPMgSUVrA VtdQHV7BcoAkmJycdAtRob7M/4gVPC5lhqOT/pYBfPvJHNRw91nSlIcJ/EiuDDPGNUt9bT7WjUQ xxydwtcspGmWoHQ3EGrppU5RKRAIVs3H0Jcsjj0stn5cMJ/elLm2mNq/CH9QJ071kPmLl68gX/7 MPtJltZmXFRIDYQDUNvONv//n2SsTuwf9Kc/PaGQXaZFvPBB8sUHgZL732YqpDkcWWaAATYwRn8 f7jGn4h4w9iDQCFFqpUX/eq4x5a0fwB4FWW5sJJvMluvEXcGFMd7pERDULrcz7fQaqrMdjLg3GH t4y5CMulfUENK/2g5gA== X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.293,Aquarius:18.0.1143,Hydra:6.1.51,FMLib:17.12.100.49 definitions=2026-04-08_03,2026-04-07_05,2025-10-01_01 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 suspectscore=0 malwarescore=0 lowpriorityscore=0 adultscore=0 impostorscore=0 clxscore=1015 phishscore=0 priorityscore=1501 spamscore=0 bulkscore=0 classifier=typeunknown authscore=0 authtc= authcc= route=outbound adjust=0 reason=mlx scancount=1 engine=8.22.0-2604010000 definitions=main-2604080079 Hi Yury. Thanks for going through the series. On 4/8/26 1:57 AM, Yury Norov wrote: > On Wed, Apr 08, 2026 at 12:49:36AM +0530, Shrikanth Hegde wrote: >> This patch does >> - Declare and Define cpu_preferred_mask. >> - Get/Set helpers for it. >> >> Values are set/clear by the scheduler by detecting the steal time values. >> >> A CPU is set to preferred when it comes online. Later it may be >> marked as non-preferred depending on steal time values with >> STEAL_MONITOR enabled. >> >> Signed-off-by: Shrikanth Hegde >> --- >> include/linux/cpumask.h | 22 ++++++++++++++++++++++ >> kernel/cpu.c | 6 ++++++ >> kernel/sched/core.c | 5 +++++ >> 3 files changed, 33 insertions(+) >> >> diff --git a/include/linux/cpumask.h b/include/linux/cpumask.h >> index 80211900f373..80c5cc13b8ad 100644 >> --- a/include/linux/cpumask.h >> +++ b/include/linux/cpumask.h >> @@ -1296,6 +1296,28 @@ static __always_inline bool cpu_dying(unsigned int cpu) >> >> #endif /* NR_CPUS > 1 */ >> >> +/* >> + * All related wrappers kept together to avoid too many ifdefs >> + * See Documentation/scheduler/sched-arch.rst for details >> + */ >> +#ifdef CONFIG_PARAVIRT >> +extern struct cpumask __cpu_preferred_mask; >> +#define cpu_preferred_mask ((const struct cpumask *)&__cpu_preferred_mask) >> +#define set_cpu_preferred(cpu, preferred) assign_cpu((cpu), &__cpu_preferred_mask, (preferred)) >> + >> +static __always_inline bool cpu_preferred(unsigned int cpu) >> +{ >> + return cpumask_test_cpu(cpu, cpu_preferred_mask); >> +} >> +#else >> +static __always_inline bool cpu_preferred(unsigned int cpu) >> +{ >> + return true; >> +} > > This doesn't look consistent, probably not correct. What if > I pass an offline CPU here? Is it still preferred? > preferred cpu state follows the online state. This was done by change below in set_cpu_online. So when cpu goes offline, it will be removed from the preferred mask too. In the design principle I wanted, preferred to be always subset of online preferred <= online <= possible. > Later you say that preferred CPU is online + STEAL-approved one. > So in non-paravirtualized case, I believe, you should consider There it would clearly be same as online CPUs. > that only online CPUs are preferred. What about dying CPUs? Can > they be preferred too? When there is no CPU hotplug, preferred will be subset of online. Lets see different cases with CPU hotplug. when STEAL_MONITOR is on and there is high steal time. Lets say, 600 CPUs system with SMT. Case 1: CPU 500 was offline. It would have it's preferred bit=0 . after a while there was high steal time, and preferred_cpus = <0-399> and once the contention was gone, since it is using cpu_smt_mask, it would set 500's preferred bit=1, though it is offline. Case 2: all online CPUs were preferred. 500 was offline. after a while there was high steal and while iterating through cpu_smt_mask, after say 499 was done, 500 is brought online. that would set it in preferred. Since it was part of the mask, 500 will be marked preferred=0. That's ok. It was meant to be anyway. Case 3: all online CPUs were preferred. 500 was offline. after a while there was high steal and preferred_cpus = <0-399> and 500 is brought online. that would set it in preferred. In the next cycle, bringing online causes more steal time, and since it is the last CPU in the mask, it will be marked as non-preferred. Thats ok. So Case 1 is the one where the construct is broken. This is solvable by checking the online state in steal time handling code. diff --git a/kernel/sched/core.c b/kernel/sched/core.c index d3b2bcb6008c..bad091f1f604 100644 --- a/kernel/sched/core.c +++ b/kernel/sched/core.c @@ -11329,7 +11329,7 @@ void sched_steal_detection_work(struct work_struct *work) if (cpumask_equal(cpu_smt_mask(last_cpu), cpu_smt_mask(this_cpu))) return; - for_each_cpu(tmp_cpu, cpu_smt_mask(last_cpu)) { + for_each_cpu_and(tmp_cpu, cpu_smt_mask(last_cpu), cpu_online_mask) { set_cpu_preferred(tmp_cpu, false); if (tick_nohz_full_cpu(tmp_cpu)) tick_nohz_dep_set_cpu(tmp_cpu, TICK_DEP_BIT_SCHED); @@ -11345,7 +11345,7 @@ void sched_steal_detection_work(struct work_struct *work) if (first_cpu >= nr_cpu_ids) return; - for_each_cpu(tmp_cpu, cpu_smt_mask(first_cpu)) + for_each_cpu_and(tmp_cpu, cpu_smt_mask(first_cpu), cpu_online_mask) set_cpu_preferred(tmp_cpu, true); } I had thought of this scenario. I hadn't seen it from consistency point of view. It should be consistent since it is exposed to user. Functionality wise it was okay since, current code has enough checks to schedule only on online CPUs. Even is_cpu_allowed returns true only if it is online. But i get the point, and above diff should address it. > > At least, please run cpumask_check() on the argument. It is set either within online or in PATCH 15/17 by iterating through cpu_smt_mask. That should always yeild cpu < nr_cpu_ids. I didn't get why cpumask_check is needed again. > > There's a top-comment describing all the system cpumasks. Except for > cpu_dying, it's nice and complete. Can you describe your new creature > there? Ok. I can add a comment there. > > Finally, I don't think that __cpu_preferred_mask should depend on > PARAVIRT config. Consider cpu_present_mask. It mirrors cpu_possible_mask > if hotplug is disabled, but it's still a real mask even in that case. > The way you're doing it, you spread CONFIG_PARAVIRT ifdefery pretty > much anywhere where people might want to use this new mask for anything > except for testing a bit. > One concern you had raised earlier was bloating of the code for systems CONFIG_PARAVIRT=n. Maybe in some of the hotpaths we could do, IS_ENABLED(CONFIG_PARAVIRT) check and that should be ok? If so, we can get rid off lot of this ifdefery. cpu_preferred(cpu) is a bit check and shouldn't that expensive. > Thanks, > Yury > >> +static __always_inline void set_cpu_preferred(unsigned int cpu, bool preferred) { } >> +#endif >> + >> #define cpu_is_offline(cpu) unlikely(!cpu_online(cpu)) >> >> #if NR_CPUS <= BITS_PER_LONG >> diff --git a/kernel/cpu.c b/kernel/cpu.c >> index bc4f7a9ba64e..2d4d037680d4 100644 >> --- a/kernel/cpu.c >> +++ b/kernel/cpu.c >> @@ -3137,6 +3137,12 @@ void set_cpu_online(unsigned int cpu, bool online) >> if (cpumask_test_and_clear_cpu(cpu, &__cpu_online_mask)) >> atomic_dec(&__num_online_cpus); >> } >> + >> + /* >> + * An online CPU is by default assumed to be preferred >> + * Unitl STEAL_MONITOR changes it >> + */ >> + set_cpu_preferred(cpu, online); >> } Here, preferred follows the online state. >> >> /* >> diff --git a/kernel/sched/core.c b/kernel/sched/core.c >> index f351296922ac..7ea05a7a717b 100644 >> --- a/kernel/sched/core.c >> +++ b/kernel/sched/core.c >> @@ -11228,3 +11228,8 @@ void sched_change_end(struct sched_change_ctx *ctx) >> p->sched_class->prio_changed(rq, p, ctx->prio); >> } >> } >> + >> +#ifdef CONFIG_PARAVIRT >> +struct cpumask __cpu_preferred_mask __read_mostly; >> +EXPORT_SYMBOL(__cpu_preferred_mask); >> +#endif >> -- >> 2.47.3