From mboxrd@z Thu Jan 1 00:00:00 1970 Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.remote-ip=158.69.130.18 ARC-Seal: i=1; d=subspace.kernel.org; s=arc20261015; a=rsa-sha256; cv=none; t=1795182962; b=TXR0A+tiFhW8U/oTQw3H40epqj6Zl6uv+BFOBn7UufygVG4mnP9SLeQzBadXLqoAZvLD d2wW8lIAD4hhIf7RYRoOevchPgLJXcewk72Acxjpg2STAzKdydcHhLvxbT4Dhbh+6wXdV 8xE1U3IPIBvXXqr3bV1oQfH7P7xJzezAWBntvJXoX9J4kwKJ3JlGnZ3wNyEjCPuY3Va5I 6LO7fxOhBqNWm3GUM2MYHrm41lSdEIAQzVJhSJXXWzTcOS/NScgwSPrknHMlODi41GMdo Q4bFGndaTlke9O+QYH+UF3wdlzuQ7/PsnVi6nw8T5TnSb1sN6+44VSej9/go2UuyXyg== ARC-Message-Signature: i=1; d=subspace.kernel.org; s=arc20261015; a=rsa-sha256; c=relaxed/relaxed; t=1795182962; h=DMARC-Filter:DKIM-Signature:Received:From:To:Cc:Subject:Date: Message-Id:X-Mailer:In-Reply-To:References:MIME-Version: Content-Transfer-Encoding; bh=i1Z5x78dWJEXVYZNMP8lj9mZgpOU9qyHFlqs4h3VoDs=; b=R4CzUUC6QzbktSZ2gmoO5q9NI1V1u76VhnawxSkJaiSpNgoDFldyNd8ZJJsRPh1/B8SG jVGBlqd6KGBHgIZ0AJYKYsfwku/LgktpRmistwmuNtXGOpxQdgs1p3DlUhR3Oz6rI7RqW jKpp9NQleaAhUExTOGNu+1JXXertL2kpY85EgF2fEgsH+Np0xEG/gKa5H1lZrTVIJ1FZa k+jIi2y4JPuozjhwJkiErfUbKJzm4Z+HECp/l4hdKB9g78DygTLOos96yWVZQAjigjiRk eIuRRXB/T8I6z+z0Cl6eINY9pp/eOF/+79Ez51Q4ilbOjgh00gO0/34X8Oy4QtiOD6A== ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass header.from=efficios.com; spf=pass smtp.mailfrom=efficios.com; dkim=pass header.d=efficios.com header.i=@efficios.com header.a=rsa-sha256 header.s=smtpout1 header.b=GBaLeGC2; arc=none smtp.remote-ip=158.69.130.18 Received: from smtpout.efficios.com (smtpout.efficios.com [158.69.130.18]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (prime256v1)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id D3DE860A261D; Fri, 20 Nov 2026 13:56:01 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.4.2 smtp.subspace.kernel.org D3DE860A261D Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=efficios.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=efficios.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=efficios.com header.i=@efficios.com header.a=rsa-sha256 header.s=smtpout1 header.b=GBaLeGC2 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=efficios.com; s=smtpout1; t=1795182960; bh=i1Z5x78dWJEXVYZNMP8lj9mZgpOU9qyHFlqs4h3VoDs=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=GBaLeGC2gbrUuPM00rFv5BgjwpjM/bnZ44zLw1zpb6mrQ3O8LjEpcJFBzzvbDbegr 9KtY7V0KVFrjtnLJVZgctjS2EicqLePAkSdDciy1Rq/62sz0FQNsvPVcssv7LLHp7n IAbT4lT4m9RsqQ0wPBHgzR9RVaPryd8EAx7ScJH6aPqDiD9mFlDUlJT3DLJ5tUS0hP 1RDzWA1yupNdTG0fStNyVWFS84YxWrGNnkdQ4FEeXeGe9Z8y2QO/3/eVvGZdpFJb5y Z10DRLjnzbzFax6xPmQdvVutAwDVcf+lCZYqfTdzxgNFrKtgjli1I8KyPUsGQTpzl+ SwJvxMjpw80nA== Received: from thinkos.internal.efficios.com (mtl.efficios.com [216.120.195.104]) by smtpout.efficios.com (Postfix) with ESMTPSA id 4jWH1D4C96zSlC; Fri, 20 Nov 2026 08:56:00 -0500 (EST) From: Mathieu Desnoyers To: juri.lelli@redhat.com, peterz@infradead.org, mingo@redhat.com, vincent.guittot@linaro.org Cc: Mathieu Desnoyers , tglx@kernel.org, will@kernel.org, boqun@kernel.org, dietmar.eggemann@arm.com, rostedt@goodmis.org, bsegall@google.com, mgorman@suse.de, vschneid@redhat.com, kprateek.nayak@amd.com, luca.abeni@santannapisa.it, mathieu.poirier@linaro.org, longman@redhat.com, ridong.chen@linux.dev, tj@kernel.org, hannes@cmpxchg.org, mkoutny@suse.com, shuah@kernel.org, bigeasy@linutronix.de, clrkwllms@kernel.org, parri.andrea@gmail.com, m.szyprowski@samsung.com, kayracizmeci@gmail.com, weihengqiuu@gmail.com, linux-kernel@vger.kernel.org, cgroups@vger.kernel.org, linux-kselftest@vger.kernel.org, linux-rt-devel@lists.linux.dev, stable@vger.kernel.org Subject: [PATCH v9 08/33] cgroup/cpuset: Wait for an attach before rebuilding the sched domains Date: Fri, 20 Nov 2026 08:55:31 -0500 Message-Id: <5ce98b2047649b4e822e405a2ebe367d0ef4304d.1795181240.git.mathieu.desnoyers@efficios.com> X-Mailer: git-send-email 2.39.5 In-Reply-To: References: X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Post: List-Help: List-Subscribe: List-Unsubscribe: List-Owner: Precedence: list MIME-Version: 1.0 Content-Transfer-Encoding: 8bit cpuset_can_attach() reserves the bandwidth of the deadline tasks it moves in the destination root domain. cpuset_attach() moves their bandwidth later, on the strength of that reservation. Commit 75f7a25ec6bb ("cgroup/cpuset: Prevent race between task attach and cpuset state change") lets cpuset_attach() rely on what cpuset_can_attach() set up. The writes of cpus, mems and cpus.partition wait for an attach in progress, in wait_attach_done_lock(). CPU hotplug cannot run in between either: it takes cpus_write_lock, and the attach holds cpus_read_lock throughout. But a rebuild of the sched domains does not wait. A write of sched_rt_runtime_us and the energy model rebuild them through rebuild_sched_domains(). The cgroup v1 writes of sched_load_balance and sched_relax_domain_level, and hk_sd_workfn(), use cpuset_full_lock(). In this example, a rebuild drops the reservation. T is a deadline task asleep in root domain R. Thread A moves T to a partition root P, which has a root domain of its own. Thread B writes sched_rt_runtime_us: A B cpuset_can_attach() takes cpuset_mutex cpuset_reserve_dl_bw() P's total_bw += T's bandwidth drops cpuset_mutex rebuild_sched_domains() takes cpuset_mutex dl_rebuild_rd_accounting() clears R's and P's total_bw counts T in R (not moved yet) drops cpuset_mutex cpuset_attach() takes cpuset_mutex cpuset_attach_task(T) set_cpus_allowed_dl(T) R's total_bw -= T's bandwidth records a CPU of P P now lacks the bandwidth of T, and admits deadline tasks beyond its capacity. When T leaves P, P's total_bw underflows. In testing, the race left a destination admitting 3 tasks of 10% too many, or P admitting no task at all. Fix this by waiting for an attach in progress in rebuild_sched_domains_cpuslocked() and in cpuset_full_lock(). The latter then takes its locks in the order of the writes of cpus and cpus.partition. A rebuild from CPU hotplug finds no attach in progress. The online, offline and kill of a cpuset never wait: they hold cgroup_mutex, which the attach holds throughout. The move_vs_rebuild case, added to deadline_bw_test later in this series, tests this race. Without this patch, it fails in 5 of 8 VMs with 8 CPUs. With it, the case passes in 8 of 8. The next patch needs this wait too: without it, it would give back a reservation that a rebuild dropped already. The Sashiko AI reviews of this series found the race and the cgroup v1 writes. Fixes: 2ef269ef1ac0 ("cgroup/cpuset: Free DL BW in case can_attach() fails") Signed-off-by: Mathieu Desnoyers Reviewed-by: Juri Lelli Cc: stable@vger.kernel.org --- kernel/cgroup/cpuset.c | 16 +++++++++++++--- 1 file changed, 13 insertions(+), 3 deletions(-) diff --git a/kernel/cgroup/cpuset.c b/kernel/cgroup/cpuset.c index 194a438e25c3..51b6be460794 100644 --- a/kernel/cgroup/cpuset.c +++ b/kernel/cgroup/cpuset.c @@ -296,17 +296,20 @@ void lockdep_assert_cpuset_lock_held(void) lockdep_assert_held(&cpuset_mutex); } +static void wait_attach_done_lock(void) __acquires(&cpuset_mutex); + /** * cpuset_full_lock - Acquire full protection for cpuset modification * * Takes both CPU hotplug read lock (cpus_read_lock()) and cpuset mutex - * to safely modify cpuset data. + * to safely modify cpuset data. Waits for an attach in progress before + * it takes cpuset mutex. */ void cpuset_full_lock(void) { mutex_lock(&cpuset_top_mutex); cpus_read_lock(); - mutex_lock(&cpuset_mutex); + wait_attach_done_lock(); } void cpuset_full_unlock(void) @@ -1005,7 +1008,14 @@ void rebuild_sched_domains_locked(void) static void rebuild_sched_domains_cpuslocked(void) { - mutex_lock(&cpuset_mutex); + /* + * Wait for an attach in progress. cpuset_can_attach() has reserved + * the deadline bandwidth of the moving tasks in their new root + * domain, and cpuset_attach() moves it on the strength of that + * reservation. A rebuild of the accounting in between would drop + * the reservation. + */ + wait_attach_done_lock(); rebuild_sched_domains_locked(); mutex_unlock(&cpuset_mutex); } -- 2.47.3