From: Alice Ryhl <aliceryhl@google.com>
To: Tejun Heo <tj@kernel.org>, Lai Jiangshan <jiangshanlai@gmail.com>,
Jonathan Corbet <corbet@lwn.net>
Cc: "Boqun Feng" <boqun@kernel.org>,
"Miguel Ojeda" <ojeda@kernel.org>,
"Danilo Krummrich" <dakr@kernel.org>,
"Philipp Stanner" <phasta@kernel.org>,
"Matthew Brost" <matthew.brost@intel.com>,
"Christian König" <ckoenig.leichtzumerken@gmail.com>,
"Thomas Hellström" <thomas.hellstrom@linux.intel.com>,
"Rodrigo Vivi" <rodrigo.vivi@intel.com>,
"Boris Brezillon" <boris.brezillon@collabora.com>,
"Steven Price" <steven.price@arm.com>,
"Liviu Dudau" <liviu.dudau@arm.com>,
"Onur Özkan" <work@onurozkan.dev>,
dri-devel@lists.freedesktop.org, intel-xe@lists.freedesktop.org,
rust-for-linux@vger.kernel.org, linux-doc@vger.kernel.org,
linux-kernel@vger.kernel.org, stable@vger.kernel.org,
"Alice Ryhl" <aliceryhl@google.com>
Subject: [PATCH 1/2] workqueue: fix cancel_work_sync() on ordered workqueues
Date: Wed, 18 Nov 2026 17:09:51 +0000 [thread overview]
Message-ID: <20261118-ordered-wq-cancel-v1-1-916e01f9affe@google.com> (raw)
In-Reply-To: <20261118-ordered-wq-cancel-v1-0-916e01f9affe@google.com>
There is currently a scenario where cancel_work_sync() /
disable_work_sync() does not wait for the work to finish execution on an
ordered workqueue (__WQ_ORDERED). This is because ordered workqueues
contain multiple workqueues internally (pwqs). Consider the following
scenario:
1. @work starts executing on pwq A (pool A), the oldest and only
unplugged pwq in wq->pwqs.
2. Writing a new cpumask to /sys/devices/virtual/workqueue/cpumask
allocates a new dfl_pwq (pwq B, backed by pool B) with
pwq->plugged = true and appends it to wq->pwqs behind pwq A.
3. While @work is still executing on pool A, it is re-queued to the same
ordered workqueue. Unlike normal workqueues, __queue_work() skips
last_pool redirection on ordered workqueues so re-queued items do not
jump ahead of work already waiting on pwq B, so @work is placed on
pwq B->inactive_works and work->data is overwritten to point to
pwq B.
4. cancel_work_sync() or disable_work_sync() steals @work from pwq B,
and try_to_grab_pending() records pwq B->pool->id (pool B) in
work->data.
5. start_flush_work() only inspects the single pool recorded in
work->data (pool B, where @work has never executed), finds no worker
running @work, and returns while @work is still executing on pool A.
Unfortunately, this scenario can lead to UAF if a driver uses
cancel_work_sync() and then frees the work item (or resources used by
the work item). And this happens on ordered workqueues in practice:
- drm/sched: drm_sched_wqueue_stop() calling cancel_work_sync() on
work_run_job and work_free_job before scheduler teardown.
- drm/xe: gt_worker_disable() calling disable_work_sync() on
gt->reset.worker and gt->wedge.worker.
- drm/panthor: panthor_device_suspend() calling cancel_work_sync() on
ptdev->reset.work before suspending hardware.
Thus, fix try_to_grab_pending() to record the pool of the oldest pwq in
wq->pwqs when stealing a pending work item from an ordered workqueue, so
start_flush_work() flushes pool A and waits for @work to finish. If
@work is not actually executing on pool A, find_worker_executing_work()
simply returns NULL.
It is also needed for the soundness of the upcoming Rust ScopedWork
abstraction, which binds a work item to a single workqueue and relies on
cancel_work_sync() in Drop to guarantee that data borrowed by the work
item is no longer accessed once drop() returns.
Cc: stable@vger.kernel.org
Fixes: 58629d4871e8 ("workqueue: Always queue work items to the newest PWQ for order workqueues")
Signed-off-by: Alice Ryhl <aliceryhl@google.com>
---
kernel/workqueue.c | 20 ++++++++++++++++++--
1 file changed, 18 insertions(+), 2 deletions(-)
diff --git a/kernel/workqueue.c b/kernel/workqueue.c
index af845214e78b..d7acedfb8b27 100644
--- a/kernel/workqueue.c
+++ b/kernel/workqueue.c
@@ -2263,6 +2263,7 @@ static int try_to_grab_pending(struct work_struct *work, u32 cflags,
pwq = get_work_pwq(work);
if (pwq && pwq->pool == pool) {
unsigned long work_data = *work_data_bits(work);
+ struct worker_pool *offq_pool = pool;
debug_work_deactivate(work);
@@ -2288,9 +2289,24 @@ static int try_to_grab_pending(struct work_struct *work, u32 cflags,
/*
* work->data points to pwq iff queued. Let's point to pool. As
* this destroys work->data needed by the next step, stash it.
+ *
+ * For ordered workqueues, __queue_work() skips last_pool
+ * redirection so @pwq may be plugged while @work is still
+ * executing on the oldest pwq after a cpumask update. Only the
+ * oldest pwq is unplugged and can be executing @work, so record
+ * its pool instead.
*/
- set_work_pool_and_keep_pending(work, pool->id,
- pool_offq_flags(pool));
+ if (unlikely(pwq->wq->flags & __WQ_ORDERED)) {
+ struct pool_workqueue *oldest_pwq =
+ list_first_or_null_rcu(&pwq->wq->pwqs,
+ struct pool_workqueue,
+ pwqs_node);
+
+ if (oldest_pwq)
+ offq_pool = oldest_pwq->pool;
+ }
+ set_work_pool_and_keep_pending(work, offq_pool->id,
+ pool_offq_flags(offq_pool));
/* must be the last step, see the function comment */
pwq_dec_nr_in_flight(pwq, work_data);
--
2.56.1.703.gf848ed807c-goog
next prev parent reply other threads:[~2026-11-18 17:10 UTC|newest]
Thread overview: 3+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-11-18 17:09 [PATCH 0/2] workqueue: fix cancel_work_sync() on ordered workqueues and clarify docs Alice Ryhl
2026-11-18 17:09 ` Alice Ryhl [this message]
2026-11-18 17:09 ` [PATCH 2/2] workqueue: doc: clarify cancel_work_sync() cross-workqueue behavior Alice Ryhl
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20261118-ordered-wq-cancel-v1-1-916e01f9affe@google.com \
--to=aliceryhl@google.com \
--cc=boqun@kernel.org \
--cc=boris.brezillon@collabora.com \
--cc=ckoenig.leichtzumerken@gmail.com \
--cc=corbet@lwn.net \
--cc=dakr@kernel.org \
--cc=dri-devel@lists.freedesktop.org \
--cc=intel-xe@lists.freedesktop.org \
--cc=jiangshanlai@gmail.com \
--cc=linux-doc@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=liviu.dudau@arm.com \
--cc=matthew.brost@intel.com \
--cc=ojeda@kernel.org \
--cc=phasta@kernel.org \
--cc=rodrigo.vivi@intel.com \
--cc=rust-for-linux@vger.kernel.org \
--cc=stable@vger.kernel.org \
--cc=steven.price@arm.com \
--cc=thomas.hellstrom@linux.intel.com \
--cc=tj@kernel.org \
--cc=work@onurozkan.dev \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®