From: Niranjana Vishwanathapura <niranjana.vishwanathapura@intel.com>
To: Matthew Brost <matthew.brost@intel.com>
Cc: intel-xe@lists.freedesktop.org, dri-devel@lists.freedesktop.org,
"Carlos Santa" <carlos.santa@intel.com>,
"Ryan Neph" <ryanneph@google.com>,
"Christian Koenig" <christian.koenig@amd.com>,
"Huang Rui" <ray.huang@amd.com>,
"Matthew Auld" <matthew.auld@intel.com>,
"Maarten Lankhorst" <maarten.lankhorst@linux.intel.com>,
"Maxime Ripard" <mripard@kernel.org>,
"Thomas Zimmermann" <tzimmermann@suse.de>,
"David Airlie" <airlied@gmail.com>,
"Simona Vetter" <simona@ffwll.ch>,
linux-kernel@vger.kernel.org,
"Thomas Hellström" <thomas.hellstrom@linux.intel.com>
Subject: Re: [PATCH v3 24/33] drm/xe: Add defrag profiling tracepoints
Date: Sun, 8 Nov 2026 20:34:18 -0800 [thread overview]
Message-ID: <avFNSl7oIffZTPi8@nvishwa1-desk> (raw)
In-Reply-To: <20260711025619.2540575-25-matthew.brost@intel.com>
On Fri, Jul 10, 2026 at 07:56:10PM -0700, Matthew Brost wrote:
>Add two tracepoints to profile the page defragmentation worker:
>
> - xe_bo_defrag_worker: emitted on worker entry and exit with the
> current defrag list count and the bytes processed in the run.
> - xe_bo_defrag_one: emitted per BO with the run budget, the prealloc
> fill ratio (got/want) and the lock-held, lock-wait and prealloc
> durations, plus the bytes consumed and the result.
>
>These break down the cost of a defrag attempt into its locked vs
>unlocked phases, making it possible to confirm that the expensive
>beneficial-order allocation and cpu cache mode change happen outside
>the BO dma-resv lock and that the residual lock-held time is copy-bound
>(with the tail dominated by lock-wait behind active rendering).
>
>Cc: Carlos Santa <carlos.santa@intel.com>
>Cc: Ryan Neph <ryanneph@google.com>
>Cc: Christian Koenig <christian.koenig@amd.com>
>Cc: Huang Rui <ray.huang@amd.com>
>Cc: Matthew Auld <matthew.auld@intel.com>
>Cc: Maarten Lankhorst <maarten.lankhorst@linux.intel.com>
>Cc: Maxime Ripard <mripard@kernel.org>
>Cc: Thomas Zimmermann <tzimmermann@suse.de>
>Cc: David Airlie <airlied@gmail.com>
>Cc: Simona Vetter <simona@ffwll.ch>
>Cc: dri-devel@lists.freedesktop.org
>Cc: linux-kernel@vger.kernel.org
>Cc: Thomas Hellström <thomas.hellstrom@linux.intel.com>
>Assisted-by: GitHub_Copilot:claude-opus-4.8
>Signed-off-by: Matthew Brost <matthew.brost@intel.com>
>
>---
>
>v3:
> - Move the ns-to-us division into TP_fast_assign() to avoid a 64-bit
> divide in TP_printk() (Sashiko)
>---
> drivers/gpu/drm/xe/xe_bo.c | 18 +++++++++-
> drivers/gpu/drm/xe/xe_trace_bo.h | 59 ++++++++++++++++++++++++++++++++
> 2 files changed, 76 insertions(+), 1 deletion(-)
>
>diff --git a/drivers/gpu/drm/xe/xe_bo.c b/drivers/gpu/drm/xe/xe_bo.c
>index 8b89d34f37d4..25e5b72f870c 100644
>--- a/drivers/gpu/drm/xe/xe_bo.c
>+++ b/drivers/gpu/drm/xe/xe_bo.c
>@@ -1263,7 +1263,9 @@ static int xe_bo_defrag_one(struct xe_device *xe, struct xe_bo *bo,
> struct ttm_placement placement;
> struct ttm_place place;
> enum ttm_caching tt_caching;
>- unsigned int order, want = 0;
>+ unsigned int order, want = 0, got = 0;
>+ u64 lock_ns = 0, prealloc_ns = 0, lockwait_ns = 0;
>+ ktime_t t0;
> int ret = 0;
>
> *consumed = 0;
>@@ -1294,6 +1296,7 @@ static int xe_bo_defrag_one(struct xe_device *xe, struct xe_bo *bo,
>
> /* Phase 2: preallocate outside the lock; */
> if (want) {
>+ t0 = ktime_get();
> ret = ttm_pool_prealloc_fill(pool, tt_caching, &pp, want);
> if (ret || !pp.count) {
> ret = ret ?: -ENOMEM;
>@@ -1301,12 +1304,16 @@ static int xe_bo_defrag_one(struct xe_device *xe, struct xe_bo *bo,
> XE_GT_STATS_ID_DEFRAG_FAILED_COUNT, 1);
> goto out_err;
> }
>+ prealloc_ns = ktime_to_ns(ktime_sub(ktime_get(), t0));
> }
>
> /*
> * Phase 3: re-take the lock, re-check, and validate using the prealloc.
> */
>+ t0 = ktime_get();
> xe_bo_lock(bo, false);
>+ lockwait_ns = ktime_to_ns(ktime_sub(ktime_get(), t0));
>+ t0 = ktime_get();
Here only phase 3 locking is profiled. What about phase 1 locking?
Niranjana
>
> if (!xe_bo_needs_defrag(bo)) {
> xe_bo_defrag_remove(bo);
>@@ -1362,9 +1369,13 @@ static int xe_bo_defrag_one(struct xe_device *xe, struct xe_bo *bo,
>
> unlock:
> xe_bo_unlock(bo);
>+ lock_ns = ktime_to_ns(ktime_sub(ktime_get(), t0));
>+ got = pp.used;
> out_err:
> ttm_pool_prealloc_fini(pool, &pp);
> out:
>+ trace_xe_bo_defrag_one(bo, budget, want, got, lock_ns, prealloc_ns,
>+ lockwait_ns, *consumed, ret);
> return ret;
> }
>
>@@ -1396,6 +1407,9 @@ static void xe_bo_defrag_worker(struct work_struct *w)
> return;
> }
>
>+ trace_xe_bo_defrag_worker(xe, 0, atomic_read(&xe->mem.defrag.count),
>+ true);
>+
> /*
> * Process at most XE_BO_DEFRAG_SIZE_LIMIT bytes of newly (re)allocated
> * backing per run rather than draining the whole list in one go. Only
>@@ -1503,6 +1517,8 @@ static void xe_bo_defrag_worker(struct work_struct *w)
>
> xe_pm_runtime_put(xe);
> drm_dev_exit(idx);
>+ trace_xe_bo_defrag_worker(xe, defrag_bytes,
>+ atomic_read(&xe->mem.defrag.count), false);
> }
>
> static int xe_bo_move(struct ttm_buffer_object *ttm_bo, bool evict,
>diff --git a/drivers/gpu/drm/xe/xe_trace_bo.h b/drivers/gpu/drm/xe/xe_trace_bo.h
>index 86323cf3be2c..b159d37d39a1 100644
>--- a/drivers/gpu/drm/xe/xe_trace_bo.h
>+++ b/drivers/gpu/drm/xe/xe_trace_bo.h
>@@ -85,6 +85,65 @@ TRACE_EVENT(xe_bo_move,
> __get_str(new_placement_name), __get_str(device_id))
> );
>
>+TRACE_EVENT(xe_bo_defrag_worker,
>+ TP_PROTO(struct xe_device *xe, u64 defrag_bytes, int count,
>+ bool enter),
>+ TP_ARGS(xe, defrag_bytes, count, enter),
>+ TP_STRUCT__entry(
>+ __string(dev, dev_name(xe->drm.dev))
>+ __field(u64, defrag_bytes)
>+ __field(int, count)
>+ __field(bool, enter)
>+ ),
>+ TP_fast_assign(
>+ __assign_str(dev);
>+ __entry->defrag_bytes = defrag_bytes;
>+ __entry->count = count;
>+ __entry->enter = enter;
>+ ),
>+ TP_printk("dev=%s %s defrag_bytes=%llu count=%d",
>+ __get_str(dev), __entry->enter ? "enter" : "exit",
>+ __entry->defrag_bytes, __entry->count)
>+);
>+
>+TRACE_EVENT(xe_bo_defrag_one,
>+ TP_PROTO(struct xe_bo *bo, u64 budget, unsigned int prealloc_want,
>+ unsigned int prealloc_got, u64 lock_ns, u64 prealloc_ns,
>+ u64 lockwait_ns, u64 consumed, int ret),
>+ TP_ARGS(bo, budget, prealloc_want, prealloc_got, lock_ns,
>+ prealloc_ns, lockwait_ns, consumed, ret),
>+ TP_STRUCT__entry(
>+ __string(dev, __dev_name_bo(bo))
>+ __field(size_t, size)
>+ __field(u64, budget)
>+ __field(unsigned int, prealloc_want)
>+ __field(unsigned int, prealloc_got)
>+ __field(u64, lock_us)
>+ __field(u64, prealloc_us)
>+ __field(u64, lockwait_us)
>+ __field(u64, consumed)
>+ __field(int, ret)
>+ ),
>+ TP_fast_assign(
>+ __assign_str(dev);
>+ __entry->size = xe_bo_size(bo);
>+ __entry->budget = budget;
>+ __entry->prealloc_want = prealloc_want;
>+ __entry->prealloc_got = prealloc_got;
>+ __entry->lock_us = div_u64(lock_ns, 1000);
>+ __entry->prealloc_us = div_u64(prealloc_ns, 1000);
>+ __entry->lockwait_us = div_u64(lockwait_ns, 1000);
>+ __entry->consumed = consumed;
>+ __entry->ret = ret;
>+ ),
>+ TP_printk("dev=%s size=%zu budget=%llu prealloc=%u/%u lock_us=%llu lockwait_us=%llu prealloc_us=%llu consumed=%llu ret=%d",
>+ __get_str(dev), __entry->size, __entry->budget,
>+ __entry->prealloc_got, __entry->prealloc_want,
>+ __entry->lock_us, __entry->lockwait_us,
>+ __entry->prealloc_us, __entry->consumed,
>+ __entry->ret)
>+);
>+
> DECLARE_EVENT_CLASS(xe_vma,
> TP_PROTO(struct xe_vma *vma),
> TP_ARGS(vma),
>--
>2.34.1
>
next prev parent reply other threads:[~2026-11-09 4:34 UTC|newest]
Thread overview: 58+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-07-11 2:55 [PATCH v3 00/33] drm/ttm, drm/xe: Minimize dma-resv hold times and defragment sub-optimally backed BOs Matthew Brost
2026-07-11 2:55 ` [PATCH v3 01/33] drm/ttm/pool: Allow backing off reclaim at the beneficial order Matthew Brost
2026-11-06 2:55 ` Niranjana Vishwanathapura
2026-07-11 2:55 ` [PATCH v3 02/33] drm/ttm/pool: Add ttm_pool_page_order_nodma() helper Matthew Brost
2026-11-05 11:27 ` Matthew Auld
2026-11-06 2:30 ` Niranjana Vishwanathapura
2026-07-11 2:55 ` [PATCH v3 03/33] drm/ttm: Record sub-optimal page order allocations in ttm_tt Matthew Brost
2026-11-06 2:34 ` Niranjana Vishwanathapura
2026-11-06 20:06 ` Matthew Brost
2026-07-11 2:55 ` [PATCH v3 04/33] drm/ttm: Introduce ttm_pool_alloc_iter for __ttm_pool_alloc() Matthew Brost
2026-11-06 2:39 ` Niranjana Vishwanathapura
2026-07-11 2:55 ` [PATCH v3 05/33] drm/ttm: Support defragmentation moves Matthew Brost
2026-11-06 2:51 ` Niranjana Vishwanathapura
2026-07-11 2:55 ` [PATCH v3 06/33] drm/ttm: Add fault injection for beneficial-order allocation failures Matthew Brost
2026-11-06 2:54 ` Niranjana Vishwanathapura
2026-07-11 2:55 ` [PATCH v3 07/33] drm/ttm: Harvest beneficial-order pages on defragmentation moves Matthew Brost
2026-07-11 2:55 ` [PATCH v3 08/33] drm/ttm: Bound page (re)allocation per defragmentation move Matthew Brost
2026-07-11 2:55 ` [PATCH v3 09/33] drm/ttm: Preallocate beneficial-order defrag pages outside the lock Matthew Brost
2026-07-11 2:55 ` [PATCH v3 10/33] drm/ttm: Add full out-of-lock preallocation for ttm_pool_alloc() Matthew Brost
2026-07-11 2:56 ` [PATCH v3 15/33] drm/xe: Track BOs backed at a sub-optimal page order Matthew Brost
2026-11-07 4:49 ` Niranjana Vishwanathapura
2026-07-11 2:56 ` [PATCH v3 16/33] drm/xe: Back off beneficial-order reclaim under defrag pressure Matthew Brost
2026-11-07 5:02 ` Niranjana Vishwanathapura
2026-07-11 2:56 ` [PATCH v3 17/33] drm/xe: Add xe_migrate_copy_defrag() for on-GPU defrag copies Matthew Brost
2026-11-03 12:58 ` Matthew Auld
2026-11-03 20:08 ` Matthew Brost
2026-11-04 12:37 ` Matthew Auld
2026-11-07 5:07 ` Niranjana Vishwanathapura
2026-07-11 2:56 ` [PATCH v3 18/33] drm/xe: Handle defrag moves in xe_bo_move() Matthew Brost
2026-11-07 5:12 ` Niranjana Vishwanathapura
2026-07-11 2:56 ` [PATCH v3 19/33] drm/xe: Skip self-copies for borrowed pages on defrag moves Matthew Brost
2026-07-11 2:56 ` [PATCH v3 20/33] drm/xe: Add a page defragmentation worker Matthew Brost
2026-11-07 5:27 ` Niranjana Vishwanathapura
2026-07-11 2:56 ` [PATCH v3 21/33] drm/xe: Add defrag GT stats Matthew Brost
2026-11-09 1:10 ` Niranjana Vishwanathapura
2026-07-11 2:56 ` [PATCH v3 22/33] drm/xe: Add Kconfig.profile options for BO defrag configuration Matthew Brost
2026-11-09 1:31 ` Niranjana Vishwanathapura
2026-07-11 2:56 ` [PATCH v3 23/33] drm/xe: Defrag using out-of-lock page preallocation Matthew Brost
2026-07-11 2:56 ` [PATCH v3 24/33] drm/xe: Add defrag profiling tracepoints Matthew Brost
2026-11-09 4:34 ` Niranjana Vishwanathapura [this message]
2026-07-11 2:56 ` [PATCH v3 25/33] drm/xe: Preallocate system BO backing outside the dma-resv lock Matthew Brost
2026-07-11 2:56 ` [PATCH v3 26/33] drm/xe: Add tracepoint for xe_gem_create_ioctl Matthew Brost
2026-07-11 2:56 ` [PATCH v3 27/33] drm/xe: Add IOVA-based xe_res_cursor variant Matthew Brost
2026-11-04 12:23 ` Matthew Auld
2026-07-11 2:56 ` [PATCH v3 28/33] drm/xe: Use IOVA-based DMA mapping for eligible tt BOs Matthew Brost
2026-11-03 19:00 ` Matthew Auld
2026-11-03 20:21 ` Matthew Brost
2026-11-04 11:39 ` Matthew Auld
2026-11-05 3:04 ` Matthew Brost
2026-07-11 2:56 ` [PATCH v3 29/33] drm/xe: Add per-device dependency scheduler for IOVA defrag finalize Matthew Brost
2026-07-11 2:56 ` [PATCH v3 30/33] drm/xe: Add packed copy-step IOVA mapping for defrag Matthew Brost
2026-07-11 2:56 ` [PATCH v3 31/33] drm/xe: Blit src-natural to dst-packed for defrag-IOVA copies Matthew Brost
2026-07-11 2:56 ` [PATCH v3 32/33] drm/xe: Finalize defrag-IOVA moves with post-copy job Matthew Brost
2026-07-11 2:56 ` [PATCH v3 33/33] drm/amdgpu: Preallocate system BO pages outside the reservation lock Matthew Brost
2026-07-11 10:46 ` Christian König
2026-07-13 20:24 ` Matthew Brost
2026-07-14 9:17 ` Christian König
2026-07-14 15:15 ` Matthew Brost
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=avFNSl7oIffZTPi8@nvishwa1-desk \
--to=niranjana.vishwanathapura@intel.com \
--cc=airlied@gmail.com \
--cc=carlos.santa@intel.com \
--cc=christian.koenig@amd.com \
--cc=dri-devel@lists.freedesktop.org \
--cc=intel-xe@lists.freedesktop.org \
--cc=linux-kernel@vger.kernel.org \
--cc=maarten.lankhorst@linux.intel.com \
--cc=matthew.auld@intel.com \
--cc=matthew.brost@intel.com \
--cc=mripard@kernel.org \
--cc=ray.huang@amd.com \
--cc=ryanneph@google.com \
--cc=simona@ffwll.ch \
--cc=thomas.hellstrom@linux.intel.com \
--cc=tzimmermann@suse.de \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®