mirror of https://lore.kernel.org/lkml/
 help / color / mirror / Atom feed
From: "zhen.ni" <zhen.ni@easystack.cn>
To: "Vlastimil Babka (SUSE)" <vbabka@kernel.org>,
	Andrew Morton <akpm@linux-foundation.org>
Cc: David Hildenbrand <david@kernel.org>,
	Lorenzo Stoakes <ljs@kernel.org>,
	"Liam R . Howlett" <liam@infradead.org>,
	Mike Rapoport <rppt@kernel.org>,
	Suren Baghdasaryan <surenb@google.com>,
	Michal Hocko <mhocko@suse.com>, Jonathan Corbet <corbet@lwn.net>,
	Shuah Khan <skhan@linuxfoundation.org>,
	Randy Dunlap <rdunlap@infradead.org>,
	Brendan Jackman <brendan.jackman@linux.dev>,
	Johannes Weiner <hannes@cmpxchg.org>, Zi Yan <ziy@nvidia.com>,
	linux-mm@kvack.org, linux-doc@vger.kernel.org,
	linux-kernel@vger.kernel.org,
	Steven Rostedt <rostedt@goodmis.org>
Subject: Re: [PATCH v2 0/8] mm/page_owner: Add PID/TGID/COMM and cgroup filtering
Date: Tue, 8 Sep 2026 10:41:23 +0800	[thread overview]
Message-ID: <6744bcdb-3456-4ba2-95a0-a58c354bfbfa@easystack.cn> (raw)
In-Reply-To: <5d4c247c-b8ea-4d3f-b2b9-d442d372fd03@kernel.org>



在 2026/9/7 23:21, Vlastimil Babka (SUSE) 写道:
> On 9/7/26 06:08, zhen.ni wrote:
>>
>>
>> 在 2026/9/4 16:25, Vlastimil Babka (SUSE) 写道:
>>> On 9/3/26 06:18, Zhen Ni wrote:
>>>> This patch series adds process and memory cgroup filtering support to
>>>> page_owner. Following the previous series that introduced print_mode and
>>>> NUMA node filters:
>>>>     https://lore.kernel.org/linux-mm/20260707115411.1714314-1-zhen.ni@easystack.cn/
>>>>
>>>> This series adds filtering capabilities to page_owner, allowing users to
>>>> filter output by specific processes and memory cgroups. Users can now
>>>> filter page_owner output by PID, TGID, COMM (with wildcard support), and
>>>> memory cgroup path. This makes page_owner debugging more focused and
>>>> efficient for tracking memory allocations in specific contexts.
>>>
>>> I wonder about the usefulness of all the new filters. In my experience
>>> page_owner is useful to find a kernel memory leak code, and for that the
>>> stacktraces are most useful. Dealing with things like pid/tgid/comm/cgroups
>>> sounds more like your aim is to profile and optimize particular userspace to
>>> use less kernel memory? In that case, isn't it rather the area of memory
>>> allocation profiling (or maybe tracing with bpf), not page_owner?
>>>
>>> Moreover, tracing or bpf can already do such kind of filtering and AFAIK
>>> ftrace filters for tracepoints are nice and generic, while this is adding a
>>> bunch of custom parsing and filtering. So that makes me somewhat sceptical.
>>>
>>
>> Thanks for the review, and the scepticism is fair - let me first
>> clarify where I agree with you, then explain the niche I think these
>> filters fill.
> 
> Sorry but your whole reply reads like a LLM slop. It took a lot of mental
> effor to actually try and engage with it.
> 

This reply was written by me, and its viewpoints are not simply copied 
directly from an LLM. The LLM only assists with the wording.

>> In memory usage source analysis and memory leak analysis, I believe
>> page_owner has its own unique niche:
>>
>> 1. Nearly all historical allocation records are queryable. Dynamic
>>      tracing tools (bpf, ftrace) cannot do this.
> 
> This seems totally the opposite. page_owner gives you the current allocation
> snapshot. Tracing can provide the full historical record of allocation and
> freeing, which can be also postprocessed for snapshots.
> 
Here you completely misunderstood my meaning, perhaps I did not express 
it clearly.

The biggest difference between page_owner and dynamic tracing tools is 
that page_owner traverses all currently allocated pages using PFN; 
whereas dynamic tracing tools can only view pages after the observation 
point is established. The pages collected by page_owner include those 
from relatively early in the kernel — as long as they are still 
occupying memory, they can be detected. This is what I mean by 
"historical allocation records."

>> 2. The full allocation stack is recorded via stackdepot. Memory
>>      allocation profiling as a code-tagging technique cannot do this.
> 
> I think there's some extension (or plan for it), Suren would know better.
> 

I have previously researched the code and documentation of Memory 
allocation profiling, so this viewpoint is not directly copied from an 
LLM. The reason I think it cannot record stacks is: its design goal is 
to be lightweight and usable in production environments, therefore it 
chose the code-tagging approach. If it recorded stacks, it would already 
deviate from its original design goal.

>> 3. Zero extra usage cost (works as long as page_owner is enabled) and
>>      a low barrier to entry (one echo line versus writing a bpf
>>      program).
>>
>> On the pain points that motivated the series. On production machines
>> with large memory configurations (e.g., 250GB+):
>>
>> 1. Collecting page_owner information takes minutes to tens of minutes.
>> 2. The output is several gigabytes to over 10GB.
>>
>> That makes the raw output nearly unreadable and forces post-processing
>> with tools/mm/page_owner_sort.c, adding further workload. The root
>> causes are:
> 
> the "workload" is just cpu time though

This workload is not just CPU — printing the stack takes up the vast 
majority of it.

> 
>> 1. The PFN scan itself - unavoidable, it is the price of page_owner's
>>      core function of covering every page.
>> 2. Printing every stack for every page - this dominates the cost and
>>      is avoidable. stackdepot already deduplicates stacks and keeps a
>>      refcount per unique stack; page_owner then re-prints the same stack
>>      once per page, and page_owner_sort deduplicates it all over again
>>      in userspace.
> 
> Since it's avoidable, why mention it at all? Oh I know, LLM slop.
> 

I feel like you haven't really understood what I'm trying to express.

>> The filters target exactly this waste: they keep page_owner focused on
>> the user's area of interest instead of paying the full print cost.
>>
>> On the overlap with dynamic tracing and allocation profiling: the
>> features do look similar, but the usage scenarios differ. page_owner
>> is not enabled by default on production systems, so most developers
>> rightly reach for the lighter-weight tools first - dynamic tracing or
>> allocation profiling.
> 
> Good! That's an argument against.
> 
>> But when page_owner is already enabled, or the
>> lighter-weight tools cannot solve (or cannot conveniently solve) the
> 
> Adding custom filtering code to kernel vs user convenience is a trade-off.
> 
>> problem and enabling page_owner is an option, the advantages above
>> kick in: the historical snapshot is filterable in place, and the
>> filtered output is small enough to read directly.
>>
>> So I see the filters as completing page_owner for the scenarios where
>> it is the right tool, rather than competing with the profiling and
>> tracing tooling.
> 
> I'm not convinced it's worth it.

You may keep your opinion. I think you haven't carefully read my reply, 
or you simply assumed this is just an automated reply from an LLM.

Perhaps you haven't actually used page_owner on a server with very large 
memory to investigate memory usage or leak issues (for example, the NIC 
ring buffer usage problem cannot be solved with dynamic tracing tools). 
Once you've used it, you'll know how much you need a filter.


Thanks,
Zhen

  reply	other threads:[~2026-09-08  2:46 UTC|newest]

Thread overview: 20+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-09-03  4:18 Zhen Ni
2026-09-03  4:18 ` [PATCH v2 1/8] mm/page_owner: Add PID filtering support Zhen Ni
2026-09-03  4:18 ` [PATCH v2 2/8] mm/page_owner: Add TGID " Zhen Ni
2026-09-03  4:18 ` [PATCH v2 3/8] mm/page_owner: Add COMM filtering with wildcard support Zhen Ni
2026-09-03  4:18 ` [PATCH v2 4/8] mm/page_owner: Refactor memcg handling for cgroup filter support Zhen Ni
2026-09-03  4:18 ` [PATCH v2 5/8] mm/page_owner: Add memcg " Zhen Ni
2026-09-03  4:18 ` [PATCH v2 6/8] tools/mm: Add PID/TGID/COMM filtering support to page_owner_filter Zhen Ni
2026-09-03  4:18 ` [PATCH v2 7/8] tools/mm: Add memory cgroup " Zhen Ni
2026-09-03  4:18 ` [PATCH v2 8/8] Documentation: page_owner: Document PID/TGID/COMM and cgroup filters Zhen Ni
     [not found] ` <20260902221225.228fb4b18e115ba55b29fe29@linux-foundation.org>
2026-09-03 12:00   ` [PATCH v2 0/8] mm/page_owner: Add PID/TGID/COMM and cgroup filtering zhen.ni
2026-09-04  8:25 ` Vlastimil Babka (SUSE)
2026-09-07  4:08   ` zhen.ni
2026-09-07 15:21     ` Vlastimil Babka (SUSE)
2026-09-08  2:41       ` zhen.ni [this message]
2026-09-08  6:24         ` Weijie Yuan
2026-09-08  6:40           ` zhen.ni
2026-09-08  7:04             ` Weijie Yuan
2026-09-08  9:13               ` Lorenzo Stoakes (ARM)
2026-09-08 11:18                 ` zhen.ni
2026-09-08 17:37                 ` Weijie Yuan

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=6744bcdb-3456-4ba2-95a0-a58c354bfbfa@easystack.cn \
    --to=zhen.ni@easystack.cn \
    --cc=akpm@linux-foundation.org \
    --cc=brendan.jackman@linux.dev \
    --cc=corbet@lwn.net \
    --cc=david@kernel.org \
    --cc=hannes@cmpxchg.org \
    --cc=liam@infradead.org \
    --cc=linux-doc@vger.kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=ljs@kernel.org \
    --cc=mhocko@suse.com \
    --cc=rdunlap@infradead.org \
    --cc=rostedt@goodmis.org \
    --cc=rppt@kernel.org \
    --cc=skhan@linuxfoundation.org \
    --cc=surenb@google.com \
    --cc=vbabka@kernel.org \
    --cc=ziy@nvidia.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox

all inboxes | Powered by JetHome®