From: Baolin Wang <baolin.wang@linux.alibaba.com>
To: "liuq131@chinatelecom.cn" <liuq131@chinatelecom.cn>,
akpm <akpm@linux-foundation.org>
Cc: linux-mm <linux-mm@kvack.org>,
linux-kernel <linux-kernel@vger.kernel.org>
Subject: Re: [PATCH] mm/compaction: fix the total_isolated in strict mode
Date: Tue, 12 Nov 2024 17:47:01 +0800 [thread overview]
Message-ID: <2503b955-79a9-4d21-9a25-34a6c33e688d@linux.alibaba.com> (raw)
In-Reply-To: <2024111210165296529720@chinatelecom.cn>
On 2024/11/12 10:16, liuq131@chinatelecom.cn wrote:
> "We assume that the block we are currently processing is distributed as follows:
> 0 1 2 511
> --------------------------------------------------
> | | | |
> ---------------------------------------------------
> Index 0 and 1 are both pages with an order of 0.
> Index 2 has a bogus order (let's assume the order is 9).
> When the for loop reaches index 2, it will enter the following code:
> /*
> * For compound pages such as THP and hugetlbfs, we can save
> * potentially a lot of iterations if we skip them at once.
> * The check is racy, but we can consider only valid values
> * and the only danger is skipping too much.
> */
> if (PageCompound(page)) {
> const unsigned int order = compound_order(page);
> if (blockpfn + (1UL << order) <= end_pfn) {
> blockpfn += (1UL << order) - 1;
> page += (1UL << order) - 1;
> nr_scanned += (1UL << order) - 1;
> }
> goto isolate_fail;
> }
>
> After exiting the for loop:
> blockpfn =basepfn+ 2+2^9 = basepfn+514
> endpfn = basepfn +512
> total_isolated = 2
> nr_scanned = 514
In your case, the 'blockpfn' will not be updated to 'basepfn+514',
because 'blockpfn + (1UL << order) > end_pfn', right? And remember the
'end_pfn' is the end of the pageblock.
So I'm still confused about your case. Is this from code inspection?
> /*
> * Be careful to not go outside of the pageblock.
> */
> if (unlikely(blockpfn > end_pfn))
> blockpfn = end_pfn;
>
> So this can happen
>
> /*
> * If strict isolation is requested by CMA then check that all the
> * pages requested were isolated. If there were any failures, 0 is
> * returned and CMA will fail.
> */
> if (strict && blockpfn < end_pfn)
> total_isolated = 0;
>
> If processed according to the old code, it will not enter the if statement to reset total_isolated, but the correct handling is to reset total_isolated to 0.
Please do not top-posting:
"
- Use interleaved ("inline") replies, which makes your response easier
to read. (i.e. avoid top-posting -- the practice of putting your answer
above the quoted text you are responding to.) For more details, see
:ref:`Documentation/process/submitting-patches.rst
<interleaved_replies>`.
"
WARNING: multiple messages have this Message-ID
From: Qiang Liu <liuq131@chinatelecom.cn>
To: liuq131@chinatelecom.cn, akpm <akpm@linux-foundation.org>
Cc: linux-mm <linux-mm@kvack.org>,
linux-kernel <linux-kernel@vger.kernel.org>,
Baolin Wang <baolin.wang@linux.alibaba.com>
Subject: Re: [PATCH] mm/compaction: fix the total_isolated in strict mode
Date: Thu, 14 Nov 2024 09:55:17 +0800 [thread overview]
Message-ID: <2503b955-79a9-4d21-9a25-34a6c33e688d@linux.alibaba.com> (raw)
Message-ID: <20241114015517.ehhj8L63mkbK-zS-cZEOmQ9MSP0qz1usDs-gF4yhayg@z> (raw)
In-Reply-To: <2024111210165296529720@chinatelecom.cn>
From: Baolin Wang <baolin.wang@linux.alibaba.com>
On 2024/11/12 10:16, liuq131@chinatelecom.cn wrote:
> "We assume that the block we are currently processing is distributed as follows:
> 0 1 2 511
> --------------------------------------------------
> | | | |
> ---------------------------------------------------
> Index 0 and 1 are both pages with an order of 0.
> Index 2 has a bogus order (let's assume the order is 9).
> When the for loop reaches index 2, it will enter the following code:
> /*
> * For compound pages such as THP and hugetlbfs, we can save
> * potentially a lot of iterations if we skip them at once.
> * The check is racy, but we can consider only valid values
> * and the only danger is skipping too much.
> */
> if (PageCompound(page)) {
> const unsigned int order = compound_order(page);
> if (blockpfn + (1UL << order) <= end_pfn) {
> blockpfn += (1UL << order) - 1;
> page += (1UL << order) - 1;
> nr_scanned += (1UL << order) - 1;
> }
> goto isolate_fail;
> }
>
> After exiting the for loop:
> blockpfn =basepfn+ 2+2^9 = basepfn+514
> endpfn = basepfn +512
> total_isolated = 2
> nr_scanned = 514
In your case, the 'blockpfn' will not be updated to 'basepfn+514',
because 'blockpfn + (1UL << order) > end_pfn', right? And remember the
'end_pfn' is the end of the pageblock.
So I'm still confused about your case. Is this from code inspection?
> /*
> * Be careful to not go outside of the pageblock.
> */
> if (unlikely(blockpfn > end_pfn))
> blockpfn = end_pfn;
>
> So this can happen
>
> /*
> * If strict isolation is requested by CMA then check that all the
> * pages requested were isolated. If there were any failures, 0 is
> * returned and CMA will fail.
> */
> if (strict && blockpfn < end_pfn)
> total_isolated = 0;
>
> If processed according to the old code, it will not enter the if statement to reset total_isolated, but the correct handling is to reset total_isolated to 0.
Please do not top-posting:
"
- Use interleaved ("inline") replies, which makes your response easier
to read. (i.e. avoid top-posting -- the practice of putting your answer
above the quoted text you are responding to.) For more details, see
:ref:`Documentation/process/submitting-patches.rst
<interleaved_replies>`.
"
WARNING: multiple messages have this Message-ID
From: Qiang Liu <liuq131@chinatelecom.cn>
To: liuq131@chinatelecom.cn, akpm <akpm@linux-foundation.org>
Cc: linux-mm <linux-mm@kvack.org>,
linux-kernel <linux-kernel@vger.kernel.org>,
Baolin Wang <baolin.wang@linux.alibaba.com>
Subject: Re: [PATCH] mm/compaction: fix the total_isolated in strict mode
Date: Thu, 14 Nov 2024 09:54:46 +0800 [thread overview]
Message-ID: <2503b955-79a9-4d21-9a25-34a6c33e688d@linux.alibaba.com> (raw)
Message-ID: <20241114015446.fR7gmuTVzLIgjiH6rUvK3S3rdHGtrukr0YsMHItc4RI@z> (raw)
In-Reply-To: <2024111210165296529720@chinatelecom.cn>
From: Baolin Wang <baolin.wang@linux.alibaba.com>
On 2024/11/12 10:16, liuq131@chinatelecom.cn wrote:
> "We assume that the block we are currently processing is distributed as follows:
> 0 1 2 511
> --------------------------------------------------
> | | | |
> ---------------------------------------------------
> Index 0 and 1 are both pages with an order of 0.
> Index 2 has a bogus order (let's assume the order is 9).
> When the for loop reaches index 2, it will enter the following code:
> /*
> * For compound pages such as THP and hugetlbfs, we can save
> * potentially a lot of iterations if we skip them at once.
> * The check is racy, but we can consider only valid values
> * and the only danger is skipping too much.
> */
> if (PageCompound(page)) {
> const unsigned int order = compound_order(page);
> if (blockpfn + (1UL << order) <= end_pfn) {
> blockpfn += (1UL << order) - 1;
> page += (1UL << order) - 1;
> nr_scanned += (1UL << order) - 1;
> }
> goto isolate_fail;
> }
>
> After exiting the for loop:
> blockpfn =basepfn+ 2+2^9 = basepfn+514
> endpfn = basepfn +512
> total_isolated = 2
> nr_scanned = 514
In your case, the 'blockpfn' will not be updated to 'basepfn+514',
because 'blockpfn + (1UL << order) > end_pfn', right? And remember the
'end_pfn' is the end of the pageblock.
So I'm still confused about your case. Is this from code inspection?
> /*
> * Be careful to not go outside of the pageblock.
> */
> if (unlikely(blockpfn > end_pfn))
> blockpfn = end_pfn;
>
> So this can happen
>
> /*
> * If strict isolation is requested by CMA then check that all the
> * pages requested were isolated. If there were any failures, 0 is
> * returned and CMA will fail.
> */
> if (strict && blockpfn < end_pfn)
> total_isolated = 0;
>
> If processed according to the old code, it will not enter the if statement to reset total_isolated, but the correct handling is to reset total_isolated to 0.
Please do not top-posting:
"
- Use interleaved ("inline") replies, which makes your response easier
to read. (i.e. avoid top-posting -- the practice of putting your answer
above the quoted text you are responding to.) For more details, see
:ref:`Documentation/process/submitting-patches.rst
<interleaved_replies>`.
"
WARNING: multiple messages have this Message-ID
From: Qiang Liu <liuq131@chinatelecom.cn>
To: liuq131@chinatelecom.cn, akpm <akpm@linux-foundation.org>
Cc: linux-mm <linux-mm@kvack.org>,
linux-kernel <linux-kernel@vger.kernel.org>,
Baolin Wang <baolin.wang@linux.alibaba.com>
Subject: Re: [PATCH] mm/compaction: fix the total_isolated in strict mode
Date: Thu, 14 Nov 2024 10:10:44 +0800 [thread overview]
Message-ID: <2503b955-79a9-4d21-9a25-34a6c33e688d@linux.alibaba.com> (raw)
Message-ID: <20241114021044.96H5DRtKAXyWWwTriThyEqZ19ejl6YQJbHJiy2xYF54@z> (raw)
In-Reply-To: <2024111210165296529720@chinatelecom.cn>
From: Baolin Wang <baolin.wang@linux.alibaba.com>
On 2024/11/12 17:47, baolin.wang@linux.alibaba.com wrote:
>On 2024/11/12 10:16, liuq131@chinatelecom.cn wrote:
>> "We assume that the block we are currently processing is distributed as follows:
>> 0 1 2 511
>> --------------------------------------------------
>> | | | |
>> ---------------------------------------------------
>> Index 0 and 1 are both pages with an order of 0.
>> Index 2 has a bogus order (let's assume the order is 9).
>> When the for loop reaches index 2, it will enter the following code:
>> /*
>> * For compound pages such as THP and hugetlbfs, we can save
>> * potentially a lot of iterations if we skip them at once.
>> * The check is racy, but we can consider only valid values
>> * and the only danger is skipping too much.
>> */
>> if (PageCompound(page)) {
>> const unsigned int order = compound_order(page);
>> if (blockpfn + (1UL << order) <= end_pfn) {
>> blockpfn += (1UL << order) - 1;
>> page += (1UL << order) - 1;
>> nr_scanned += (1UL << order) - 1;
>> }
>> goto isolate_fail;
>> }
>>
>> After exiting the for loop:
>> blockpfn =basepfn+ 2+2^9 = basepfn+514
>> endpfn = basepfn +512
>> total_isolated = 2
>> nr_scanned = 514
>
>In your case, the 'blockpfn' will not be updated to 'basepfn+514',
>because 'blockpfn + (1UL << order) > end_pfn', right? And remember the
>'end_pfn' is the end of the pageblock.
>
>So I'm still confused about your case. Is this from code inspection?
You're right, the situation where blockpfn > end_pfn would not actually occur here.
I encountered this issue in the 4.19 kernel, which did not have this check.
I didn't carefully examine this scenario later. Sorry about that.
However, when blockpfn == end_pfn, I believe the patch is still applicable,
but the git log needs to be updated. Is there still an opportunity to submit
a revised version of the patch?
>> /*
>> * Be careful to not go outside of the pageblock.
>> */
>> if (unlikely(blockpfn > end_pfn))
>> blockpfn = end_pfn;
>>
>> So this can happen
>>
>> /*
>> * If strict isolation is requested by CMA then check that all the
>> * pages requested were isolated. If there were any failures, 0 is
>> * returned and CMA will fail.
>> */
>> if (strict && blockpfn < end_pfn)
>> total_isolated = 0;
>>
>> If processed according to the old code, it will not enter the if statement to reset total_isolated, but the correct handling is to reset total_isolated to 0.
>
>Please do not top-posting:
>
>"
>- Use interleaved ("inline") replies, which makes your response easier
>to read. (i.e. avoid top-posting -- the practice of putting your answer
>above the quoted text you are responding to.) For more details, see
> :ref:`Documentation/process/submitting-patches.rst
><interleaved_replies>`.
>"
>
next prev parent reply other threads:[~2024-11-12 9:47 UTC|newest]
Thread overview: 11+ messages / expand[flat|nested] mbox.gz Atom feed top
2024-11-02 20:16 Qiang Liu
2024-11-12 0:22 ` Andrew Morton
2024-11-12 1:24 ` Baolin Wang
[not found] ` <2024111210165296529720@chinatelecom.cn>
2024-11-12 9:47 ` Baolin Wang [this message]
2024-11-14 1:54 ` Qiang Liu
2024-11-14 1:55 ` Qiang Liu
2024-11-14 2:10 ` Qiang Liu
2024-11-14 2:58 ` Baolin Wang
2024-11-12 7:51 liuq131
2024-11-14 2:29 liuq131
2024-11-14 3:39 liuq131
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=2503b955-79a9-4d21-9a25-34a6c33e688d@linux.alibaba.com \
--to=baolin.wang@linux.alibaba.com \
--cc=akpm@linux-foundation.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=liuq131@chinatelecom.cn \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®