From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-5.5 required=3.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,SIGNED_OFF_BY,SPF_PASS,URIBL_BLOCKED,USER_AGENT_MUTT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 3F682C43441 for ; Tue, 27 Nov 2018 10:56:21 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 065692086B for ; Tue, 27 Nov 2018 10:56:20 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 065692086B Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=linux.ibm.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1730931AbeK0Vxt (ORCPT ); Tue, 27 Nov 2018 16:53:49 -0500 Received: from mx0b-001b2d01.pphosted.com ([148.163.158.5]:41324 "EHLO mx0a-001b2d01.pphosted.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1726501AbeK0Vxt (ORCPT ); Tue, 27 Nov 2018 16:53:49 -0500 Received: from pps.filterd (m0098416.ppops.net [127.0.0.1]) by mx0b-001b2d01.pphosted.com (8.16.0.22/8.16.0.22) with SMTP id wARArpsX036831 for ; Tue, 27 Nov 2018 05:56:17 -0500 Received: from e06smtp05.uk.ibm.com (e06smtp05.uk.ibm.com [195.75.94.101]) by mx0b-001b2d01.pphosted.com with ESMTP id 2p12nkwphj-1 (version=TLSv1.2 cipher=AES256-GCM-SHA384 bits=256 verify=NOT) for ; Tue, 27 Nov 2018 05:56:17 -0500 Received: from localhost by e06smtp05.uk.ibm.com with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted for from ; Tue, 27 Nov 2018 10:56:14 -0000 Received: from b06cxnps4075.portsmouth.uk.ibm.com (9.149.109.197) by e06smtp05.uk.ibm.com (192.168.101.135) with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted; (version=TLSv1/SSLv3 cipher=AES256-GCM-SHA384 bits=256/256) Tue, 27 Nov 2018 10:56:08 -0000 Received: from d06av22.portsmouth.uk.ibm.com (d06av22.portsmouth.uk.ibm.com [9.149.105.58]) by b06cxnps4075.portsmouth.uk.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id wARAu7VK9568580 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Tue, 27 Nov 2018 10:56:07 GMT Received: from d06av22.portsmouth.uk.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 7CC224C050; Tue, 27 Nov 2018 10:56:07 +0000 (GMT) Received: from d06av22.portsmouth.uk.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 96EC04C044; Tue, 27 Nov 2018 10:56:05 +0000 (GMT) Received: from rapoport-lnx (unknown [9.148.204.155]) by d06av22.portsmouth.uk.ibm.com (Postfix) with ESMTPS; Tue, 27 Nov 2018 10:56:05 +0000 (GMT) Date: Tue, 27 Nov 2018 12:56:03 +0200 From: Mike Rapoport To: Matthew Wilcox Cc: Hugh Dickins , Linus Torvalds , Andrew Morton , Baoquan He , Michal Hocko , Vlastimil Babka , Andrea Arcangeli , David Hildenbrand , Mel Gorman , David Herrmann , Tim Chen , Kan Liang , Andi Kleen , Davidlohr Bueso , Peter Zijlstra , Christoph Lameter , Nick Piggin , pifang@redhat.com, linux-kernel@vger.kernel.org, linux-mm@kvack.org Subject: Re: [PATCHi v2] mm: put_and_wait_on_page_locked() while page is migrated References: <20181126205351.GM3065@bombadil.infradead.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20181126205351.GM3065@bombadil.infradead.org> User-Agent: Mutt/1.5.24 (2015-08-30) X-TM-AS-GCONF: 00 x-cbid: 18112710-0020-0000-0000-000002EE5FAF X-IBM-AV-DETECTION: SAVI=unused REMOTE=unused XFE=unused x-cbparentid: 18112710-0021-0000-0000-0000213DB386 Message-Id: <20181127105602.GC16502@rapoport-lnx> X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:,, definitions=2018-11-27_09:,, signatures=0 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 priorityscore=1501 malwarescore=0 suspectscore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1015 lowpriorityscore=0 mlxscore=0 impostorscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1810050000 definitions=main-1811270096 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Mon, Nov 26, 2018 at 12:53:51PM -0800, Matthew Wilcox wrote: > On Mon, Nov 26, 2018 at 11:27:07AM -0800, Hugh Dickins wrote: > > Waiting on a page migration entry has used wait_on_page_locked() all > > along since 2006: but you cannot safely wait_on_page_locked() without > > holding a reference to the page, and that extra reference is enough to > > make migrate_page_move_mapping() fail with -EAGAIN, when a racing task > > faults on the entry before migrate_page_move_mapping() gets there. > > > > And that failure is retried nine times, amplifying the pain when > > trying to migrate a popular page. With a single persistent faulter, > > migration sometimes succeeds; with two or three concurrent faulters, > > success becomes much less likely (and the more the page was mapped, > > the worse the overhead of unmapping and remapping it on each try). > > > > This is especially a problem for memory offlining, where the outer > > level retries forever (or until terminated from userspace), because > > a heavy refault workload can trigger an endless loop of migration > > failures. wait_on_page_locked() is the wrong tool for the job. > > > > David Herrmann (but was he the first?) noticed this issue in 2014: > > https://marc.info/?l=linux-mm&m=140110465608116&w=2 > > > > Tim Chen started a thread in August 2017 which appears relevant: > > https://marc.info/?l=linux-mm&m=150275941014915&w=2 > > where Kan Liang went on to implicate __migration_entry_wait(): > > https://marc.info/?l=linux-mm&m=150300268411980&w=2 > > and the thread ended up with the v4.14 commits: > > 2554db916586 ("sched/wait: Break up long wake list walk") > > 11a19c7b099f ("sched/wait: Introduce wakeup boomark in wake_up_page_bit") > > > > Baoquan He reported "Memory hotplug softlock issue" 14 November 2018: > > https://marc.info/?l=linux-mm&m=154217936431300&w=2 > > > > We have all assumed that it is essential to hold a page reference while > > waiting on a page lock: partly to guarantee that there is still a struct > > page when MEMORY_HOTREMOVE is configured, but also to protect against > > reuse of the struct page going to someone who then holds the page locked > > indefinitely, when the waiter can reasonably expect timely unlocking. > > > > But in fact, so long as wait_on_page_bit_common() does the put_page(), > > and is careful not to rely on struct page contents thereafter, there is > > no need to hold a reference to the page while waiting on it. That does > > mean that this case cannot go back through the loop: but that's fine for > > the page migration case, and even if used more widely, is limited by the > > "Stop walking if it's locked" optimization in wake_page_function(). > > > > Add interface put_and_wait_on_page_locked() to do this, using "behavior" > > enum in place of "lock" arg to wait_on_page_bit_common() to implement it. > > No interruptible or killable variant needed yet, but they might follow: > > I have a vague notion that reporting -EINTR should take precedence over > > return from wait_on_page_bit_common() without knowing the page state, > > so arrange it accordingly - but that may be nothing but pedantic. > > > > __migration_entry_wait() still has to take a brief reference to the > > page, prior to calling put_and_wait_on_page_locked(): but now that it > > is dropped before waiting, the chance of impeding page migration is > > very much reduced. Should we perhaps disable preemption across this? > > > > shrink_page_list()'s __ClearPageLocked(): that was a surprise! This > > survived a lot of testing before that showed up. PageWaiters may have > > been set by wait_on_page_bit_common(), and the reference dropped, just > > before shrink_page_list() succeeds in freezing its last page reference: > > in such a case, unlock_page() must be used. Follow the suggestion from > > Michal Hocko, just revert a978d6f52106 ("mm: unlockless reclaim") now: > > that optimization predates PageWaiters, and won't buy much these days; > > but we can reinstate it for the !PageWaiters case if anyone notices. > > > > It does raise the question: should vmscan.c's is_page_cache_freeable() > > and __remove_mapping() now treat a PageWaiters page as if an extra > > reference were held? Perhaps, but I don't think it matters much, since > > shrink_page_list() already had to win its trylock_page(), so waiters are > > not very common there: I noticed no difference when trying the bigger > > change, and it's surely not needed while put_and_wait_on_page_locked() > > is only used for page migration. > > > > Reported-and-tested-by: Baoquan He > > Signed-off-by: Hugh Dickins > > Acked-by: Michal Hocko > > Reviewed-by: Andrea Arcangeli > > --- > > include/linux/pagemap.h | 2 ++ > > mm/filemap.c | 77 ++++++++++++++++++++++++++++++++++------- > > mm/huge_memory.c | 6 ++-- > > mm/migrate.c | 12 +++---- > > mm/vmscan.c | 10 ++---- > > 5 files changed, 74 insertions(+), 33 deletions(-) > > > > /** > * put_and_wait_on_page_locked - Drop a reference and wait for it to be unlocked wait for page ? > * @page: The page to wait for. > * > * The caller should hold a reference on @page. They expect the page to > * become unlocked relatively soon, but do not wish to hold up migration > * (for example) by holding the reference while waiting for the page to > * come unlocked. After this function returns, the caller should not > * dereference @page. > */ How about: They expect the page to become unlocked relatively soon, but they can wait for the page to come unlocked without holding the reference, to allow other users of the @page (for example migration) to continue. > (improvements gratefully received) > > > +void put_and_wait_on_page_locked(struct page *page) > > +{ > > + wait_queue_head_t *q; > > + > > + page = compound_head(page); > > + q = page_waitqueue(page); > > + wait_on_page_bit_common(q, page, PG_locked, TASK_UNINTERRUPTIBLE, DROP); > > +} > > + > > /** > > * add_page_wait_queue - Add an arbitrary waiter to a page's wait queue > > * @page: Page defining the wait queue of interest > -- Sincerely yours, Mike.