From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-5.6 required=3.0 tests=DKIMWL_WL_HIGH,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,MAILING_LIST_MULTI,SIGNED_OFF_BY,SPF_HELO_NONE, SPF_PASS,USER_AGENT_SANE_1 autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 259CDC606DA for ; Tue, 9 Jul 2019 09:55:24 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id EBE8920844 for ; Tue, 9 Jul 2019 09:55:23 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1562666124; bh=dACXy/neZ1O1zKF33cib0n3DI1HLMPZsLk6r5xkTQ8M=; h=Date:From:To:Cc:Subject:References:In-Reply-To:List-ID:From; b=VhuwVWBWY65MnwaC4JAwoh8e3zAtDRqm/QL+tg5e/BuyJxitOzclTKKw0v5IIXn9N xshLIB4xCPGEGfP7QSbF05mVIhpE68bQYrA9TmYmswqc7E4OIgcfCtctvq9P731IMo rtt98G32++knb7PjFn6AhIwyO3UW9FeLEssXMCFw= Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726636AbfGIJzX (ORCPT ); Tue, 9 Jul 2019 05:55:23 -0400 Received: from mx2.suse.de ([195.135.220.15]:47032 "EHLO mx1.suse.de" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1726126AbfGIJzW (ORCPT ); Tue, 9 Jul 2019 05:55:22 -0400 X-Virus-Scanned: by amavisd-new at test-mx.suse.de Received: from relay2.suse.de (unknown [195.135.220.254]) by mx1.suse.de (Postfix) with ESMTP id 7524CAD3E; Tue, 9 Jul 2019 09:55:20 +0000 (UTC) Date: Tue, 9 Jul 2019 11:55:19 +0200 From: Michal Hocko To: Minchan Kim Cc: Andrew Morton , linux-mm , LKML , linux-api@vger.kernel.org, Johannes Weiner , Tim Murray , Joel Fernandes , Suren Baghdasaryan , Daniel Colascione , Shakeel Butt , Sonny Rao , oleksandr@redhat.com, hdanton@sina.com, lizeb@google.com, Dave Hansen , "Kirill A . Shutemov" Subject: Re: [PATCH v3 4/5] mm: introduce MADV_PAGEOUT Message-ID: <20190709095518.GF26380@dhcp22.suse.cz> References: <20190627115405.255259-1-minchan@kernel.org> <20190627115405.255259-5-minchan@kernel.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20190627115405.255259-5-minchan@kernel.org> User-Agent: Mutt/1.10.1 (2018-07-13) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu 27-06-19 20:54:04, Minchan Kim wrote: > When a process expects no accesses to a certain memory range > for a long time, it could hint kernel that the pages can be > reclaimed instantly but data should be preserved for future use. > This could reduce workingset eviction so it ends up increasing > performance. > > This patch introduces the new MADV_PAGEOUT hint to madvise(2) > syscall. MADV_PAGEOUT can be used by a process to mark a memory > range as not expected to be used for a long time so that kernel > reclaims *any LRU* pages instantly. The hint can help kernel in > deciding which pages to evict proactively. > > - man-page material > > MADV_PAGEOUT (since Linux x.x) > > Do not expect access in the near future so pages in the specified > regions could be reclaimed instantly regardless of memory pressure. > Thus, access in the range after successful operation could cause > major page fault but never lose the up-to-date contents unlike > MADV_DONTNEED. > It works for only private anonymous mappings and > non-anonymous mappings that belong to files that the calling process > could successfully open for writing; otherwise, it could be used for > sidechannel attack. I would rephrase this way: " Pages belonging to a shared mapping are only processed if a write access is allowed for the calling process. " I wouldn't really mention side channel attacks for a man page. You can mention can_do_mincore check and the side channel prevention in the changelog that is not aimed for the man page. > MADV_PAGEOUT cannot be applied to locked pages, Huge TLB pages, or > VM_PFNMAP pages. > > * v2 > * add comment about SWAP_CLUSTER_MAX - mhocko > * add permission check to prevent sidechannel attack - mhocko > * add man page stuff - dave > > * v1 > * change pte to old and rely on the other's reference - hannes > * remove page_mapcount to check shared page - mhocko > > * RFC v2 > * make reclaim_pages simple via factoring out isolate logic - hannes > > * RFCv1 > * rename from MADV_COLD to MADV_PAGEOUT - hannes > * bail out if process is being killed - Hillf > * fix reclaim_pages bugs - Hillf > > Signed-off-by: Minchan Kim > --- I am still not convinced about the SWAP_CLUSTER_MAX batching and the udnerlying OOM argument. Is one pmd worth of pages really an OOM risk? Sure you can have many invocations in parallel and that would add on but the same might happen with SWAP_CLUSTER_MAX. So I would just remove the batching for now and think of it only if we really see this being a problem for real. Unless you feel really strong about this, of course. Anyway the patch looks ok to me otherwise. Acked-by: Michal Hocko -- Michal Hocko SUSE Labs