From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1756372AbbDOVRE (ORCPT ); Wed, 15 Apr 2015 17:17:04 -0400 Received: from mail-pa0-f50.google.com ([209.85.220.50]:34072 "EHLO mail-pa0-f50.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1753557AbbDOVQ7 (ORCPT ); Wed, 15 Apr 2015 17:16:59 -0400 Date: Wed, 15 Apr 2015 14:16:49 -0700 (PDT) From: Hugh Dickins X-X-Sender: hugh@eggly.anvils To: Rik van Riel cc: Mel Gorman , Linux-MM , Johannes Weiner , Dave Hansen , Andi Kleen , LKML Subject: Re: [PATCH 2/4] mm: Send a single IPI to TLB flush multiple pages when unmapping In-Reply-To: <552ED214.3050105@redhat.com> Message-ID: References: <1429094576-5877-1-git-send-email-mgorman@suse.de> <1429094576-5877-3-git-send-email-mgorman@suse.de> <552ED214.3050105@redhat.com> User-Agent: Alpine 2.11 (LSU 23 2013-08-11) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Wed, 15 Apr 2015, Rik van Riel wrote: > On 04/15/2015 06:42 AM, Mel Gorman wrote: > > An IPI is sent to flush remote TLBs when a page is unmapped that was > > recently accessed by other CPUs. There are many circumstances where this > > happens but the obvious one is kswapd reclaiming pages belonging to a > > running process as kswapd and the task are likely running on separate CPUs. > > > > On small machines, this is not a significant problem but as machine > > gets larger with more cores and more memory, the cost of these IPIs can > > be high. This patch uses a structure similar in principle to a pagevec > > to collect a list of PFNs and CPUs that require flushing. It then sends > > one IPI to flush the list of PFNs. A new TLB flush helper is required for > > this and one is added for x86. Other architectures will need to decide if > > batching like this is both safe and worth the memory overhead. Specifically > > the requirement is; > > > > If a clean page is unmapped and not immediately flushed, the > > architecture must guarantee that a write to that page from a CPU > > with a cached TLB entry will trap a page fault. > > > > This is essentially what the kernel already depends on but the window is > > much larger with this patch applied and is worth highlighting. > > This means we already have a (hard to hit?) data corruption > issue in the kernel. We can lose data if we unmap a writable > but not dirty pte from a file page, and the task writes before > we flush the TLB. I don't think so. IIRC, when the CPU needs to set the dirty bit, it doesn't just do that in its TLB entry, but has to fetch and update the actual pte entry - and at that point discovers it's no longer valid so traps, as Mel says. (I'm now reading that paragraph differently from when I replied to 4/4.) Hugh