From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1751886AbdA3KPY (ORCPT ); Mon, 30 Jan 2017 05:15:24 -0500 Received: from Galois.linutronix.de ([146.0.238.70]:58142 "EHLO Galois.linutronix.de" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751054AbdA3KOo (ORCPT ); Mon, 30 Jan 2017 05:14:44 -0500 From: John Ogness To: linux-rt-users Cc: Sebastian Siewior Cc: Peter Zijlstra Cc: linux-kernel@vger.kernel.org Cc: Thomas Gleixner Cc: x86@kernel.org Cc: fenghua.yu@intel.com Cc: h.peter.anvin@intel.com Cc: vikas.shivappa@linux.intel.com Cc: tony.luck@intel.com Cc: davidcc@google.com Cc: dave.hansen@intel.com Cc: eranian@google.com Subject: [PATCHv2] x86/mm/cpa: avoid wbinvd() for PREEMPT Date: Mon, 30 Jan 2017 09:41:21 +0100 Message-ID: <87o9ypvt1q.fsf@linutronix.de> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Although wbinvd() is faster than flushing many individual pages, it blocks the memory bus for "long" periods of time (>100us), thus directly causing unusually large latencies on all CPUs, regardless of any CPU isolation features that may be active. For 1024 pages, flushing those pages individually can take up to 2200us, but the task remains fully preemptible during that time. Signed-off-by: John Ogness --- v1-v2: changed CONFIG_PREEMPT_RT_FULL to CONFIG_PREEMPT It was suggested that wbinvd() is removed altogether, but any kernel configured without CONFIG_PREEMPT probably doesn't care about latencies. arch/x86/mm/pageattr.c | 8 ++++++++ 1 file changed, 8 insertions(+) diff --git a/arch/x86/mm/pageattr.c b/arch/x86/mm/pageattr.c index 5a287e5..ba1393d 100644 --- a/arch/x86/mm/pageattr.c +++ b/arch/x86/mm/pageattr.c @@ -214,7 +214,15 @@ static void cpa_flush_array(unsigned long *start, int numpages, int cache, int in_flags, struct page **pages) { unsigned int i, level; +#ifdef CONFIG_PREEMPT + /* + * Avoid wbinvd() because it causes latencies on all CPUs, + * regardless of any CPU isolation that may be in effect. + */ + unsigned long do_wbinvd = 0; +#else unsigned long do_wbinvd = cache && numpages >= 1024; /* 4M threshold */ +#endif BUG_ON(irqs_disabled()); -- 1.7.10.4