From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1754227AbdBAS1I (ORCPT ); Wed, 1 Feb 2017 13:27:08 -0500 Received: from mx1.redhat.com ([209.132.183.28]:50282 "EHLO mx1.redhat.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752938AbdBAS0o (ORCPT ); Wed, 1 Feb 2017 13:26:44 -0500 From: Waiman Long To: Peter Zijlstra , Ingo Molnar Cc: linux-kernel@vger.kernel.org, Waiman Long Subject: [PATCH 1/2] locking/spinlock_debug: Reduce lockup suspected message clutter Date: Wed, 1 Feb 2017 13:26:23 -0500 Message-Id: <1485973584-3574-2-git-send-email-longman@redhat.com> In-Reply-To: <1485973584-3574-1-git-send-email-longman@redhat.com> References: <1485973584-3574-1-git-send-email-longman@redhat.com> X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.5.110.39]); Wed, 01 Feb 2017 18:26:44 +0000 (UTC) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org When the debug spinlock code detects a lockup, it will print out an error messages as well as the backtraces of all the CPUs. However, if more than one CPUs are waiting on that lock, multiple lockup messages will be printed leading to garbled output. To reduce clutter in the console log, now only one of the lock waiters will be allowed to print out the CPU backtraces. Signed-off-by: Waiman Long --- include/linux/spinlock_types.h | 3 ++- kernel/locking/spinlock_debug.c | 26 +++++++++++++++++++++----- 2 files changed, 23 insertions(+), 6 deletions(-) diff --git a/include/linux/spinlock_types.h b/include/linux/spinlock_types.h index 73548eb..ef28ce5 100644 --- a/include/linux/spinlock_types.h +++ b/include/linux/spinlock_types.h @@ -23,7 +23,7 @@ unsigned int break_lock; #endif #ifdef CONFIG_DEBUG_SPINLOCK - unsigned int magic, owner_cpu; + unsigned int magic, owner_cpu, lockup; void *owner; #endif #ifdef CONFIG_DEBUG_LOCK_ALLOC @@ -45,6 +45,7 @@ # define SPIN_DEBUG_INIT(lockname) \ .magic = SPINLOCK_MAGIC, \ .owner_cpu = -1, \ + .lockup = 0, \ .owner = SPINLOCK_OWNER_INIT, #else # define SPIN_DEBUG_INIT(lockname) diff --git a/kernel/locking/spinlock_debug.c b/kernel/locking/spinlock_debug.c index 0374a59..0f880a8 100644 --- a/kernel/locking/spinlock_debug.c +++ b/kernel/locking/spinlock_debug.c @@ -27,6 +27,7 @@ void __raw_spin_lock_init(raw_spinlock_t *lock, const char *name, lock->magic = SPINLOCK_MAGIC; lock->owner = SPINLOCK_OWNER_INIT; lock->owner_cpu = -1; + lock->lockup = 0; } EXPORT_SYMBOL(__raw_spin_lock_init); @@ -101,6 +102,24 @@ static inline void debug_spin_unlock(raw_spinlock_t *lock) lock, "wrong CPU"); lock->owner = SPINLOCK_OWNER_INIT; lock->owner_cpu = -1; + lock->lockup = 0; +} + +static inline void __spin_lockup(raw_spinlock_t *lock) +{ + /* + * lockup suspected: + * + * Only one of the lock waiters will be allowed to print the lockup + * message in order to avoid an avalanche of lockup and backtrace + * messages from different lock waiters of the same lock. + */ + if (!xchg(&lock->lockup, 1)) { + spin_dump(lock, "lockup suspected"); +#ifdef CONFIG_SMP + trigger_all_cpu_backtrace(); +#endif + } } static void __spin_lock_debug(raw_spinlock_t *lock) @@ -113,11 +132,8 @@ static void __spin_lock_debug(raw_spinlock_t *lock) return; __delay(1); } - /* lockup suspected: */ - spin_dump(lock, "lockup suspected"); -#ifdef CONFIG_SMP - trigger_all_cpu_backtrace(); -#endif + + __spin_lockup(lock); /* * The trylock above was causing a livelock. Give the lower level arch -- 1.8.3.1