From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id 5A0F6C433EF for ; Wed, 23 Mar 2022 15:33:30 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S245199AbiCWPej (ORCPT ); Wed, 23 Mar 2022 11:34:39 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:39096 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S245187AbiCWPef (ORCPT ); Wed, 23 Mar 2022 11:34:35 -0400 Received: from out0.migadu.com (out0.migadu.com [94.23.1.103]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 2BD30330 for ; Wed, 23 Mar 2022 08:33:03 -0700 (PDT) X-Report-Abuse: Please report any abuse attempt to abuse@migadu.com and include these headers. DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linux.dev; s=key1; t=1648049582; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Mmc3nZQPUIWzZbIw9R7zdg/6fIrR3qfP7vluF20CZjk=; b=UTJfa80A9sjfbSyh7XvFmbslezbBssH3pgpUdBaLBgs3IL2A3I6NA415UycL5yEGhbwHb6 vpUhIr+s+DTQPNB7OYobvxHrvMaOkJFmdVvDpJbnJ21kD5Gc+xjflW3QFSbiifKEwW887J jc+p/iTWkpBgyYYx+H4uOeaKNyAMx8U= From: andrey.konovalov@linux.dev To: Marco Elver , Alexander Potapenko , Catalin Marinas , Will Deacon , Andrew Morton Cc: Andrey Konovalov , Dmitry Vyukov , Andrey Ryabinin , kasan-dev@googlegroups.com, Mark Rutland , Vincenzo Frascino , Sami Tolvanen , Peter Collingbourne , Evgenii Stepanov , Florian Mayer , linux-mm@kvack.org, linux-kernel@vger.kernel.org, Andrey Konovalov Subject: [PATCH v2 1/4] stacktrace: add interface based on shadow call stack Date: Wed, 23 Mar 2022 16:32:52 +0100 Message-Id: <21e3e20ea58e242e3c82c19abbfe65b579e0e4b8.1648049113.git.andreyknvl@google.com> In-Reply-To: References: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Migadu-Flow: FLOW_OUT X-Migadu-Auth-User: linux.dev Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org From: Andrey Konovalov Add a new interface stack_trace_save_shadow() for collecting stack traces by copying frames from the Shadow Call Stack. Collecting stack traces this way is significantly faster: boot time of a defconfig build with KASAN enabled gets descreased by ~30%. The few patches following this one add an implementation of stack_trace_save_shadow() for arm64. The implementation of the added interface is not meant to use stack_trace_consume_fn to avoid making a function call for each collected frame to further improve performance. Signed-off-by: Andrey Konovalov --- arch/Kconfig | 6 ++++++ include/linux/stacktrace.h | 15 +++++++++++++++ kernel/stacktrace.c | 21 +++++++++++++++++++++ 3 files changed, 42 insertions(+) diff --git a/arch/Kconfig b/arch/Kconfig index e12a4268c01d..207c1679c53a 100644 --- a/arch/Kconfig +++ b/arch/Kconfig @@ -1041,6 +1041,12 @@ config HAVE_RELIABLE_STACKTRACE arch_stack_walk_reliable() function which only returns a stack trace if it can guarantee the trace is reliable. +config HAVE_SHADOW_STACKTRACE + bool + help + If this is set, the architecture provides the arch_stack_walk_shadow() + function, which collects the stack trace from the shadow call stack. + config HAVE_ARCH_HASH bool default n diff --git a/include/linux/stacktrace.h b/include/linux/stacktrace.h index 97455880ac41..b74d1e42e157 100644 --- a/include/linux/stacktrace.h +++ b/include/linux/stacktrace.h @@ -60,6 +60,9 @@ int arch_stack_walk_reliable(stack_trace_consume_fn consume_entry, void *cookie, void arch_stack_walk_user(stack_trace_consume_fn consume_entry, void *cookie, const struct pt_regs *regs); + +int arch_stack_walk_shadow(unsigned long *store, unsigned int size, + unsigned int skipnr); #endif /* CONFIG_ARCH_STACKWALK */ #ifdef CONFIG_STACKTRACE @@ -108,4 +111,16 @@ static inline int stack_trace_save_tsk_reliable(struct task_struct *tsk, } #endif +#if defined(CONFIG_STACKTRACE) && defined(CONFIG_HAVE_SHADOW_STACKTRACE) +int stack_trace_save_shadow(unsigned long *store, unsigned int size, + unsigned int skipnr); +#else +static inline int stack_trace_save_shadow(unsigned long *store, + unsigned int size, + unsigned int skipnr) +{ + return -ENOSYS; +} +#endif + #endif /* __LINUX_STACKTRACE_H */ diff --git a/kernel/stacktrace.c b/kernel/stacktrace.c index 9ed5ce989415..fe305861fd55 100644 --- a/kernel/stacktrace.c +++ b/kernel/stacktrace.c @@ -237,6 +237,27 @@ unsigned int stack_trace_save_user(unsigned long *store, unsigned int size) } #endif +#ifdef CONFIG_HAVE_SHADOW_STACKTRACE +/** + * stack_trace_save_shadow - Save a stack trace based on shadow call stack + * @store: Pointer to the storage array + * @size: Size of the storage array + * @skipnr: Number of entries to skip at the start of the stack trace + * + * Return: Number of trace entries stored. + */ +int stack_trace_save_shadow(unsigned long *store, unsigned int size, + unsigned int skipnr) +{ + /* + * Do not use stack_trace_consume_fn to avoid making a function + * call for each collected frame to improve performance. + * Skip + 1 frame to skip stack_trace_save_shadow. + */ + return arch_stack_walk_shadow(store, size, skipnr + 1); +} +#endif + #else /* CONFIG_ARCH_STACKWALK */ /* -- 2.25.1