From mboxrd@z Thu Jan 1 00:00:00 1970 Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.remote-ip=100.103.45.18 ARC-Seal: i=1; d=subspace.kernel.org; s=arc20261015; a=rsa-sha256; cv=none; t=1793868250; b=itpUTxcSnGSJB3vF4pmdBo6LRKn55Ta1wPHepAqHvlJeQY6YmszRKy0OesIlJOBbPC/h fvjonMczaJ6gPqOUGIL1ye0dWxpDaBsu7pb6QEuEaV9/1n2UlvNpNE2I7rYsZ54uAB/GS rX9Ga/GCnsE4wIiEN9qho3eRR5yQX8WZx+tZce2OGEvem+AIKiB/NQxU9pNgjKxaVBavG O4BKPfCYZngvTYf5qXJ0+wAGoCnwueFMuyzabhZPfa8Sc3mtUKIfj5fVR50d9EDwIY/co uMkd5GzFzf+xAm2USVUZ3MzsAMCLfUj117eRkCaeL5GDZqhqXnSaJDpbQIg7ZC9fvWQ== ARC-Message-Signature: i=1; d=subspace.kernel.org; s=arc20261015; a=rsa-sha256; c=relaxed/relaxed; t=1793868250; h=Received:DKIM-Signature:From:Date:Subject:MIME-Version:Content-Type: Content-Transfer-Encoding:Message-Id:References:In-Reply-To:To:Cc: X-Mailer; bh=iu5/0CAAr9pJxXMAISy8ciswj9EjhTb+ydO2NNeMnUk=; b=a8Uo0+1vNg4IsmGneNDJAf5m0cSDtRU1B+C4bHt6wBpz9ZzvZI2+lDz+ep4S1AVMjTjY vsjS5PiFIuCgXs4QTUF3lPbkymihh8c+edys7pVQJuojrkq/8tDp4esAjZa5+eKG+YMEd xCGphBgknD0OCaTT+BZqQUPzRxH3yexfDEWmPcGvRHhgbhxUaWLtyO8jaKDCWR3PquDG9 V57wzbYmyegwbJY+B1Vfkgr6u8EijwzHFSBK5NEPjJRMCR86Cr8E+OS6gZvBlUO8Lztw2 AbCSAPcFs5kGCDewyBtMZUO4yKISJh6s6pooX0Fjh643n4fI3KdnhER5ZfoJ107hZUQ== ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dkim=pass header.d=kernel.org header.i=@kernel.org header.a=rsa-sha256 header.s=k20260515 header.b=J8NkHEK9; arc=none smtp.remote-ip=100.103.45.18 Received: from smtp.kernel.org (quasi.space.kernel.org [100.103.45.18]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (prime256v1)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 73F76606A326 for ; Thu, 5 Nov 2026 08:44:10 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key, unprotected) header.d=kernel.org header.i=@kernel.org header.a=rsa-sha256 header.s=k20260515 header.b=J8NkHEK9 Received: by smtp.kernel.org (Postfix) with ESMTPSA id 1A4BC1F000C1; Thu, 5 Nov 2026 08:44:06 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kernel.org; s=k20260515; t=1793868250; bh=iu5/0CAAr9pJxXMAISy8ciswj9EjhTb+ydO2NNeMnUk=; h=From:Date:Subject:References:In-Reply-To:To:Cc; b=J8NkHEK9iTuXRjMKFYOhhkSFbTFDWaiVXotj2Vg+7HJ50gV7IOrq0ejMqx0ZLoNo2 HOQf4oK4MigaUkAWernnrw3kZygxHgQGIOg4wniV+mvFICOlMsw35BkYaNBw/KRBAW s7UGrRQOeOgYwoytt/Usiqup92jOp40YN5SkKdEKrR4pSdu81Sl9Uin4hEt7NxLh5S hJLeMcc/OA/yqxsCFQ5rmlR+4K9VYKLKEzDf8CN9jTFvDSSW20jW/DT4OnERT7f44+ 8OqOLOEC5/yZoEWPl8l0RkAicCgc0w8jUSSFJ9VxB4pK2Lj3rSBSqQbQlHMAwtSDey pvuYJj7DgdFgQ== From: "Vlastimil Babka (SUSE)" Date: Thu, 05 Nov 2026 09:43:53 +0100 Subject: [PATCH v3 04/10] mm, slab: introduce slab_debug=N X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Post: List-Help: List-Subscribe: List-Unsubscribe: List-Owner: Precedence: list MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Message-Id: <20261105-slub_tiny_rework-v3-4-0484ce59eabb@kernel.org> References: <20261105-slub_tiny_rework-v3-0-0484ce59eabb@kernel.org> In-Reply-To: <20261105-slub_tiny_rework-v3-0-0484ce59eabb@kernel.org> To: Harry Yoo , Andrey Ryabinin Cc: Hao Li , Christoph Lameter , David Rientjes , Roman Gushchin , Geert Uytterhoeven , Conor Dooley , Damien Le Moal , linux-mm@kvack.org, linux-kernel@vger.kernel.org, Alexander Potapenko , Andrey Konovalov , Dmitry Vyukov , Vincenzo Frascino , kasan-dev@googlegroups.com, "Vlastimil Babka (SUSE)" X-Mailer: b4 0.16.0 Enabling slab_debug has the side-effect of disabling all percpu caching of objects (now via sheaves), which can be sometimes useful for saving memory for e.g. kdump kernels. To make this possible without the overhead (CPU or memory) of actual debugging options such as poisoning, introduce a No-op debug option that only forces the debugging slow paths and zero sheaf capacity. The new corresponding slab flag is SLAB_DEBUG_NOOP. This will also allow reimplementing CONFIG_SLUB_TINY as a boot-time option. Two details have to be considered, as suggested by Harry Yoo [1]. - While SLAB_DEBUG_NOOP is part of SLAB_DEBUG_FLAGS, it should not prevent cache merging as it doesn't affect object metadata, and lack of merging would go against the memory footprint reduction. Thus exclude the flag from SLAB_NEVER_MERGE. - However add the flag to SLAB_MERGE_SAME, per sashiko. - SLAB_DEBUG_NOOP alone should not request disabling printk pointer hashing. Thus rework the call to hash_pointers_finalize() to not rely on the slub_debug static key state. Instead determine whether the global or per-cache slab_debug options include any flags that are not SLAB_DEBUG_NOOP. This does not change the fact that caches created with explicit debug flags (i.e. slub_kunit tests) later in boot have no effect on pointer hashing, which is determined in kmem_cache_init(). While documenting the new N option, remove obsolete SLAB references from the F option description. [1] https://lore.kernel.org/all/arUx56ee_nkxYP_f@thinkstation/ [2] https://sashiko.dev/#/patchset/20261024-slub_tiny_rework-v2-0-bf1419ab5ffd@kernel.org?part=2 Signed-off-by: Vlastimil Babka (SUSE) --- Documentation/admin-guide/mm/slab.rst | 13 +++++++++++-- include/linux/slab.h | 5 ++++- mm/slab.h | 2 +- mm/slab_common.c | 9 +++++---- mm/slub.c | 21 ++++++++++++++++++++- 5 files changed, 41 insertions(+), 9 deletions(-) diff --git a/Documentation/admin-guide/mm/slab.rst b/Documentation/admin-guide/mm/slab.rst index 14429ab90611..0beeae71d472 100644 --- a/Documentation/admin-guide/mm/slab.rst +++ b/Documentation/admin-guide/mm/slab.rst @@ -45,12 +45,12 @@ of the first "select slabs" blocks that matches the slab's name are applied. Possible debug options are:: - F Sanity checks on (enables SLAB_DEBUG_CONSISTENCY_CHECKS - Sorry SLAB legacy issues) + F Sanity (slab consistency) checks on alloc and free Z Red zoning P Poisoning (object and padding) U User tracking (free and alloc) T Trace (please only use on single slabs) + N No-op (force debugging slowpaths without any checks) A Enable failslab filter mark for the cache O Switch debugging off for caches that would have caused higher minimum slab orders @@ -85,6 +85,15 @@ in low memory situations or if there's high fragmentation of memory. To slab_debug=O +The No-op option can be useful to minimize slab memory overhead by forcing slab +debugging slowpaths, which disables percpu object caching. This reduces SMP +scalability significantly, but does not impose the extra cpu or memory overhead +of debugging options that actually perform checks. This can be useful for e.g. +kdump kernels where scalability is not a concern, but memory has to be +pre-reserved from the production kernel. So for a kdump kernel you can use:: + + slab_debug=N + You can apply different options to different list of slab names, using blocks of options. This will enable red zoning for dentry and user tracking for kmalloc. All other slabs will not get any debugging enabled:: diff --git a/include/linux/slab.h b/include/linux/slab.h index cda126def67a..ed949e8522be 100644 --- a/include/linux/slab.h +++ b/include/linux/slab.h @@ -35,6 +35,7 @@ enum _slab_flag_bits { _SLAB_PANIC, _SLAB_TYPESAFE_BY_RCU, _SLAB_TRACE, + _SLAB_DEBUG_NOOP, #ifdef CONFIG_DEBUG_OBJECTS _SLAB_DEBUG_OBJECTS, #endif @@ -166,8 +167,10 @@ enum _slab_flag_bits { * Note that SLAB_TYPESAFE_BY_RCU was originally named SLAB_DESTROY_BY_RCU. */ #define SLAB_TYPESAFE_BY_RCU __SLAB_FLAG_BIT(_SLAB_TYPESAFE_BY_RCU) -/* Trace allocations and frees */ +/* DEBUG: Trace allocations and frees */ #define SLAB_TRACE __SLAB_FLAG_BIT(_SLAB_TRACE) +/* DEBUG: Force the debug slowpaths without actually doing anything */ +#define SLAB_DEBUG_NOOP __SLAB_FLAG_BIT(_SLAB_DEBUG_NOOP) /* Flag to prevent checks on free */ #ifdef CONFIG_DEBUG_OBJECTS diff --git a/mm/slab.h b/mm/slab.h index e94ac63d10dc..79774e2be3bb 100644 --- a/mm/slab.h +++ b/mm/slab.h @@ -476,7 +476,7 @@ void flush_rcu_sheaves_on_cache(struct kmem_cache *s); SLAB_NO_USER_FLAGS | SLAB_KMALLOC | SLAB_NO_MERGE) #define SLAB_DEBUG_FLAGS (SLAB_RED_ZONE | SLAB_POISON | SLAB_STORE_USER | \ - SLAB_TRACE | SLAB_CONSISTENCY_CHECKS) + SLAB_TRACE | SLAB_DEBUG_NOOP | SLAB_CONSISTENCY_CHECKS) #define SLAB_FLAGS_PERMITTED (SLAB_CORE_FLAGS | SLAB_DEBUG_FLAGS) diff --git a/mm/slab_common.c b/mm/slab_common.c index 01c64ef661e7..6036ce1ac333 100644 --- a/mm/slab_common.c +++ b/mm/slab_common.c @@ -47,12 +47,13 @@ struct kmem_cache *kmem_cache; * Any flag that adds per-object metadata should be included, * since slab merging can update s->inuse that affects the metadata layout. */ -#define SLAB_NEVER_MERGE (SLAB_DEBUG_FLAGS | SLAB_TYPESAFE_BY_RCU | \ - SLAB_NOLEAKTRACE | SLAB_FAILSLAB | SLAB_NO_MERGE | \ - SLAB_OBJ_EXT_IN_OBJ) +#define SLAB_NEVER_MERGE ((SLAB_DEBUG_FLAGS & ~SLAB_DEBUG_NOOP) | \ + SLAB_TYPESAFE_BY_RCU | SLAB_NOLEAKTRACE | SLAB_FAILSLAB | \ + SLAB_NO_MERGE | SLAB_OBJ_EXT_IN_OBJ) #define SLAB_MERGE_SAME (SLAB_RECLAIM_ACCOUNT | SLAB_CACHE_DMA | \ - SLAB_CACHE_DMA32 | SLAB_ACCOUNT | SLAB_MAY_ACCOUNT) + SLAB_CACHE_DMA32 | SLAB_ACCOUNT | SLAB_MAY_ACCOUNT | \ + SLAB_DEBUG_NOOP) /* * Merge control. If this is set then no merging of slab caches will occur. diff --git a/mm/slub.c b/mm/slub.c index 30714557306d..51daf361c601 100644 --- a/mm/slub.c +++ b/mm/slub.c @@ -1053,6 +1053,19 @@ static slab_flags_t slub_debug; static const char *slub_debug_string __ro_after_init; static int disable_higher_order_debug; +/* Union of all slab debug flags enabled for specific caches only */ +static slab_flags_t slab_debug_per_cache_union __initdata; + +static inline bool __init slab_want_nohash_pointers(void) +{ + /* + * If any debugging is enabled globally or per-cache, we would like + * nohash pointers. The exception is no-op debugging that only forces + * the slowpaths. + */ + return (slub_debug | slab_debug_per_cache_union) & ~SLAB_DEBUG_NOOP; +} + /* * Object debugging */ @@ -1898,6 +1911,9 @@ parse_slub_debug_flags(const char *str, slab_flags_t *flags, const char **slabs, case 't': *flags |= SLAB_TRACE; break; + case 'n': + *flags |= SLAB_DEBUG_NOOP; + break; case 'a': *flags |= SLAB_FAILSLAB; break; @@ -1961,6 +1977,7 @@ static int __init setup_slub_debug(const char *str, const struct kernel_param *k global_slub_debug_changed = true; } else { slab_list_specified = true; + slab_debug_per_cache_union |= flags; if (flags & SLAB_STORE_USER) stack_depot_request_early_init(); } @@ -2069,6 +2086,8 @@ static inline void setup_object_debug(struct kmem_cache *s, void *object) {} static inline void setup_slab_debug(struct kmem_cache *s, struct slab *slab, void *addr) {} +static inline bool __init slab_want_nohash_pointers(void) { return false; } + static inline bool alloc_debug_processing(struct kmem_cache *s, struct slab *slab, void *object, int orig_size) { return true; } @@ -8755,7 +8774,7 @@ void __init kmem_cache_init(void) slab_min_order = slab_max_order; /* Inform pointer hashing choice about slub debugging state. */ - hash_pointers_finalize(__slub_debug_enabled()); + hash_pointers_finalize(slab_want_nohash_pointers()); kmem_cache_node = &boot_kmem_cache_node; kmem_cache = &boot_kmem_cache; -- 2.56.0