From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from foss.arm.com (foss.arm.com [217.140.110.172]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 9FE7034A3D8; Fri, 27 Mar 2026 16:25:11 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=217.140.110.172 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1774628713; cv=none; b=GH7KQ5jJJ7B257d6Lg/hhM7fYQ2VYLTtu/kAlgHXLgTFFXfuZ6WKADb4pKd2mSdoD361JGbpD7L66In2ydO4FrGomUr99cQtXZvIcUa2H2jnNGa68/lMNwGsH6pD02/AojnQMdxx0hvFIvQDswP4h4hG9QLnEIx2lGNfwSEu4nQ= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1774628713; c=relaxed/simple; bh=o37e/u2s3ApNY3T2Mivm5sQi2e7lLw78zt9EIlgSSfo=; h=Message-ID:Date:MIME-Version:Subject:To:Cc:References:From: In-Reply-To:Content-Type; b=fcPRprlC2tUEiTqAwVPHTleBR11qdNlaqApv/RHHTJmszMJeGPStI6XWuKoiaopb5N+PrJHQqNX8K3YUDtz2s4acXj7Q180NWfbHbfZZQ1OSR8JFay/ZRWJQURH5umL16AkyYs/XbNV9YCp0PAQEsFSJRKHUYDWKLCb3RlcxDhE= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=arm.com; spf=pass smtp.mailfrom=arm.com; dkim=pass (1024-bit key) header.d=arm.com header.i=@arm.com header.b=YiI6Npr6; arc=none smtp.client-ip=217.140.110.172 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=arm.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=arm.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=arm.com header.i=@arm.com header.b="YiI6Npr6" Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id 24FC935DA; Fri, 27 Mar 2026 09:25:05 -0700 (PDT) Received: from [10.163.180.175] (unknown [10.163.180.175]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPSA id AB3E73F905; Fri, 27 Mar 2026 09:25:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=arm.com; s=foss; t=1774628711; bh=o37e/u2s3ApNY3T2Mivm5sQi2e7lLw78zt9EIlgSSfo=; h=Date:Subject:To:Cc:References:From:In-Reply-To:From; b=YiI6Npr6YyJq4PlBLVpfqiUTOOL161bptBTF8MU82La2TI82X2RO4XSVDq+AGrDXt LHhV9Pdl3j6OF27Npzjr4tIAziCsnEIupAbkdCevLtRBxf4jTYQjxcj+BAnG3ri7lV w2AICP2O5dCu263VnHUEwfdWQqetcjrXRZ2nJ/Wg= Message-ID: <346eeb8c-616b-4f4e-b811-ad1a3ae4a58f@arm.com> Date: Fri, 27 Mar 2026 21:54:43 +0530 Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [REGRESSION] slab: replace cpu (partial) slabs with sheaves To: "Vlastimil Babka (SUSE)" , "Harry Yoo (Oracle)" , Ryan Roberts Cc: Uladzislau Rezki , Vlastimil Babka , Petr Tesarik , Christoph Lameter , David Rientjes , Roman Gushchin , Hao Li , Andrew Morton , "Liam R. Howlett" , Suren Baghdasaryan , Sebastian Andrzej Siewior , Alexei Starovoitov , linux-mm@kvack.org, linux-kernel@vger.kernel.org, linux-rt-devel@lists.linux.dev, bpf@vger.kernel.org, kasan-dev@googlegroups.com, kernel test robot , stable@vger.kernel.org, "Paul E. McKenney" References: <20260123-sheaves-for-all-v4-0-041323d506f7@suse.cz> <0f441d8f-d84c-470a-a4cb-0249b15220a2@kernel.org> Content-Language: en-US From: Aishwarya Rambhadran In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Hi all, Thanks for the discussion and the insights. For completeness, the SUTs used are single NUMA node: $ numactl -H available: 1 nodes (0) node 0 cpus: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 node 0 size: 257218 MB node 0 free: 255376 MB node distances: node   0   0:  10 As suggested by Ryan, I re-ran and compared the perf benchmarks across 6.17, 6.18, and later kernels. The behavior is consistent with what has been discussed in this thread and aligns with our observations. Thanks again for the clarifications and apologies for the table rendering issues in the initial email. Regards, Aishwarya Rambhadran On 27/03/26 4:51 PM, Vlastimil Babka (SUSE) wrote: > On 3/27/26 11:00, Harry Yoo (Oracle) wrote: >> On Fri, Mar 27, 2026 at 08:58:36AM +0000, Ryan Roberts wrote: >>>>>>>> On 3/26/26 13:43, Aishwarya Rambhadran wrote: >>>>>> Right so there should be just the overhead of the extra >>>>>> is_vmalloc_addr() test. Possibly also the call of >>>>>> kfree_rcu_sheaf() if it's not inlined. I'd say it's something we >>>>>> can just accept? It seems this is a unit test being used as a >>>>>> microbenchmark, so it can be very sensitive even to such details, >>>>>> but it should be negligible in practice. >>>>> The perf/syscall cases might be a bit more concerning though? >>>>> (those tests are from "perf bench syscall fork|execve"). Yes they >>>>> are microbenchmarks, but a 7% increased cost for fork seems like >>>>> something we'd want to avoid if we can. >>>> Sure, I tried to explain those in my first reply. Harry then linked >>>> to how that explanation can be verified. Hopefully it's really the >>>> same reason. >>> Ahh sorry I missed your first email. We only added that benchmark >>> from 6.19 so don't have results for earlier kernels, but I'll ask >>> Aishu to run it for 6.17 and 6.18 to see if the results correlate >>> with your expectation. But from a high level perspective, a 7% >>> regression on fork is not ideal even if there was a 7% improvement >>> in 6.18. > In retrospect it was an oversight not to disable the pre-existing cpu > caching layer immediately for sheaf-enabled caches in 6.18. Can't undo > that mistake now, unfortunately. >> If that improvement comes from the number of objects cached per CPU, >> I'm not sure if determining the default value (# of cached objs) >> based on "a point when microbenchmarks stop improving" is a >> reasonable measure because the default value affects all slab caches >> and will inevitably increase overall memory usage. > Yeah that's the thing, some workloads might just keep improving as you > throw more caching at them, but there's a memory usage cost to that. A > case of stress test doing nothing but forks might also not be > representative of performance of forks under normal workload where > other operations also happen, returning the related slab objects, so > in the end it doesn't expose the batch size that much. >> Hopefully we could discuss what a reasonable heuristic that "works >> for most situations" looks like, and allow users to tune it further >> based on their needs. As a side note, changing sheaf capacity at >> runtime is not supported yet (I'm working on it) and targeting at >> least before the next LTS.