From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mail-pg1-f170.google.com (mail-pg1-f170.google.com [209.85.215.170]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 8389813DBA0 for ; Wed, 27 May 2026 12:01:35 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.215.170 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1779883296; cv=none; b=G4uvULERX1NDEA79E7ikBTmEj53MnbwgPVdrmAmbzfcP/bSNyuE7mvSO7/7QVxKuHFztDfUJMtgSLn9WKvPiTuwZ1E7xaP9GVn55IbYdxy8uhZekDkhqlFaEqG8qZnQu2DvAcFkYdxSUzsy1nXxrW+iB6pN8Nio7M/YgQxDfFnw= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1779883296; c=relaxed/simple; bh=mZJAeDRne7CD5GlvQrC6ClC/osOhmSYnb9b39uFp3CA=; h=From:To:Cc:Subject:Date:Message-Id:MIME-Version; b=MSC+nq72+gkr3cKt0q7jUhAM8UeL+KuUD3wSBgsARn/+OXi8VOk9Izg68lqm/UPhsSpLZGyLQt6mmWyMvMNeGaKAxfGZGJHnOaQzZYACoGz5ILDy3ZANbwYU6CLVkhchUurd8l3j7C+rTBIpQhl3zryrYXTu/5SKXD5jeJ/Hvlo= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=gmail.com; spf=pass smtp.mailfrom=gmail.com; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b=JfDmX291; arc=none smtp.client-ip=209.85.215.170 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=gmail.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=gmail.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="JfDmX291" Received: by mail-pg1-f170.google.com with SMTP id 41be03b00d2f7-c80227b1f6cso4348482a12.1 for ; Wed, 27 May 2026 05:01:35 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20251104; t=1779883295; x=1780488095; darn=vger.kernel.org; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:from:to:cc:subject:date:message-id:reply-to; bh=UH1N0NOamh9kJ4BcFKC3HtiFonlBtglJgKM2R0Sxie0=; b=JfDmX291FSzu1fNvkfuLpnkVI8xIf/p3OngBkKfzM0iWSME9eepvkjJxDobsBwrvlA y/vJ1WOEjmzTdokWNE12tQTynBv4tLAGM0Jn18R5LUA0R00Sat2OlyD/y0bodz2/32Mj 9fZc3aGThgRXuk2u9Ww+o1aq05EYbNNLoEhUQKt+KHs0dWLV3AMXiC+ZFzQKYI+gqHpV ulnsTCGnS5LA8lz9duI/qr5xPak5j65as1gt8r9PPC4o8WmRQxXnx6ekav/uUw/xGo5t g5zvBoYuWSMtrSW/x3E5OtVmuFai+ZbWRNIhx3AGtWZn09NwzQRuEl3s1rC5LU8zrsCk ZoOA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1779883295; x=1780488095; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:x-gm-gg:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=UH1N0NOamh9kJ4BcFKC3HtiFonlBtglJgKM2R0Sxie0=; b=p0+KIB0b/9DWzVaKUwLmH+/K3NUgO79DXhZVWMUW6q6XnModXZy4l/e9zMjUi1GbqS VidXr8CwtsK4O5XWe/DYKASwX4zdmDfEozEzzq+cmCUkMVM9/DNHeaAW6wT0Y9dgXbxa uc0s0FwMNf0ZSj9kzud3lGpwj2GVp3AbISXDvgXUjXODqCMpZ+LUXHApHEC6F4kFkNtU Jku77gkSaHZoRS7R5jxXEaYs6h3vKoaCF5EB8hY4OY9qKvTNUgTVzGocQownXG4UkfR2 utt2FLA5xsXBEUNLpt/qmDFJ9ZwmPSyD+bmn1HxV5sk6WIAnGkHRiXSPnUPJv1waptFo tWiw== X-Forwarded-Encrypted: i=1; AFNElJ+/DJNKrQoX/NTdGKMjjnT4Bi6mpPxJEyzJ9ZURC2++1lP1awvahAyTGvtQk+ukE2HBKRz9VBU4LdgO6Mc=@vger.kernel.org X-Gm-Message-State: AOJu0YxhBpKYzjZE5GeGf187zCgcDPqPIacW3nuRWsyYFpIT7dPz7N1W 3wHdzCO/p0lUQrz8v+nNGyyrLhdQjOyfNMcCdfXwxf5faT4Ficsug85k X-Gm-Gg: Acq92OGp5/kZU+379+ZjwbtXWYG4n6qGWndrG3IeHiz9gAiPw1cznVEOjRpEUbrvyQn 3TmXc1FDrc+6pBBHKQgl4lTGPKEFhZfqkgtN47mWpw2cWOijm6MDBDtIHjkvjIZpKjqTHGYXRAV zg/IYpUJDEVLvS0HpsFIT9qpfCnhCh3RClChXTqgon0Ck/mjOJqEeiXZb9vFiFcMc5nWnTGzYeJ fmvaORNIFhUZFWynK+v4mJI6ECUIdwq8ChutcFuCwThiUhyU9FmsDiziRF+ZXZH+h1foFA+3+1S AFLQdfeYa+hy40ZWhCkXK1lh4A/0Uffwwsjth72tpd5QX83SiY4YMln/rTD0+eZvg6YNMIu7w8Q PRINKo2ps+kwjkMutSGPLrQvN3oWXs34OGGMVeO5nwC/bfCkCkvKDCzaQCm/VNSC5G/nf+AMsSJ ysnhByvBiRBTYGswWR0SuAxAVmuaeBXPkfZ2iNbXTMDFbc3kf4 X-Received: by 2002:a17:903:11c6:b0:2bd:3bfd:7512 with SMTP id d9443c01a7336-2beb065b6edmr249502705ad.29.1779883294834; Wed, 27 May 2026 05:01:34 -0700 (PDT) Received: from ubuntu22.mioffice.cn ([43.224.245.232]) by smtp.gmail.com with ESMTPSA id d9443c01a7336-2beb56b5886sm136250465ad.20.2026.05.27.05.01.31 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 27 May 2026 05:01:34 -0700 (PDT) From: Wenchao Hao X-Google-Original-From: Wenchao Hao To: Andrew Morton , Nhat Pham , Yosry Ahmed , linux-kernel@vger.kernel.org, linux-mm@kvack.org, Minchan Kim , Sergey Senozhatsky Cc: Wenchao Hao Subject: [RFC PATCH v2 0/3] mm/zsmalloc: reduce lock contention in zs_free() Date: Wed, 27 May 2026 19:59:27 +0800 Message-Id: <20260527115930.3138213-1-haowenchao@xiaomi.com> X-Mailer: git-send-email 2.34.1 Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit This series reduces lock contention in zs_free(), which dominates the unmap path under memory pressure on Android (LMK kills) and on x86 servers running zswap-heavy workloads. The current zs_free() takes pool->lock (rwlock, read side) just to look up the size_class for a handle, then takes class->lock and holds it across __free_zspage() which can call into the buddy allocator and acquire zone->lock. Two costs follow: * pool->lock reader-counter cacheline bouncing among concurrent zs_free() callers. * class->lock held across folio_put(), so any zone->lock wait fans out to every other zs_free() on the same class. The series tackles both: Patch 1: encode size_class index into obj alongside PFN and obj_idx, so zs_free() can locate the class without pool->lock. Patch 2: drop pool->lock from zs_free() on 64-bit; 32-bit unchanged. Patch 3: move zspage page-freeing out of class->lock. Performance results: Test: each process independently mmap 256MB, write data, madvise MADV_PAGEOUT to swap out via zram (lzo-rle), then concurrent munmap. Raspberry Pi 4B (4-core ARM64 Cortex-A72): mode Base Patched Speedup single 59.0ms 56.0ms 1.05x multi 2p 94.6ms 66.7ms 1.42x multi 4p 202.9ms 110.6ms 1.83x x86 (20-core Intel i7-12700, 16 concurrent processes): mode Base Patched Speedup single 11.7ms 9.8ms 1.19x multi 2p 24.1ms 17.2ms 1.40x multi 4p 63.0ms 45.3ms 1.39x Changes since v1: - Rename obj-encoding macros for clarity. - Make 32-bit / 64-bit handling transparent at call sites (no #ifdef in callers). - Extract a helper to keep zs_free() unified. Wenchao Hao (2): mm/zsmalloc: encode class index in obj value for lockless class lookup mm/zsmalloc: drop pool->lock from zs_free on 64-bit systems Xueyuan Chen (1): mm/zsmalloc: drop class lock before freeing zspage mm/zsmalloc.c | 175 +++++++++++++++++++++++++++++++++++++++++--------- 1 file changed, 143 insertions(+), 32 deletions(-) -- 2.34.1