From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from smtp.kernel.org (aws-us-west-2-korg-mail-alma10-1.taild15c8.ts.net [100.103.45.18]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 0E7CD3812DA; Wed, 16 Sep 2026 15:08:37 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=100.103.45.18 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1789571319; cv=none; b=FAgJPmFvpl+9mcgJW2vecTnsfbwHH+Mluw+zOY57D3S8kgM45ZIKKUu4jZBioOebGosNI7M+qwNff5Y9UqxX5uk2LFp/uwrSW9b4aW9ATf838Qs/lI0i6CqgNjiGskPLzBc+SJeShjkhavuZH+n32e21mH06Mjz2eqU9//M20Ro= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1789571319; c=relaxed/simple; bh=YrCOczfMsNmVaLE9Bwnine4ICJQF28O30yXtLuwki3I=; h=Date:From:To:Cc:Subject:Message-ID:References:MIME-Version: Content-Type:Content-Disposition:In-Reply-To; b=sNP6oYQ5LvOYcX5m4sQ1hTfEUPvHlfNF+1S6YOr5e2AxzJCnrLJ62bmFUTGG7Rrm2gLzcxz9lkMqVtsWHD0LXXA+KPtYH6xPIe2NM8VIfEdTRYpTqiTdxT98NVPgIrkgCCaRM2ZymO9Och6KDL8UqqWudHUzebA4cRCcWXjQjYA= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=U6Pi09cG; arc=none smtp.client-ip=100.103.45.18 Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="U6Pi09cG" Received: by smtp.kernel.org (Postfix) with ESMTPSA id 516B01F00893; Wed, 16 Sep 2026 15:08:25 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kernel.org; s=k20260515; t=1789571317; bh=mvnJw+3qk5WKTUY8hybHvBw9Pfdia/n58K2DMAIEiJo=; h=Date:From:To:Cc:Subject:References:In-Reply-To; b=U6Pi09cGtQDbhTokf7C/H+aoSaJVEvhKHRf1h/Np280E5R0VyWuj/lmoXuvhFYO3O Ye/ZaPq6MjnI7ltToyvk17zdgDUhcXfw/zXQ5o1Ve7sEHgp0UQBUGt93f4EXe9arJG SyzSZd+kgHjYDKeSdq2ISr3m5EIlQfJNd1qhvBmpE/Hc3yREkrxiMAdOMfhWp5b2oj fIFHN5mEh9nzM7Kj1hgezMh1UwhtZsNuWpy+ztqriuFcfCaOAqOAqPzqH099k8iile WiHRfLWihpTKUfypFkJIVnLhWjLZNemheJHIVGaexaZnqfZRq+BmQq04sXJknranBY yjqwqwO/JUg7g== Date: Wed, 16 Sep 2026 16:08:22 +0100 From: "Lorenzo Stoakes (ARM)" To: Arnd Bergmann Cc: Kees Cook , Linus Torvalds , Nathan Chancellor , Nicolas Schier , Nick Desaulniers , Bill Wendling , Justin Stitt , Masahiro Yamada , Alexey Gladkov , Thomas Gleixner , Ingo Molnar , Borislav Petkov , Dave Hansen , x86@kernel.org, "H. Peter Anvin" , Paul Walmsley , Palmer Dabbelt , Albert Ou , Alexandre Ghiti , Catalin Marinas , Will Deacon , Mark Rutland , Ard Biesheuvel , Ilias Apalodimas , Josh Poimboeuf , Peter Zijlstra , Miguel Ojeda , Boqun Feng , Gary Guo , =?utf-8?B?QmrDtnJu?= Roy Baron , Benno Lossin , Andreas Hindborg , Alice Ryhl , Trevor Gross , Danilo Krummrich , Daniel Almeida , Tamir Duberstein , Alexandre Courbot , Onur =?utf-8?B?w5Z6a2Fu?= , Jonathan Corbet , Randy Dunlap , "Gustavo A. R. Silva" , linux-kbuild@vger.kernel.org, linux-kernel@vger.kernel.org, llvm@lists.linux.dev, linux-riscv@lists.infradead.org, Linux-Arch , linux-arm-kernel@lists.infradead.org, linux-efi@vger.kernel.org, rust-for-linux@vger.kernel.org, linux-doc@vger.kernel.org, Jens Axboe , linux-hardening@vger.kernel.org Subject: Re: [PATCH v2 21/21] kbuild: use pigz for gzip compression if available Message-ID: References: <20260914-build-speedup-v2-0-39817ec5db23@kernel.org> <20260914-build-speedup-v2-21-39817ec5db23@kernel.org> <202609151758.BA5732348@keescook> <081b2b60-e295-4cd7-b201-d996a88c5f28@app.fastmail.com> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <081b2b60-e295-4cd7-b201-d996a88c5f28@app.fastmail.com> On Wed, Sep 16, 2026 at 08:38:33AM +0200, Arnd Bergmann wrote: > On Wed, Sep 16, 2026, at 03:06, Kees Cook wrote: > > On Mon, Sep 14, 2026 at 10:22:20AM +0100, Lorenzo Stoakes (ARM) wrote: > > > > Makefile: > > > > KPGZIP := $(if $(shell command -v pigz 2>/dev/null),$(PYTHON3) > > $(abs_srctree)/scripts/jobserver-exec > > $(abs_srctree)/scripts/parallel-gzip,gzip) > > > > and the same scripts/parallel-gzip: > > > > #!/bin/sh > > exec pigz -p ${PARALLELISM:-1} "$@" > > > > And then replace the /boot/ KGZIP uses with KPGZIP. Then we don't need > > to change modules, config_data, new users, nor cmd_gzip, etc, which all > > continue to use the regular KGZIP and the "use python" part for the > > KPGZIP case becomes is a 1-time cost? > > Nice, I like the idea and this this will work. I didn't know about > scripts/jobserver-exec, but this does seem like a perfect fit. Agreed, this solution balances everything well! > > I checked the other compression tools we support, and found that > zstd is another one that has built-in support for parallel > compression, so we probably want to have it there as well. Nice, zstd really seems a lot better than gzip in general, but people default out of habit I guess :) I think one for a follow-up though? > > Arnd -- Cheers, Lorenzo