From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id EB554C4321E for ; Thu, 20 Oct 2022 12:53:16 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230255AbiJTMxO (ORCPT ); Thu, 20 Oct 2022 08:53:14 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:33476 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S230243AbiJTMxL (ORCPT ); Thu, 20 Oct 2022 08:53:11 -0400 Received: from mail-pf1-x434.google.com (mail-pf1-x434.google.com [IPv6:2607:f8b0:4864:20::434]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id C839517F2A6 for ; Thu, 20 Oct 2022 05:53:09 -0700 (PDT) Received: by mail-pf1-x434.google.com with SMTP id y1so20177312pfr.3 for ; Thu, 20 Oct 2022 05:53:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kernel-dk.20210112.gappssmtp.com; s=20210112; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :from:to:cc:subject:date:message-id:reply-to; bh=m1tSUOR0CGd4Km4WU9EABqtl9X4dWfnj8PpCfOdNXBc=; b=3Fin5tR+DxTOnCymWvNQXvC4DP5A9CvW/OpgGKccrmRGVFcE1OuUJQGkrqlo+ckrFh U+MGbaf9A8ztgk82880CFy4vbbjNXjhtqi5eSxxDu3XyziyuvWI7H9MeAMWY9hrAejxi 5j3rfjrvbU7Jl3E5wgG3nrBCZsTDZVxaUgfEZrWPMEwVm19q7lbCXQAV/HzVjWBqk9GO L885iNCloh3qLdmRxDaEq+Ev5GUBKwzDFWxEGiVCxKxZsoqeQIyFeiWyyAZSrDkSNbV9 FtkzOyVRIr86K6bOzCntYKwU4AnrmZYaZKMBUbcAFaKDCq/xXZjENs8qIFYfy1MYehUi L4Iw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=m1tSUOR0CGd4Km4WU9EABqtl9X4dWfnj8PpCfOdNXBc=; b=knASAZ4BE+HDiYvNLChAkFLl4fftW859Q2MKXn7NxSyGSU2XGuOmvISnCJB7oaSpzo G6Be/xrbLNmnRhELLwkzpVsAkJja+lgWu3UWhwoAaY2ISMAcnul5Q0ySHTiWsPUBrBpZ oaL4Nqf2qF0C0tBCUD0+EIvuqQMRl/G4xfz2uNFVcWI4zqy7CgziMit9noGNY6ke5IBh v2v5zyg5fVpA9pDcGK3RyOfJJUulC3UFBwh8ujljAW/3e5Q9kKlu363AJ8YFCGvhi7kG ALXa+/yFEcHKrBx4wP4Wi9DjM4MB42UI+5loPHoeOrz9uEEdXfw+XyIJQObJ3/ghtqNU hVsw== X-Gm-Message-State: ACrzQf0j5dY7PdaaXzS88IQmP6Na6v0I5Nis3bn3VAcGxmMLLMmfDb0I pSLIs3kHsEGTx7TMtasGcah1gg== X-Google-Smtp-Source: AMsMyM7f5pr+Q4da5tL5VdWH16B7hstNTIj3sdj6G8HPE6MKotRnhdQnl2hrqR7v/as4WRggLhM+mw== X-Received: by 2002:a63:1612:0:b0:461:4180:d88b with SMTP id w18-20020a631612000000b004614180d88bmr11920615pgl.434.1666270389223; Thu, 20 Oct 2022 05:53:09 -0700 (PDT) Received: from [192.168.4.201] (cpe-72-132-29-68.dc.res.rr.com. [72.132.29.68]) by smtp.gmail.com with ESMTPSA id 186-20020a6215c3000000b005626ef1a48bsm13162954pfv.197.2022.10.20.05.53.08 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Thu, 20 Oct 2022 05:53:08 -0700 (PDT) Message-ID: <80702edc-3e81-441b-efe7-a746c36f1d01@kernel.dk> Date: Thu, 20 Oct 2022 05:53:07 -0700 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux aarch64; rv:102.0) Gecko/20100101 Thunderbird/102.3.3 Subject: Re: [RFC for-next v2 0/4] enable pcpu bio caching for IRQ I/O Content-Language: en-US To: Pavel Begunkov , Christoph Hellwig Cc: linux-block@vger.kernel.org, io-uring@vger.kernel.org, linux-kernel@vger.kernel.org, linux-fsdevel@vger.kernel.org References: From: Jens Axboe In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 10/20/22 5:40 AM, Pavel Begunkov wrote: > On 10/20/22 09:32, Christoph Hellwig wrote: >> On Tue, Oct 18, 2022 at 08:50:54PM +0100, Pavel Begunkov wrote: >>> This series implements bio pcpu caching for normal / IRQ-driven I/O >>> extending REQ_ALLOC_CACHE currently limited to iopoll. The allocation side >>> still only works from non-irq context, which is the reason it's not enabled >>> by default, but turning it on for other users (e.g. filesystems) is >>> as a matter of passing a flag. >>> >>> t/io_uring with an Optane SSD setup showed +7% for batches of 32 requests >>> and +4.3% for batches of 8. >> >> This looks much nicer to me than the previous attempt exposing the bio >> internals to io_uring, thanks. > > Yeah, I saw the one Jens posted before but I wanted this one to be more > generic, i.e. applicable not only to io_uring. Thanks for taking a look. It is indeed better like that, also because we can get rid of the alloc cache flag long term and just have it be the way that bio allocations work. -- Jens Axboe