From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mail-qv1-f49.google.com (mail-qv1-f49.google.com [209.85.219.49]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 68CA1266572 for ; Wed, 23 Apr 2025 18:02:21 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.219.49 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1745431345; cv=none; b=Npzfa94+O/SoXbABp7p6PhXBID9v5fK7rgQSeWcQfkAaa2MKfhnAhdBarLwadf2bghbmGSGGvUgkxnktp9PJkNx6yizXeYoyL1UBVa6huCxuBEUD1kPSSQeEPGEnxp5VTN68BARjkEWk0fVG4fISCe/pj5RRhiWgKbf14X9EA7Y= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1745431345; c=relaxed/simple; bh=jMGBnlKKS3wriE0M2t3GS1b7w0yLhTPXvhMeTWbbHrA=; h=Date:From:To:Cc:Subject:Message-ID:References:MIME-Version: Content-Type:Content-Disposition:In-Reply-To; b=cczCqyViWgG5tzQZ3Mh1mU0R2xJuvkjFDvWz+q5ZQUSQIPQNS4FMle25g5Y0XeoT+G0jVeMMtxnnpZjpjwvXrB/mc8hlbbHqbxTyB/HOO4gAbNY7QrN2/k8JT45RjH4ki+3xoS3mpA5ArnG6uSQE2RGLiP1LGyFkrG4pcOUIxFs= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=none (p=none dis=none) header.from=ziepe.ca; spf=pass smtp.mailfrom=ziepe.ca; dkim=pass (2048-bit key) header.d=ziepe.ca header.i=@ziepe.ca header.b=oME2bGbG; arc=none smtp.client-ip=209.85.219.49 Authentication-Results: smtp.subspace.kernel.org; dmarc=none (p=none dis=none) header.from=ziepe.ca Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=ziepe.ca Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=ziepe.ca header.i=@ziepe.ca header.b="oME2bGbG" Received: by mail-qv1-f49.google.com with SMTP id 6a1803df08f44-6eeb7589db4so2217596d6.1 for ; Wed, 23 Apr 2025 11:02:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ziepe.ca; s=google; t=1745431340; x=1746036140; darn=vger.kernel.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:from:to:cc:subject:date:message-id:reply-to; bh=v/H5CAwHQKAGhhgyjSbvaHcVayhHkcFdusJoJuYFxH8=; b=oME2bGbGIz+n8qPmjxlLjGtl64CvjZEPLK7vic6PtKju9KvsD8hbQoAkwLgEIUXBXg iqMA9uiI8nIhmBox8Z7ZtsEVF9rde1sOPnx8+Ic/YkmuJ9mTOLkrk722E5IWEIRNAYGR CVnGLdLxvEKtC2PTbivi1fVVAU/xnbJH1e3h1aYaD6xXqyyQUWxXFa7Xe/FlDmqtEMBh M2vt6LSy6VXOVecd3pdAWZPlsCrclj/UmngB8o9ubhNBU5XVxQpZ9ogcCm6n3z5DL56T 4rghcIF1xc2841w2V+rvve+AZ1efnzAOOk4mZhF4CMwBHIR6quQkjZVOdYpgnKUYZnoy QpAA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1745431340; x=1746036140; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=v/H5CAwHQKAGhhgyjSbvaHcVayhHkcFdusJoJuYFxH8=; b=Pkpd0XKs5aIy3sVF2UhdYV7gXQekoMxiqElie3e+jre9UdB1FlSrMCSErS1q7hYIBp 6Uee0jmmQWObOoQgeCNnGeAWB//CdlmTflYBeOXIGQtIWYoYTqgCxjE6rn4EVdwvuLfB aH8t4hUPMmcOpEY2rn3GsqnJ1c9DMNm8JDAb3M4bzaKcgVl6C5ocvHGJ9wJpUjR5dL8u iCbLOfFcpNX+7GjHXNRA621lkcWlDj8SIfdtsuKHIOxDs1qTB/FN0ual8zymrjgcdsX8 C1n8GIwP5nlkRtdMRn1sYk4sS+WLKOoeZ0O1MMSO/+jM1wWC9yjdfQnPjeQcLep9Bcb2 mR5Q== X-Forwarded-Encrypted: i=1; AJvYcCXslMKnFQKDd6Js5OZY5kQDGLdMh9ql/KX338G5y3CkUhbauveZr9vbljFGTieGKZ0y0Ze8PI/5L6KSA+o=@vger.kernel.org X-Gm-Message-State: AOJu0YxO3U7kYEzhNDbws0bLehjTSlXHrqf9d96eXkiNMpQogXMyr6Al ux3PK+VHH2J1Mxh9ofRRe6Vqpd9HYk42VWrzH6nONuC7zGP6eG/nEq4dMIA63pE= X-Gm-Gg: ASbGncvjoUM5EX+h0p0mqL8C2uKLPYJKXe7k3mykxKemPBQsPsWf4YzkgsM8dzKHT+l bHyLhhqOwj27/A6JdatIZRX7uOVsGpwX69aw+9CDo7TzfnQvM1q8UEkw5UM8vMKDArKwbx+ciPQ hMCKY7oI5BKA6nWEWS8JbuWcLLTp4lkotX2VWTo0o3CgEmap0czpJP77Gisesy5mxYFmxZRn2U2 RfYPw0YxnWhtFmF54By3xYvMYpwVeyBif3IHGDQqZSvbuzaM9+dCkV2Z2Tr9hsXFghcQM8oK2MX ukX9ZAqxtwL67UqViq/tPzD4xhbj7hhWJ+eyisMw4OUy5GJnacdsUsSRxF0KacdZ2PV+cAO91rD 5oPrzWzbZhwRPfbcXFPg= X-Google-Smtp-Source: AGHT+IHxXzsMEe6MN5UQygppndiI4ddaFnTKWUy8FtozhFzNSVoZsB8f3DMDl3MfRyMHEIrbMun+Mw== X-Received: by 2002:a05:6214:19c8:b0:6ee:ba58:e099 with SMTP id 6a1803df08f44-6f2c454e522mr330593466d6.15.1745431340219; Wed, 23 Apr 2025 11:02:20 -0700 (PDT) Received: from ziepe.ca (hlfxns017vw-142-167-219-86.dhcp-dynamic.fibreop.ns.bellaliant.net. [142.167.219.86]) by smtp.gmail.com with ESMTPSA id 6a1803df08f44-6f2c2c3ba3fsm73300796d6.125.2025.04.23.11.02.19 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 23 Apr 2025 11:02:19 -0700 (PDT) Received: from jgg by wakko with local (Exim 4.97) (envelope-from ) id 1u7eQN-00000007LrM-0sGN; Wed, 23 Apr 2025 15:02:19 -0300 Date: Wed, 23 Apr 2025 15:02:19 -0300 From: Jason Gunthorpe To: Leon Romanovsky Cc: Marek Szyprowski , Jens Axboe , Christoph Hellwig , Keith Busch , Leon Romanovsky , Jake Edge , Jonathan Corbet , Zhu Yanjun , Robin Murphy , Joerg Roedel , Will Deacon , Sagi Grimberg , Bjorn Helgaas , Logan Gunthorpe , Yishai Hadas , Shameer Kolothum , Kevin Tian , Alex Williamson , =?utf-8?B?SsOpcsO0bWU=?= Glisse , Andrew Morton , linux-doc@vger.kernel.org, linux-kernel@vger.kernel.org, linux-block@vger.kernel.org, linux-rdma@vger.kernel.org, iommu@lists.linux.dev, linux-nvme@lists.infradead.org, linux-pci@vger.kernel.org, kvm@vger.kernel.org, linux-mm@kvack.org, Niklas Schnelle , Chuck Lever , Luis Chamberlain , Matthew Wilcox , Dan Williams , Kanchan Joshi , Chaitanya Kulkarni Subject: Re: [PATCH v9 16/24] vfio/mlx5: Rewrite create mkey flow to allow better code reuse Message-ID: <20250423180219.GR1213339@ziepe.ca> References: Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: On Wed, Apr 23, 2025 at 11:13:07AM +0300, Leon Romanovsky wrote: > From: Leon Romanovsky > > Change the creation of mkey to be performed in multiple steps: > data allocation, DMA setup and actual call to HW to create that mkey. > > In this new flow, the whole input to MKEY command is saved to eliminate > the need to keep array of pointers for DMA addresses for receive list > and in the future patches for send list too. > > In addition to memory size reduce and elimination of unnecessary data > movements to set MKEY input, the code is prepared for future reuse. > > Tested-by: Jens Axboe > Signed-off-by: Leon Romanovsky > --- > drivers/vfio/pci/mlx5/cmd.c | 157 ++++++++++++++++++++---------------- > drivers/vfio/pci/mlx5/cmd.h | 4 +- > 2 files changed, 91 insertions(+), 70 deletions(-) Reviewed-by: Jason Gunthorpe Jason