From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mail-pl1-f182.google.com (mail-pl1-f182.google.com [209.85.214.182]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 2981F3FA5FE for ; Mon, 17 Aug 2026 11:16:26 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.214.182 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1786965387; cv=none; b=L5gVWe1JS1+xqW7rfq0l15nyVBrnBTfNWMLxaWw+DXiZRQJKFscNsOxOqvLNKyNPWQx/sNBQFUJieQnqcDE2WfdTpg3luz+4plNVwYgJd9rGykXHjaY7M+1h1aPPAuaROFvITQcOT7bhBRZHfypHFMRqX4zP9zq67XOE8rHjmlw= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1786965387; c=relaxed/simple; bh=VVXh1hJaIziTnYcw5VXBnBRcdWv8NrGa70oD5ZkUoBQ=; h=Date:From:To:Cc:Subject:Message-ID:References:MIME-Version: Content-Type:Content-Disposition:In-Reply-To; b=r3Y17UXYvru6JBzp3gn0pKEGIu42fRgWwgnQ7PreXUbjMeXutMUwve9F4OvOCQY/WLJc3dg4hUXyfkyqQsAXvgf83ByvvGuu+IqmNPicws0KFPbbL9Hld1PjqlQ8ZKwDLlgdclOWqpf5IL4Y8fc3k5KZuCDCYqDBnHgD64kKR9Q= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=google.com; spf=pass smtp.mailfrom=google.com; dkim=pass (2048-bit key) header.d=google.com header.i=@google.com header.b=AWKcQcjX; arc=none smtp.client-ip=209.85.214.182 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=google.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=google.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=google.com header.i=@google.com header.b="AWKcQcjX" Received: by mail-pl1-f182.google.com with SMTP id d9443c01a7336-2d3b440b97aso256245ad.1 for ; Mon, 17 Aug 2026 04:16:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20251104; t=1786965385; x=1787570185; darn=vger.kernel.org; h=in-reply-to:content-disposition:content-type:mime-version :references:message-id:subject:cc:to:from:date:from:to:cc:subject :date:message-id:reply-to:content-type; bh=R+l+UxdGP4xSYpq+snL3DrvZxjB7YwI2tVyA/dO6w4c=; b=AWKcQcjXD/D6J5J1hZni+5sx8WNCevU9x2JSSbpH2TJ0yKIPP2LmJ3QcQUyxItHItF 4+bCQQxgh4eEGt5OHlTHLQkvvT6S8421GiRvp5gzhESIZpFXgFb9iyYmY4HoDy+4E8xx lub2WalbGNi3NDuornLxNnmj2gQwUJu5t9kFXft2xbUB5yIAowJaDLC55gg6+E6+mwlD Do1+DO6f2v6Mr9Ih9FaocC3vblyf80ZBDTqG2/KdHti/wQPLogjd1UAqCqwZTdaP7EO/ NIN6RJHPV2jaQdWGvuNRAtYSuBwdS0nZ7gO783Jjzss4JoqSFwJN+9Shdx76+VkJ9a4I eN4g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1786965385; x=1787570185; h=in-reply-to:content-disposition:content-type:mime-version :references:message-id:subject:cc:to:from:date:x-gm-gg :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to :content-type; bh=R+l+UxdGP4xSYpq+snL3DrvZxjB7YwI2tVyA/dO6w4c=; b=dh35C3drSnYRyOBMuSwaAluyU5+MD/6YdcoA9ZUqVjev1UeW9Xz6t3bYRxNiAQjWhj M7GiECWQvE8AantuLFxa+Zr7m5ojWthQwD2efftvb0mUsE6c1opdUpDJgt41xYiyWGeE Am2AHjMTdbREeUTRz/BcNxHPtH4NZPJ+y+HuVmA+3NV2iRu2CYe5YDJgt5y+NW6J0eB4 j2Pfq9RbxGOhqsUH5MbPWmDMO6yr1PcScCfE834HcSvtT2SCRjhW4qzen9zcQouMFIqA MjO7QnsM3iwYbyn5Gguv90o95YVBdJHKb1n4P+n4RP3XeA5LWbeOTJQ7eN7EZp0hga/O WYVQ== X-Forwarded-Encrypted: i=1; AHgh+RpDUEf7RdCDoOVcoiAHf+GiLmLgueQQO9AY61UPnTQpTbgSBlbwC7iKe0Odu9uZdLLiyNXCXh5BPd2ZTQc=@vger.kernel.org X-Gm-Message-State: AOJu0Yw8GN/dbbqOLpnUxT+fIQayf9590tuOJyc+wGzFTPZmZqlsaRns G4uPeWfaKtdnQwbxdk0N8BOdQG7HHT+VyQ3AMCkNYRz7Sd8YeX2EYW+dYztRSa9+9w== X-Gm-Gg: AR+sD10vPlw7JDqdTHZRaOWsULYeAMj+aONPUHCXo/4uYRUqTxrSr+Je1KUYcGwCS16 4FtrMWq6HNHzaeVJDNQ1M+hQ0qF6X+DfVKIIEa5t3V+tnwKxOkLzTysdhEWexrqh56eNGhh9RS9 i2swxLlMFmHG5iZCJIjPz3V6qtJ4WDTqA/7qcLgAFttf8UhHmW+UTUleCQEHrZ8hkUjM0VW4z98 8MG+oD0NovsMvxnUFo3xg6piz9ijPflypweaBuC/jbI4x2Y9rVVxunjqacxcN7qeNnYdNrACs3x vfDnBGkII9hiGOD9ByY5nag/ph0+9eGOGqea1KeuRWjFjrcU+yZ2d3r9g/jepQl4Qo9BGN4N3Tn 2gCHRST5xkErBmXdGwZ7rSxgwsKId0Q/MgMU6uXWL/XR+oIpc9noi+8I1vG0R0eUZ6pJpUZO4Ii gTIuSKbfkj1HOcr4NCntDGxmprXIL77+RCLfX4BphiJ53Wp+ujLKUoxtRn7vr6uPfhi+2EFRczd QVDdqN3pTAQ9M4f7aMCG7I= X-Received: by 2002:a17:903:2b0c:b0:2bf:1000:d3ac with SMTP id d9443c01a7336-2d596cfb925mr4566865ad.11.1786965384912; Mon, 17 Aug 2026 04:16:24 -0700 (PDT) Received: from google.com (21.168.124.34.bc.googleusercontent.com. [34.124.168.21]) by smtp.gmail.com with ESMTPSA id d9443c01a7336-2d5bb499e8csm3975245ad.2.2026.08.17.04.16.21 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 17 Aug 2026 04:16:24 -0700 (PDT) Date: Mon, 17 Aug 2026 11:16:17 +0000 From: Pranjal Shrivastava To: Dmitry Malkin Cc: Jason Gunthorpe , Will Deacon , Robin Murphy , Joerg Roedel , Nicolin Chen , "iommu@lists.linux.dev" , "linux-arm-kernel@lists.infradead.org" , "linux-kernel@vger.kernel.org" , "regressions@lists.linux.dev" , "stable@vger.kernel.org" , NB-Core Team Subject: Re: [RFC PATCH] iommu/arm-smmu-v3: Allow nested attach for PCI bridges without vDEVICE Message-ID: References: <20260814174825.GC510472@nvidia.com> <20260814221103.GE510472@nvidia.com> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: On Mon, Aug 17, 2026 at 09:29:10AM +0000, Dmitry Malkin wrote: > > Don't use it that way? > > Why not? We use pci=config_acs to configure ACS at kernel startup and > enable direct PCIe peer-to-peer traffic between GPUs and NICs. All > affected devices are assigned to the same VM and IOMMU domain, which > also reduces the memory footprint by reducing the number of page tables > and lowers IOTLB pressure. > I'll defer the debate of enabling ACS or not OR supporting multi-device groups for vIOMMU for a moment. But, regarding PCI P2PDMA, you can still enable it with ACS enabled in the upstream kernel *IF* your hardware supports TLP forwarding between root ports. When ACS is enabled, all TLPs get forwarded to the host's Root Ports instead of getting routed directly through the switch. All that needs to be done is to add an entry of your hardware to the whitelist in p2pdma.c (pci_p2pdma_whitelist). Are you aware if your HW supports this? If yes, then a simple addition like [1] should work. Thanks, Praan [1] https://lore.kernel.org/all/20260409150123.3538444-2-jmoroni@google.com/