From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 2212BC433FE for ; Fri, 22 Oct 2021 13:39:54 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 03DAE61208 for ; Fri, 22 Oct 2021 13:39:53 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232949AbhJVNmJ (ORCPT ); Fri, 22 Oct 2021 09:42:09 -0400 Received: from foss.arm.com ([217.140.110.172]:54108 "EHLO foss.arm.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S232818AbhJVNmE (ORCPT ); Fri, 22 Oct 2021 09:42:04 -0400 Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id 9736F1FB; Fri, 22 Oct 2021 06:39:46 -0700 (PDT) Received: from [10.57.27.231] (unknown [10.57.27.231]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPSA id E25DB3F694; Fri, 22 Oct 2021 06:39:44 -0700 (PDT) Subject: Re: [PATCH v3 4/6] iommu: Move IOMMU pagesize check to attach_device To: Marc Zyngier , Lu Baolu Cc: Sven Peter , iommu@lists.linux-foundation.org, Arnd Bergmann , Hector Martin , linux-kernel@vger.kernel.org, Alexander Graf , Mohamed Mediouni , Will Deacon , Alyssa Rosenzweig References: <20211019163737.46269-1-sven@svenpeter.dev> <20211019163737.46269-5-sven@svenpeter.dev> <9e25f2c0-d9d3-475d-e973-63be1891f9a5@linux.intel.com> <8735ovdbcv.wl-maz@kernel.org> <6a886030-cbc6-9e92-bf79-77b659da2915@linux.intel.com> <87wnm6bxx2.wl-maz@kernel.org> <106088e3-2928-dace-e1b6-e1e74ffec366@linux.intel.com> <87pmrxbi0v.wl-maz@kernel.org> From: Robin Murphy Message-ID: Date: Fri, 22 Oct 2021 14:39:38 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; rv:78.0) Gecko/20100101 Thunderbird/78.14.0 MIME-Version: 1.0 In-Reply-To: <87pmrxbi0v.wl-maz@kernel.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-GB Content-Transfer-Encoding: 7bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 2021-10-22 09:06, Marc Zyngier wrote: > On Fri, 22 Oct 2021 03:52:38 +0100, > Lu Baolu wrote: >> >> On 10/21/21 4:10 PM, Marc Zyngier wrote: >>> On Thu, 21 Oct 2021 03:22:30 +0100, >>> Lu Baolu wrote: >>>> >>>> On 10/20/21 10:22 PM, Marc Zyngier wrote: >>>>> On Wed, 20 Oct 2021 06:21:44 +0100, >>>>> Lu Baolu wrote: >>>>>> >>>>>> On 2021/10/20 0:37, Sven Peter via iommu wrote: >>>>>>> + /* >>>>>>> + * Check that CPU pages can be represented by the IOVA granularity. >>>>>>> + * This has to be done after ops->attach_dev since many IOMMU drivers >>>>>>> + * only limit domain->pgsize_bitmap after having attached the first >>>>>>> + * device. >>>>>>> + */ >>>>>>> + ret = iommu_check_page_size(domain); >>>>>>> + if (ret) { >>>>>>> + __iommu_detach_device(domain, dev); >>>>>>> + return ret; >>>>>>> + } >>>>>> >>>>>> It looks odd. __iommu_attach_device() attaches an I/O page table for a >>>>>> device. How does it relate to CPU pages? Why is it a failure case if CPU >>>>>> page size is not covered? >>>>> >>>>> If you allocate a CPU PAGE_SIZE'd region, and point it at a device >>>>> that now can DMA to more than what you have allocated because the >>>>> IOMMU's own page size is larger, the device has now access to data it >>>>> shouldn't see. In my book, that's a pretty bad thing. >>>> >>>> But even you enforce the CPU page size check here, this problem still >>>> exists unless all DMA buffers are PAGE_SIZE aligned and sized, right? >>> >>> Let me take a CPU analogy: you have a page that contains some user >>> data *and* a kernel secret. How do you map this page into userspace >>> without leaking the kernel secret? >>> >>> PAGE_SIZE allocations are the unit of isolation, and this applies to >>> both CPU and IOMMU. If you have allocated a DMA buffer that is less >>> than a page, you then have to resort to bounce buffering, or accept >>> that your data isn't safe. >> >> I can understand the problems when IOMMU page sizes is larger than CPU >> page size. But the code itself is not clean. The vendor iommu drivers >> know more hardware details than the iommu core. It looks odd that the >> vendor iommu says "okay, I can attach this I/O page table to the >> device", but the iommu core says "no, you can't" and rolls everything >> back. > > If your IOMMU driver can do things behind the core's back and > contradict the view that the core has, then it is probably time to fix > your IOMMU driver and make the core aware of what is going on. > Supported page sizes is one of these things. > > In general, keeping the IOMMU driver as dumb as possible is a worthy > design goal, and this is why we have these abstractions. In this case it's the abstractions that are the problem, though. Any driver which supports heterogeneous IOMMU instances with potentially differing page sizes currently has no choice but to do horrible bodges to make the bus-based iommu_domain_alloc() paradigm work *at all*. Fixing that from the fundamental API level upwards has been on the to-do list for some time now, but won't be straightforward. Robin.