From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id 3CE54C433EF for ; Sat, 5 Mar 2022 10:37:40 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S231483AbiCEKiZ (ORCPT ); Sat, 5 Mar 2022 05:38:25 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:49856 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229878AbiCEKiX (ORCPT ); Sat, 5 Mar 2022 05:38:23 -0500 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) by lindbergh.monkeyblade.net (Postfix) with ESMTP id 6092B22527 for ; Sat, 5 Mar 2022 02:37:28 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1646476647; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Sxnm92K8BcGrTDkhusF0TdYHzI5WzXe99rqHFRUvS4Y=; b=GfiQJsC9YlZRznqqxgf7Rg27cpWMyj08y+uj4Yx7kB6tUqT7twgesMAHxD2tMgiwergJF5 XAuua9+IZq6CenQ3Z3Zr7Ky/OJkRwUMRW0Q3uhtENGMEXAgXzpSaJQjBH6iFIgcmdS1D8b IiRWMxoPisdRa8GftLg66UGgy7EKyCE= Received: from mail-ed1-f72.google.com (mail-ed1-f72.google.com [209.85.208.72]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id us-mta-422-NNQeDqvQMWiWiBry-E1RFg-1; Sat, 05 Mar 2022 05:37:26 -0500 X-MC-Unique: NNQeDqvQMWiWiBry-E1RFg-1 Received: by mail-ed1-f72.google.com with SMTP id da28-20020a056402177c00b00415ce4b20baso4882063edb.17 for ; Sat, 05 Mar 2022 02:37:25 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:message-id:date:mime-version:user-agent:subject :content-language:from:to:cc:references:in-reply-to :content-transfer-encoding; bh=Sxnm92K8BcGrTDkhusF0TdYHzI5WzXe99rqHFRUvS4Y=; b=FM3LWIe98BK0OL5/oVTC5kHtfMfezNP5gbAebHKOnQXrWLyq+M+9QztA31F5gWDWIt 03yxZqBU4SsDma7IaXaDKFcj5aDdJIXi4ojRqDyCxadc/H1jEN6rvvS0YFED2Vv5jUi9 d5w1Hj5ZQlDCM1zZsb5IxXvyY0Cfh1VtDgCAKrBUZP6gMl18g1jqoKtVkL7syBCdUkUa nTNkABvHq7TxM58RfSvyseYMrze568nH/Bt1vrvRbbz78h07XzbeSTx0b3BQ9oklbCzv rkmWdjtpo9apNrqBOhKbVTJIdvPO61I4OSRXC5nm2HE/QgLm8jriDJDKL8zTK9ZnVdBx UoTQ== X-Gm-Message-State: AOAM530E0S2F7E6IPm0VloJEAA174v5RB5Dh6qm5t/AO2rkjx9kfTnpA nl+8ZVoRkjxjA6bZOYQHlGBpphAB2w7yJN/JWyzZmGWdsZxwW6ARlH11Gea5EgLagyBmi8uRlqS mLg+tBAx/ReFVwfhmr+K/ZCYK X-Received: by 2002:a50:a68b:0:b0:413:3b43:ae02 with SMTP id e11-20020a50a68b000000b004133b43ae02mr2474610edc.11.1646476644883; Sat, 05 Mar 2022 02:37:24 -0800 (PST) X-Google-Smtp-Source: ABdhPJyMWBC+rGTw/SMh/xY2esi/Xkgc3gYCVse5gjtk9TrQ3wR/N4TpVoPk3zXr58jAmu8x3QEqhQ== X-Received: by 2002:a50:a68b:0:b0:413:3b43:ae02 with SMTP id e11-20020a50a68b000000b004133b43ae02mr2474581edc.11.1646476644582; Sat, 05 Mar 2022 02:37:24 -0800 (PST) Received: from ?IPV6:2001:1c00:c1e:bf00:1db8:22d3:1bc9:8ca1? (2001-1c00-0c1e-bf00-1db8-22d3-1bc9-8ca1.cable.dynamic.v6.ziggo.nl. [2001:1c00:c1e:bf00:1db8:22d3:1bc9:8ca1]) by smtp.gmail.com with ESMTPSA id a4-20020a170906274400b006da9456e802sm2529071ejd.102.2022.03.05.02.37.23 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sat, 05 Mar 2022 02:37:24 -0800 (PST) Message-ID: Date: Sat, 5 Mar 2022 11:37:23 +0100 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Thunderbird/91.4.0 Subject: Re: [PATCH 3/3] x86/PCI: Preserve host bridge windows completely covered by E820 Content-Language: en-US From: Hans de Goede To: Bjorn Helgaas Cc: "Rafael J . Wysocki" , Borislav Petkov , "H . Peter Anvin" , Ingo Molnar , Mika Westerberg , =?UTF-8?Q?Krzysztof_Wilczy=c5=84ski?= , Myron Stowe , Juha-Pekka Heikkila , =?UTF-8?Q?Benoit_Gr=c3=a9goire?= , Hui Wang , Kai-Heng Feng , linux-acpi@vger.kernel.org, linux-pci@vger.kernel.org, x86@kernel.org, linux-kernel@vger.kernel.org, Bjorn Helgaas , wse@tuxedocomputers.com References: <20220304153245.GA1030861@bhelgaas> <86b17447-b285-f6ce-99d8-f2cad01405d5@redhat.com> In-Reply-To: <86b17447-b285-f6ce-99d8-f2cad01405d5@redhat.com> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hi, On 3/4/22 16:46, Hans de Goede wrote: > Hi, > > On 3/4/22 16:32, Bjorn Helgaas wrote: >> On Fri, Mar 04, 2022 at 03:16:42PM +0100, Hans de Goede wrote: >>> Hi Bjorn, >>> >>> On 3/4/22 04:51, Bjorn Helgaas wrote: >>>> From: Bjorn Helgaas >>>> >>>> Many folks have reported PCI devices not working. It could affect any >>>> device, but most reports are for Thunderbolt controllers on Lenovo Yoga and >>>> Clevo Barebone laptops and the touchpad on Lenovo IdeaPads. >>>> >>>> In every report, a region in the E820 table entirely encloses a PCI host >>>> bridge window from _CRS, and because of 4dc2287c1805 ("x86: avoid E820 >>>> regions when allocating address space"), we ignore the entire window, >>>> preventing us from assigning space to PCI devices. >>>> >>>> For example, the dmesg log [2] from bug report [1] shows: >>>> >>>> BIOS-e820: [mem 0x000000004bc50000-0x00000000cfffffff] reserved >>>> pci_bus 0000:00: root bus resource [mem 0x65400000-0xbfffffff window] >>>> pci 0000:00:15.0: BAR 0: no space for [mem size 0x00001000 64bit] >>>> >>>> The efi=debug dmesg log [3] from the same report shows the EFI memory map >>>> entries that created the E820 map: >>>> >>>> efi: mem47: [Reserved | |WB|WT|WC|UC] range=[0x4bc50000-0x5fffffff] >>>> efi: mem48: [Reserved | |WB| | |UC] range=[0x60000000-0x60ffffff] >>>> efi: mem49: [Reserved | | | | | ] range=[0x61000000-0x653fffff] >>>> efi: mem50: [MMIO |RUN| | | |UC] range=[0x65400000-0xcfffffff] >>>> >>>> 4dc2287c1805 ("x86: avoid E820 regions when allocating address space") >>>> works around issues where _CRS contains non-window address space that can't >>>> be used for PCI devices. It does this by removing E820 regions from host >>>> bridge windows. But in these reports, the E820 region covers the entire >>>> window, so 4dc2287c1805 makes it completely unusable. >>>> >>>> Per UEFI v2.8, sec 7.2, the EfiMemoryMappedIO type means: >>>> >>>> Used by system firmware to request that a memory-mapped IO region be >>>> mapped by the OS to a virtual address so it can be accessed by EFI >>>> runtime services. >>>> >>>> A host bridge window is definitely a memory-mapped IO region, and EFI >>>> runtime services may need to access it, so I don't think we can argue that >>>> this is a firmware defect. >>>> >>>> Instead, change the 4dc2287c1805 strategy so it only removes E820 regions >>>> when they overlap *part* of a host bridge window on the assumption that a >>>> partial overlap is really register space, not part of the window proper. >>>> >>>> If an E820 region covers the entire window from _CRS, assume the _CRS >>>> window is correct and do nothing. >>>> >>>> [1] https://bugzilla.redhat.com/show_bug.cgi?id=1868899 >>>> [2] https://bugzilla.redhat.com/attachment.cgi?id=1711424 >>>> [3] https://bugzilla.redhat.com/attachment.cgi?id=1861407 >>>> >>>> BugLink: https://bugzilla.kernel.org/show_bug.cgi?id=206459 >>>> BugLink: https://bugzilla.kernel.org/show_bug.cgi?id=214259 >>>> BugLink: https://bugzilla.redhat.com/show_bug.cgi?id=1868899 >>>> BugLink: https://bugzilla.redhat.com/show_bug.cgi?id=1871793 >>>> BugLink: https://bugs.launchpad.net/bugs/1878279 >>>> BugLink: https://bugs.launchpad.net/bugs/1931715 >>>> BugLink: https://bugs.launchpad.net/bugs/1932069 >>>> BugLink: https://bugs.launchpad.net/bugs/1921649 >>>> Fixes: 4dc2287c1805 ("x86: avoid E820 regions when allocating address space") >>>> Link: https://lore.kernel.org/r/20220228105259.230903-1-hdegoede@redhat.com >>>> Based-on-patch-by: Hans de Goede >>>> Reported-by: Benoit Grégoire # BZ 206459 >>>> Reported-by: wse@tuxedocomputers.com # BZ 214259 >>>> Signed-off-by: Bjorn Helgaas >>>> --- >>>> arch/x86/kernel/resource.c | 11 +++++++++++ >>>> 1 file changed, 11 insertions(+) >>>> >>>> diff --git a/arch/x86/kernel/resource.c b/arch/x86/kernel/resource.c >>>> index 7378ea146976..405f0af53e3d 100644 >>>> --- a/arch/x86/kernel/resource.c >>>> +++ b/arch/x86/kernel/resource.c >>>> @@ -39,6 +39,17 @@ void remove_e820_regions(struct device *dev, struct resource *avail) >>>> e820_start = entry->addr; >>>> e820_end = entry->addr + entry->size - 1; >>>> >>>> + /* >>>> + * If an E820 entry covers just part of the resource, we >>>> + * assume E820 is telling us about something like host >>>> + * bridge register space that is unavailable for PCI >>>> + * devices. But if it covers the *entire* resource, it's >>>> + * more likely just telling us that this is MMIO space, and >>>> + * that doesn't need to be removed. >>>> + */ >>>> + if (e820_start <= avail->start && avail->end <= e820_end) >>>> + continue; >>>> + >>> >>> IMHO it would be good to add some logging here, since hitting this is >>> somewhat of a special case. For the Fedora test kernels I did I changed >>> this to: >>> >>> if (e820_start <= avail->start && avail->end <= e820_end) { >>> dev_info(dev, "resource %pR fully covered by e820 entry [mem %#010Lx-%#010Lx]\n", >>> avail, e820_start, e820_end); >>> continue; >>> } >>> >>> And I expect/hope to see this new info message on the ideapad with the >>> touchpad issue. >> >> Right, I would expect the same. >> >> We could add something like this. But both the e820 entry and the >> host bridge window are already in the dmesg log, so it doesn't really >> add new information > > Well it adds the information that the workaround (to the workaround) > which we added for this case is working as expected and it allows > seeing that is the case in a single glance. So I just got the first report back from the Fedora test 5.16.12 kernel with this series added. Good news on the ideapad this wotks fine to fix the touchpad issue (as expected). What is interesting is that the above dev_info message which I added triggers *twice*: [ 0.327837] acpi PNP0A08:00: resource [mem 0x000a0000-0x000bffff window] fully covered by e820 entry [mem 0x0009f000-0x000fffff] [ 0.327843] acpi PNP0A08:00: resource [mem 0x65400000-0xbfffffff window] fully covered by e820 entry [mem 0x4bc50000-0xcfffffff] Notice that it also stops from the mem-window for ISA io getting fully clipped, which I did not realize also was a potential issue. I hope this also shows that having the dev_info here is good, at least IMHO this confirms that having the dev_info for this is a good thing. I'm still waiting for testing results on the X1C2 which had the suspend/resume regressions with my bios-date based approach. Regards, Hans