From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1754806AbcI1SlV (ORCPT ); Wed, 28 Sep 2016 14:41:21 -0400 Received: from mail-by2nam01on0116.outbound.protection.outlook.com ([104.47.34.116]:30688 "EHLO NAM01-BY2-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1754438AbcI1Sk6 (ORCPT ); Wed, 28 Sep 2016 14:40:58 -0400 X-Greylist: delayed 7319 seconds by postgrey-1.27 at vger.kernel.org; Wed, 28 Sep 2016 14:40:57 EDT Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=skenton@ou.edu; Subject: Re: lspci not showing motherboard ethernet controller after PCIe card firmware update change from 32-bit to 64-bit BAR To: Lennart Sorensen References: <2cc60cd1-bab1-a086-2326-7ce161b8f083@ou.edu> <20160926155018.GL14311@csclub.uwaterloo.ca> CC: , , Bjorn Helgaas , yinghai Lu , "Blackmagic Developer Support" From: Steve Kenton Message-ID: <68936975-5496-0e0d-5137-d48575e8ec0d@ou.edu> Date: Wed, 28 Sep 2016 09:05:44 -0500 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.3.0 MIME-Version: 1.0 In-Reply-To: <20160926155018.GL14311@csclub.uwaterloo.ca> Content-Type: text/plain; charset="windows-1252" Content-Transfer-Encoding: 7bit X-Originating-IP: [68.97.3.132] X-ClientProxiedBy: BLUPR08CA0032.namprd08.prod.outlook.com (10.141.200.12) To MWHPR03MB2701.namprd03.prod.outlook.com (10.168.207.135) X-MS-Office365-Filtering-Correlation-Id: e880fc7d-fe5c-4f84-9f17-08d3e7a88cba X-Microsoft-Exchange-Diagnostics: 1;MWHPR03MB2701;2:fuDFWYNXBXGSzegRySWl7UiFaGNdFxDLhm4Xu7ElPPxSyKGOUHhSPa4Tu4AjhTEUYdYUGoomaIVaQiEF2i1aGIbKBQzsPC6TNF+IZGCGihtMqXueQQjd5FHsjJcE7kMU/3u/DALYrF5tuJEoOIzWz7pny3oi4cgdyyYeSnLA0Tb+XCnDTGUpvXBGx7oijfog;3:atmfqUJhN5wyMkibOand1wN1dYn2R6YYGBVbRQ/NvDxB5bxfBwKZCiQQHDipBDulH41mVhYaEUABJ6g7PtBGBwo9FRuZ3k+EuLEJqBpsKxwY3Hku0+z5uQXZ/BMi5owU X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:MWHPR03MB2701; X-Microsoft-Exchange-Diagnostics: 1;MWHPR03MB2701;25:HmxDC463JYmPHDaiBRjM8t3i6MVjPPzij9wyAUMzJId3uKwVbgO/QIxWxszSipn3ehI7MtxvfpmuSRFMz66w5PHGyZgTtFS1o3LQdhuu8flqEYm0NvPdVHImVRK0BESbAtOFy5qzQv+wTkMzSvLgGGxOgIBFkCO4QQ9FWtKLg66Y0gDgBd4pkr6HyFqcm+66bvS/FCBItb1OdDLe/jDx2rK7ssQS9SpJKdVbGuuFpGY5MTsklMIPtGqcltpXSeB2wiLP/56iDByuJE+CU5HgBwelahm3bTl5nujGVZ752PBslL7SzFQTwD28z9NZmGVQFBnP+GTtwRZY+zWeB5wAxFAjQeSR+pOV5QXtqkPOc28h+RmniYsI+mnfzK6c+7yfa02P6J8LYFTm4vMybFXEjDKRE87RJz7gbVVrcaZEiIzwSgwWr21kzM3xftO+yC1vUp5eNuPqsIv8XkVpwWO/Uq6B6Mbn66FNGYULkWd/qrV6zhTnREx7Xu60OlKSh9az1nEX/IEltSS2HH+bBEKPYghC/1m5R3VH4TMbPBUi8yrb7T268zaSo45LQMgUE4/2wLyJZvHL6TDgZtKGkIoE/PN3+YrH7Y7J45qkyS1JdZHpPQPnM7ea4OyNY0sfSaOFVkebus6PZWPQrCOeOV0uSV/ToeGTUuuiLvVLvySLujktjFiqrlrdcYDkegKoywbzvmSwNmYTxOrwapR1W4ZXBQ==;31:lxmYV2XXeguopJVZF+SM/s1DSzr/DjSNlDpcTcwVB1kB181f7DDHV4WT+icjjM3oyGZkGVCe9WI2dXQwpIyKzv0ca28q7fwQpL81KetFF52ao3nVMaOMdewMzqoJp5n5+vjJ5LWhMbhBEVD+KJVzNV7N9UemQ8Ou4DRd7kzI2TvE+li9LIZ4yeCrLanmWZfIEVnr3dp1cNlwH2qXrNFplt/O1trWMppst/SnpmoDu1k= X-Microsoft-Exchange-Diagnostics: 1;MWHPR03MB2701;20:98MVBEELZ+++pZXajlHghgUaXuNDee7k7J4Ty1pSFM0rzgR34ZK7D+tIa+G55e9J/ILw2AhXyOY1DgvOkqz94JLL3GflthS64iUi3CZUtkyguywoavl9Q3ZPbyNSMR+dBLChLneULZPUN/CGE8u2vWgl6OQV6SA7nzwv9ozWmuvv0juUqQJujp+/uEKlZQRtfciRr2nDZ3cOrNSJ5ZkUgCfQ0YFbCVp0W2zX4flg+p+D4dUtgKTnn3ocvRG0gAG0W1DnTfjAuQP5ITeckuQpix54G74ciMr+OvwplFH+WDUazbSgGuEjqUJ4PXd/jtRfIkPOTFHbTsbkjAuaUY4Z8qAZ4XGJUIU6rWfi6FqvXX3facokaVHHrM60NBKT6WwvJnF+w0v5/XiTT4RaWN4mZSCEhrvggV5bZLMmftaYbYjPmySdEB1YRziyfrF1sUPVNvv1LOnGDRNolS9HS0gv26aneaZaOMOnmmdZWMi9rHIXlppiKVWxVi5Cl6M+S0vh;4:5Amv3vS6XN0fQ0+wIHsfLCqLr6QOE3KGyraLyfomE+CI3fYdD/o6KyCUUG5OKfvPgSnJXh1wfDdK0IcVKoXph+fhq89Q2bRDJB7F4MWjPZAPp1WgFmqEbd2MzWz553DxRMgVJ7/tuGGcLpfnXVtP5/6s+5PQS5uL/i7YK9AnbyCLt9LLfEW3CAVoCUUA/AcE4kNHk7N5sOrT5lMCcTUW/CiZl3Kj5/Au0cdaksyAIHnPC1JG0wg6YNhN7ovqacuFxXajamvfpRiFutANDZtCQb2rY2UnCFruhG7Bw8jqMH+/l4moKWeFXnEr3grf2dqdDsa9epMxxTT1aOT77B0U6YVkFjOtXmye/paTm4yysAx4zDoJY+/0TqD11rdRSla6A2+8Lv9x3ySjI//kURGTVQ== X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0;PCL:0;RULEID:(6040176)(601004)(2401047)(8121501046)(5005006)(3002001)(10201501046);SRVR:MWHPR03MB2701;BCL:0;PCL:0;RULEID:;SRVR:MWHPR03MB2701; X-Forefront-PRVS: 0079056367 X-Forefront-Antispam-Report: SFV:NSPM;SFS:(10019020)(4630300001)(6009001)(6049001)(7916002)(199003)(189002)(377454003)(24454002)(575784001)(86362001)(106356001)(50466002)(31696002)(81166006)(8676002)(7846002)(7736002)(81156014)(305945005)(105586002)(90282001)(42186005)(31686004)(89122001)(50986999)(92566002)(3846002)(64126003)(586003)(6116002)(101416001)(23746002)(2950100002)(76176999)(6916009)(54356999)(75432002)(117156001)(83506001)(77096005)(65826007)(110136003)(65806001)(4326007)(230700001)(47776003)(88552002)(65956001)(5660300001)(68736007)(33646002)(2906002)(97736004)(189998001)(36756003)(4001350100001)(66066001);DIR:OUT;SFP:1102;SCL:1;SRVR:MWHPR03MB2701;H:[192.168.1.20];FPR:;SPF:None;PTR:InfoNoRecords;A:1;MX:1;LANG:en; X-Microsoft-Exchange-Diagnostics: =?Windows-1252?Q?1;MWHPR03MB2701;23:eF+qA41ky0GX7s5XOyPq0+fsV4q5d5nR2olhR?= =?Windows-1252?Q?AL2zjQoqBWCUJq3l/u63pPODu0w4Mutcifu4ta7uClI+qNu9VtIa08gS?= =?Windows-1252?Q?UU/qNYOday0yqXzwZVjVTpKjTPKzMgemrQaVtwyNlq0/7SKw4ScZGf1U?= =?Windows-1252?Q?4F5OgGz7BVfIva3Gy1jUpP8Vd9WYqdeJ1ycUIM1s3nrjtmDI375J9363?= =?Windows-1252?Q?Tl/SNFiC78pLaOwovJwkQaTk5y0OG8EkO6hC5327t//TDEEYzO/XkqL+?= =?Windows-1252?Q?QV8IJ2FZZnDhzAq5OkikxDKNIZxKSkRgQlBl/fz5GCh+6jGRljRXKAU6?= =?Windows-1252?Q?rgHNgRBMgYXDOX5k9qDddqUQPLBZjUq292/Fyi2gWxsEwT4BxQNnUxBR?= =?Windows-1252?Q?9fBrYN46y0ZYNpWJWD1oyLYsISJdMzBqgd3E9TT9syXTY61tsl9mTXOc?= =?Windows-1252?Q?24fT2rEXc39L/cpX+czUAj+hpqlFmbB92WrOVsdVkoIM6Cz21UZv7IlU?= =?Windows-1252?Q?9/q0Rgp31PB/KdNhSyuI9djNxZ8zDM3WFmdq6Wbwnv0q+P+gFexsaAcH?= =?Windows-1252?Q?qBhjxCymq8Owl6zhDXpl2ksO7gepREBk6d0BRZwuWZxOBbR+T9eZcsaZ?= =?Windows-1252?Q?BaaT5gkBRA4rtoeO3qD/kzPGrtYFEi4BrNuAf/PsxN23tjx7X235vujg?= =?Windows-1252?Q?iwRYDVQsNME5oYXEOm5A+NitqEDUsoB656O7aOgCgd7T4Hmqdu13H9Av?= =?Windows-1252?Q?Fm+X5Zhi4YzFzp0fsRxL/5CJnSz04N6qKjWk/wMNxjyOK2SESYYFbvgI?= =?Windows-1252?Q?eVnr7UUOPqbybYH/W1nQSx7rgZzfaUfmpX72tqJYKqEu71KUWN/HDdyW?= =?Windows-1252?Q?tQE0aahRnamSH+OBSGiG/ZBWpgFiBfVJLzZEb6uri2xWyrH7W6E/fURb?= =?Windows-1252?Q?Vutj/dXemhxRLzgLQkpLs0xnrLYo7XJNjaCBFfLmw4mxI6awW1fGKtzA?= =?Windows-1252?Q?HZvIlx1zr2ojVCRVcAtJwfnlXwrXJjKtMec8BzMDRiNYZeBpnOrDEQAU?= =?Windows-1252?Q?IglUAdKip+74XllufEDnwcoBUgwQ/DFydaRfDK5nO6duUJxKan/J9Kwd?= =?Windows-1252?Q?ew0OlVLwt7e6xmr7fbiIYXO8NAapBJMVEqSoSvNiWiq/xDrMfoNaTYJ3?= =?Windows-1252?Q?FTet8ZUh1JWmHuhTVYVgT2PkRjXp7Ih9uXeak3Ith0wfWNeAMz8DurRY?= =?Windows-1252?Q?IFJrU3fWqf+AD3opOORDbOFpR+JFWaxI5f9/UJBkPgz4fGZbC5GcCqx0?= =?Windows-1252?Q?AcfPxVbO1raDtc8rCFbn1wGgfTnPaHbOEoor+zzyF4MECipSpD7+byTb?= =?Windows-1252?Q?JiGblZNRm4Ofl76bGxDFhFR77h/OekpVlh/0y0uT/TCvwEquE0ge6ptL?= =?Windows-1252?Q?uVE5MssJEgaoPQYj90B5e/9kDiK/nIOWTsIBTfkJw=3D=3D?= X-Microsoft-Exchange-Diagnostics: 1;MWHPR03MB2701;6:B29MtzN38PahTPGYGz9949ecOnsiMcIsHi0v+9KaKHrzrW7BZJFBWb9hc0R6b1NdwMnFB8eBIPlMQN2+vvwFn+6nnWr9ir8ZyTE5UKftgeDQ5uDI7+5+gUp5fGhhmgjIWToBGYys1w6AuOze+H2/sL7yWBk7xYiD2SKNGbwyVm5ji3iHFqz0UMV3em/7o8NM6YOBH+yf4Uqm1hGJ8F0xxgMgOz1RS4BWLD98MwQY7dqn3bGyodjtApqwaJWV1r4mX2WeeE4riXTFVJxN48WiDRDiVk4R/ZpnSi28jAWcI34=;5:16J3jTqD007xgC9tW9NehW6VvMqAVWqLopEFAV05A66O/0N29LRhfWKXqdmjjRrpL7a+obCihCej1YdlziZ+IzRZAjEtBLUURuTXTVUBQiQpatko0wMXBk356xaDqh2tf8kjy32O0xntqVRmvbcoSg==;24:RExMMHQWuJ5+4taae1egAyDSrbNpPG/OY396GlpElyxSE7io5PgryYl8B7OGM8NJ0U4An7SFqlxNbvlQD7+E38p7RlptL3osvVZpmBXJdX0=;7:q/VsPuNAjgvSRMRnhMezvvrEO6xMmRckn+UUHJnXlndwgmXFqapQPDXZsv7ZKwSGHCo2uondhWJuTlfl8a+g34MZtTRT8iFcRLlVUXmLR6EUgRu3zmDG8CiYwL40zwWUb0dhSpYrmqh0XH6T3TqNJdbVNcopeO22krpuQ3D938qo+ZmBZGUs+MrlSY7bLPjPAEf5uo5rljXSnNKZHk1W23qjrwQVyMo44gZdVqwpEkHiPyHXo5GMeJ0ODeEVOJVd9npSXeq/04EDJQRZ3c212ES+EH20psuYbf3zFKSYTtS19T0fxMjWZpcNqdcVAUHB SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: ou.edu X-MS-Exchange-CrossTenant-OriginalArrivalTime: 28 Sep 2016 14:05:48.0075 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: MWHPR03MB2701 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 09/26/2016 10:50 AM, Lennart Sorensen wrote: > Well pci=bios is 32 bit only, so that doesn't work, pci=bfs was probably > supposed to be pci=bfsort. It sure looks like the bios fails to allocate > the network device when the other device is 64 bit. Sure looks like > a bios bug. I see nothing indicating that the address space ran out. > It looks fine. > > You could try: > > pci=realloc > pci=assign-busses > pci=bfsort (the one I think you were trying to do). > > I certainly wouldn't be surprised if the only thing ever tested in that > board was a graphics card. > > Of course your network card is also 64 bit bar (when seen), so the system > can work with such. Makes one wonder if the bios has a bus, or the H81 > has a limit that only one of the ethernet and the add in card can use > 64 bit bar at a time. That would seem weird of course. > I decided to experiment with /sys/bus/pci and the BIOS settings to try and understand things better. The BIOS has a settings to enable/disable the on-board LAN. When the Blackmagic card firmware is upgraded bus[03] and hence the on-board LAN disappears, but the apparently unused bus[02] is still visible and the BIOS setting is still enabled. When the BIOS LAN settings is disabled busses[02][03] and the on-board LAN disappear. In both cases, the "disappeared" resources are not restored by echo to /sys/.../rescan Why? What can the BIOS be doing to the chipset/busses[02][03] to make them invisible to /sys manipulation? There is apparently something I do not understand about the H81 chipset PCIe configuration. I have been reading the Intel Series 8 / Series C220 Chipset documentation but so far have come up empty. Anybody have cluebat for me? Steve Kenton ===================================================================================================================================== Here is the lspci tree output as configured by the BIOS with the on-board LAN enabled Using echo to various /sys files successfully removes and restores(rescan) the Blackmagic card, the Realtek LAN as well as busses[01][02][03] -[0000:00]-+-00.0 Intel Corporation 4th Gen Core Processor DRAM Controller [8086:0c00] +-01.0-[01]----00.0 Blackmagic Design Intensity Pro 4K [bdbd:a139] +-02.0 Intel Corporation Xeon E3-1200 v3/4th Gen Core Processor Integrated Graphics Controller [8086:0412] +-03.0 Intel Corporation Xeon E3-1200 v3/4th Gen Core Processor HD Audio Controller [8086:0c0c] +-14.0 Intel Corporation 8 Series/C220 Series Chipset Family USB xHCI [8086:8c31] +-16.0 Intel Corporation 8 Series/C220 Series Chipset Family MEI Controller #1 [8086:8c3a] +-1a.0 Intel Corporation 8 Series/C220 Series Chipset Family USB EHCI #2 [8086:8c2d] +-1b.0 Intel Corporation 8 Series/C220 Series Chipset High Definition Audio Controller [8086:8c20] +-1c.0-[02]-- +-1c.5-[03]----00.0 Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller [10ec:8168] +-1d.0 Intel Corporation 8 Series/C220 Series Chipset Family USB EHCI #1 [8086:8c26] +-1f.0 Intel Corporation C220 Series Chipset Family H81 Express LPC Controller [8086:8c5c] +-1f.2 Intel Corporation 8 Series/C220 Series Chipset Family 6-port SATA Controller 1 [AHCI mode] [8086:8c02] \-1f.3 Intel Corporation 8 Series/C220 Series Chipset Family SMBus Controller [8086:8c22] ===================================================================================================================================== Here is the lspci tree output as configured by the BIOS with the on-board LAN disabled Using echo to various /sys files I am unable to restore busses[02][03] so I cannot even attempt to restore the Realtek LAN -[0000:00]-+-00.0 Intel Corporation 4th Gen Core Processor DRAM Controller [8086:0c00] +-01.0-[01]----00.0 Blackmagic Design Intensity Pro 4K [bdbd:a139] +-02.0 Intel Corporation Xeon E3-1200 v3/4th Gen Core Processor Integrated Graphics Controller [8086:0412] +-03.0 Intel Corporation Xeon E3-1200 v3/4th Gen Core Processor HD Audio Controller [8086:0c0c] +-14.0 Intel Corporation 8 Series/C220 Series Chipset Family USB xHCI [8086:8c31] +-16.0 Intel Corporation 8 Series/C220 Series Chipset Family MEI Controller #1 [8086:8c3a] +-1a.0 Intel Corporation 8 Series/C220 Series Chipset Family USB EHCI #2 [8086:8c2d] +-1b.0 Intel Corporation 8 Series/C220 Series Chipset High Definition Audio Controller [8086:8c20] +-1d.0 Intel Corporation 8 Series/C220 Series Chipset Family USB EHCI #1 [8086:8c26] +-1f.0 Intel Corporation C220 Series Chipset Family H81 Express LPC Controller [8086:8c5c] +-1f.2 Intel Corporation 8 Series/C220 Series Chipset Family 6-port SATA Controller 1 [AHCI mode] [8086:8c02] \-1f.3 Intel Corporation 8 Series/C220 Series Chipset Family SMBus Controller [8086:8c22] I'm guessing that bus[02] is reserved for a dual LAN option and is not used in this case but may toggle with the BIOS LAN setting