From: Dirk Gouders <dirk@gouders.net>
To: Yinghai Lu <yinghai@kernel.org>
Cc: Bjorn Helgaas <bhelgaas@google.com>,
Linus Torvalds <torvalds@linux-foundation.org>,
Andreas Noever <andreas.noever@gmail.com>,
Linux Kernel <linux-kernel@vger.kernel.org>,
"linux-pci\@vger.kernel.org" <linux-pci@vger.kernel.org>
Subject: Re: [BUG] Bisected Problem with LSI PCI FC Adapter
Date: Fri, 19 Sep 2014 17:03:26 +0200 [thread overview]
Message-ID: <ghwq8zzm81.fsf@lena.gouders.net> (raw)
In-Reply-To: <CAE9FiQUeP84585-4b+Y6WBVD3zqOi7ch_OXytsTmKEz9AyZ3Vg@mail.gmail.com> (Yinghai Lu's message of "Fri, 12 Sep 2014 18:59:23 -0700")
Yinghai Lu <yinghai@kernel.org> writes:
> On Fri, Sep 12, 2014 at 5:11 PM, Dirk Gouders <dirk@gouders.net> wrote:
>> Yinghai Lu <yinghai@kernel.org> writes:
>>
>> Yes, I skip them in pci_scan_device() to get the unused bus number space
>> that 0a.0 and 0b.0 then can use when reconfiguration is triggered.
>
> That is not right. Can not let two bridges use same bus num.
>
>>
>>> Proper simulation could be:
>>> 1. remove 07:00.0
>>> echo 1 > /sys/bus/pci/devices/0000:07:00.0/remove
>>> 2. change bus range in 00:0a.0 bus
>>> setpci -s 00:0a.0 0x1c.l=0x00101000
>>> 3. remove 00:0a.0
>>> echo 1 > /sys/bus/pci/devices/0000:00:0a.0/remove
>>> 4. rescan pci
>>> echo 1 > /sys/bus/pci/rescan
>>> 5. reset pcie link from 00:0a.0
>>> setpci -s 00:0a.0 0xc0.b=0x18
>>> sleep 1s
>>> setpci -s 00:0a.0 0xc0.b=0x08
>>> 6. rescan pci bus
>>> echo 1 > /sys/bus/pci/rescan
>>
>> OK, I did that (with 3.16) but the reconfiguration code doesn't
>> get triggered. Here is what dmesg and lspci -tv say:
>
> 2 should be
> setpci -s 00:0a.0 0x18.l=0x00101000
I'm very sorry for the late test result, Yinghai, I totally overlooked
this correction.
I'm not sure if it is still of interest but
I now tried these corrected commands on the test machine with a vanilla
3.16 kernel. The FC adapter disappears but I cannot see the
"bridge configuration invalid ..., reconfiguring" message,
so I assume that the test situation is still not exactly matching that
on the vx50 or am I missing something?
lspci before and lspci + dmesg after above commands attached.
Dirk
- lspci before ---------------------------------------------------------
-[0000:00]-+-01.0-[01-02]--+-0d.0-[02]--
| +-0e.0 Broadcom BCM5785 [HT1000] SATA (PATA/IDE Mode)
| \-0e.1 Broadcom BCM5785 [HT1000] SATA (PATA/IDE Mode)
+-02.0 Broadcom BCM5785 [HT1000] Legacy South Bridge
+-02.1 Broadcom BCM5785 [HT1000] IDE
+-02.2 Broadcom BCM5785 [HT1000] LPC
+-03.0 Broadcom BCM5785 [HT1000] USB
+-03.1 Broadcom BCM5785 [HT1000] USB
+-03.2 Broadcom BCM5785 [HT1000] USB
+-06.0-[03]--
+-07.0-[04]--+-04.0 Broadcom Corporation NetXtreme BCM5780 Gigabit Ethernet
| \-04.1 Broadcom Corporation NetXtreme BCM5780 Gigabit Ethernet
+-08.0-[05]--
+-09.0-[06]--
+-0a.0-[07]----00.0 LSI Logic / Symbios Logic FC949ES Fibre Channel Adapter
+-0b.0-[08]--
+-0c.0 Advanced Micro Devices, Inc. [AMD/ATI] ES1000
+-18.0 Advanced Micro Devices, Inc. [AMD] K8 [Athlon64/Opteron] HyperTransport Technology Configuration
+-18.1 Advanced Micro Devices, Inc. [AMD] K8 [Athlon64/Opteron] Address Map
+-18.2 Advanced Micro Devices, Inc. [AMD] K8 [Athlon64/Opteron] DRAM Controller
+-18.3 Advanced Micro Devices, Inc. [AMD] K8 [Athlon64/Opteron] Miscellaneous Control
+-19.0 Advanced Micro Devices, Inc. [AMD] K8 [Athlon64/Opteron] HyperTransport Technology Configuration
+-19.1 Advanced Micro Devices, Inc. [AMD] K8 [Athlon64/Opteron] Address Map
+-19.2 Advanced Micro Devices, Inc. [AMD] K8 [Athlon64/Opteron] DRAM Controller
\-19.3 Advanced Micro Devices, Inc. [AMD] K8 [Athlon64/Opteron] Miscellaneous Control
- lspci after ----------------------------------------------------------
-[0000:00]-+-01.0-[01-02]--+-0d.0-[02]--
| +-0e.0 Broadcom BCM5785 [HT1000] SATA (PATA/IDE Mode)
| \-0e.1 Broadcom BCM5785 [HT1000] SATA (PATA/IDE Mode)
+-02.0 Broadcom BCM5785 [HT1000] Legacy South Bridge
+-02.1 Broadcom BCM5785 [HT1000] IDE
+-02.2 Broadcom BCM5785 [HT1000] LPC
+-03.0 Broadcom BCM5785 [HT1000] USB
+-03.1 Broadcom BCM5785 [HT1000] USB
+-03.2 Broadcom BCM5785 [HT1000] USB
+-06.0-[03]--
+-07.0-[04]--+-04.0 Broadcom Corporation NetXtreme BCM5780 Gigabit Ethernet
| \-04.1 Broadcom Corporation NetXtreme BCM5780 Gigabit Ethernet
+-08.0-[05]--
+-09.0-[06]--
+-0a.0-[10]--
+-0b.0-[08]--
+-0c.0 Advanced Micro Devices, Inc. [AMD/ATI] ES1000
+-18.0 Advanced Micro Devices, Inc. [AMD] K8 [Athlon64/Opteron] HyperTransport Technology Configuration
+-18.1 Advanced Micro Devices, Inc. [AMD] K8 [Athlon64/Opteron] Address Map
+-18.2 Advanced Micro Devices, Inc. [AMD] K8 [Athlon64/Opteron] DRAM Controller
+-18.3 Advanced Micro Devices, Inc. [AMD] K8 [Athlon64/Opteron] Miscellaneous Control
+-19.0 Advanced Micro Devices, Inc. [AMD] K8 [Athlon64/Opteron] HyperTransport Technology Configuration
+-19.1 Advanced Micro Devices, Inc. [AMD] K8 [Athlon64/Opteron] Address Map
+-19.2 Advanced Micro Devices, Inc. [AMD] K8 [Athlon64/Opteron] DRAM Controller
\-19.3 Advanced Micro Devices, Inc. [AMD] K8 [Athlon64/Opteron] Miscellaneous Control
- dmesg after ----------------------------------------------------------
[ 214.234819] pci_bus 0000:07: busn_res: [bus 07] is released
[ 214.234981] pci_scan_child_bus: pci_bus 0000:00: scanning bus
[ 214.235037] pci 0000:00:0a.0: [1166:0132] type 01 class 0x060400
[ 214.235128] pci 0000:00:0a.0: System wakeup disabled by ACPI
[ 214.235221] pci_scan_bridge: pci 0000:00:01.0: scanning [bus 01-02] behind bridge, pass 0
[ 214.235227] pci_scan_child_bus: pci_bus 0000:01: scanning bus
[ 214.235258] pci_scan_bridge: pci 0000:01:0d.0: scanning [bus 02-02] behind bridge, pass 0
[ 214.235262] pci_scan_child_bus: pci_bus 0000:02: scanning bus
[ 214.235295] pci_scan_child_bus: pci_bus 0000:02: bus scan returning with max=02
[ 214.235301] pci_scan_bridge: pci 0000:01:0d.0: scanning [bus 02-02] behind bridge, pass 1
[ 214.235306] pci_scan_child_bus: pci_bus 0000:01: bus scan returning with max=02
[ 214.235312] pci_scan_bridge: pci 0000:00:06.0: scanning [bus 03-03] behind bridge, pass 0
[ 214.235316] pci_scan_child_bus: pci_bus 0000:03: scanning bus
[ 214.235343] pci_scan_child_bus: pci_bus 0000:03: bus scan returning with max=03
[ 214.235348] pci_scan_bridge: pci 0000:00:07.0: scanning [bus 04-04] behind bridge, pass 0
[ 214.235352] pci_scan_child_bus: pci_bus 0000:04: scanning bus
[ 214.235376] pci_scan_child_bus: pci_bus 0000:04: bus scan returning with max=04
[ 214.235381] pci_scan_bridge: pcieport 0000:00:08.0: scanning [bus 05-05] behind bridge, pass 0
[ 214.235386] pci_scan_child_bus: pci_bus 0000:05: scanning bus
[ 214.235390] pci_scan_child_bus: pci_bus 0000:05: bus scan returning with max=05
[ 214.235394] pci_scan_bridge: pcieport 0000:00:09.0: scanning [bus 06-06] behind bridge, pass 0
[ 214.235398] pci_scan_child_bus: pci_bus 0000:06: scanning bus
[ 214.235402] pci_scan_child_bus: pci_bus 0000:06: bus scan returning with max=06
[ 214.235407] pci_scan_bridge: pcieport 0000:00:0b.0: scanning [bus 08-08] behind bridge, pass 0
[ 214.235411] pci_scan_child_bus: pci_bus 0000:08: scanning bus
[ 214.235415] pci_scan_child_bus: pci_bus 0000:08: bus scan returning with max=08
[ 214.235420] pci_scan_bridge: pci 0000:00:0a.0: scanning [bus 10-10] behind bridge, pass 0
[ 214.235457] pci_scan_child_bus: pci_bus 0000:10: scanning bus
[ 214.235461] pci_scan_child_bus: pci_bus 0000:10: fixups for bus
[ 214.235464] pci 0000:00:0a.0: PCI bridge to [bus 10]
[ 214.235470] pci 0000:00:0a.0: bridge window [io 0x9000-0xbfff]
[ 214.235475] pci 0000:00:0a.0: bridge window [mem 0xff300000-0xff5fffff]
[ 214.235480] pci 0000:00:0a.0: bridge window [mem 0xcfe00000-0xcfefffff 64bit pref]
[ 214.235483] pci_scan_child_bus: pci_bus 0000:10: bus scan returning with max=10
[ 214.235487] pci_scan_bridge: pci 0000:00:01.0: scanning [bus 01-02] behind bridge, pass 1
[ 214.235493] pci_scan_bridge: pci 0000:00:06.0: scanning [bus 03-03] behind bridge, pass 1
[ 214.235498] pci_scan_bridge: pci 0000:00:07.0: scanning [bus 04-04] behind bridge, pass 1
[ 214.235503] pci_scan_bridge: pcieport 0000:00:08.0: scanning [bus 05-05] behind bridge, pass 1
[ 214.235508] pci_scan_bridge: pcieport 0000:00:09.0: scanning [bus 06-06] behind bridge, pass 1
[ 214.235513] pci_scan_bridge: pcieport 0000:00:0b.0: scanning [bus 08-08] behind bridge, pass 1
[ 214.235518] pci_scan_bridge: pci 0000:00:0a.0: scanning [bus 10-10] behind bridge, pass 1
[ 214.235522] pci_scan_child_bus: pci_bus 0000:00: bus scan returning with max=10
[ 214.235567] pci 0000:00:0a.0: BAR 8: assigned [mem 0x80000000-0x802fffff]
[ 214.235574] pci 0000:00:0a.0: BAR 9: assigned [mem 0x280000000-0x2800fffff 64bit pref]
[ 214.235579] pci 0000:00:0a.0: BAR 7: assigned [io 0x1000-0x3fff]
[ 214.235583] pci 0000:01:0d.0: PCI bridge to [bus 02]
[ 214.235592] pci 0000:00:06.0: PCI bridge to [bus 03]
[ 214.235599] pci 0000:00:0a.0: PCI bridge to [bus 10]
[ 214.235603] pci 0000:00:0a.0: bridge window [io 0x1000-0x3fff]
[ 214.235607] pci 0000:00:0a.0: bridge window [mem 0x80000000-0x802fffff]
[ 214.235610] pci 0000:00:0a.0: bridge window [mem 0x280000000-0x2800fffff 64bit pref]
[ 214.235622] fixup_debug_start: pci 0000:00:0a.0: calling quirk_msi_ht_cap+0x0/0x50
[ 214.235627] pci 0000:00:0a.0: Found enabled HT MSI Mapping
[ 215.257656] pci_scan_child_bus: pci_bus 0000:00: scanning bus
[ 215.257713] pci_scan_bridge: pci 0000:00:01.0: scanning [bus 01-02] behind bridge, pass 0
[ 215.257720] pci_scan_child_bus: pci_bus 0000:01: scanning bus
[ 215.257750] pci_scan_bridge: pci 0000:01:0d.0: scanning [bus 02-02] behind bridge, pass 0
[ 215.257755] pci_scan_child_bus: pci_bus 0000:02: scanning bus
[ 215.257788] pci_scan_child_bus: pci_bus 0000:02: bus scan returning with max=02
[ 215.257793] pci_scan_bridge: pci 0000:01:0d.0: scanning [bus 02-02] behind bridge, pass 1
[ 215.257798] pci_scan_child_bus: pci_bus 0000:01: bus scan returning with max=02
[ 215.257803] pci_scan_bridge: pci 0000:00:06.0: scanning [bus 03-03] behind bridge, pass 0
[ 215.257807] pci_scan_child_bus: pci_bus 0000:03: scanning bus
[ 215.257834] pci_scan_child_bus: pci_bus 0000:03: bus scan returning with max=03
[ 215.257839] pci_scan_bridge: pci 0000:00:07.0: scanning [bus 04-04] behind bridge, pass 0
[ 215.257843] pci_scan_child_bus: pci_bus 0000:04: scanning bus
[ 215.257867] pci_scan_child_bus: pci_bus 0000:04: bus scan returning with max=04
[ 215.257872] pci_scan_bridge: pcieport 0000:00:08.0: scanning [bus 05-05] behind bridge, pass 0
[ 215.257876] pci_scan_child_bus: pci_bus 0000:05: scanning bus
[ 215.257880] pci_scan_child_bus: pci_bus 0000:05: bus scan returning with max=05
[ 215.257884] pci_scan_bridge: pcieport 0000:00:09.0: scanning [bus 06-06] behind bridge, pass 0
[ 215.257889] pci_scan_child_bus: pci_bus 0000:06: scanning bus
[ 215.257893] pci_scan_child_bus: pci_bus 0000:06: bus scan returning with max=06
[ 215.257897] pci_scan_bridge: pcieport 0000:00:0b.0: scanning [bus 08-08] behind bridge, pass 0
[ 215.257901] pci_scan_child_bus: pci_bus 0000:08: scanning bus
[ 215.257905] pci_scan_child_bus: pci_bus 0000:08: bus scan returning with max=08
[ 215.257910] pci_scan_bridge: pcieport 0000:00:0a.0: scanning [bus 10-10] behind bridge, pass 0
[ 215.257914] pci_scan_child_bus: pci_bus 0000:10: scanning bus
[ 215.257918] pci_scan_child_bus: pci_bus 0000:10: bus scan returning with max=10
[ 215.257922] pci_scan_bridge: pci 0000:00:01.0: scanning [bus 01-02] behind bridge, pass 1
[ 215.257928] pci_scan_bridge: pci 0000:00:06.0: scanning [bus 03-03] behind bridge, pass 1
[ 215.257933] pci_scan_bridge: pci 0000:00:07.0: scanning [bus 04-04] behind bridge, pass 1
[ 215.257938] pci_scan_bridge: pcieport 0000:00:08.0: scanning [bus 05-05] behind bridge, pass 1
[ 215.257942] pci_scan_bridge: pcieport 0000:00:09.0: scanning [bus 06-06] behind bridge, pass 1
[ 215.257947] pci_scan_bridge: pcieport 0000:00:0b.0: scanning [bus 08-08] behind bridge, pass 1
[ 215.257952] pci_scan_bridge: pcieport 0000:00:0a.0: scanning [bus 10-10] behind bridge, pass 1
[ 215.257956] pci_scan_child_bus: pci_bus 0000:00: bus scan returning with max=10
[ 215.257994] pci 0000:01:0d.0: PCI bridge to [bus 02]
[ 215.258033] pci 0000:00:06.0: PCI bridge to [bus 03]
next prev parent reply other threads:[~2014-09-19 15:04 UTC|newest]
Thread overview: 42+ messages / expand[flat|nested] mbox.gz Atom feed top
2014-09-03 10:57 Dirk Gouders
2014-09-03 12:28 ` Andreas Noever
2014-09-03 12:47 ` Dirk Gouders
2014-09-03 15:54 ` Andreas Noever
2014-09-04 6:09 ` Dirk Gouders
2014-09-11 13:43 ` Dirk Gouders
2014-09-11 17:30 ` Bjorn Helgaas
2014-09-11 19:26 ` Yinghai Lu
2014-09-11 20:33 ` Dirk Gouders
2014-09-11 20:42 ` Bjorn Helgaas
2014-09-11 21:24 ` Dirk Gouders
2014-09-11 22:51 ` Bjorn Helgaas
2014-09-11 23:50 ` Dirk Gouders
2014-09-12 11:11 ` Dirk Gouders
2014-09-12 20:05 ` Dirk Gouders
2014-09-12 20:37 ` Andreas Noever
2014-09-12 20:38 ` Bjorn Helgaas
2014-09-12 20:39 ` Yinghai Lu
2014-09-12 20:54 ` Dirk Gouders
2014-09-12 21:49 ` Yinghai Lu
2014-09-12 22:05 ` Dirk Gouders
2014-09-12 23:09 ` Yinghai Lu
2014-09-13 0:11 ` Dirk Gouders
2014-09-13 1:59 ` Yinghai Lu
2014-09-13 4:07 ` Bjorn Helgaas
2014-09-13 9:30 ` Dirk Gouders
2014-09-13 19:41 ` Dirk Gouders
2014-09-14 10:42 ` Andreas Noever
2014-09-14 10:44 ` Andreas Noever
2014-09-14 11:40 ` Dirk Gouders
2014-09-14 13:16 ` Andreas Noever
2014-09-14 14:24 ` Dirk Gouders
2014-09-19 18:39 ` Bjorn Helgaas
2014-09-20 18:41 ` Dirk Gouders
2014-09-22 14:25 ` Bjorn Helgaas
2014-09-22 14:53 ` Andreas Noever
2014-09-22 15:23 ` Bjorn Helgaas
2014-09-19 17:12 ` Bjorn Helgaas
2014-09-19 15:03 ` Dirk Gouders [this message]
2014-09-19 18:21 ` Dirk Gouders
2014-09-11 20:35 ` Dirk Gouders
2014-09-11 20:42 ` Linus Torvalds
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=ghwq8zzm81.fsf@lena.gouders.net \
--to=dirk@gouders.net \
--cc=andreas.noever@gmail.com \
--cc=bhelgaas@google.com \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-pci@vger.kernel.org \
--cc=torvalds@linux-foundation.org \
--cc=yinghai@kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®