From: Marek Vasut <marek.vasut@mailbox.org>
To: Koichiro Den <den@valinux.co.jp>
Cc: "Yoshihiro Shimoda" <yoshihiro.shimoda.uh@renesas.com>,
"Lorenzo Pieralisi" <lpieralisi@kernel.org>,
"Krzysztof Wilczyński" <kwilczynski@kernel.org>,
"Manivannan Sadhasivam" <mani@kernel.org>,
"Rob Herring" <robh@kernel.org>,
"Bjorn Helgaas" <bhelgaas@google.com>,
"Krzysztof Kozlowski" <krzk+dt@kernel.org>,
"Conor Dooley" <conor+dt@kernel.org>,
"Geert Uytterhoeven" <geert+renesas@glider.be>,
"Magnus Damm" <magnus.damm@gmail.com>,
"Jingoo Han" <jingoohan1@gmail.com>,
"Philipp Zabel" <p.zabel@pengutronix.de>,
"Frank Li" <Frank.Li@nxp.com>,
"Niklas Cassel" <cassel@kernel.org>,
"Wilfred Mallawa" <wilfred.mallawa@wdc.com>,
"Serge Semin" <fancer.lancer@gmail.com>,
linux-pci@vger.kernel.org, linux-renesas-soc@vger.kernel.org,
devicetree@vger.kernel.org, linux-kernel@vger.kernel.org
Subject: Re: [PATCH 07/11] PCI: rcar-gen4: Recover the Root Port on link down
Date: Mon, 28 Sep 2026 00:37:43 +0200 [thread overview]
Message-ID: <e70e5f17-35aa-429e-905f-a1990d549126@mailbox.org> (raw)
In-Reply-To: <jbekhkl7ywblowemhmm4nhzzvg6bk6vpfciaebwvxe7nitfisc@3hbnpq6uz2rw>
On 9/24/26 6:15 PM, Koichiro Den wrote:
> On Tue, Sep 22, 2026 at 11:44:02PM +0200, Marek Vasut wrote:
>> On 9/18/26 5:20 AM, Koichiro Den wrote:
>>> On R-Car, intreq_pcim_sub carries both the integrated MSI receiver and
>>> the controller's reset requests (smlh_req_rst_not, link_req_rst_not), so
>>> the generic DesignWare chained handler reads the MSI status from DBI as
>>> soon as the link goes down. On R-Car S4 that is a hazard: DBI accesses
>>> issued within a few hundred microseconds of an unexpected link down do
>>> not complete and hang the host. In testing, the first Root Port config
>>> read after powering off the link partner hung unless delayed by ~300 us.
>>
>> Out of curiosity, do they trigger SError, and does the firmware (TFA)
>> trap/fix those up in EL3?
>
> I haven't confirmed whether those DBI accesses trigger an SError.
> The BL31 on the Spider I'm using should be based on rcar-s4_v2.5 [1] from the
> Spider BSP (as I haven't updated it). I just checked that this version also sets
> HANDLE_EA_EL3_FIRST=1, plus plat_ea_handler() is empty. So IIUC an SError would
> be taken to EL3
Yes.
> , and the normal path would return to the kernel without fixing
> the underlying error.
That is correct.
R-Car Gen3 does PCIe link error fixup in TFA, it looks this way:
https://github.com/ARM-software/arm-trusted-firmware/commit/0969397f295621aa26b3d14b76dd397d22be58bf
> And, regardless of whether it's a synchronous abort or an SError:
> - There was no crash report (via report_unhandled_exception) on the console.
> - Once that DBI access in the small window hangs, it never recovers,
> whereas adding udelay(300) before the access avoids the hang. So I
> doubt it's just retrying the same access after a transient synchronous
> abort as well (though I can't rule it out).
( It just crossed my mind, this sounds similar to 0056d29f8c1b ("PCI:
rcar-gen4: Assure reset occurs before DBI access") )
> [1] https://github.com/renesas-rcar/arm-trusted-firmware/tree/rcar-s4_v2.5
>
>>
>>> Use the pre-MSI callback to check the APP reset status before DBI is
>>> touched. When a reset request is latched, mask the sources, ack the
>>> request and schedule recovery work. The work calls
>>> pci_host_handle_link_down(), which runs the AER-style recovery and
>>> resets the controller through reset_root_port(). If the reset fails, the
>>> sources stay masked so nothing touches the unrecovered controller.
>>>
>>> Only unmasked status bits are handled and pending latches are cleared
>>> when re-arming, so requests recorded during probe or the reset itself do
>>> not trigger another recovery. Teardown only disables link-down
>>> detection: MSI delivery has to keep working while devices are removed.
>>>
>>> When iMSI-RX is not used (external MSI controller or pci=nomsi), the
>>> DesignWare core does not request intreq_pcim_sub, so request it in the
>>> driver.
>>
>> Would it make sense to request the line unconditionally, to simplify the
>> driver(s) ?
>
> Yes. The pcie-rcar-gen4 can set pp->msi_irq[0] = -ENODEV just like spear13xx,
> dra7xx and keembay for the same reason. That also removes the need for adding
> .pre_msi_irq addition in patch 4. Some other adjustments might be needed, but I
> believe that is the right and clean direction. I will respin with that in mind.
>
> Thanks for the review, that helps a lot!
Likewise, thank you for your help !
--
Best regards,
Marek Vasut
next prev parent reply other threads:[~2026-09-27 22:37 UTC|newest]
Thread overview: 34+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-09-18 3:20 [PATCH 00/11] PCI: rcar-gen4: Recover from link down and route Root Port interrupts Koichiro Den
2026-09-18 3:20 ` [PATCH 01/11] PCI: dwc: Add Renesas to the RAS DES VSEC list Koichiro Den
2026-09-22 19:40 ` Marek Vasut
2026-09-18 3:20 ` [PATCH 02/11] PCI: rcar-gen4: Drop the APP-based link_up check Koichiro Den
2026-09-22 20:56 ` Marek Vasut
2026-09-23 14:56 ` Koichiro Den
2026-09-27 19:59 ` Marek Vasut
2026-09-28 4:20 ` Koichiro Den
2026-09-28 15:07 ` Marek Vasut
2026-09-18 3:20 ` [PATCH 03/11] dt-bindings: PCI: rcar-gen4: Add optional "aer" interrupt Koichiro Den
2026-09-22 20:59 ` Marek Vasut
2026-09-28 18:32 ` Rob Herring (Arm)
2026-09-18 3:20 ` [PATCH 04/11] PCI: dwc: Add a host op to run before iMSI-RX status is read Koichiro Den
2026-09-18 3:20 ` [PATCH 05/11] PCI: rcar-gen4: Split reusable hardware initialization Koichiro Den
2026-09-22 21:15 ` Marek Vasut
2026-09-23 15:24 ` Koichiro Den
2026-09-27 20:43 ` Marek Vasut
2026-09-18 3:20 ` [PATCH 06/11] PCI: rcar-gen4: Add Root Port reset support Koichiro Den
2026-09-22 21:22 ` Marek Vasut
2026-09-23 16:12 ` Koichiro Den
2026-09-27 22:25 ` Marek Vasut
2026-09-28 3:50 ` Koichiro Den
2026-09-28 17:47 ` Marek Vasut
2026-09-18 3:20 ` [PATCH 07/11] PCI: rcar-gen4: Recover the Root Port on link down Koichiro Den
2026-09-22 21:44 ` Marek Vasut
2026-09-24 16:15 ` Koichiro Den
2026-09-27 22:37 ` Marek Vasut [this message]
2026-09-28 4:06 ` Koichiro Den
2026-09-28 17:36 ` Marek Vasut
2026-09-18 3:20 ` [PATCH 08/11] PCI: dwc: Let glue drivers hide the Root Port MSI capabilities Koichiro Den
2026-09-18 3:20 ` [PATCH 09/11] PCI: rcar-gen4: Route Root Port AER to a virtual Root Port IRQ Koichiro Den
2026-09-18 3:20 ` [PATCH 10/11] PCI: rcar-gen4: Route Root Port PME and bandwidth notifications Koichiro Den
2026-09-18 3:20 ` [PATCH 11/11] arm64: dts: renesas: r8a779f0: Describe the PCIe AER interrupts Koichiro Den
2026-09-22 21:31 ` Marek Vasut
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=e70e5f17-35aa-429e-905f-a1990d549126@mailbox.org \
--to=marek.vasut@mailbox.org \
--cc=Frank.Li@nxp.com \
--cc=bhelgaas@google.com \
--cc=cassel@kernel.org \
--cc=conor+dt@kernel.org \
--cc=den@valinux.co.jp \
--cc=devicetree@vger.kernel.org \
--cc=fancer.lancer@gmail.com \
--cc=geert+renesas@glider.be \
--cc=jingoohan1@gmail.com \
--cc=krzk+dt@kernel.org \
--cc=kwilczynski@kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-pci@vger.kernel.org \
--cc=linux-renesas-soc@vger.kernel.org \
--cc=lpieralisi@kernel.org \
--cc=magnus.damm@gmail.com \
--cc=mani@kernel.org \
--cc=p.zabel@pengutronix.de \
--cc=robh@kernel.org \
--cc=wilfred.mallawa@wdc.com \
--cc=yoshihiro.shimoda.uh@renesas.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®