mirror of https://lore.kernel.org/lkml/
 help / color / mirror / Atom feed
From: Marek Vasut <marek.vasut@mailbox.org>
To: Koichiro Den <den@valinux.co.jp>
Cc: "Yoshihiro Shimoda" <yoshihiro.shimoda.uh@renesas.com>,
	"Lorenzo Pieralisi" <lpieralisi@kernel.org>,
	"Krzysztof Wilczyński" <kwilczynski@kernel.org>,
	"Manivannan Sadhasivam" <mani@kernel.org>,
	"Rob Herring" <robh@kernel.org>,
	"Bjorn Helgaas" <bhelgaas@google.com>,
	"Krzysztof Kozlowski" <krzk+dt@kernel.org>,
	"Conor Dooley" <conor+dt@kernel.org>,
	"Geert Uytterhoeven" <geert+renesas@glider.be>,
	"Magnus Damm" <magnus.damm@gmail.com>,
	"Jingoo Han" <jingoohan1@gmail.com>,
	"Philipp Zabel" <p.zabel@pengutronix.de>,
	"Frank Li" <Frank.Li@nxp.com>,
	"Niklas Cassel" <cassel@kernel.org>,
	"Wilfred Mallawa" <wilfred.mallawa@wdc.com>,
	"Serge Semin" <fancer.lancer@gmail.com>,
	linux-pci@vger.kernel.org, linux-renesas-soc@vger.kernel.org,
	devicetree@vger.kernel.org, linux-kernel@vger.kernel.org
Subject: Re: [PATCH 07/11] PCI: rcar-gen4: Recover the Root Port on link down
Date: Mon, 28 Sep 2026 00:37:43 +0200	[thread overview]
Message-ID: <e70e5f17-35aa-429e-905f-a1990d549126@mailbox.org> (raw)
In-Reply-To: <jbekhkl7ywblowemhmm4nhzzvg6bk6vpfciaebwvxe7nitfisc@3hbnpq6uz2rw>

On 9/24/26 6:15 PM, Koichiro Den wrote:
> On Tue, Sep 22, 2026 at 11:44:02PM +0200, Marek Vasut wrote:
>> On 9/18/26 5:20 AM, Koichiro Den wrote:
>>> On R-Car, intreq_pcim_sub carries both the integrated MSI receiver and
>>> the controller's reset requests (smlh_req_rst_not, link_req_rst_not), so
>>> the generic DesignWare chained handler reads the MSI status from DBI as
>>> soon as the link goes down. On R-Car S4 that is a hazard: DBI accesses
>>> issued within a few hundred microseconds of an unexpected link down do
>>> not complete and hang the host. In testing, the first Root Port config
>>> read after powering off the link partner hung unless delayed by ~300 us.
>>
>> Out of curiosity, do they trigger SError, and does the firmware (TFA)
>> trap/fix those up in EL3?
> 
> I haven't confirmed whether those DBI accesses trigger an SError.
> The BL31 on the Spider I'm using should be based on rcar-s4_v2.5 [1] from the
> Spider BSP (as I haven't updated it). I just checked that this version also sets
> HANDLE_EA_EL3_FIRST=1, plus plat_ea_handler() is empty. So IIUC an SError would
> be taken to EL3

Yes.

> , and the normal path would return to the kernel without fixing
> the underlying error.

That is correct.

R-Car Gen3 does PCIe link error fixup in TFA, it looks this way:

https://github.com/ARM-software/arm-trusted-firmware/commit/0969397f295621aa26b3d14b76dd397d22be58bf

> And, regardless of whether it's a synchronous abort or an SError:
> - There was no crash report (via report_unhandled_exception) on the console.
> - Once that DBI access in the small window hangs, it never recovers,
>    whereas adding udelay(300) before the access avoids the hang. So I
>    doubt it's just retrying the same access after a transient synchronous
>    abort as well (though I can't rule it out).

( It just crossed my mind, this sounds similar to 0056d29f8c1b ("PCI: 
rcar-gen4: Assure reset occurs before DBI access") )

> [1] https://github.com/renesas-rcar/arm-trusted-firmware/tree/rcar-s4_v2.5
> 
>>
>>> Use the pre-MSI callback to check the APP reset status before DBI is
>>> touched. When a reset request is latched, mask the sources, ack the
>>> request and schedule recovery work. The work calls
>>> pci_host_handle_link_down(), which runs the AER-style recovery and
>>> resets the controller through reset_root_port(). If the reset fails, the
>>> sources stay masked so nothing touches the unrecovered controller.
>>>
>>> Only unmasked status bits are handled and pending latches are cleared
>>> when re-arming, so requests recorded during probe or the reset itself do
>>> not trigger another recovery. Teardown only disables link-down
>>> detection: MSI delivery has to keep working while devices are removed.
>>>
>>> When iMSI-RX is not used (external MSI controller or pci=nomsi), the
>>> DesignWare core does not request intreq_pcim_sub, so request it in the
>>> driver.
>>
>> Would it make sense to request the line unconditionally, to simplify the
>> driver(s) ?
> 
> Yes. The pcie-rcar-gen4 can set pp->msi_irq[0] = -ENODEV just like spear13xx,
> dra7xx and keembay for the same reason. That also removes the need for adding
> .pre_msi_irq addition in patch 4. Some other adjustments might be needed, but I
> believe that is the right and clean direction. I will respin with that in mind.
> 
> Thanks for the review, that helps a lot!

Likewise, thank you for your help !

-- 
Best regards,
Marek Vasut

  reply	other threads:[~2026-09-27 22:37 UTC|newest]

Thread overview: 34+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-09-18  3:20 [PATCH 00/11] PCI: rcar-gen4: Recover from link down and route Root Port interrupts Koichiro Den
2026-09-18  3:20 ` [PATCH 01/11] PCI: dwc: Add Renesas to the RAS DES VSEC list Koichiro Den
2026-09-22 19:40   ` Marek Vasut
2026-09-18  3:20 ` [PATCH 02/11] PCI: rcar-gen4: Drop the APP-based link_up check Koichiro Den
2026-09-22 20:56   ` Marek Vasut
2026-09-23 14:56     ` Koichiro Den
2026-09-27 19:59       ` Marek Vasut
2026-09-28  4:20         ` Koichiro Den
2026-09-28 15:07           ` Marek Vasut
2026-09-18  3:20 ` [PATCH 03/11] dt-bindings: PCI: rcar-gen4: Add optional "aer" interrupt Koichiro Den
2026-09-22 20:59   ` Marek Vasut
2026-09-28 18:32   ` Rob Herring (Arm)
2026-09-18  3:20 ` [PATCH 04/11] PCI: dwc: Add a host op to run before iMSI-RX status is read Koichiro Den
2026-09-18  3:20 ` [PATCH 05/11] PCI: rcar-gen4: Split reusable hardware initialization Koichiro Den
2026-09-22 21:15   ` Marek Vasut
2026-09-23 15:24     ` Koichiro Den
2026-09-27 20:43       ` Marek Vasut
2026-09-18  3:20 ` [PATCH 06/11] PCI: rcar-gen4: Add Root Port reset support Koichiro Den
2026-09-22 21:22   ` Marek Vasut
2026-09-23 16:12     ` Koichiro Den
2026-09-27 22:25       ` Marek Vasut
2026-09-28  3:50         ` Koichiro Den
2026-09-28 17:47           ` Marek Vasut
2026-09-18  3:20 ` [PATCH 07/11] PCI: rcar-gen4: Recover the Root Port on link down Koichiro Den
2026-09-22 21:44   ` Marek Vasut
2026-09-24 16:15     ` Koichiro Den
2026-09-27 22:37       ` Marek Vasut [this message]
2026-09-28  4:06         ` Koichiro Den
2026-09-28 17:36           ` Marek Vasut
2026-09-18  3:20 ` [PATCH 08/11] PCI: dwc: Let glue drivers hide the Root Port MSI capabilities Koichiro Den
2026-09-18  3:20 ` [PATCH 09/11] PCI: rcar-gen4: Route Root Port AER to a virtual Root Port IRQ Koichiro Den
2026-09-18  3:20 ` [PATCH 10/11] PCI: rcar-gen4: Route Root Port PME and bandwidth notifications Koichiro Den
2026-09-18  3:20 ` [PATCH 11/11] arm64: dts: renesas: r8a779f0: Describe the PCIe AER interrupts Koichiro Den
2026-09-22 21:31   ` Marek Vasut

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=e70e5f17-35aa-429e-905f-a1990d549126@mailbox.org \
    --to=marek.vasut@mailbox.org \
    --cc=Frank.Li@nxp.com \
    --cc=bhelgaas@google.com \
    --cc=cassel@kernel.org \
    --cc=conor+dt@kernel.org \
    --cc=den@valinux.co.jp \
    --cc=devicetree@vger.kernel.org \
    --cc=fancer.lancer@gmail.com \
    --cc=geert+renesas@glider.be \
    --cc=jingoohan1@gmail.com \
    --cc=krzk+dt@kernel.org \
    --cc=kwilczynski@kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-pci@vger.kernel.org \
    --cc=linux-renesas-soc@vger.kernel.org \
    --cc=lpieralisi@kernel.org \
    --cc=magnus.damm@gmail.com \
    --cc=mani@kernel.org \
    --cc=p.zabel@pengutronix.de \
    --cc=robh@kernel.org \
    --cc=wilfred.mallawa@wdc.com \
    --cc=yoshihiro.shimoda.uh@renesas.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox

all inboxes | Powered by JetHome®