mirror of https://lore.kernel.org/lkml/
 help / color / mirror / Atom feed
From: "Kyrie Wu (吴晗)" <Kyrie.Wu@mediatek.com>
To: "robh@kernel.org" <robh@kernel.org>,
	"linux-media@vger.kernel.org" <linux-media@vger.kernel.org>,
	"nicolas.dufresne@collabora.com" <nicolas.dufresne@collabora.com>,
	"AngeloGioacchino Del Regno"
	<angelogioacchino.delregno@collabora.com>,
	"Bin Liu (刘彬)" <bin.liu@mediatek.com>,
	"linux-mediatek@lists.infradead.org"
	<linux-mediatek@lists.infradead.org>,
	"Irui Wang (王瑞)" <Irui.Wang@mediatek.com>,
	"hverkuil@kernel.org" <hverkuil@kernel.org>,
	"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
	"conor+dt@kernel.org" <conor+dt@kernel.org>,
	"devicetree@vger.kernel.org" <devicetree@vger.kernel.org>,
	"krzk+dt@kernel.org" <krzk+dt@kernel.org>,
	"Kyrie Wu (吴晗)" <Kyrie.Wu@mediatek.com>,
	"mchehab@kernel.org" <mchehab@kernel.org>,
	"linux-arm-kernel@lists.infradead.org"
	<linux-arm-kernel@lists.infradead.org>,
	"matthias.bgg@gmail.com" <matthias.bgg@gmail.com>,
	"kyrie.wu@mediatek.corp-partner.google.com"
	<kyrie.wu@mediatek.corp-partner.google.com>
Subject: Re: [PATCH v17 05/12] media: mediatek: jpeg: Fix multi-core clk suspend and resume setting
Date: Sat, 10 Oct 2026 06:27:49 +0000	[thread overview]
Message-ID: <7bd7a5c8592d37a1aba98e93c44d0d3d011ea3e8.camel@mediatek.com> (raw)
In-Reply-To: <8df54405-811e-47ac-94a2-7cf0873c066a@collabora.com>

On Tue, 2026-09-22 at 13:39 +0200, AngeloGioacchino Del Regno wrote:
> On 9/22/26 11:15, Kyrie Wu wrote:
> > The suspend/resume callback function is defined in the dev_pm_ops
> > structure, which is defined in platform_driver. For multiple-core
> > architecture, each hardware driver will register a platform_driver
> > structure, so it is necessary to add a suspend/resume callback
> > function for each hardware to support this operation.
> > 
> > Fixes: 934e8bccac95 ("mtk-jpegenc: support jpegenc multi-hardware")
> > Fixes: 0fa49df4222f ("media: mtk-jpegdec: support jpegdec multi-
> > hardware")
> > Signed-off-by: Kyrie Wu <kyrie.wu@mediatek.com>
> > ---
> >   .../platform/mediatek/jpeg/mtk_jpeg_core.c    | 28 +++-------
> >   .../platform/mediatek/jpeg/mtk_jpeg_dec_hw.c  | 55
> > +++++++++++++++++--
> >   .../platform/mediatek/jpeg/mtk_jpeg_enc_hw.c  | 53
> > ++++++++++++++++--
> >   3 files changed, 107 insertions(+), 29 deletions(-)
> > 
> 
> ..snip..
> 
> > @@ -673,11 +669,58 @@ static int mtk_jpegdec_hw_probe(struct
> > platform_device *pdev)
> >   	return 0;
> >   }
> >   
> > +static int mtk_jpegdec_pm_suspend(struct device *dev)
> > +{
> > +	struct mtk_jpegdec_comp_dev *jpeg = dev_get_drvdata(dev);
> > +
> > +	clk_bulk_disable_unprepare(jpeg->jdec_clk.clk_num,
> > +				   jpeg->jdec_clk.clks);
> > +
> > +	return 0;
> > +}
> > +
> > +static int mtk_jpegdec_pm_resume(struct device *dev)
> > +{
> > +	struct mtk_jpegdec_comp_dev *jpeg = dev_get_drvdata(dev);
> > +
> > +	return clk_bulk_prepare_enable(jpeg->jdec_clk.clk_num,
> > +				       jpeg->jdec_clk.clks);
> > +}
> > +
> > +static int mtk_jpegdec_suspend(struct device *dev)
> > +{
> > +	struct mtk_jpegdec_comp_dev *jpeg = dev_get_drvdata(dev);
> > +
> > +	v4l2_m2m_suspend(jpeg->master_dev->m2m_dev);
> > +
> > +	return pm_runtime_force_suspend(dev);
> 
> Uhm, are you validating that the JPEG decoder IP is actually idle, or
> that
> the job actually stopped, before forcing clk-off suspend?
> 
> I don't see that done anywhere... am I missing anything?
> 
> Also, can't we unify single and multicore suspend strategies?
> That'd be nice for maintainability.
> 
> Cheers,
> Angelo
> 
Dear Angelo,

The suspend/resume callbacks added here are for the multi-hw component
devices.
Each JPEG core is a separate platform device and owns its clocks, while
the single-hw callbacks remain on the master device.
For that reason, I think keeping these callbacks in the component
drivers is clearer.

For system suspend, v4l2_m2m_suspend() stops new jobs and waits for the
running job to
finish before pm_runtime_force_suspend() can disable the component
clocks. For runtime PM,
each active job holds a runtime-PM reference until the IRQ or timeout
path marks the hardware idle and drops the reference.
So the clocks are not disabled while a job is running.

I’ll clarify this ordering in the next revision.

Reagrds,
Kyrie

> > +}
> > +
> > +static int mtk_jpegdec_resume(struct device *dev)
> > +{
> > +	struct mtk_jpegdec_comp_dev *jpeg = dev_get_drvdata(dev);
> > +	int ret;
> > +
> > +	ret = pm_runtime_force_resume(dev);
> > +	if (ret < 0)
> > +		return ret;
> > +
> > +	v4l2_m2m_resume(jpeg->master_dev->m2m_dev);
> > +
> > +	return 0;
> > +}
> > +
> > +static const struct dev_pm_ops mtk_jpegdec_pm_ops = {
> > +	SYSTEM_SLEEP_PM_OPS(mtk_jpegdec_suspend,
> > mtk_jpegdec_resume)
> > +	RUNTIME_PM_OPS(mtk_jpegdec_pm_suspend,
> > mtk_jpegdec_pm_resume, NULL)
> > +};
> > +
> >   static struct platform_driver mtk_jpegdec_hw_driver = {
> >   	.probe = mtk_jpegdec_hw_probe,
> >   	.driver = {
> >   		.name = "mtk-jpegdec-hw",
> >   		.of_match_table = mtk_jpegdec_hw_ids,
> > +		.pm             = &mtk_jpegdec_pm_ops,
> >   	},
> >   };
> >   
> > diff --git a/drivers/media/platform/mediatek/jpeg/mtk_jpeg_enc_hw.c
> > b/drivers/media/platform/mediatek/jpeg/mtk_jpeg_enc_hw.c
> > index 44a064dc7..4a8559c35 100644
> > --- a/drivers/media/platform/mediatek/jpeg/mtk_jpeg_enc_hw.c
> > +++ b/drivers/media/platform/mediatek/jpeg/mtk_jpeg_enc_hw.c
> > @@ -263,13 +263,12 @@ static void mtk_jpegenc_timeout_work(struct
> > work_struct *work)
> >   	v4l2_m2m_buf_copy_metadata(src_buf, dst_buf);
> >   
> >   	mtk_jpeg_enc_reset(cjpeg->reg_base);
> > -	clk_disable_unprepare(cjpeg->venc_clk.clks->clk);
> > -	pm_runtime_put(cjpeg->dev);
> >   	cjpeg->hw_state = MTK_JPEG_HW_IDLE;
> >   	atomic_inc(&master_jpeg->hw_rdy);
> >   	wake_up(&master_jpeg->hw_wq);
> >   	v4l2_m2m_buf_done(src_buf, buf_state);
> >   	mtk_jpegenc_put_buf(cjpeg);
> > +	pm_runtime_put(cjpeg->dev);
> >   }
> >   
> >   static irqreturn_t mtk_jpegenc_hw_irq_handler(int irq, void
> > *priv)
> > @@ -303,12 +302,11 @@ static irqreturn_t
> > mtk_jpegenc_hw_irq_handler(int irq, void *priv)
> >   	buf_state = VB2_BUF_STATE_DONE;
> >   	v4l2_m2m_buf_done(src_buf, buf_state);
> >   	mtk_jpegenc_put_buf(jpeg);
> > -	pm_runtime_put(ctx->jpeg->dev);
> > -	clk_disable_unprepare(jpeg->venc_clk.clks->clk);
> >   
> >   	jpeg->hw_state = MTK_JPEG_HW_IDLE;
> >   	wake_up(&master_jpeg->hw_wq);
> >   	atomic_inc(&master_jpeg->hw_rdy);
> > +	pm_runtime_put(jpeg->dev);
> >   
> >   	return IRQ_HANDLED;
> >   }
> > @@ -394,11 +392,58 @@ static int mtk_jpegenc_hw_probe(struct
> > platform_device *pdev)
> >   	return 0;
> >   }
> >   
> > +static int mtk_jpegenc_pm_suspend(struct device *dev)
> > +{
> > +	struct mtk_jpegenc_comp_dev *jpeg = dev_get_drvdata(dev);
> > +
> > +	clk_bulk_disable_unprepare(jpeg->venc_clk.clk_num,
> > +				   jpeg->venc_clk.clks);
> > +
> > +	return 0;
> > +}
> > +
> > +static int mtk_jpegenc_pm_resume(struct device *dev)
> > +{
> > +	struct mtk_jpegenc_comp_dev *jpeg = dev_get_drvdata(dev);
> > +
> > +	return clk_bulk_prepare_enable(jpeg->venc_clk.clk_num,
> > +				       jpeg->venc_clk.clks);
> > +}
> > +
> > +static int mtk_jpegenc_suspend(struct device *dev)
> > +{
> > +	struct mtk_jpegenc_comp_dev *jpeg = dev_get_drvdata(dev);
> > +
> > +	v4l2_m2m_suspend(jpeg->master_dev->m2m_dev);
> > +
> > +	return pm_runtime_force_suspend(dev);
> > +}
> > +
> > +static int mtk_jpegenc_resume(struct device *dev)
> > +{
> > +	struct mtk_jpegenc_comp_dev *jpeg = dev_get_drvdata(dev);
> > +	int ret;
> > +
> > +	ret = pm_runtime_force_resume(dev);
> > +	if (ret < 0)
> > +		return ret;
> > +
> > +	v4l2_m2m_resume(jpeg->master_dev->m2m_dev);
> > +
> > +	return 0;
> > +}
> > +
> > +static const struct dev_pm_ops mtk_jpegenc_pm_ops = {
> > +	SYSTEM_SLEEP_PM_OPS(mtk_jpegenc_suspend,
> > mtk_jpegenc_resume)
> > +	RUNTIME_PM_OPS(mtk_jpegenc_pm_suspend,
> > mtk_jpegenc_pm_resume, NULL)
> > +};
> > +
> >   static struct platform_driver mtk_jpegenc_hw_driver = {
> >   	.probe = mtk_jpegenc_hw_probe,
> >   	.driver = {
> >   		.name = "mtk-jpegenc-hw",
> >   		.of_match_table = mtk_jpegenc_drv_ids,
> > +		.pm = &mtk_jpegenc_pm_ops,
> >   	},
> >   };
> >   


  reply	other threads:[~2026-10-10  6:28 UTC|newest]

Thread overview: 26+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-09-22  9:15 [PATCH v17 00/12] Enable jpeg enc & dec multi-hardwares for MT8196 Kyrie Wu
2026-09-22  9:15 ` [PATCH v17 01/12] media: mediatek: jpeg: fix jpeg cores' amounts setting Kyrie Wu
2026-09-22  9:15 ` [PATCH v17 02/12] media: mediatek: jpeg: fix jpeg buffer payload size setting Kyrie Wu
2026-09-22 11:40   ` AngeloGioacchino Del Regno
2026-09-22  9:15 ` [PATCH v17 03/12] media: mediatek: jpeg: fix buffer structure size and layout Kyrie Wu
2026-09-22 11:40   ` AngeloGioacchino Del Regno
2026-09-22  9:15 ` [PATCH v17 04/12] media: mediatek: jpeg: Fix buffer completion on multi-core streaming stop Kyrie Wu
2026-09-22 11:40   ` AngeloGioacchino Del Regno
2026-09-22  9:15 ` [PATCH v17 05/12] media: mediatek: jpeg: Fix multi-core clk suspend and resume setting Kyrie Wu
2026-09-22 11:39   ` AngeloGioacchino Del Regno
2026-10-10  6:27     ` Kyrie Wu (吴晗) [this message]
2026-09-22  9:15 ` [PATCH v17 06/12] media: mediatek: jpeg: fix buffer state update timing Kyrie Wu
2026-09-22 11:40   ` AngeloGioacchino Del Regno
2026-09-22  9:15 ` [PATCH v17 07/12] media: mediatek: jpeg: fix resolution change event handling in decoder Kyrie Wu
2026-09-22 11:40   ` AngeloGioacchino Del Regno
2026-09-22  9:15 ` [PATCH v17 08/12] media: mediatek: jpeg: fix remove buffer removal timing for multi-core Kyrie Wu
2026-09-22 11:39   ` AngeloGioacchino Del Regno
2026-09-22  9:15 ` [PATCH v17 09/12] media: dt-bindings: mediatek,jpeg: Add mediatek, mt8196-jpgdec compatible Kyrie Wu
2026-09-22 11:39   ` AngeloGioacchino Del Regno
2026-09-22  9:15 ` [PATCH v17 10/12] media: dt-bindings: mediatek,jpeg: Add mediatek, mt8196-jpgenc compatible Kyrie Wu
2026-09-22 11:39   ` AngeloGioacchino Del Regno
2026-09-22  9:15 ` [PATCH v17 11/12] media: mediatek: jpeg: add jpeg compatible Kyrie Wu
2026-09-22 11:39   ` AngeloGioacchino Del Regno
2026-09-22  9:15 ` [PATCH v17 12/12] media: mediatek: jpeg: add jpeg smmu sid setting Kyrie Wu
2026-09-22 11:39   ` AngeloGioacchino Del Regno
2026-10-10  6:30     ` Kyrie Wu (吴晗)

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=7bd7a5c8592d37a1aba98e93c44d0d3d011ea3e8.camel@mediatek.com \
    --to=kyrie.wu@mediatek.com \
    --cc=Irui.Wang@mediatek.com \
    --cc=angelogioacchino.delregno@collabora.com \
    --cc=bin.liu@mediatek.com \
    --cc=conor+dt@kernel.org \
    --cc=devicetree@vger.kernel.org \
    --cc=hverkuil@kernel.org \
    --cc=krzk+dt@kernel.org \
    --cc=kyrie.wu@mediatek.corp-partner.google.com \
    --cc=linux-arm-kernel@lists.infradead.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-media@vger.kernel.org \
    --cc=linux-mediatek@lists.infradead.org \
    --cc=matthias.bgg@gmail.com \
    --cc=mchehab@kernel.org \
    --cc=nicolas.dufresne@collabora.com \
    --cc=robh@kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox

all inboxes | Powered by JetHome®