mirror of https://lore.kernel.org/lkml/
 help / color / mirror / Atom feed
From: Ming Qian <ming.qian@nxp.com>
To: Nicolas Dufresne <nicolas@ndufresne.ca>,
	"mchehab@kernel.org" <mchehab@kernel.org>,
	"hverkuil-cisco@xs4all.nl" <hverkuil-cisco@xs4all.nl>
Cc: "shawnguo@kernel.org" <shawnguo@kernel.org>,
	"robh+dt@kernel.org" <robh+dt@kernel.org>,
	"s.hauer@pengutronix.de" <s.hauer@pengutronix.de>,
	"kernel@pengutronix.de" <kernel@pengutronix.de>,
	"festevam@gmail.com" <festevam@gmail.com>,
	dl-linux-imx <linux-imx@nxp.com>,
	"linux-media@vger.kernel.org" <linux-media@vger.kernel.org>,
	"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
	"linux-arm-kernel@lists.infradead.org" 
	<linux-arm-kernel@lists.infradead.org>
Subject: RE: [EXT] Re: [PATCH] media: amphion: only insert the first sequence startcode for vc1l format
Date: Tue, 5 Jul 2022 11:27:55 +0000	[thread overview]
Message-ID: <AM6PR04MB634136824EC98EE804FAD0CEE7819@AM6PR04MB6341.eurprd04.prod.outlook.com> (raw)
In-Reply-To: <AM6PR04MB6341F4EB028CAE9B61C85157E7819@AM6PR04MB6341.eurprd04.prod.outlook.com>

>>From: Ming Qian
>>Sent: 2022年7月5日 10:00
>>To: Nicolas Dufresne <nicolas@ndufresne.ca>; mchehab@kernel.org;
>>hverkuil-cisco@xs4all.nl
>>Cc: shawnguo@kernel.org; robh+dt@kernel.org; s.hauer@pengutronix.de;
>>kernel@pengutronix.de; festevam@gmail.com; dl-linux-imx
>><linux-imx@nxp.com>; linux-media@vger.kernel.org;
>>linux-kernel@vger.kernel.org; linux-arm-kernel@lists.infradead.org
>>Subject: RE: [EXT] Re: [PATCH] media: amphion: only insert the first sequence
>>startcode for vc1l format
>>
>>> From: Nicolas Dufresne <nicolas@ndufresne.ca>
>>> Sent: 2022年7月5日 0:06
>>> To: Ming Qian <ming.qian@nxp.com>; mchehab@kernel.org;
>>> hverkuil-cisco@xs4all.nl
>>> Cc: shawnguo@kernel.org; robh+dt@kernel.org; s.hauer@pengutronix.de;
>>> kernel@pengutronix.de; festevam@gmail.com; dl-linux-imx
>>> <linux-imx@nxp.com>; linux-media@vger.kernel.org;
>>> linux-kernel@vger.kernel.org; linux-arm-kernel@lists.infradead.org
>>> Subject: [EXT] Re: [PATCH] media: amphion: only insert the first
>>> sequence startcode for vc1l format
>>>
>>> Caution: EXT Email
>>>
>>> Hi Ming,
>>>
>>> Le mardi 28 juin 2022 à 13:20 +0800, Ming Qian a écrit :
>>> > For some formats, the amphion vpu requires startcode before sequence
>>> > and frame, such as vc1, vp8.
>>>
>>> I'm not sure why VP8 is being mentioned here. There is no specified
>>> sartcode for VP8, and no split of headers either.
>>>
>>
>>Hi Nicolas,
>>    This patch has nothing to do with vp8, and indeed there is no specified
>>startcode for VP8.
>>But amphion vpu requires driver to help insert some custom startcode for vp8
>>and vc1.
>>It's custom behavior.
>>
> Instead of exposing the custom format, you should use data_offset like VENUS driver do.  They vp8/9 codec in VENUS have the frame prefixed with an IVF header, the data_offset let the userland skip it.

Hi Nicolas,
    There is a stream buffer, and driver will copy the coded frame data to the stream buffer, driver can decide to insert custom startcode or not, userland won't know about it, so I don't think it's necessary to use data_offset to let userland skip something.
    Currently , driver will insert startcode for format vp8 and vc1. This is transparent to the user.

Ming

>>    I'm sorry that my description include some confusion
>>
>>Ming
>>
>>> >
>>> > But for V4L2_PIX_FMT_VC1_ANNEX_L, only the first sequence startcode
>>> > is needed, the extra startcode will cause decoding error.
>>> > So after seek, we don't need to insert the sequence startcode.
>>> >
>>> > In other words, for V4L2_PIX_FMT_VC1_ANNEX_L, the vpu doesn't
>>> > support dynamic resolution change.
>>> >
>>> > Fixes: 145e936380edb ("media: amphion: implement malone decoder rpc
>>> > interface")
>>> > Signed-off-by: Ming Qian <ming.qian@nxp.com>
>>> > ---
>>> >  drivers/media/platform/amphion/vdec.c       | 1 +
>>> >  drivers/media/platform/amphion/vpu.h        | 1 +
>>> >  drivers/media/platform/amphion/vpu_malone.c | 2 ++
>>> >  drivers/media/platform/amphion/vpu_rpc.h    | 7 ++++++-
>>> >  4 files changed, 10 insertions(+), 1 deletion(-)
>>> >
>>> > diff --git a/drivers/media/platform/amphion/vdec.c
>>> > b/drivers/media/platform/amphion/vdec.c
>>> > index 09d4f27970ec..51218a41a5ac 100644
>>> > --- a/drivers/media/platform/amphion/vdec.c
>>> > +++ b/drivers/media/platform/amphion/vdec.c
>>> > @@ -731,6 +731,7 @@ static void vdec_stop_done(struct vpu_inst *inst)
>>> >       vdec->eos_received = 0;
>>> >       vdec->is_source_changed = false;
>>> >       vdec->source_change = 0;
>>> > +     inst->total_input_count = 0;
>>> >       vpu_inst_unlock(inst);
>>> >  }
>>> >
>>> > diff --git a/drivers/media/platform/amphion/vpu.h
>>> > b/drivers/media/platform/amphion/vpu.h
>>> > index e56b96a7e5d3..f914de6ed81e 100644
>>> > --- a/drivers/media/platform/amphion/vpu.h
>>> > +++ b/drivers/media/platform/amphion/vpu.h
>>> > @@ -258,6 +258,7 @@ struct vpu_inst {
>>> >       struct vpu_format cap_format;
>>> >       u32 min_buffer_cap;
>>> >       u32 min_buffer_out;
>>> > +     u32 total_input_count;
>>> >
>>> >       struct v4l2_rect crop;
>>> >       u32 colorspace;
>>> > diff --git a/drivers/media/platform/amphion/vpu_malone.c
>>> > b/drivers/media/platform/amphion/vpu_malone.c
>>> > index c62b49e85060..f4a488bf9880 100644
>>> > --- a/drivers/media/platform/amphion/vpu_malone.c
>>> > +++ b/drivers/media/platform/amphion/vpu_malone.c
>>> > @@ -1314,6 +1314,8 @@ static int
>>> vpu_malone_insert_scode_vc1_l_seq(struct malone_scode_t *scode)
>>> >       int size = 0;
>>> >       u8 rcv_seqhdr[MALONE_VC1_RCV_SEQ_HEADER_LEN];
>>> >
>>> > +     if (scode->inst->total_input_count)
>>> > +             return 0;
>>> >       scode->need_data = 0;
>>> >
>>> >       ret = vpu_malone_insert_scode_seq(scode,
>>> > MALONE_CODEC_ID_VC1_SIMPLE, sizeof(rcv_seqhdr)); diff --git
>>> > a/drivers/media/platform/amphion/vpu_rpc.h
>>> > b/drivers/media/platform/amphion/vpu_rpc.h
>>> > index 25119e5e807e..7eb6f01e6ab5 100644
>>> > --- a/drivers/media/platform/amphion/vpu_rpc.h
>>> > +++ b/drivers/media/platform/amphion/vpu_rpc.h
>>> > @@ -312,11 +312,16 @@ static inline int vpu_iface_input_frame(struct
>>> vpu_inst *inst,
>>> >                                       struct vb2_buffer *vb)  {
>>> >       struct vpu_iface_ops *ops = vpu_core_get_iface(inst->core);
>>> > +     int ret;
>>> >
>>> >       if (!ops || !ops->input_frame)
>>> >               return -EINVAL;
>>> >
>>> > -     return ops->input_frame(inst->core->iface, inst, vb);
>>> > +     ret = ops->input_frame(inst->core->iface, inst, vb);
>>> > +     if (ret < 0)
>>> > +             return ret;
>>> > +     inst->total_input_count++;
>>> > +     return ret;
>>> >  }
>>> >
>>> >  static inline int vpu_iface_config_memory_resource(struct vpu_inst
>>> > *inst,


  reply	other threads:[~2022-07-05 11:28 UTC|newest]

Thread overview: 11+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2022-06-28  5:20 Ming Qian
2022-06-29 12:10 ` Hans Verkuil
2022-06-29 12:53   ` [EXT] " Ming Qian
2022-06-29 13:03     ` Hans Verkuil
2022-06-29 13:08       ` Ming Qian
2022-07-04 16:05 ` Nicolas Dufresne
2022-07-05  2:00   ` [EXT] " Ming Qian
2022-07-05 11:27     ` Ming Qian [this message]
2022-07-05 12:59       ` Nicolas Dufresne
2022-07-06  4:09         ` Ming Qian
2022-07-08 13:32           ` Nicolas Dufresne

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=AM6PR04MB634136824EC98EE804FAD0CEE7819@AM6PR04MB6341.eurprd04.prod.outlook.com \
    --to=ming.qian@nxp.com \
    --cc=festevam@gmail.com \
    --cc=hverkuil-cisco@xs4all.nl \
    --cc=kernel@pengutronix.de \
    --cc=linux-arm-kernel@lists.infradead.org \
    --cc=linux-imx@nxp.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-media@vger.kernel.org \
    --cc=mchehab@kernel.org \
    --cc=nicolas@ndufresne.ca \
    --cc=robh+dt@kernel.org \
    --cc=s.hauer@pengutronix.de \
    --cc=shawnguo@kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox

all inboxes | Powered by JetHome®