From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 0435C3242AB; Tue, 3 Feb 2026 08:52:19 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1770108740; cv=none; b=Ze/W5oKDxj5AhoSGmbeN41gii227BkOM1y+0xeO1LEuGYc5PlSQSA9u/y6dduX5eYRTfDgEtyg/ps6vSNdpLGymNISsa1H6tlOwWnRu70mQwqEDho+fwTDu75ApABUk2hcnyYpWUl/Si5rFjCCKJsbDKaX1SMV6SnWN8R9HtuC0= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1770108740; c=relaxed/simple; bh=ArkmdIZwMtxV439h7DDoSsMbzFo3medF34IPcR0b4X8=; h=Date:From:To:Cc:Subject:Message-ID:References:MIME-Version: Content-Type:Content-Disposition:In-Reply-To; b=Lgtzk37Z3K9YbSESCjrSqLwuyry7P0qQVzP0HgQEqgQ5dkTi4TKJtEtKSgaJxHGsD0IHj/jYPT3ZFZLa4hILgCs9ZS7PBXCAbIMA9Rp4nKLlP8oRJYweB3YYLdoXmag8MRQ1dQ0cAS9kX74FpBdeUELXws2aW6PfoLMDoCjlTgE= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=dgpHZzna; arc=none smtp.client-ip=10.30.226.201 Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="dgpHZzna" Received: by smtp.kernel.org (Postfix) with ESMTPSA id 24ED9C116D0; Tue, 3 Feb 2026 08:52:18 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1770108739; bh=ArkmdIZwMtxV439h7DDoSsMbzFo3medF34IPcR0b4X8=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=dgpHZznajfvupYyJSuJyq1T5H4OI4S9OWfQM5v93TjooP/5L1wWlTQtVznjWTJdWB q3H6cV3knIN09IhjcnNra+oWEUBo+1gHdF3upvzn5+DAM2FZn5Dx5azIXnGzq9R0uO rOiY82M2Zjeuh6KkLB91VozCCmalvsyHfe7UiweEegfdeJdHhjuUjWsBTjKyAst1xS MplPK+9IPcXrifL1v1HZD60tfh6J1Mi9ez/64cEQMwOmQQ8yUxC58Ai9pKqCWN8xkk KHpylOqGmHJlFtkzkoVNIweIfPrMqG0rGzVBrcVMt3lH2ew9hpd4CIskvtmPGyM8To xWsPmbwUmg3kA== Date: Tue, 3 Feb 2026 09:52:16 +0100 From: Maxime Ripard To: Laurent Pinchart Cc: Mauro Carvalho Chehab , Mats Randgaard , Alain Volmat , Sakari Ailus , Hans Verkuil , linux-media@vger.kernel.org, linux-kernel@vger.kernel.org, Hans Verkuil , Dave Stevenson Subject: Re: [PATCH v4 2/4] media: uapi: Introduce MEDIA_BUS_FMT_BGR565_1X16 Message-ID: <20260203-bald-meek-crayfish-fdaafc@houat> References: <20251013-csi-bgr-rgb-v4-0-55eab2caa69f@kernel.org> <20251013-csi-bgr-rgb-v4-2-55eab2caa69f@kernel.org> <20251026231553.GB9719@pendragon.ideasonboard.com> <20251026233308.GC9719@pendragon.ideasonboard.com> <20251208-powerful-penguin-of-reputation-ffdc5c@houat> <20260123153432.GA415966@killaraus> <20260128-neon-lyrical-pheasant-6cbdf2@houat> <20260128131903.GC3210848@killaraus> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha384; protocol="application/pgp-signature"; boundary="6hpfkoqwcvgpoxxg" Content-Disposition: inline In-Reply-To: <20260128131903.GC3210848@killaraus> --6hpfkoqwcvgpoxxg Content-Type: text/plain; protected-headers=v1; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Subject: Re: [PATCH v4 2/4] media: uapi: Introduce MEDIA_BUS_FMT_BGR565_1X16 MIME-Version: 1.0 On Wed, Jan 28, 2026 at 03:19:03PM +0200, Laurent Pinchart wrote: > On Wed, Jan 28, 2026 at 01:32:15PM +0100, Maxime Ripard wrote: > > On Fri, Jan 23, 2026 at 05:34:32PM +0200, Laurent Pinchart wrote: > > > On Mon, Dec 08, 2025 at 04:32:33PM +0100, Maxime Ripard wrote: > > > > On Mon, Oct 27, 2025 at 01:33:08AM +0200, Laurent Pinchart wrote: > > > > > On Mon, Oct 27, 2025 at 01:15:54AM +0200, Laurent Pinchart wrote: > > > > > > On Mon, Oct 13, 2025 at 01:01:34PM +0200, Maxime Ripard wrote: > > > > > > > MIPI-CSI2 sends its RGB format on the wire with the blue comp= onent > > > > > > > first, then green, then red. MIPI calls that format "RGB", bu= t by v4l2 > > > > > > > conventions it would be BGR. > > > > > > >=20 > > > > > > > MIPI-CSI2 supports three RGB variants: 444, 555, 565, 666 and= 888. > > > > > > >=20 > > > > > > > We already have BGR666 and BGR888 media bus formats, we don't= have any > > > > > > > CSI transceivers using the 444 and 555 variants, but some tra= nsceivers > > > > > > > use the CSI RGB565 format, while using the RGB565 media bus c= ode. > > > > > > >=20 > > > > > > > That's a mistake, but since we don't have a BGR565 media bus = code we > > > > > > > need to introduce one before fixing it. > > > > > > >=20 > > > > > > > Signed-off-by: Maxime Ripard > > > > > > > --- > > > > > > > .../userspace-api/media/v4l/subdev-formats.rst | 37 ++++= ++++++++++++++++++ > > > > > > > include/uapi/linux/media-bus-format.h | 3 +- > > > > > > > 2 files changed, 39 insertions(+), 1 deletion(-) > > > > > > >=20 > > > > > > > diff --git a/Documentation/userspace-api/media/v4l/subdev-for= mats.rst b/Documentation/userspace-api/media/v4l/subdev-formats.rst > > > > > > > index 8e92f784abd8123f9ea950f954a60af56ee76dbe..def0d24ef6cdb= 1a2ec9395af1468f56adf31a8de 100644 > > > > > > > --- a/Documentation/userspace-api/media/v4l/subdev-formats.rst > > > > > > > +++ b/Documentation/userspace-api/media/v4l/subdev-formats.rst > > > > > > > @@ -625,10 +625,47 @@ The following tables list existing pack= ed RGB formats. > > > > > > > - b\ :sub:`4` > > > > > > > - b\ :sub:`3` > > > > > > > - b\ :sub:`2` > > > > > > > - b\ :sub:`1` > > > > > > > - b\ :sub:`0` > > > > > > > + * .. _MEDIA-BUS-FMT-BGR565-1X16: > > > > > > > + > > > > > > > + - MEDIA_BUS_FMT_BGR565_1X16 > > > > > > > + - 0x1028 > > > > > > > + - > > > > > > > + - > > > > > > > + - > > > > > > > + - > > > > > > > + - > > > > > > > + - > > > > > > > + - > > > > > > > + - > > > > > > > + - > > > > > > > + - > > > > > > > + - > > > > > > > + - > > > > > > > + - > > > > > > > + - > > > > > > > + - > > > > > > > + - > > > > > > > + - > > > > > > > + - b\ :sub:`4` > > > > > > > + - b\ :sub:`3` > > > > > > > + - b\ :sub:`2` > > > > > > > + - b\ :sub:`1` > > > > > > > + - b\ :sub:`0` > > > > > > > + - g\ :sub:`5` > > > > > > > + - g\ :sub:`4` > > > > > > > + - g\ :sub:`3` > > > > > > > + - g\ :sub:`2` > > > > > > > + - g\ :sub:`1` > > > > > > > + - g\ :sub:`0` > > > > > > > + - r\ :sub:`4` > > > > > > > + - r\ :sub:`3` > > > > > > > + - r\ :sub:`2` > > > > > > > + - r\ :sub:`1` > > > > > > > + - r\ :sub:`0` > > > > > >=20 > > > > > > We're definitely in convention territory, because this is not h= ow 16-bit > > > > > > RGB data is transmitted over CSI-2. CSI-2 transmits blue first,= but > > > > > > starts with bit 0, not bit 4. > > > > > >=20 > > > > > > Have you explored the alternative of picking the parallel bus c= ode that > > > > > > matches the serial order when transmitted with the least signif= icant bit > > > > > > first ? That would be MEDIA_BUS_FMT_RGB565_1X16 here, and > > > > > > MEDIA_BUS_FMT_RGB888_1X24 for 24-bit RGB. > > > > >=20 > > > > > To be clear, media bus codes are a matter of conventions. Some > > > > > conventions would be easier to explain that others, and can also = be more > > > > > consistent with pixel format namings, but at the end of the day t= hey're > > > > > all conventions. While saying "pick the media bus code that trans= mits a > > > > > pixel in one clock sample, with the bit order matching LSB-first > > > > > transmission" could be the simplest to document, there will be a > > > > > mismatch in component orders between the media bus code and the p= ixel > > > > > format in some cases. There may also be more drivers implementing= other > > > > > conventions, making the transition more difficult. > > > > >=20 > > > > > I'll be very busy the upcoming week and will likely not be able to > > > > > participate in this discussion in the near future. > > > >=20 > > > > For the record, we've discussed it on IRC recently. > > > >=20 > > > > The suggestion to have all CSI Data Formats as MEDIA_BUS_FMT_RGB*_1= X* > > > > variants make sense to me. And we can easily document it, because we > > > > could match the first bit transmitted with the least significant bit > > > > of a media bus code indeed. > > >=20 > > > That's one of the things I like about it, it's consistent and easy to > > > document. Glad we agree :-) > > >=20 > > > > Thus a sensor using RGB888 would register MEDIA_BUS_FMT_RGB888_1X24. > > > > That's indeed the case right now with tc358743: > > > > https://elixir.bootlin.com/linux/v6.18/source/drivers/media/i2c/tc3= 58743.c#L1775 > > > >=20 > > > > Unicam however hardcodes (and validates) that the v4l2 format codes > > > > matches the media bus code of the other end: > > > >=20 > > > > https://elixir.bootlin.com/linux/v6.18/source/drivers/media/platfor= m/broadcom/bcm2835-unicam.c#L1333 > > > >=20 > > > > That alone makes total sense, but it has an association between > > > > V4l2_PIX_FMT_RGB24 and MEDIA_BUS_FMT_RGB888_1X24, and between > > > > V4L2_PIX_FMT_BGR24 and MEDIA_BUS_FMT_BGR888_1X24 > > > >=20 > > > > https://elixir.bootlin.com/linux/v6.18/source/drivers/media/platfor= m/broadcom/bcm2835-unicam.c#L343 > > > >=20 > > > > Using the convention you suggested, this association is wrong, and > > > > V4L2_PIX_FMT_BGR24 should be associated MEDIA_BUS_FMT_RGB888_1X24. = Thus, > > > > the red and blue color components are mixed up. > > >=20 > > > Correct. > > >=20 > > > > I initially tried to fix it in my v1 by removing the RGB24 support > > > > https://lore.kernel.org/all/20250606-rpi-unicam-rgb-bgr-fix-v1-1-99= 30b963f3eb@kernel.org/ > > > >=20 > > > > This was shot down (rightfully) because it would still be broken. > > > >=20 > > > > The second version changed the media bus tc358743 reported: > > > > https://lore.kernel.org/all/20250612-csi-bgr-rgb-v1-0-dc8a309118f8@= kernel.org/ > > > >=20 > > > > Dave was against it because it would potentially break userspace, c= iting > > > > Linus that we shouldn't break userspace ever. I understand and some= what > > > > agree with his point, but having two drivers reporting the same data > > > > format but with a different meaning is also a way of breaking users= pace. > > >=20 > > > Yes, I would find that pretty bad, possibly even worse. > > >=20 > > > > Anyway. It was then suggested to support both in the tc358743. That= 's > > > > what the second, third and fourth that you commented on worked towa= rds. > > > >=20 > > > > https://lore.kernel.org/all/20250911-csi-bgr-rgb-v2-0-e6c6b10c1040@= kernel.org/ > > > > https://lore.kernel.org/all/20250917-csi-bgr-rgb-v3-0-0145571b3aa4@= kernel.org/ > > > > https://lore.kernel.org/all/20251013-csi-bgr-rgb-v4-0-55eab2caa69f@= kernel.org/ > > > >=20 > > > > In order to implement your suggestion, I wouldn't to modify tc35874= 3, > > > > but would need to modify the association between the v4l2 format and > > > > media bus code that unicam has. In a way, it's very similar to my f= irst > > > > version that got shot down, and suffers from the same flaws: we cou= ld > > > > have a userspace application out there hardcoding formats and codes= that > > > > will get an error. > > > >=20 > > > > So I'm not sure your suggestion really works, unless we reevaluate = what > > > > we mean by breaking userspace. Either way, I don't care, I just wan= t to > > > > get pixels in the expected (and documented!) order when using unica= m. > > >=20 > > > I've lost track of the status of this series and what your current > > > suggestion is. Can we standardize on > > >=20 > > > - Using MEDIA_BUS_FMT_RGB* > >=20 > > I guess we can do that. > >=20 > > > - Produce V4L2_PIX_FMT_BGR24 from MEDIA_BUS_FMT_RGB888_1X24 in unicam > >=20 > > You called "pretty bad, possibly even worse" to do the exact opposite > > (ie, change the bridge media bus to match unicam) because it would break > > userspace. Changing the unicam media bus to match the bridge creates the > > exact same situation. > >=20 > > The alternative would still be to report both for the bridge, and invert > > the current assocation for the v4l2 formats and mbus codes. > >=20 > > > - Possibly implement backward compatibility somewhere (where ?) to av= oid > > > regressions, but with a big warning > >=20 > > What would you improve there exactly? It's very clearly in the patches > > already, so unless you have some specific comments I'm not really sure > > what you want me to do. >=20 > If we standardize on MEDIA_BUS_FMT_RGB*, then the issue is in the unicam > driver, not in the tc358743 driver. Is it possible to implement the > backward compatibility (with a warning) in unicam instead of tc358743 ? I don't think we can, because the media bus code is exposed on the links, and we would change the media bus code we require on that link. Maxime --6hpfkoqwcvgpoxxg Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iJUEABMJAB0WIQTkHFbLp4ejekA/qfgnX84Zoj2+dgUCaYG3PAAKCRAnX84Zoj2+ dkocAYCiLb+3DDKC+w6Fj32TWZ4K3a1c45H2QJs/fsCIEkGm1r/3px/Ioh/CNzTz tgzxaykBf08UYQStbV/3k1AoD4lNJ3l6Ld2owO4SMonjxhCnthHCox/LV5B827BJ z4lPCjxqHQ== =krRI -----END PGP SIGNATURE----- --6hpfkoqwcvgpoxxg--