mirror of https://lore.kernel.org/lkml/
 help / color / mirror / Atom feed
From: Herve Codina <herve.codina@bootlin.com>
To: David Gibson <david@gibson.dropbear.id.au>
Cc: Rob Herring <robh@kernel.org>,
	Krzysztof Kozlowski <krzk@kernel.org>,
	Conor Dooley <conor+dt@kernel.org>,
	Laurent Pinchart <laurent.pinchart@ideasonboard.com>,
	David Lechner <dlechner@baylibre.com>,
	Ayush Singh <ayush@beagleboard.org>,
	Geert Uytterhoeven <geert@linux-m68k.org>,
	devicetree-compiler@vger.kernel.org, devicetree@vger.kernel.org,
	linux-kernel@vger.kernel.org, devicetree-spec@vger.kernel.org,
	Hui Pu <hui.pu@gehealthcare.com>,
	Ian Ray <ian.ray@gehealthcare.com>,
	Luca Ceresoli <luca.ceresoli@bootlin.com>,
	Thomas Petazzoni <thomas.petazzoni@bootlin.com>,
	Frank Li <Frank.Li@nxp.com>
Subject: Re: [PATCH v3 09/15] libfdt: Handle unknown tags in fdt_next_tag()
Date: Thu, 17 Sep 2026 10:34:10 +0200	[thread overview]
Message-ID: <20260917103410.1fcfe0f1@bootlin.com> (raw)
In-Reply-To: <aqpc9HZ2T74Q2lYs@gractus.seuss>

Hi David,

On Wed, 16 Sep 2026 19:10:27 +1000
David Gibson <david@gibson.dropbear.id.au> wrote:

> On Wed, Aug 26, 2026 at 10:31:40AM +0200, Herve Codina wrote:
> > The structured tag value definition introduced recently gives the
> > ability to ignore unknown tags without any error when they are read.
> > 
> > libfdt uses fdt_next_tag() to get a tag.
> > 
> > Filtering out tags that should be ignored in fdt_next_tag() allows to
> > have the filtering done globally and allows, in future releases, to have
> > a central place to add new known tags that should not be filtered out.
> > 
> > An already known tag exists with the meaning of "just ignore". This tag
> > is FDT_NOP. fdt_next_tag() callers already handle the FDT_NOP tag.
> > 
> > Avoid unneeded modification at callers side and use a fake FDT_NOP tag
> > when an unknown tag that should be ignored is encountered.
> > 
> > Add also fdt_next_tag_() internal function for callers who need to know
> > if the FDT_NOP tag returned is a real FDT_NOP or a fake FDT_NOP due to
> > an unknown tag.  
> 
> I'm a bit unsure about this one.  If we were designing the libfdt
> interface from scratch, I'd definitely say that fdt_next_tag() - as a
> low level function - should return every tag, and it's up to the
> caller to skip unknown ones.  fdt_next_tag() already provides
> nextoffset making it fairly easy to do so.
> 
> But, of course, we're not building from scratch so we do need to
> consider backwards compatibility.  Supplying a skipping and
> non-skipping version as you have here is the obvious approach.
> 
> But I'm not entirely convinced it's the only or best approach.  A user
> which calls fdt_next_tag() is, in a sense, already opting in to
> low-level handling of the dtb.  They could well already be broken by
> new tags (depending on how they handle the default case).  Arguably
> it's reasonable to require them to be updated (once only) for this new
> family of tags.

I can go in that way. We will have same kind of sequence in almost all
callers.

   do {
      tag = fdt_next_tag()
   } while (!fdt_tag_is_unknown(tag));


We have to care about those "unknown_and_skippable" tags only when
we modify a dtb. This is handled by a few functions.

The vast majority of callers of fdt_next_tag() just want to skip
unknown tags.

> 
> Another potential approach would be to actually use the symbol
> versioning we have, but have som far only minimally exploited.  The
> LIBFDT_1.2 version of fdt_next_tag() would skip tags that postdate it,
> but we'd introduce a new version tag and the new default version of
> fdt_next_tag() would return all tags.  That would of course require
> figuring out how to do that with the verison script.

Hum, I really don't want to have versioning in loop for fdt_next_tag().

Also, this could work in the dynamic lib (.so) case but not for static
link and even less for libfdt code copy compiled in bootloaders or Linux
kernel code.

fdt_next_tag() is a low level function accessible out of libfdt (API).
If it doesn't skip unknown tags even for other libfdt internal function it
will be a too lower function. Ok, we can have a wrapper on top of
fdt_next_tag() to skip unknown tags.

fdt_next_tag() is a low level function but the rule related to skipping
unknown tags is also a low level rule.

We have to choose:
a) fdt_next_tag() as I proposed
   Of course ok for me

b) fdt_next_tag() returns all tags -> Full handling at caller side
   Ok, we can go in that direction but it will bring quite a lot of
   code duplication. I am not fully convinced by this option.

c) lib version
   I disagree on my side

d) Other idea
   Of course, I am still open.

> 
> 
> > Signed-off-by: Herve Codina <herve.codina@bootlin.com>
> > Reviewed-by: Luca Ceresoli <luca.ceresoli@bootlin.com>
> > Reviewed-by: Frank Li <Frank.Li@nxp.com>
> > ---
> >  libfdt/fdt.c             | 75 ++++++++++++++++++++++++++++++++++++++--
> >  libfdt/libfdt_internal.h |  3 ++
> >  tests/run_tests.sh       |  9 +++--
> >  3 files changed, 83 insertions(+), 4 deletions(-)
> > 
> > diff --git a/libfdt/fdt.c b/libfdt/fdt.c
> > index eb803e8a..506e0dd3 100644
> > --- a/libfdt/fdt.c
> > +++ b/libfdt/fdt.c
> > @@ -167,7 +167,7 @@ const void *fdt_offset_ptr(const void *fdt, int offset, unsigned int len)
> >  	return fdt_offset_ptr_(fdt, offset);
> >  }
> >  
> > -uint32_t fdt_next_tag(const void *fdt, int startoffset, int *nextoffset)
> > +static uint32_t fdt_next_tag_all(const void *fdt, int startoffset, int *nextoffset)
> >  {
> >  	const fdt32_t *tagp, *lenp;
> >  	uint32_t tag, len, sum;
> > @@ -218,7 +218,37 @@ uint32_t fdt_next_tag(const void *fdt, int startoffset, int *nextoffset)
> >  		break;
> >  
> >  	default:
> > -		return FDT_END;
> > +		if (!(tag & FDT_TAG_STRUCTURED) || !(tag & FDT_TAG_SKIP_SAFE))
> > +			return FDT_END;
> > +
> > +		switch (tag & FDT_TAG_DATA_MASK) {
> > +		case FDT_TAG_DATA_NONE:
> > +			break;
> > +		case FDT_TAG_DATA_1CELL:
> > +			offset += FDT_CELLSIZE;
> > +			break;
> > +		case FDT_TAG_DATA_2CELLS:
> > +			offset += 2 * FDT_CELLSIZE;
> > +			break;
> > +		case FDT_TAG_DATA_VARLEN:
> > +			/* Get the length */
> > +			lenp = fdt_offset_ptr(fdt, offset, sizeof(*lenp));
> > +			if (!can_assume(VALID_DTB) && !lenp)
> > +				return FDT_END; /* premature end */
> > +			len = fdt32_to_cpu(*lenp);
> > +			/*
> > +			 * Skip the cell encoding the length and the
> > +			 * following length bytes
> > +			 */
> > +			len += sizeof(*lenp);
> > +			sum = len + offset;
> > +			if (!can_assume(VALID_DTB) &&
> > +			    (sum >= INT_MAX || sum < (uint32_t) offset))
> > +				return FDT_END; /* premature end */
> > +
> > +			offset += len;
> > +			break;
> > +		}
> >  	}
> >  
> >  	if (!fdt_offset_ptr(fdt, startoffset, offset - startoffset))
> > @@ -228,6 +258,47 @@ uint32_t fdt_next_tag(const void *fdt, int startoffset, int *nextoffset)
> >  	return tag;
> >  }
> >  
> > +static bool fdt_tag_is_unknown(uint32_t tag)  
> 
> Regardless of what approach we decide to take, "unknown" is a
> misleading term here.  As we add support for new metadata tags to
> libfdt, they will no longer be unknown to libfdt.  But what matters

Yes, metadata tags once supported in libfdt will not be considered as "unknown"
tags.

An unknow tag is a tag libfdt don't know about except:
- weither it can be skip or not,
- the data length related to this tag.
- Is relation ship with other objects:
   - Global to the whole dtb if found out of any nodes
   - Related to a node if found right after FDT_BEGIN_NODE
   - Related to a poperty if found right after FDT_PROP

> for the interface compatibility is whether they're unknown to the
> caller, which we can't know.  So really this is checking for

If a caller need to handle this unknown tag, it has to use a libfdt which
support this tag.

> structured tags specifically.
> 
> > +{
> > +	switch (tag) {
> > +	case FDT_BEGIN_NODE:
> > +	case FDT_END_NODE:
> > +	case FDT_PROP:
> > +	case FDT_NOP:
> > +	case FDT_END:

This list will grow as soon as new tags are defined and supported in libfdt.

See all tags added by the addon series:
https://github.com/bootlin/dtc/blob/c68038e0ff4cde5de37a21419df8a082032ef994/libfdt/fdt.c#L435

> > +		return false;
> > +	default:
> > +		break;
> > +	}
> > +	return true;
> > +}
> > +
> > +uint32_t fdt_next_tag_(const void *fdt, int startoffset, int *nextoffset, bool *is_unknown)  
> 
> 
> Nothing in this patch uses the is_unknown parameter.  Presumably
> something later does, but it's not clear to me what it's useful for.

Yes later in [PATCH v3 14/15] libfdt: Handle unknown tags on dtb modifications
In this patch, libfdt/fdt_rw.c, fdt_prop_remove_unknown_tags().
Code also in git repo [0].

[0] https://github.com/bootlin/dtc/blob/2653bb9cd4414780c863051467b5e77eea6e5bdd/libfdt/fdt_rw.c#L211

Best regards,
Hervé

  reply	other threads:[~2026-09-17  8:34 UTC|newest]

Thread overview: 63+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-08-26  8:31 [PATCH v3 00/15] Add support for structured tags and v18 dtb version Herve Codina
2026-08-26  8:31 ` [PATCH v3 01/15] fdtget: Use libfdt iterators instead of open coded loops Herve Codina
2026-08-27  3:55   ` David Gibson
2026-08-26  8:31 ` [PATCH v3 02/15] libfdt: Don't assume the root node is available at offset 0 Herve Codina
2026-08-30  3:21   ` David Gibson
2026-08-31 12:01     ` Herve Codina
2026-09-01  7:42       ` David Gibson
2026-09-01 12:18         ` Herve Codina
2026-09-02  7:06           ` David Gibson
2026-09-07 16:46             ` Herve Codina
2026-09-08  6:41               ` David Gibson
2026-09-08  8:08                 ` Herve Codina
2026-09-09  6:18                   ` David Gibson
2026-09-09  6:58                     ` Herve Codina
2026-09-09  7:02                       ` David Gibson
2026-08-26  8:31 ` [PATCH v3 03/15] tests: " Herve Codina
2026-09-01  8:03   ` David Gibson
2026-09-01 13:36     ` Herve Codina
2026-09-02  8:56       ` David Gibson
2026-08-26  8:31 ` [PATCH v3 04/15] tests/nopulate: Add a FDT_NOP before the root node Herve Codina
2026-09-01  8:05   ` David Gibson
2026-08-26  8:31 ` [PATCH v3 05/15] tests: treegen: Introduce emit_fdt_header_vers() Herve Codina
2026-09-09  6:38   ` David Gibson
2026-08-26  8:31 ` [PATCH v3 06/15] Introduce structured tag value definition Herve Codina
2026-09-10  4:51   ` David Gibson
2026-09-10  7:41     ` Herve Codina
2026-09-10  9:32       ` David Gibson
2026-09-11  7:16         ` Herve Codina
2026-09-12  2:34           ` David Gibson
2026-09-14 10:19             ` Herve Codina
2026-09-16  5:21               ` David Gibson
2026-09-17  7:04                 ` Herve Codina
2026-09-10  5:33   ` David Gibson
2026-09-10  7:58     ` Herve Codina
2026-09-10  9:41       ` David Gibson
2026-09-11  7:53         ` Herve Codina
2026-09-12  2:35           ` David Gibson
2026-09-17  8:56             ` Herve Codina
2026-08-26  8:31 ` [PATCH v3 07/15] fdtdump: Handle unknown tags Herve Codina
2026-09-10  5:25   ` David Gibson
2026-08-26  8:31 ` [PATCH v3 08/15] flattree: " Herve Codina
2026-09-14  8:23   ` David Gibson
2026-09-15 10:16     ` Herve Codina
2026-09-15 11:52       ` David Gibson
2026-09-16  6:31         ` Herve Codina
2026-09-16  8:27           ` David Gibson
2026-09-17  7:11             ` Herve Codina
2026-08-26  8:31 ` [PATCH v3 09/15] libfdt: Handle unknown tags in fdt_next_tag() Herve Codina
2026-09-16  9:10   ` David Gibson
2026-09-17  8:34     ` Herve Codina [this message]
2026-09-17  9:36       ` David Gibson
2026-08-26  8:31 ` [PATCH v3 10/15] libfdt: Introduce fdt_ptr_offset_() Herve Codina
2026-08-26  8:31 ` [PATCH v3 11/15] libfdt: Introduce fdt_getprop_by_offset_w() Herve Codina
2026-09-16  9:56   ` David Gibson
2026-09-16 10:42     ` Herve Codina
2026-09-17  4:52       ` David Gibson
2026-09-17  8:43         ` Herve Codina
2026-08-26  8:31 ` [PATCH v3 12/15] libfdt: Introduce fdt_getprop_offset_namelen() Herve Codina
2026-08-26  8:31 ` [PATCH v3 13/15] tests: Add wip_func utility Herve Codina
2026-09-16 10:00   ` David Gibson
2026-09-16 17:27     ` Herve Codina
2026-08-26  8:31 ` [PATCH v3 14/15] libfdt: Handle unknown tags on dtb modifications Herve Codina
2026-08-26  8:31 ` [PATCH v3 15/15] Introduce v18 dtb version Herve Codina

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20260917103410.1fcfe0f1@bootlin.com \
    --to=herve.codina@bootlin.com \
    --cc=Frank.Li@nxp.com \
    --cc=ayush@beagleboard.org \
    --cc=conor+dt@kernel.org \
    --cc=david@gibson.dropbear.id.au \
    --cc=devicetree-compiler@vger.kernel.org \
    --cc=devicetree-spec@vger.kernel.org \
    --cc=devicetree@vger.kernel.org \
    --cc=dlechner@baylibre.com \
    --cc=geert@linux-m68k.org \
    --cc=hui.pu@gehealthcare.com \
    --cc=ian.ray@gehealthcare.com \
    --cc=krzk@kernel.org \
    --cc=laurent.pinchart@ideasonboard.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=luca.ceresoli@bootlin.com \
    --cc=robh@kernel.org \
    --cc=thomas.petazzoni@bootlin.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox

all inboxes | Powered by JetHome®