mirror of https://lore.kernel.org/lkml/
 help / color / mirror / Atom feed
From: David Gibson <david@gibson.dropbear.id.au>
To: Herve Codina <herve.codina@bootlin.com>
Cc: Rob Herring <robh@kernel.org>,
	Krzysztof Kozlowski <krzk@kernel.org>,
	Conor Dooley <conor+dt@kernel.org>,
	Laurent Pinchart <laurent.pinchart@ideasonboard.com>,
	David Lechner <dlechner@baylibre.com>,
	Ayush Singh <ayush@beagleboard.org>,
	Geert Uytterhoeven <geert@linux-m68k.org>,
	devicetree-compiler@vger.kernel.org, devicetree@vger.kernel.org,
	linux-kernel@vger.kernel.org, devicetree-spec@vger.kernel.org,
	Hui Pu <hui.pu@gehealthcare.com>,
	Ian Ray <ian.ray@gehealthcare.com>,
	Luca Ceresoli <luca.ceresoli@bootlin.com>,
	Thomas Petazzoni <thomas.petazzoni@bootlin.com>
Subject: Re: [RFC PATCH v2 08/74] livetree: Improve get_node_by_phandle()
Date: Mon, 26 Oct 2026 12:33:51 +1100	[thread overview]
Message-ID: <at6t-l9XYYFfS48T@gractus.seuss> (raw)
In-Reply-To: <20261023181533.0c44a57f@bootlin.com>

[-- Attachment #1: Type: text/plain, Size: 8664 bytes --]

On Fri, Oct 23, 2026 at 06:15:33PM +0200, Herve Codina wrote:
> Hi David,
> 
> On Fri, 23 Oct 2026 14:25:29 +1100
> David Gibson <david@gibson.dropbear.id.au> wrote:
> 
> > On Wed, Aug 26, 2026 at 11:48:37AM +0200, Herve Codina wrote:
> > > get_node_by_phandle() allows to get a node based on its phandle value.
> > > It checks the phandle value against value available in internal node
> > > structure.
> > > 
> > > This internal phandle value is updated during process_check() and so,
> > > get_node_by_phandle() cannot give correct results before the
> > > process_check() call.
> > > 
> > > Improve get_node_by_phandle() to look at node phandle properties when
> > > the internal phandle value is not valid.
> > > 
> > > This allows to return a correct matching node even if process_check()
> > > was not called yet.  
> > 
> > The idea is sound - it's always been kind of clunky that we need the
> > process_checks() pass to fill the phandles before we can use them.
> > But, there's at least one significant catch:
> > 
> > [Aside: you might notice the way it's done violates the principle I
> >  stated elsewhere of avoiding structures where you must know where you
> >  are in the flow to know which parts are populated.  My type
> >  discipline has improved since I first wrote this code :)]
> > 
> > We need to gracefully handle the case of malformed phandle /
> > linux,phandle properties; that's actually the reason for the weird
> > placement of this in checks.c.  By treating it as a "check" we handle
> > this case by failing the check.  Other checks that rely on phandles
> > then have the 'explicit_phandles' check as a prereq so they don't need
> > to verify this again.  We can still report errors for other checks
> > that don't rely on that (which is the whole point of the checks
> > mechanism).
> > 
> > That's not the only way to do it, of course, but we need something to
> > check for that error case.  Further notes on the code.
> > 
> > > With the recently introduced FDT_PROPDATA_HANDLE dtb tag, this will be
> > > needed to update internal phandle references before the call to
> > > process_check(). Indeed, this tag allows to identify phandles and
> > > internal references need to be updated based on the phandle value before
> > > the process_check() call.
> > > 
> > > Signed-off-by: Herve Codina <herve.codina@bootlin.com>
> > > ---
> > >  livetree.c | 21 ++++++++++++++++++++-
> > >  1 file changed, 20 insertions(+), 1 deletion(-)
> > > 
> > > diff --git a/livetree.c b/livetree.c
> > > index abe73de1..a9f8c5d2 100644
> > > --- a/livetree.c
> > > +++ b/livetree.c
> > > @@ -628,16 +628,35 @@ struct node *get_node_by_label(struct node *tree, const char *label)
> > >  	return NULL;
> > >  }
> > >  
> > > +static cell_t get_node_phandle_existing(struct node *node)
> > > +{
> > > +	struct property *prop;
> > > +
> > > +	if (phandle_is_valid(node->phandle))
> > > +		return node->phandle;
> > > +
> > > +	prop = get_property(node, "phandle");
> > > +	if (!prop) {
> > > +		prop = get_property(node, "linux,phandle");
> > > +		if (!prop)
> > > +			return 0;
> > > +	}
> > > +
> > > +	return propval_cell(prop);  
> > 
> > In the case of a malformed property, this could SEGV.
> 
> Ok, will update to
> --- 8< ---
> 	if (prop->val.len != sizeof(cell_t))
> 		return 0;
> 
> 	return propval_cell(prop)
> --- 8< ---
> 
> > 
> > > +}
> > > +
> > >  struct node *get_node_by_phandle(struct node *tree, cell_t phandle)
> > >  {
> > >  	struct node *child, *node;
> > > +	cell_t tree_phandle;
> > >  
> > >  	if (!phandle_is_valid(phandle)) {
> > >  		assert(generate_fixups);
> > >  		return NULL;
> > >  	}
> > >  
> > > -	if (tree->phandle == phandle) {
> > > +	tree_phandle = get_node_phandle_existing(tree);  
> > 
> > This means that every time we search for a phandle, for every node
> > scanned before the destination with no phandle, we do a full property
> > scan to check that no, it still doesn't have a phandle.
> > 
> > I don't care that much about dtc performance, but that's still a bit
> > much to swallow.  I think we need to cache negative lookups to avoid
> > that.  Happily, since there are two invalid phandle values this
> > shouldn't be too hard.  We could, say, use tree->phandle == 0 to mean
> > we don't know if there's a phandle, and tree->phandle == -1 to mean
> > we've scanned the properties and we know there isn't one.
> > 
> > In fact, caching property lookups might be the better way to do this.
> > Rather than having an explicit pass where tree->phandle is populated,
> > we could have get_node_by_phandle() cache its property scan (success
> > or failure) in tree->phandle.
> > 
> > I think that's a more elegant approach than the current one, but we do
> > still need to handle the malformed property case.
> 
> Well, get_node_phandle_existing() can be improved:
> ---- 8< ----
> static cell_t get_node_phandle_existing(struct node *node)
> {
> 	cell_t phandle1, phandle2;
> 	struct property *prop1, *prop2;
> 
> 	if (phandle_is_valid(node->phandle))
> 		return node->phandle;
> 	if (node->phandle == ~0UL) {
> 		/*
> 		 * We've already looked at existing properties and no valid
> 		 * phandle value were present. Avoid looking at them again
> 		 * and just return the invalid phandle value.
> 		 */
> 		return 0;
> 	}
> 
> 	/* Try to get it from the 'phandle' property */
> 	phandle1 = 0; /* Assume invalid */
> 	prop1 = get_property(node, "phandle");
> 	if (prop1) {
> 		if (prop1->val.len == sizeof(cell_t))
> 			phandle1 = propval_cell(prop1); /* Well formed -> Get it */
> 	}
> 
> 	/* Try to get it from the 'linux,phandle' property */
> 	phandle2 = 0; /* Assume invalid */
> 	prop2 = get_property(node, "linux,phandle");
> 	if (prop2) {
> 		if (prop2->val.len == sizeof(cell_t))
> 			phandle2 = propval_cell(prop2); /* Well formed -> Get it */
> 	}
> 
> 	if (prop1 && prop2) {
> 		/*
> 		 * Both property are present. They values must be the same
> 		 * and valid.
> 		 */
> 		if (phandle1 == phandle2) && phandle_is_valid(phandle1)) {
> 			/* Ok, Cache this correct phandle value and return it */
> 			node->phandle = phandle1;
> 			return phandle1;
> 		}
> 	} else if (prop1) {
> 		/*
> 		 * Only the 'phandle' property is present.
> 		 * Check its value validity
> 		 */
> 		if (phandle_is_valid(phandle1)) {
> 			/* Ok, Cache this correct phandle value and return it */
> 			node->phandle = phandle1;
> 			return phandle1;
> 		}
> 	} else if (prop2) {
> 		/*
> 		 * Only the 'linux,phandle' property is present.
> 		 * Check its value validity
> 		 */
> 		if (phandle_is_valid(phandle2)) {
> 			/* Ok, Cache this correct phandle value and return it */
> 			node->phandle = phandle2;
> 			return phandle2;
> 		}
> 	}
> 
> 	/*
> 	 * No valid phandle value were found. Cache this information and return
> 	 * the invalid phandle value.
> 	 */
> 	node->phandle == ~0UL;
> 	return 0;
> }
> --- 8< ---

That looks good to me.  But the "existing" in the name no longer says
anything useful - this can be the standard way to get a node's
phandle.  In fact it might be worth changing the name of the
node->phandle field to make sure we don't have any stale users rather
than going through the get_phandle() function.

> In get_node_by_phandle(), no change compared to my proposition and so the
> full function is:
> --- 8< ---
> struct node *get_node_by_phandle(struct node *tree, cell_t phandle)
> {
>         struct node *child, *node;
>         cell_t tree_phandle;
> 
>         if (!phandle_is_valid(phandle)) {
>                 assert(generate_fixups);
>                 return NULL;
>         }
> 
>         tree_phandle = get_node_phandle_existing(tree);
>         if (phandle_is_valid(tree_phandle) && tree_phandle == phandle) {
>                 if (tree->deleted)
>                         return NULL;
>                 return tree;
>         }
> 
>         for_each_child(tree, child) {
>                 node = get_node_by_phandle(child, phandle);
>                 if (node)
>                         return node;
>         }
> 
>         return NULL;
> }
> --- 8< ---
> 
> Caching should work correctly without any other modification.
> 
> I let you double-check on your side. Let me know about your opinion.

Yes, I think that should work.

-- 
David Gibson (he or they)	| I'll have my music baroque, and my code
david AT gibson.dropbear.id.au	| minimalist, thank you, not the other way
				| around.
http://www.ozlabs.org/~dgibson

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

  reply	other threads:[~2026-10-26  4:51 UTC|newest]

Thread overview: 98+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-08-26  9:48 [RFC PATCH v2 00/74] Add support for dtb metadata and addon device-trees Herve Codina
2026-08-26  9:48 ` [RFC PATCH v2 01/74] dtc-parser.y: Avoid an empty proplist Herve Codina
2026-10-14  9:25   ` David Gibson
2026-08-26  9:48 ` [RFC PATCH v2 02/74] Introduce v20 dtb version Herve Codina
2026-10-16  8:29   ` David Gibson
2026-08-26  9:48 ` [RFC PATCH v2 03/74] fdtdump: Introduce get_structured_tag_data() Herve Codina
2026-10-16  8:30   ` David Gibson
2026-10-19 13:17     ` Herve Codina
2026-08-26  9:48 ` [RFC PATCH v2 04/74] libfdt: Introduce fdt_get_structured_tag_data() Herve Codina
2026-10-19  0:24   ` David Gibson
2026-10-19 13:18     ` Herve Codina
2026-08-26  9:48 ` [RFC PATCH v2 05/74] libfdt: Prepare for metadata tag support Herve Codina
2026-10-19  0:58   ` David Gibson
2026-10-19 13:56     ` Herve Codina
2026-10-20  6:41       ` David Gibson
2026-10-20 11:14         ` Herve Codina
2026-10-21  1:44           ` David Gibson
2026-08-26  9:48 ` [RFC PATCH v2 06/74] dtc: Move fill_fullpaths() into build_dt_info() Herve Codina
2026-10-19  2:12   ` David Gibson
2026-08-26  9:48 ` [RFC PATCH v2 07/74] Add support for FDT_PROPDATA_PHANDLE dtb tag Herve Codina
2026-10-21  3:13   ` David Gibson
2026-10-21 17:26     ` Herve Codina
2026-10-22  3:02       ` David Gibson
2026-10-22  9:47         ` Herve Codina
2026-10-23  1:23           ` David Gibson
2026-10-23 11:29             ` Herve Codina
2026-10-26  1:30               ` David Gibson
2026-08-26  9:48 ` [RFC PATCH v2 08/74] livetree: Improve get_node_by_phandle() Herve Codina
2026-10-23  3:25   ` David Gibson
2026-10-23 16:15     ` Herve Codina
2026-10-26  1:33       ` David Gibson [this message]
2026-10-26 11:56         ` Herve Codina
2026-08-26  9:48 ` [RFC PATCH v2 09/74] dtc: Complete REF_PHANDLE markers with ref strings and is_local flags Herve Codina
2026-08-26  9:48 ` [RFC PATCH v2 10/74] tests: Add basic metadata tests Herve Codina
2026-08-26  9:48 ` [RFC PATCH v2 11/74] Add support for FDT_PROPDATA_PHANDLE_REF dtb tag Herve Codina
2026-08-26  9:48 ` [RFC PATCH v2 12/74] tests: metadata: Add external phandle reference tests Herve Codina
2026-08-26  9:48 ` [RFC PATCH v2 13/74] Add support for /addon/ keyword Herve Codina
2026-08-26  9:48 ` [RFC PATCH v2 14/74] tests: Add a test related to addon dt_flags header value Herve Codina
2026-08-26  9:48 ` [RFC PATCH v2 15/74] tests: metadata: Add a basic addon test Herve Codina
2026-08-26  9:48 ` [RFC PATCH v2 16/74] dtc: Introduce export symbols Herve Codina
2026-08-26  9:48 ` [RFC PATCH v2 17/74] dtc: Add support for /export/ dts keyword parsing Herve Codina
2026-08-26  9:48 ` [RFC PATCH v2 18/74] checks: Handle export symbols in fixup_phandle_references() Herve Codina
2026-08-26  9:48 ` [RFC PATCH v2 19/74] dtc: Add export symbols (/export/ keyword) in generated dts file Herve Codina
2026-08-26  9:48 ` [RFC PATCH v2 20/74] dtc: Extend complete_references() to handle export symbols Herve Codina
2026-08-26  9:48 ` [RFC PATCH v2 21/74] Add support for FDT_EXPORT_SYM dtb tag Herve Codina
2026-08-26  9:48 ` [RFC PATCH v2 22/74] tests: metadata: Add export symbols with local references tests Herve Codina
2026-08-26  9:48 ` [RFC PATCH v2 23/74] dtc: Add support for export symbols sorting Herve Codina
2026-08-26  9:48 ` [RFC PATCH v2 24/74] tests: metadata: Add a test " Herve Codina
2026-08-26  9:48 ` [RFC PATCH v2 25/74] Add support for FDT_EXPORT_SYM_REF dtb tag Herve Codina
2026-08-26  9:48 ` [RFC PATCH v2 26/74] tests: metadata: Add export symbols with external references tests Herve Codina
2026-08-26  9:48 ` [RFC PATCH v2 27/74] dtc: Introduce import symbols Herve Codina
2026-08-26  9:48 ` [RFC PATCH v2 28/74] dtc-parser: Introduce last_header_flags Herve Codina
2026-08-26  9:48 ` [RFC PATCH v2 29/74] dtc: Add support for /import/ dts keyword parsing Herve Codina
2026-08-26  9:48 ` [RFC PATCH v2 30/74] dtc: Add import symbols (/import/ keyword) in generated dts file Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 31/74] Add support for FDT_IMPORT_SYM dtb tag Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 32/74] tests: metadata: Add import symbols tests Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 33/74] dtc: Add support for import symbols sorting Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 34/74] tests: metadata: Improve sort test to check " Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 35/74] checks: Get 'chosen' node using get_subnode() Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 36/74] dtc: Change get_node_by_path() signature to take dt_info Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 37/74] dtc: Change get_node_by_label() " Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 38/74] dtc: Change get_node_by_phandle() " Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 39/74] dtc: Change get_node_by_ref() " Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 40/74] dtc: Change get_node_phandle() " Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 41/74] dtc: Change get_property_by_label() " Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 42/74] dtc: Change get_marker_label() " Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 43/74] dtc: Change fill_fullpaths() " Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 44/74] dtc: Introduce orphan nodes Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 45/74] dtc: Handle orphan nodes in get_xxx_by_yyy() Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 46/74] dtc: Avoid NULL fullpath for nodes in orphan trees Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 47/74] dtc: Handle orphan nodes in complete_references() Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 48/74] checks: Perform checks for orphan nodes Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 49/74] dtc: Rename add_orphan_node() to plugin_add_orphan_node() Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 50/74] dtc: Add basic support for addon orphan nodes in dts Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 51/74] Add support for FDT_BEGIN_NODE_REF dtb tag Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 52/74] tests: metadata: Add basic test for addon orphan nodes Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 53/74] dtc: Add support for missing root node in addon device-tree Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 54/74] tests: metadata: Add a test for addon without root node Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 55/74] dtc: Allow parser_get_node_by_ref() to return an orphan node for merging purpose Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 56/74] tests: metadata: Add a test related to orphan node merging Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 57/74] dtc: Add support for orphan nodes sorting Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 58/74] tests: metadata: Improve sort test to check " Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 59/74] dtc: Add support for references by path involving orphan nodes Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 60/74] tests: metadata: Add a test " Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 61/74] dtc: Add support for namespace labels references Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 62/74] tests: metadata: Add a test " Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 63/74] libfdt: Add support for applying an addon on a base device-tree blob Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 64/74] Add fdtaddon tool to apply an addon Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 65/74] tests: Add a first basic test for fdtaddon Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 66/74] tests: fdtaddon: Add a basic test for addons using an orphan nodes Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 67/74] tests: fdtaddon: Add a basic test for addons with unresolved phandle references Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 68/74] tests: fdtaddon: Add a basic test for addons with references by path to orphan nodes Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 69/74] tests: fdtaddon: Add a test for addons with properties identical to existing ones Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 70/74] tests: fdtaddon: Add a test for addons using namespace label references Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 71/74] tests: fdtaddon: Add a test for using 'stacked' addons Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 72/74] tests: fdtaddon: Add a test using more realistic dts and dtsa Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 73/74] libfdt/fdt_addon.c: Add support for an external resolver Herve Codina
2026-08-26  9:49 ` [RFC PATCH v2 74/74] fdtaddon: Add a simple " Herve Codina

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=at6t-l9XYYFfS48T@gractus.seuss \
    --to=david@gibson.dropbear.id.au \
    --cc=ayush@beagleboard.org \
    --cc=conor+dt@kernel.org \
    --cc=devicetree-compiler@vger.kernel.org \
    --cc=devicetree-spec@vger.kernel.org \
    --cc=devicetree@vger.kernel.org \
    --cc=dlechner@baylibre.com \
    --cc=geert@linux-m68k.org \
    --cc=herve.codina@bootlin.com \
    --cc=hui.pu@gehealthcare.com \
    --cc=ian.ray@gehealthcare.com \
    --cc=krzk@kernel.org \
    --cc=laurent.pinchart@ideasonboard.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=luca.ceresoli@bootlin.com \
    --cc=robh@kernel.org \
    --cc=thomas.petazzoni@bootlin.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox

all inboxes | Powered by JetHome®