From: Herve Codina <herve.codina@bootlin.com>
To: David Gibson <david@gibson.dropbear.id.au>
Cc: Rob Herring <robh@kernel.org>,
Krzysztof Kozlowski <krzk@kernel.org>,
Conor Dooley <conor+dt@kernel.org>,
Laurent Pinchart <laurent.pinchart@ideasonboard.com>,
David Lechner <dlechner@baylibre.com>,
Ayush Singh <ayush@beagleboard.org>,
Geert Uytterhoeven <geert@linux-m68k.org>,
devicetree-compiler@vger.kernel.org, devicetree@vger.kernel.org,
linux-kernel@vger.kernel.org, devicetree-spec@vger.kernel.org,
Hui Pu <hui.pu@gehealthcare.com>,
Ian Ray <ian.ray@gehealthcare.com>,
Luca Ceresoli <luca.ceresoli@bootlin.com>,
Thomas Petazzoni <thomas.petazzoni@bootlin.com>
Subject: Re: [RFC PATCH v2 08/74] livetree: Improve get_node_by_phandle()
Date: Fri, 23 Oct 2026 18:15:33 +0200 [thread overview]
Message-ID: <20261023181533.0c44a57f@bootlin.com> (raw)
In-Reply-To: <atrTn_I_8O6q9QUW@gractus.seuss>
Hi David,
On Fri, 23 Oct 2026 14:25:29 +1100
David Gibson <david@gibson.dropbear.id.au> wrote:
> On Wed, Aug 26, 2026 at 11:48:37AM +0200, Herve Codina wrote:
> > get_node_by_phandle() allows to get a node based on its phandle value.
> > It checks the phandle value against value available in internal node
> > structure.
> >
> > This internal phandle value is updated during process_check() and so,
> > get_node_by_phandle() cannot give correct results before the
> > process_check() call.
> >
> > Improve get_node_by_phandle() to look at node phandle properties when
> > the internal phandle value is not valid.
> >
> > This allows to return a correct matching node even if process_check()
> > was not called yet.
>
> The idea is sound - it's always been kind of clunky that we need the
> process_checks() pass to fill the phandles before we can use them.
> But, there's at least one significant catch:
>
> [Aside: you might notice the way it's done violates the principle I
> stated elsewhere of avoiding structures where you must know where you
> are in the flow to know which parts are populated. My type
> discipline has improved since I first wrote this code :)]
>
> We need to gracefully handle the case of malformed phandle /
> linux,phandle properties; that's actually the reason for the weird
> placement of this in checks.c. By treating it as a "check" we handle
> this case by failing the check. Other checks that rely on phandles
> then have the 'explicit_phandles' check as a prereq so they don't need
> to verify this again. We can still report errors for other checks
> that don't rely on that (which is the whole point of the checks
> mechanism).
>
> That's not the only way to do it, of course, but we need something to
> check for that error case. Further notes on the code.
>
> > With the recently introduced FDT_PROPDATA_HANDLE dtb tag, this will be
> > needed to update internal phandle references before the call to
> > process_check(). Indeed, this tag allows to identify phandles and
> > internal references need to be updated based on the phandle value before
> > the process_check() call.
> >
> > Signed-off-by: Herve Codina <herve.codina@bootlin.com>
> > ---
> > livetree.c | 21 ++++++++++++++++++++-
> > 1 file changed, 20 insertions(+), 1 deletion(-)
> >
> > diff --git a/livetree.c b/livetree.c
> > index abe73de1..a9f8c5d2 100644
> > --- a/livetree.c
> > +++ b/livetree.c
> > @@ -628,16 +628,35 @@ struct node *get_node_by_label(struct node *tree, const char *label)
> > return NULL;
> > }
> >
> > +static cell_t get_node_phandle_existing(struct node *node)
> > +{
> > + struct property *prop;
> > +
> > + if (phandle_is_valid(node->phandle))
> > + return node->phandle;
> > +
> > + prop = get_property(node, "phandle");
> > + if (!prop) {
> > + prop = get_property(node, "linux,phandle");
> > + if (!prop)
> > + return 0;
> > + }
> > +
> > + return propval_cell(prop);
>
> In the case of a malformed property, this could SEGV.
Ok, will update to
--- 8< ---
if (prop->val.len != sizeof(cell_t))
return 0;
return propval_cell(prop)
--- 8< ---
>
> > +}
> > +
> > struct node *get_node_by_phandle(struct node *tree, cell_t phandle)
> > {
> > struct node *child, *node;
> > + cell_t tree_phandle;
> >
> > if (!phandle_is_valid(phandle)) {
> > assert(generate_fixups);
> > return NULL;
> > }
> >
> > - if (tree->phandle == phandle) {
> > + tree_phandle = get_node_phandle_existing(tree);
>
> This means that every time we search for a phandle, for every node
> scanned before the destination with no phandle, we do a full property
> scan to check that no, it still doesn't have a phandle.
>
> I don't care that much about dtc performance, but that's still a bit
> much to swallow. I think we need to cache negative lookups to avoid
> that. Happily, since there are two invalid phandle values this
> shouldn't be too hard. We could, say, use tree->phandle == 0 to mean
> we don't know if there's a phandle, and tree->phandle == -1 to mean
> we've scanned the properties and we know there isn't one.
>
> In fact, caching property lookups might be the better way to do this.
> Rather than having an explicit pass where tree->phandle is populated,
> we could have get_node_by_phandle() cache its property scan (success
> or failure) in tree->phandle.
>
> I think that's a more elegant approach than the current one, but we do
> still need to handle the malformed property case.
Well, get_node_phandle_existing() can be improved:
---- 8< ----
static cell_t get_node_phandle_existing(struct node *node)
{
cell_t phandle1, phandle2;
struct property *prop1, *prop2;
if (phandle_is_valid(node->phandle))
return node->phandle;
if (node->phandle == ~0UL) {
/*
* We've already looked at existing properties and no valid
* phandle value were present. Avoid looking at them again
* and just return the invalid phandle value.
*/
return 0;
}
/* Try to get it from the 'phandle' property */
phandle1 = 0; /* Assume invalid */
prop1 = get_property(node, "phandle");
if (prop1) {
if (prop1->val.len == sizeof(cell_t))
phandle1 = propval_cell(prop1); /* Well formed -> Get it */
}
/* Try to get it from the 'linux,phandle' property */
phandle2 = 0; /* Assume invalid */
prop2 = get_property(node, "linux,phandle");
if (prop2) {
if (prop2->val.len == sizeof(cell_t))
phandle2 = propval_cell(prop2); /* Well formed -> Get it */
}
if (prop1 && prop2) {
/*
* Both property are present. They values must be the same
* and valid.
*/
if (phandle1 == phandle2) && phandle_is_valid(phandle1)) {
/* Ok, Cache this correct phandle value and return it */
node->phandle = phandle1;
return phandle1;
}
} else if (prop1) {
/*
* Only the 'phandle' property is present.
* Check its value validity
*/
if (phandle_is_valid(phandle1)) {
/* Ok, Cache this correct phandle value and return it */
node->phandle = phandle1;
return phandle1;
}
} else if (prop2) {
/*
* Only the 'linux,phandle' property is present.
* Check its value validity
*/
if (phandle_is_valid(phandle2)) {
/* Ok, Cache this correct phandle value and return it */
node->phandle = phandle2;
return phandle2;
}
}
/*
* No valid phandle value were found. Cache this information and return
* the invalid phandle value.
*/
node->phandle == ~0UL;
return 0;
}
--- 8< ---
In get_node_by_phandle(), no change compared to my proposition and so the
full function is:
--- 8< ---
struct node *get_node_by_phandle(struct node *tree, cell_t phandle)
{
struct node *child, *node;
cell_t tree_phandle;
if (!phandle_is_valid(phandle)) {
assert(generate_fixups);
return NULL;
}
tree_phandle = get_node_phandle_existing(tree);
if (phandle_is_valid(tree_phandle) && tree_phandle == phandle) {
if (tree->deleted)
return NULL;
return tree;
}
for_each_child(tree, child) {
node = get_node_by_phandle(child, phandle);
if (node)
return node;
}
return NULL;
}
--- 8< ---
Caching should work correctly without any other modification.
I let you double-check on your side. Let me know about your opinion.
Best regards,
Hervé
next prev parent reply other threads:[~2026-10-23 16:15 UTC|newest]
Thread overview: 95+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-08-26 9:48 [RFC PATCH v2 00/74] Add support for dtb metadata and addon device-trees Herve Codina
2026-08-26 9:48 ` [RFC PATCH v2 01/74] dtc-parser.y: Avoid an empty proplist Herve Codina
2026-10-14 9:25 ` David Gibson
2026-08-26 9:48 ` [RFC PATCH v2 02/74] Introduce v20 dtb version Herve Codina
2026-10-16 8:29 ` David Gibson
2026-08-26 9:48 ` [RFC PATCH v2 03/74] fdtdump: Introduce get_structured_tag_data() Herve Codina
2026-10-16 8:30 ` David Gibson
2026-10-19 13:17 ` Herve Codina
2026-08-26 9:48 ` [RFC PATCH v2 04/74] libfdt: Introduce fdt_get_structured_tag_data() Herve Codina
2026-10-19 0:24 ` David Gibson
2026-10-19 13:18 ` Herve Codina
2026-08-26 9:48 ` [RFC PATCH v2 05/74] libfdt: Prepare for metadata tag support Herve Codina
2026-10-19 0:58 ` David Gibson
2026-10-19 13:56 ` Herve Codina
2026-10-20 6:41 ` David Gibson
2026-10-20 11:14 ` Herve Codina
2026-10-21 1:44 ` David Gibson
2026-08-26 9:48 ` [RFC PATCH v2 06/74] dtc: Move fill_fullpaths() into build_dt_info() Herve Codina
2026-10-19 2:12 ` David Gibson
2026-08-26 9:48 ` [RFC PATCH v2 07/74] Add support for FDT_PROPDATA_PHANDLE dtb tag Herve Codina
2026-10-21 3:13 ` David Gibson
2026-10-21 17:26 ` Herve Codina
2026-10-22 3:02 ` David Gibson
2026-10-22 9:47 ` Herve Codina
2026-10-23 1:23 ` David Gibson
2026-10-23 11:29 ` Herve Codina
2026-08-26 9:48 ` [RFC PATCH v2 08/74] livetree: Improve get_node_by_phandle() Herve Codina
2026-10-23 3:25 ` David Gibson
2026-10-23 16:15 ` Herve Codina [this message]
2026-08-26 9:48 ` [RFC PATCH v2 09/74] dtc: Complete REF_PHANDLE markers with ref strings and is_local flags Herve Codina
2026-08-26 9:48 ` [RFC PATCH v2 10/74] tests: Add basic metadata tests Herve Codina
2026-08-26 9:48 ` [RFC PATCH v2 11/74] Add support for FDT_PROPDATA_PHANDLE_REF dtb tag Herve Codina
2026-08-26 9:48 ` [RFC PATCH v2 12/74] tests: metadata: Add external phandle reference tests Herve Codina
2026-08-26 9:48 ` [RFC PATCH v2 13/74] Add support for /addon/ keyword Herve Codina
2026-08-26 9:48 ` [RFC PATCH v2 14/74] tests: Add a test related to addon dt_flags header value Herve Codina
2026-08-26 9:48 ` [RFC PATCH v2 15/74] tests: metadata: Add a basic addon test Herve Codina
2026-08-26 9:48 ` [RFC PATCH v2 16/74] dtc: Introduce export symbols Herve Codina
2026-08-26 9:48 ` [RFC PATCH v2 17/74] dtc: Add support for /export/ dts keyword parsing Herve Codina
2026-08-26 9:48 ` [RFC PATCH v2 18/74] checks: Handle export symbols in fixup_phandle_references() Herve Codina
2026-08-26 9:48 ` [RFC PATCH v2 19/74] dtc: Add export symbols (/export/ keyword) in generated dts file Herve Codina
2026-08-26 9:48 ` [RFC PATCH v2 20/74] dtc: Extend complete_references() to handle export symbols Herve Codina
2026-08-26 9:48 ` [RFC PATCH v2 21/74] Add support for FDT_EXPORT_SYM dtb tag Herve Codina
2026-08-26 9:48 ` [RFC PATCH v2 22/74] tests: metadata: Add export symbols with local references tests Herve Codina
2026-08-26 9:48 ` [RFC PATCH v2 23/74] dtc: Add support for export symbols sorting Herve Codina
2026-08-26 9:48 ` [RFC PATCH v2 24/74] tests: metadata: Add a test " Herve Codina
2026-08-26 9:48 ` [RFC PATCH v2 25/74] Add support for FDT_EXPORT_SYM_REF dtb tag Herve Codina
2026-08-26 9:48 ` [RFC PATCH v2 26/74] tests: metadata: Add export symbols with external references tests Herve Codina
2026-08-26 9:48 ` [RFC PATCH v2 27/74] dtc: Introduce import symbols Herve Codina
2026-08-26 9:48 ` [RFC PATCH v2 28/74] dtc-parser: Introduce last_header_flags Herve Codina
2026-08-26 9:48 ` [RFC PATCH v2 29/74] dtc: Add support for /import/ dts keyword parsing Herve Codina
2026-08-26 9:48 ` [RFC PATCH v2 30/74] dtc: Add import symbols (/import/ keyword) in generated dts file Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 31/74] Add support for FDT_IMPORT_SYM dtb tag Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 32/74] tests: metadata: Add import symbols tests Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 33/74] dtc: Add support for import symbols sorting Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 34/74] tests: metadata: Improve sort test to check " Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 35/74] checks: Get 'chosen' node using get_subnode() Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 36/74] dtc: Change get_node_by_path() signature to take dt_info Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 37/74] dtc: Change get_node_by_label() " Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 38/74] dtc: Change get_node_by_phandle() " Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 39/74] dtc: Change get_node_by_ref() " Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 40/74] dtc: Change get_node_phandle() " Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 41/74] dtc: Change get_property_by_label() " Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 42/74] dtc: Change get_marker_label() " Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 43/74] dtc: Change fill_fullpaths() " Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 44/74] dtc: Introduce orphan nodes Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 45/74] dtc: Handle orphan nodes in get_xxx_by_yyy() Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 46/74] dtc: Avoid NULL fullpath for nodes in orphan trees Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 47/74] dtc: Handle orphan nodes in complete_references() Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 48/74] checks: Perform checks for orphan nodes Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 49/74] dtc: Rename add_orphan_node() to plugin_add_orphan_node() Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 50/74] dtc: Add basic support for addon orphan nodes in dts Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 51/74] Add support for FDT_BEGIN_NODE_REF dtb tag Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 52/74] tests: metadata: Add basic test for addon orphan nodes Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 53/74] dtc: Add support for missing root node in addon device-tree Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 54/74] tests: metadata: Add a test for addon without root node Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 55/74] dtc: Allow parser_get_node_by_ref() to return an orphan node for merging purpose Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 56/74] tests: metadata: Add a test related to orphan node merging Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 57/74] dtc: Add support for orphan nodes sorting Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 58/74] tests: metadata: Improve sort test to check " Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 59/74] dtc: Add support for references by path involving orphan nodes Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 60/74] tests: metadata: Add a test " Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 61/74] dtc: Add support for namespace labels references Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 62/74] tests: metadata: Add a test " Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 63/74] libfdt: Add support for applying an addon on a base device-tree blob Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 64/74] Add fdtaddon tool to apply an addon Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 65/74] tests: Add a first basic test for fdtaddon Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 66/74] tests: fdtaddon: Add a basic test for addons using an orphan nodes Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 67/74] tests: fdtaddon: Add a basic test for addons with unresolved phandle references Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 68/74] tests: fdtaddon: Add a basic test for addons with references by path to orphan nodes Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 69/74] tests: fdtaddon: Add a test for addons with properties identical to existing ones Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 70/74] tests: fdtaddon: Add a test for addons using namespace label references Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 71/74] tests: fdtaddon: Add a test for using 'stacked' addons Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 72/74] tests: fdtaddon: Add a test using more realistic dts and dtsa Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 73/74] libfdt/fdt_addon.c: Add support for an external resolver Herve Codina
2026-08-26 9:49 ` [RFC PATCH v2 74/74] fdtaddon: Add a simple " Herve Codina
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20261023181533.0c44a57f@bootlin.com \
--to=herve.codina@bootlin.com \
--cc=ayush@beagleboard.org \
--cc=conor+dt@kernel.org \
--cc=david@gibson.dropbear.id.au \
--cc=devicetree-compiler@vger.kernel.org \
--cc=devicetree-spec@vger.kernel.org \
--cc=devicetree@vger.kernel.org \
--cc=dlechner@baylibre.com \
--cc=geert@linux-m68k.org \
--cc=hui.pu@gehealthcare.com \
--cc=ian.ray@gehealthcare.com \
--cc=krzk@kernel.org \
--cc=laurent.pinchart@ideasonboard.com \
--cc=linux-kernel@vger.kernel.org \
--cc=luca.ceresoli@bootlin.com \
--cc=robh@kernel.org \
--cc=thomas.petazzoni@bootlin.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®