From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mail-pf1-f197.google.com (mail-pf1-f197.google.com [209.85.210.197]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 0F6FB36B04E for ; Mon, 21 Sep 2026 05:08:52 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.210.197 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1789967340; cv=none; b=MiUSynuYe46XjD6H45/k111j+hWfl1XesjvzKMq7JRRJrbmzDCCwWzC6jCABSnpD/4A7zugOJ0vvjT5INrqVrYnv+swPC0amOixeJ++VQXguk03A9heQCSGDO5wx1ePAyL8ZjJ9brD60opANukSVnYNJIvL2LJTmDJZCGWAhhBw= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1789967340; c=relaxed/simple; bh=O6l15Q2SjrCHgjRbMePEjur7/VEVa7Y8wfL3hPEFpYk=; h=Date:In-Reply-To:Mime-Version:References:Message-ID:Subject:From: To:Cc:Content-Type; b=s2JqR7nRkr7rOtD1OGJ36dRssep+ptTXosUxsG7Rgh0Al1+i0dS74w4zsqAN+3zIoa4gCnfO57xQ1viUrXAwfY/5fNyMVmkgGQ2xcGGKZY/J5R1QQtdIp6HnE3qfEAqGMEe901vy6ZCguc73gmPLkj3r8smEjEAPu3Oq5IVAWao= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=google.com; spf=pass smtp.mailfrom=flex--irogers.bounces.google.com; dkim=pass (2048-bit key) header.d=google.com header.i=@google.com header.b=bRLT9XPe; arc=none smtp.client-ip=209.85.210.197 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=google.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=flex--irogers.bounces.google.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=google.com header.i=@google.com header.b="bRLT9XPe" Received: by mail-pf1-f197.google.com with SMTP id d2e1a72fcca58-854f274dd69so2682013b3a.1 for ; Sun, 20 Sep 2026 22:08:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20251104; t=1789967332; x=1790572132; darn=vger.kernel.org; h=content-transfer-encoding:content-type:cc:to:from:subject :message-id:references:mime-version:in-reply-to:date:from:to:cc :subject:date:message-id:reply-to:content-type; bh=BTKNM4dcAVoYPc47s1wDbpkJ5bCz4wQiauCNilc27l4=; b=bRLT9XPeciTFrkI96/h+Nrd71DVp7Zz3fm58qExZbZLeEytiEWifdq8ZKiufmgDseK spT3VHL3RsdoptSRy8VMGzs7pxhNyNPPNLSu2SWfEOk1sk5Y2sQQbpIc2VP8uSG2MY9O wAZxtUCc6kKIkYEXwoifXqHPyFxePMw+R76C5IXilN/CHW13ctxmvj5me5c1CNEr6I5Q kzFL1Sw859rtx+279JZu0RhY/yS5rcr82jo4zZVWMj4aWs/Vrl/BpS9xW5qcAgIxswuu ymUeVyUAir9wenBF+RzQOfvXkOyxc5x55i6ZXL9CKI7ZItddagbik23E8sjTBexDN4sa sJ9Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20260707; t=1789967332; x=1790572132; h=content-transfer-encoding:content-type:cc:to:from:subject :message-id:references:mime-version:in-reply-to:date :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to :content-type; bh=BTKNM4dcAVoYPc47s1wDbpkJ5bCz4wQiauCNilc27l4=; b=f2n6t5U3Ite9JGG+MYtAsIOyA8zcYZEq2Ot5Y1Stx4RA9PPwGWfuszHqysnKsgOkb1 7ILlqAg7yQ4ktw/scC4v4j4tZzzGrFI/jd2UY++4fFwEfiO055inBqZWXOPLS6cbaRQ1 QS/e+egCVlLCUX0D/9VjLxNrDDedwswecbWRSzfKCAliHGOEqf1MZJeIwtwFjRrqP/TZ gEXDPyZ8kkacDF6brdx2y7Z/w51kDBKcjU5ywHoxtZgbLwKyNC/bu5TFU3PIADIxt147 bcvy2y8r0RTkW8z3YzFp3CZ3/MAkpUFqmOvnqEAbQIuvHxh3rvueX/j9JlFhYEF2vkgW H3nA== X-Forwarded-Encrypted: i=1; AKwUvBzVCIehcU9/C81oevLQd0eI4EYYKiTaMoz2DZvJDXTMXEcTXd1XgyWNR4iIAbZr0gyatnJJBkB3Su37ftU=@vger.kernel.org X-Gm-Message-State: AFuF++kzsrbZRo2i2MaJg8ltlbG9d6IgivBDUW5rybF43bn5mxPOIHfk zoLBQ0WaBeJSzixRj9V12yeRb7Y611ijtNy8Ly8dnawT5jklKZq3pj6d0VfG+2HQuGx2rRYUeJe ywdpSlMwVzg== X-Received: from dybvu25.prod.google.com ([2002:a05:7300:f819:b0:33e:54b9:7324]) (user=irogers job=prod-delivery.src-stubby-dispatcher) by 2002:a05:6a20:7349:b0:3dd:a195:fa0f with SMTP id adf61e73a8af0-3dda195fd49mr9938874637.52.1789967331824; Sun, 20 Sep 2026 22:08:51 -0700 (PDT) Date: Sun, 20 Sep 2026 22:07:07 -0700 In-Reply-To: Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: Mime-Version: 1.0 References: X-Mailer: git-send-email 2.55.0.1082.g2b9226bbc0-goog Message-ID: Subject: [PATCH v2 49/49] perf Documentation: Update for standalone Python scripts From: Ian Rogers To: irogers@google.com, acme@kernel.org, alice.mei.rogers@gmail.com, linux-perf-users@vger.kernel.org, namhyung@kernel.org Cc: adrian.hunter@intel.com, dapeng1.mi@linux.intel.com, james.clark@linaro.org, leo.yan@linux.dev, linux-kernel@vger.kernel.org, mingo@redhat.com, peterz@infradead.org, tmricht@linux.ibm.com Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Update perf-script documentation to reflect standalone Python script execution and the removal of embedded Python and Perl scripting: - Remove documentation for the removed -g and -s options and legacy record/report script wrapper modes in perf-script.txt. - Remove references to perf-script-perl and delete obsolete perf-script-perl.txt. - Rewrite perf-script-python.txt to document writing and running standalone Python scripts using the perf module. Assisted-by: Antigravity:gemini-3.1-pro Signed-off-by: Ian Rogers --- tools/perf/Documentation/db-export.txt | 16 +- tools/perf/Documentation/perf-script-perl.txt | 216 ------ .../perf/Documentation/perf-script-python.txt | 725 +++--------------- tools/perf/Documentation/perf-script.txt | 80 +- tools/perf/Documentation/tips.txt | 1 - 5 files changed, 113 insertions(+), 925 deletions(-) delete mode 100644 tools/perf/Documentation/perf-script-perl.txt diff --git a/tools/perf/Documentation/db-export.txt b/tools/perf/Documentat= ion/db-export.txt index 20024e1f9164..a736be3b6e84 100644 --- a/tools/perf/Documentation/db-export.txt +++ b/tools/perf/Documentation/db-export.txt @@ -1,11 +1,11 @@ Database Export =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D =20 -perf tool's python scripting engine: +perf tool's python module: =20 - tools/perf/util/scripting-engines/trace-event-python.c + tools/perf/util/python.c =20 -supports scripts: +supports standalone scripts: =20 tools/perf/python/export-to-sqlite.py tools/perf/python/export-to-postgresql.py @@ -31,11 +31,5 @@ backward compatibility by testing for the presence of ne= w tables and columns before using them. e.g. function IsSelectable() in exported-sql-viewer.py =20 4. The export scripts themselves maintain forward compatibility (i.e. an e= xisting -script will continue to work with new versions of perf) by accepting a var= iable -number of arguments (e.g. def call_return_table(*x)) i.e. perf can pass mo= re -arguments which old scripts will ignore. - -5. The scripting engine tests for the existence of script handler function= s -before calling them. The scripting engine can also test for the support o= f new -or optional features by checking for the existence and value of script glo= bal -variables. +script will continue to work with new versions of perf) by querying event = and +sample attributes dynamically from the perf Python module. diff --git a/tools/perf/Documentation/perf-script-perl.txt b/tools/perf/Doc= umentation/perf-script-perl.txt deleted file mode 100644 index 5b479f5e62ff..000000000000 --- a/tools/perf/Documentation/perf-script-perl.txt +++ /dev/null @@ -1,216 +0,0 @@ -perf-script-perl(1) -=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D - -NAME ----- -perf-script-perl - Process trace data with a Perl script - -SYNOPSIS --------- -[verse] -'perf script' [-s [Perl]:script[.pl] ] - -DESCRIPTION ------------ - -This perf script option is used to process perf script data using perf's -built-in Perl interpreter. It reads and processes the input file and -displays the results of the trace analysis implemented in the given -Perl script, if any. - -STARTER SCRIPTS ---------------- - -You can avoid reading the rest of this document by running 'perf script --g perl' in the same directory as an existing perf.data trace file. -That will generate a starter script containing a handler for each of -the event types in the trace file; it simply prints every available -field for each event in the trace file. - -You can also look at the existing scripts in -~/libexec/perf-core/scripts/perl for typical examples showing how to -do basic things like aggregate event data, print results, etc. Also, -the check-perf-script.pl script, while not interesting for its results, -attempts to exercise all of the main scripting features. - -EVENT HANDLERS --------------- - -When perf script is invoked using a trace script, a user-defined -'handler function' is called for each event in the trace. If there's -no handler function defined for a given event type, the event is -ignored (or passed to a 'trace_unhandled' function, see below) and the -next event is processed. - -Most of the event's field values are passed as arguments to the -handler function; some of the less common ones aren't - those are -available as calls back into the perf executable (see below). - -As an example, the following perf record command can be used to record -all sched_wakeup events in the system: - - # perf record -a -e sched:sched_wakeup - -Traces meant to be processed using a script should be recorded with -the above option: -a to enable system-wide collection. - -The format file for the sched_wakeup event defines the following fields -(see /sys/kernel/tracing/events/sched/sched_wakeup/format): - ----- - format: - field:unsigned short common_type; - field:unsigned char common_flags; - field:unsigned char common_preempt_count; - field:int common_pid; - - field:char comm[TASK_COMM_LEN]; - field:pid_t pid; - field:int prio; - field:int success; - field:int target_cpu; ----- - -The handler function for this event would be defined as: - ----- -sub sched::sched_wakeup -{ - my ($event_name, $context, $common_cpu, $common_secs, - $common_nsecs, $common_pid, $common_comm, - $comm, $pid, $prio, $success, $target_cpu) =3D @_; -} ----- - -The handler function takes the form subsystem::event_name. - -The $common_* arguments in the handler's argument list are the set of -arguments passed to all event handlers; some of the fields correspond -to the common_* fields in the format file, but some are synthesized, -and some of the common_* fields aren't common enough to to be passed -to every event as arguments but are available as library functions. - -Here's a brief description of each of the invariant event args: - - $event_name the name of the event as text - $context an opaque 'cookie' used in calls back into perf - $common_cpu the cpu the event occurred on - $common_secs the secs portion of the event timestamp - $common_nsecs the nsecs portion of the event timestamp - $common_pid the pid of the current task - $common_comm the name of the current process - -All of the remaining fields in the event's format file have -counterparts as handler function arguments of the same name, as can be -seen in the example above. - -The above provides the basics needed to directly access every field of -every event in a trace, which covers 90% of what you need to know to -write a useful trace script. The sections below cover the rest. - -SCRIPT LAYOUT -------------- - -Every perf script Perl script should start by setting up a Perl module -search path and 'use'ing a few support modules (see module -descriptions below): - ----- - use lib "$ENV{'PERF_EXEC_PATH'}/scripts/perl/Perf-Trace-Util/lib"; - use lib "./Perf-Trace-Util/lib"; - use Perf::Trace::Core; - use Perf::Trace::Context; - use Perf::Trace::Util; ----- - -The rest of the script can contain handler functions and support -functions in any order. - -Aside from the event handler functions discussed above, every script -can implement a set of optional functions: - -*trace_begin*, if defined, is called before any event is processed and -gives scripts a chance to do setup tasks: - ----- - sub trace_begin - { - } ----- - -*trace_end*, if defined, is called after all events have been - processed and gives scripts a chance to do end-of-script tasks, such - as display results: - ----- -sub trace_end -{ -} ----- - -*trace_unhandled*, if defined, is called after for any event that - doesn't have a handler explicitly defined for it. The standard set - of common arguments are passed into it: - ----- -sub trace_unhandled -{ - my ($event_name, $context, $common_cpu, $common_secs, - $common_nsecs, $common_pid, $common_comm) =3D @_; -} ----- - -The remaining sections provide descriptions of each of the available -built-in perf script Perl modules and their associated functions. - -AVAILABLE MODULES AND FUNCTIONS -------------------------------- - -The following sections describe the functions and variables available -via the various Perf::Trace::* Perl modules. To use the functions and -variables from the given module, add the corresponding 'use -Perf::Trace::XXX' line to your perf script script. - -Perf::Trace::Core Module -~~~~~~~~~~~~~~~~~~~~~~~~ - -These functions provide some essential functions to user scripts. - -The *flag_str* and *symbol_str* functions provide human-readable -strings for flag and symbolic fields. These correspond to the strings -and values parsed from the 'print fmt' fields of the event format -files: - - flag_str($event_name, $field_name, $field_value) - returns the string re= presentation corresponding to $field_value for the flag field $field_name o= f event $event_name - symbol_str($event_name, $field_name, $field_value) - returns the string = representation corresponding to $field_value for the symbolic field $field_= name of event $event_name - -Perf::Trace::Context Module -~~~~~~~~~~~~~~~~~~~~~~~~~~~ - -Some of the 'common' fields in the event format file aren't all that -common, but need to be made accessible to user scripts nonetheless. - -Perf::Trace::Context defines a set of functions that can be used to -access this data in the context of the current event. Each of these -functions expects a $context variable, which is the same as the -$context variable passed into every event handler as the second -argument. - - common_pc($context) - returns common_preempt count for the current event - common_flags($context) - returns common_flags for the current event - common_lock_depth($context) - returns common_lock_depth for the current e= vent - -Perf::Trace::Util Module -~~~~~~~~~~~~~~~~~~~~~~~~ - -Various utility functions for use with perf script: - - nsecs($secs, $nsecs) - returns total nsecs given secs/nsecs pair - nsecs_secs($nsecs) - returns whole secs portion given nsecs - nsecs_nsecs($nsecs) - returns nsecs remainder given nsecs - nsecs_str($nsecs) - returns printable string in the form secs.nsecs - avg($total, $n) - returns average given a sum and a total number of valu= es - -SEE ALSO --------- -linkperf:perf-script[1] diff --git a/tools/perf/Documentation/perf-script-python.txt b/tools/perf/D= ocumentation/perf-script-python.txt index 27a1cac6fe76..14cff0c525b1 100644 --- a/tools/perf/Documentation/perf-script-python.txt +++ b/tools/perf/Documentation/perf-script-python.txt @@ -3,676 +3,155 @@ perf-script-python(1) =20 NAME ---- -perf-script-python - Process trace data with a Python script +perf-script-python - Process trace data with a Python script using perf mo= dule =20 SYNOPSIS -------- [verse] -'perf script' [-s [Python]:script[.py] ] +'perf script'