From: Ian Rogers <irogers@google.com>
To: irogers@google.com, acme@kernel.org, namhyung@kernel.org
Cc: adrian.hunter@intel.com, james.clark@linaro.org,
jolsa@kernel.org, linux-kernel@vger.kernel.org,
linux-perf-users@vger.kernel.org, mingo@redhat.com,
peterz@infradead.org
Subject: [PATCH v3 0/9] perf python: Follow-up fixes and shell test deflaking
Date: Mon, 28 Sep 2026 23:58:30 -0700 [thread overview]
Message-ID: <20260929065839.407062-1-irogers@google.com> (raw)
In-Reply-To: <20260929062937.374137-1-irogers@google.com>
This series contains follow-up fixes for the standalone Python scripts
and their shell tests, particularly when running 'perf test' as root
under heavy parallel load:
- Clamp sample_id size calculation for PERF_RECORD_KSYMBOL,
PERF_RECORD_BPF_EVENT, and PERF_RECORD_TEXT_POKE records to work
around kernels without "perf/core: Restore header fields in sideband
output callbacks" [1].
- Fix offline interval printing in sctop.py and live signal races in
stat-cpi.py.
- Deflake Intel PT, failed-syscalls, and other Python shell tests under
parallel 'perf test' load by scoping tracepoint checks to
'perf list tracepoint', passing '-B -N --no-bpf-event' to 'perf record',
and avoiding unnecessary system-wide ('-a') recordings.
- Default event_analyzing_sample.py to an in-memory SQLite database
(':memory:') when '--db' is not specified.
- Initialize perf debug output ('perf_debug_setup()') when loading the
'perf' Python extension module.
- Fix races in 'perf list' ('perf_pmus__print_pmu_events()' and
'tp_pmu.c') when concurrent tests dynamically create and remove
kprobe/uprobes tracepoints.
v3:
- Wrap _open_live_evlist() inside the try/except KeyboardInterrupt block
in stat-cpi.py so signals arriving during event initialization are
caught and cleaned up gracefully.
v2:
- Fix 8-byte alignment calculation for PERF_RECORD_TEXT_POKE payload in
evsel__event_size() by aligning fixed + old_len + new_len.
- Keep offline interval clock advancing on all samples in sctop.py while
flushing any remaining syscalls at EOF.
- Use 'mktemp -d' private directories in test_sctop_python.sh and
test_failed_syscalls_python.sh so temporary files are not unlinked and
recreated directly in /tmp.
- Explicitly include <stdlib.h> in tools/perf/util/pmus.c.
[1] https://lore.kernel.org/r/20260929014206.4175245-1-irogers@google.com
Ian Rogers (9):
perf evsel: Clamp sample_id size for ksymbol, bpf, and text_poke
events
perf python sctop: Fix offline interval printing and test flakiness
perf python stat-cpi: Fix live mode signal races and test flakiness
perf test: Deflake Intel PT Python shell tests under load
perf test: Deflake failed-syscalls Python shell tests under load
perf test: Reduce overhead and contention in Python shell tests
perf python event_analyzing_sample: Default to in-memory SQLite
database
perf python: Initialize debug output on module load
perf pmu: Fix race with concurrent tracepoint creation and removal in
perf list
tools/perf/python/event_analyzing_sample.py | 35 +++-------
tools/perf/python/sctop.py | 7 +-
tools/perf/python/stat-cpi.py | 32 ++++++---
.../shell/test_check_perf_trace_python.sh | 8 ++-
.../shell/test_compaction_times_python.sh | 8 ++-
.../test_event_analyzing_sample_python.sh | 11 ++-
.../shell/test_export_to_postgresql_python.sh | 49 +++++++------
.../shell/test_export_to_sqlite_python.sh | 50 ++++++++------
.../test_failed_syscalls_by_pid_python.sh | 68 +++++++++++--------
.../shell/test_failed_syscalls_python.sh | 54 +++++++++------
.../tests/shell/test_flamegraph_python.sh | 5 +-
.../shell/test_futex_contention_python.sh | 7 +-
tools/perf/tests/shell/test_gecko_python.sh | 3 +-
.../shell/test_intel_pt_events_python.sh | 43 ++++++------
.../tests/shell/test_mem_phys_addr_python.sh | 8 ++-
.../shell/test_net_dropmonitor_python.sh | 9 +--
.../tests/shell/test_netdev_times_python.sh | 6 +-
.../tests/shell/test_powerpc_hcalls_python.sh | 4 +-
.../tests/shell/test_rw_by_file_python.sh | 5 +-
.../perf/tests/shell/test_rw_by_pid_python.sh | 4 +-
tools/perf/tests/shell/test_rwtop_python.sh | 4 +-
.../shell/test_sched_migration_python.sh | 4 +-
tools/perf/tests/shell/test_sctop_python.sh | 58 ++++++++--------
.../tests/shell/test_stackcollapse_python.sh | 2 +-
.../perf/tests/shell/test_stat_cpi_python.sh | 12 +++-
.../test_syscall_counts_by_pid_python.sh | 6 +-
.../tests/shell/test_syscall_counts_python.sh | 5 +-
tools/perf/tests/shell/test_task_analyzer.sh | 3 +-
.../tests/shell/test_wakeup_latency_python.sh | 7 +-
tools/perf/util/debug.c | 2 +-
tools/perf/util/evlist.c | 6 +-
tools/perf/util/evsel.c | 59 +++++++++++++++-
tools/perf/util/evsel.h | 1 +
tools/perf/util/pmus.c | 21 ++++--
tools/perf/util/python.c | 1 +
tools/perf/util/tp_pmu.c | 8 ++-
36 files changed, 378 insertions(+), 237 deletions(-)
--
2.56.0.rc1.315.gc6ed9934b7-goog
next prev parent reply other threads:[~2026-09-29 6:58 UTC|newest]
Thread overview: 30+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-09-29 2:19 [PATCH v1 " Ian Rogers
2026-09-29 2:19 ` [PATCH v1 1/9] perf evsel: Clamp sample_id size for ksymbol, bpf, and text_poke events Ian Rogers
2026-09-29 2:19 ` [PATCH v1 2/9] perf python sctop: Fix offline interval printing and test flakiness Ian Rogers
2026-09-29 2:19 ` [PATCH v1 3/9] perf python stat-cpi: Fix live mode signal races " Ian Rogers
2026-09-29 2:19 ` [PATCH v1 4/9] perf test: Deflake Intel PT Python shell tests under load Ian Rogers
2026-09-29 2:19 ` [PATCH v1 5/9] perf test: Deflake failed-syscalls " Ian Rogers
2026-09-29 2:19 ` [PATCH v1 6/9] perf test: Reduce overhead and contention in Python shell tests Ian Rogers
2026-09-29 2:19 ` [PATCH v1 7/9] perf python event_analyzing_sample: Default to in-memory SQLite database Ian Rogers
2026-09-29 2:19 ` [PATCH v1 8/9] perf python: Initialize debug output on module load Ian Rogers
2026-09-29 2:19 ` [PATCH v1 9/9] perf pmu: Fix race with concurrent tracepoint creation and removal in perf list Ian Rogers
2026-09-29 6:29 ` [PATCH v2 0/9] perf python: Follow-up fixes and shell test deflaking Ian Rogers
2026-09-29 6:29 ` [PATCH v2 1/9] perf evsel: Clamp sample_id size for ksymbol, bpf, and text_poke events Ian Rogers
2026-09-29 6:29 ` [PATCH v2 2/9] perf python sctop: Fix offline interval printing and test flakiness Ian Rogers
2026-09-29 6:29 ` [PATCH v2 3/9] perf python stat-cpi: Fix live mode signal races " Ian Rogers
2026-09-29 6:29 ` [PATCH v2 4/9] perf test: Deflake Intel PT Python shell tests under load Ian Rogers
2026-09-29 6:29 ` [PATCH v2 5/9] perf test: Deflake failed-syscalls " Ian Rogers
2026-09-29 6:29 ` [PATCH v2 6/9] perf test: Reduce overhead and contention in Python shell tests Ian Rogers
2026-09-29 6:29 ` [PATCH v2 7/9] perf python event_analyzing_sample: Default to in-memory SQLite database Ian Rogers
2026-09-29 6:29 ` [PATCH v2 8/9] perf python: Initialize debug output on module load Ian Rogers
2026-09-29 6:29 ` [PATCH v2 9/9] perf pmu: Fix race with concurrent tracepoint creation and removal in perf list Ian Rogers
2026-09-29 6:58 ` Ian Rogers [this message]
2026-09-29 6:58 ` [PATCH v3 1/9] perf evsel: Clamp sample_id size for ksymbol, bpf, and text_poke events Ian Rogers
2026-09-29 6:58 ` [PATCH v3 2/9] perf python sctop: Fix offline interval printing and test flakiness Ian Rogers
2026-09-29 6:58 ` [PATCH v3 3/9] perf python stat-cpi: Fix live mode signal races " Ian Rogers
2026-09-29 6:58 ` [PATCH v3 4/9] perf test: Deflake Intel PT Python shell tests under load Ian Rogers
2026-09-29 6:58 ` [PATCH v3 5/9] perf test: Deflake failed-syscalls " Ian Rogers
2026-09-29 6:58 ` [PATCH v3 6/9] perf test: Reduce overhead and contention in Python shell tests Ian Rogers
2026-09-29 6:58 ` [PATCH v3 7/9] perf python event_analyzing_sample: Default to in-memory SQLite database Ian Rogers
2026-09-29 6:58 ` [PATCH v3 8/9] perf python: Initialize debug output on module load Ian Rogers
2026-09-29 6:58 ` [PATCH v3 9/9] perf pmu: Fix race with concurrent tracepoint creation and removal in perf list Ian Rogers
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20260929065839.407062-1-irogers@google.com \
--to=irogers@google.com \
--cc=acme@kernel.org \
--cc=adrian.hunter@intel.com \
--cc=james.clark@linaro.org \
--cc=jolsa@kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-perf-users@vger.kernel.org \
--cc=mingo@redhat.com \
--cc=namhyung@kernel.org \
--cc=peterz@infradead.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®