From: Namhyung Kim <namhyung@kernel.org>
To: Ian Rogers <irogers@google.com>
Cc: acme@kernel.org, adrian.hunter@intel.com, james.clark@linaro.org,
jolsa@kernel.org, linux-kernel@vger.kernel.org,
linux-perf-users@vger.kernel.org, mingo@redhat.com,
peterz@infradead.org, eranian@google.com, ddhariwal@google.com,
rcu@vger.kernel.org
Subject: Re: [PATCH v4 2/7] perf bpf-filter: Support BPF sample filters on tracepoint events
Date: Mon, 19 Oct 2026 22:41:10 -0700 [thread overview]
Message-ID: <atb-9j8tLZ2rFtOm@z2> (raw)
In-Reply-To: <20261019220915.3943592-3-irogers@google.com>
On Mon, Oct 19, 2026 at 03:09:10PM -0700, Ian Rogers wrote:
> Commit 466db4275edd ("perf parse-events: Add parse_uid_filter helper")
> updated set_filter() to route non-tracepoint filter terms (such as uid
> and gid) on PERF_TYPE_TRACEPOINT events to evsel->bpf_filters instead
> of the ftrace tracepoint predicate filter.
>
> However, in the kernel's __perf_event_set_bpf_prog()
> (kernel/events/core.c), attaching a BPF program to a perf_event fd
> branches on perf_event_is_tracing(event):
> - Non-tracing events (hardware PMU, software events, breakpoints) call
> perf_event_set_bpf_handler(), which requires BPF_PROG_TYPE_PERF_EVENT
> (SEC("perf_event")).
> - Tracepoint events (event->pmu == &perf_tracepoint) reject
> BPF_PROG_TYPE_PERF_EVENT with -EINVAL and instead require
> BPF_PROG_TYPE_TRACEPOINT (SEC("tracepoint")), which is attached to
> event->tp_event->prog_array and executed in
> perf_trace_run_bpf_submit() before perf_tp_event(), dropping the
> sample if the BPF program returns 0. Furthermore, the
> bpf_cast_to_kern_ctx() kfunc is only permitted in
> BPF_PROG_TYPE_PERF_EVENT programs.
>
> Add SEC("tracepoint") int perf_tp_sample_filter(void *ctx) in
> sample_filter.bpf.c to evaluate context-independent filter terms (uid,
> gid, tid, cpu, time, cgroup) using BPF helpers without calling
> bpf_cast_to_kern_ctx(). When preparing a BPF filter on a
> PERF_TYPE_TRACEPOINT evsel, autoload perf_tp_sample_filter instead of
> perf_sample_filter and attach it once to the shared trace_event_call.
>
> Before:
> # perf record -e kmem:mm_page_alloc --filter 'uid == 0' -- true
> libbpf: prog 'perf_sample_filter': failed to attach to perf_event FD 3: Invalid argument
> Failed to attach perf sample-filter program
> failed to set filter "BPF" on event kmem:mm_page_alloc with 22 (Invalid argument)
>
> After:
> # perf record -e kmem:mm_page_alloc --filter 'uid == 0' -- true
> [ perf record: Woken up 1 times to write data ]
> [ perf record: Captured and wrote 0.024 MB perf.data (42 samples) ]
>
> Fixes: 466db4275edd ("perf parse-events: Add parse_uid_filter helper")
> Signed-off-by: Ian Rogers <irogers@google.com>
> ---
> tools/perf/util/bpf-filter.c | 136 ++++++++++++++++---
> tools/perf/util/bpf_skel/sample_filter.bpf.c | 85 ++++++++++++
> 2 files changed, 201 insertions(+), 20 deletions(-)
>
> diff --git a/tools/perf/util/bpf-filter.c b/tools/perf/util/bpf-filter.c
> index 72e83ac1d6a4..4e99af4764f1 100644
> --- a/tools/perf/util/bpf-filter.c
> +++ b/tools/perf/util/bpf-filter.c
> @@ -123,15 +123,26 @@ static int check_sample_flags(struct evsel *evsel, struct perf_bpf_filter_expr *
> {
> const struct perf_sample_info *info;
>
> - if (expr->term >= PBF_TERM_SAMPLE_START && expr->term <= PBF_TERM_SAMPLE_END &&
> - (evsel->core.attr.sample_type & (1 << (expr->term - PBF_TERM_SAMPLE_START))))
> - return 0;
> -
> if (expr->term == PBF_TERM_UID || expr->term == PBF_TERM_GID) {
> /* Not dependent on the sample_type as computed from a BPF helper. */
> return 0;
> }
>
> + if (evsel->core.attr.type == PERF_TYPE_TRACEPOINT) {
> + if (expr->term == PBF_TERM_TID || expr->term == PBF_TERM_CPU ||
> + expr->term == PBF_TERM_TIME || expr->term == PBF_TERM_CGROUP)
> + return 0;
> + if (expr->op != PBF_OP_GROUP_BEGIN) {
> + pr_err("Error: %s tracepoint event does not support BPF sample term %d\n",
> + evsel__name(evsel), expr->term);
> + return -1;
> + }
> + }
> +
> + if (expr->term >= PBF_TERM_SAMPLE_START && expr->term <= PBF_TERM_SAMPLE_END &&
> + (evsel->core.attr.sample_type & (1 << (expr->term - PBF_TERM_SAMPLE_START))))
> + return 0;
> +
> if (expr->op == PBF_OP_GROUP_BEGIN) {
> struct perf_bpf_filter_expr *group;
>
> @@ -427,6 +438,7 @@ int perf_bpf_filter__prepare(struct evsel *evsel, struct target *target)
> struct bpf_link *link;
> struct perf_bpf_filter_entry *entry;
> bool needs_idx_hash = !target__has_cpu(target);
> + bool is_tracepoint = (evsel->core.attr.type == PERF_TYPE_TRACEPOINT);
> #if LIBBPF_CURRENT_VERSION_GEQ(1, 7)
> DECLARE_LIBBPF_OPTS(bpf_perf_event_opts, pe_opts,
> .dont_enable = true);
> @@ -444,9 +456,15 @@ int perf_bpf_filter__prepare(struct evsel *evsel, struct target *target)
> goto err;
> }
>
> - if (needs_idx_hash && geteuid() != 0) {
> + if (needs_idx_hash && geteuid() != 0 && !perf_cap__capable(CAP_BPF)) {
> int zero = 0;
>
> + if (is_tracepoint) {
> + pr_err("Error: Tracepoint BPF filter requires CAP_BPF capability\n");
> + ret = -EPERM;
> + goto err;
> + }
> +
> /* The filters map is shared among other processes */
> ret = create_idx_hash(evsel, entry);
> if (ret < 0)
> @@ -484,8 +502,17 @@ int perf_bpf_filter__prepare(struct evsel *evsel, struct target *target)
> return 0;
> }
>
> - skel = sample_filter_bpf__open_and_load();
> + skel = sample_filter_bpf__open();
> if (!skel) {
> + ret = -errno;
> + pr_err("Failed to open perf sample-filter BPF skeleton\n");
> + goto err;
> + }
> +
> + bpf_program__set_autoload(skel->progs.perf_sample_filter, !is_tracepoint);
> + bpf_program__set_autoload(skel->progs.perf_tp_sample_filter, is_tracepoint);
> +
> + if (sample_filter_bpf__load(skel) < 0) {
> ret = -errno;
> pr_err("Failed to load perf sample-filter BPF skeleton\n");
> goto err;
> @@ -501,15 +528,35 @@ int perf_bpf_filter__prepare(struct evsel *evsel, struct target *target)
> goto err;
> }
>
> - prog = skel->progs.perf_sample_filter;
> - for (x = 0; x < xyarray__max_x(evsel->core.fd); x++) {
> - for (y = 0; y < xyarray__max_y(evsel->core.fd); y++) {
> - link = bpf_program__attach_perf_event_opts(prog, FD(evsel, x, y),
> - &pe_opts);
> - if (IS_ERR(link)) {
> - pr_err("Failed to attach perf sample-filter program\n");
> - ret = PTR_ERR(link);
> - goto err;
> + if (is_tracepoint) {
> + /*
> + * For PERF_TYPE_TRACEPOINT, PERF_EVENT_IOC_SET_BPF attaches the
> + * BPF program to event->tp_event->prog_array on the shared
> + * trace_event_call, which perf_trace_run_bpf_submit() executes
> + * for all CPUs and tasks before iterating the per-CPU perf
> + * events. Attach once on the first FD so tp_event->prog_array
> + * does not get duplicate copies for each per-CPU FD.
> + */
> + prog = skel->progs.perf_tp_sample_filter;
> + link = bpf_program__attach_perf_event_opts(prog, FD(evsel, 0, 0),
> + &pe_opts);
> + ret = libbpf_get_error(link);
> + if (ret) {
> + pr_err("Failed to attach perf tracepoint sample-filter program\n");
> + goto err;
> + }
> + skel->links.perf_tp_sample_filter = link;
> + } else {
> + prog = skel->progs.perf_sample_filter;
> + for (x = 0; x < xyarray__max_x(evsel->core.fd); x++) {
> + for (y = 0; y < xyarray__max_y(evsel->core.fd); y++) {
> + link = bpf_program__attach_perf_event_opts(prog, FD(evsel, x, y),
> + &pe_opts);
This link should be saves somewhere. I've sent a fix for it.
> + ret = libbpf_get_error(link);
> + if (ret) {
> + pr_err("Failed to attach perf sample-filter program\n");
> + goto err;
> + }
> }
> }
> }
> @@ -641,6 +688,45 @@ int perf_bpf_filter__parse(struct list_head *expr_head, const char *str)
> return ret;
> }
>
> +static int pin_filter_object(struct sample_filter_bpf *skel, const char *path)
> +{
> + char *prog_path = NULL;
> + int ret;
> +
> + ret = bpf_object__pin_maps(skel->obj, path);
> + if (ret < 0)
> + return ret;
> +
> + if (asprintf(&prog_path, "%s/perf_sample_filter", path) < 0) {
> + bpf_object__unpin_maps(skel->obj, path);
> + return -ENOMEM;
> + }
> +
> + ret = bpf_program__pin(skel->progs.perf_sample_filter, prog_path);
> + if (ret < 0)
> + bpf_object__unpin_maps(skel->obj, path);
> +
> + free(prog_path);
> + return ret;
> +}
> +
> +static int unpin_filter_object(struct sample_filter_bpf *skel, const char *path)
> +{
> + char *prog_path = NULL;
> + int ret, map_ret;
> +
> + if (asprintf(&prog_path, "%s/perf_sample_filter", path) < 0) {
> + bpf_object__unpin_maps(skel->obj, path);
> + return -ENOMEM;
> + }
> +
> + ret = bpf_program__unpin(skel->progs.perf_sample_filter, prog_path);
> + free(prog_path);
> +
> + map_ret = bpf_object__unpin_maps(skel->obj, path);
> + return ret < 0 ? ret : map_ret;
> +}
> +
> int perf_bpf_filter__pin(void)
> {
> struct sample_filter_bpf *skel;
> @@ -655,6 +741,7 @@ int perf_bpf_filter__pin(void)
> }
>
> /* pinned program will use pid-hash */
> + bpf_program__set_autoload(skel->progs.perf_tp_sample_filter, false);
> bpf_map__set_max_entries(skel->maps.filters, MAX_FILTERS);
> bpf_map__set_max_entries(skel->maps.event_hash, MAX_EVT_HASH);
> bpf_map__set_max_entries(skel->maps.idx_hash, MAX_IDX_HASH);
> @@ -674,7 +761,7 @@ int perf_bpf_filter__pin(void)
> goto err;
> }
>
> - ret = bpf_object__pin(skel->obj, path);
> + ret = pin_filter_object(skel, path);
Why is this change needed?
Thanks,
Namhyung
> if (ret < 0) {
> pr_err("Failed to pin BPF filter objects\n");
> goto err;
> @@ -683,8 +770,8 @@ int perf_bpf_filter__pin(void)
> /* setup access permissions for the pinned objects */
> dir_fd = open(path, O_PATH);
> if (dir_fd < 0) {
> - bpf_object__unpin(skel->obj, path);
> - ret = dir_fd;
> + ret = -errno;
> + unpin_filter_object(skel, path);
> goto err;
> }
>
> @@ -727,6 +814,8 @@ int perf_bpf_filter__pin(void)
>
> err_close:
> close(dir_fd);
> + if (ret < 0)
> + unpin_filter_object(skel, path);
>
> err:
> free(path);
> @@ -740,13 +829,20 @@ int perf_bpf_filter__unpin(void)
> char *path = NULL;
> int ret = -1;
>
> - skel = sample_filter_bpf__open_and_load();
> + skel = sample_filter_bpf__open();
> if (!skel) {
> ret = -errno;
> pr_err("Failed to open perf sample-filter BPF skeleton\n");
> goto err;
> }
>
> + bpf_program__set_autoload(skel->progs.perf_tp_sample_filter, false);
> + if (sample_filter_bpf__load(skel) < 0) {
> + ret = -errno;
> + pr_err("Failed to load perf sample-filter BPF skeleton\n");
> + goto err;
> + }
> +
> if (asprintf(&path, "%s/fs/bpf/%s", sysfs__mountpoint(),
> PERF_BPF_FILTER_PIN_PATH) < 0) {
> ret = -errno;
> @@ -754,7 +850,7 @@ int perf_bpf_filter__unpin(void)
> goto err;
> }
>
> - ret = bpf_object__unpin(skel->obj, path);
> + ret = unpin_filter_object(skel, path);
>
> err:
> free(path);
> diff --git a/tools/perf/util/bpf_skel/sample_filter.bpf.c b/tools/perf/util/bpf_skel/sample_filter.bpf.c
> index e5666d4c1722..576fbed270e5 100644
> --- a/tools/perf/util/bpf_skel/sample_filter.bpf.c
> +++ b/tools/perf/util/bpf_skel/sample_filter.bpf.c
> @@ -192,6 +192,28 @@ static inline __u64 perf_get_sample(struct bpf_perf_event_data_kern *kctx,
> return 0;
> }
>
> +static __always_inline __u64 perf_get_common_sample(struct perf_bpf_filter_entry *entry)
> +{
> + switch (entry->term) {
> + case PBF_TERM_TID:
> + if (entry->part)
> + return bpf_get_current_pid_tgid() >> 32;
> + return (__u32)bpf_get_current_pid_tgid();
> + case PBF_TERM_CPU:
> + return bpf_get_smp_processor_id();
> + case PBF_TERM_TIME:
> + return bpf_ktime_get_ns();
> + case PBF_TERM_CGROUP:
> + return bpf_get_current_cgroup_id();
> + case PBF_TERM_UID:
> + return bpf_get_current_uid_gid() & 0xFFFFFFFF;
> + case PBF_TERM_GID:
> + return bpf_get_current_uid_gid() >> 32;
> + default:
> + return 0;
> + }
> +}
> +
> #define CHECK_RESULT(data, op, val) \
> if (!(data op val)) { \
> if (!in_group) \
> @@ -295,4 +317,67 @@ int perf_sample_filter(void *ctx)
> return 0;
> }
>
> +/* BPF program to be called for tracepoint perf events */
> +SEC("tracepoint")
> +int perf_tp_sample_filter(void *ctx)
> +{
> + struct perf_bpf_filter_entry *entry;
> + __u64 sample_data;
> + int in_group = 0;
> + int group_result = 0;
> + int i, k = 0;
> + int *losts;
> +
> + entry = bpf_map_lookup_elem(&filters, &k);
> + if (entry == NULL)
> + goto drop;
> +
> + for (i = 0; i < MAX_FILTERS; i++) {
> + sample_data = perf_get_common_sample(&entry[i]);
> +
> + switch (entry[i].op) {
> + case PBF_OP_EQ:
> + CHECK_RESULT(sample_data, ==, entry[i].value)
> + break;
> + case PBF_OP_NEQ:
> + CHECK_RESULT(sample_data, !=, entry[i].value)
> + break;
> + case PBF_OP_GT:
> + CHECK_RESULT(sample_data, >, entry[i].value)
> + break;
> + case PBF_OP_GE:
> + CHECK_RESULT(sample_data, >=, entry[i].value)
> + break;
> + case PBF_OP_LT:
> + CHECK_RESULT(sample_data, <, entry[i].value)
> + break;
> + case PBF_OP_LE:
> + CHECK_RESULT(sample_data, <=, entry[i].value)
> + break;
> + case PBF_OP_AND:
> + CHECK_RESULT(sample_data, &, entry[i].value)
> + break;
> + case PBF_OP_GROUP_BEGIN:
> + in_group = 1;
> + group_result = 0;
> + break;
> + case PBF_OP_GROUP_END:
> + if (group_result == 0)
> + goto drop;
> + in_group = 0;
> + break;
> + case PBF_OP_DONE:
> + return 1;
> + }
> + }
> + return 1;
> +
> +drop:
> + losts = bpf_map_lookup_elem(&dropped, &k);
> + if (losts != NULL)
> + __sync_fetch_and_add(losts, 1);
> +
> + return 0;
> +}
> +
> char LICENSE[] SEC("license") = "Dual BSD/GPL";
> --
> 2.56.0.212.g129ede20d9-goog
>
next prev parent reply other threads:[~2026-10-20 5:41 UTC|newest]
Thread overview: 32+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-10-17 5:45 [PATCH v1 0/5] perf bpf-filter / lock contention: Add lock_held() sample filter and RCU/SRCU support Ian Rogers
2026-10-17 5:45 ` [PATCH v1 1/5] perf lock contention: Share common BPF and lock type definitions in lock_data.h Ian Rogers
2026-10-17 5:45 ` [PATCH v1 2/5] perf bpf-filter: Add lock_held() sample filter Ian Rogers
2026-10-17 5:45 ` [PATCH v1 3/5] perf test: Add tests for lock_held() BPF " Ian Rogers
2026-10-17 5:45 ` [PATCH v1 4/5] perf bpf-filter: Extend lock_held() to support RCU, Tasks Trace RCU, and SRCU Ian Rogers
2026-10-17 5:45 ` [PATCH v1 5/5] perf lock contention: Extend BPF lock contention to RCU " Ian Rogers
2026-10-17 17:14 ` [PATCH v2 0/6] perf bpf-filter / lock contention: Add lock_held() sample filter and RCU/SRCU support Ian Rogers
2026-10-17 17:14 ` [PATCH v2 1/6] perf lock contention: Share common BPF and lock type definitions in lock_data.h Ian Rogers
2026-10-17 17:14 ` [PATCH v2 2/6] perf bpf-filter: Add lock_held() sample filter Ian Rogers
2026-10-17 17:14 ` [PATCH v2 3/6] perf test: Add tests for lock_held() BPF " Ian Rogers
2026-10-17 17:14 ` [PATCH v2 4/6] perf bpf-filter: Extend lock_held() to support RCU, Tasks Trace RCU, and SRCU Ian Rogers
2026-10-17 17:14 ` [PATCH v2 5/6] perf lock contention: Extend BPF lock contention to RCU " Ian Rogers
2026-10-17 17:14 ` [PATCH v2 6/6] perf lock contention: Filter events before creating lock_stat Ian Rogers
2026-10-18 5:37 ` [PATCH v3 0/6] perf bpf-filter / lock contention: Add lock_held() sample filter and RCU/SRCU support Ian Rogers
2026-10-18 5:37 ` [PATCH v3 1/6] perf lock contention: Share common BPF and lock type definitions in lock_data.h Ian Rogers
2026-10-18 5:37 ` [PATCH v3 2/6] perf bpf-filter: Add lock_held() sample filter Ian Rogers
2026-10-18 5:37 ` [PATCH v3 3/6] perf test: Add tests for lock_held() BPF " Ian Rogers
2026-10-18 5:37 ` [PATCH v3 4/6] perf bpf-filter: Extend lock_held() to support RCU, Tasks Trace RCU, and SRCU Ian Rogers
2026-10-18 5:37 ` [PATCH v3 5/6] perf lock contention: Extend BPF lock contention to RCU " Ian Rogers
2026-10-18 5:37 ` [PATCH v3 6/6] perf lock contention: Filter events before creating lock_stat Ian Rogers
2026-10-19 7:00 ` [PATCH v3 0/6] perf bpf-filter / lock contention: Add lock_held() sample filter and RCU/SRCU support Namhyung Kim
2026-10-19 19:08 ` Ian Rogers
2026-10-19 22:09 ` [PATCH v4 0/7] " Ian Rogers
2026-10-19 22:09 ` [PATCH v4 1/7] perf lock contention: Filter events before creating lock_stat Ian Rogers
2026-10-20 4:34 ` Namhyung Kim
2026-10-19 22:09 ` [PATCH v4 2/7] perf bpf-filter: Support BPF sample filters on tracepoint events Ian Rogers
2026-10-20 5:41 ` Namhyung Kim [this message]
2026-10-19 22:09 ` [PATCH v4 3/7] perf lock contention: Share common BPF and lock type definitions in lock_data.h Ian Rogers
2026-10-19 22:09 ` [PATCH v4 4/7] perf bpf-filter: Add lock_held() sample filter Ian Rogers
2026-10-19 22:09 ` [PATCH v4 5/7] perf test: Add tests for lock_held() BPF " Ian Rogers
2026-10-19 22:09 ` [PATCH v4 6/7] perf bpf-filter: Extend lock_held() to support RCU, Tasks Trace RCU, and SRCU Ian Rogers
2026-10-19 22:09 ` [PATCH v4 7/7] perf lock contention: Extend BPF lock contention to RCU " Ian Rogers
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=atb-9j8tLZ2rFtOm@z2 \
--to=namhyung@kernel.org \
--cc=acme@kernel.org \
--cc=adrian.hunter@intel.com \
--cc=ddhariwal@google.com \
--cc=eranian@google.com \
--cc=irogers@google.com \
--cc=james.clark@linaro.org \
--cc=jolsa@kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-perf-users@vger.kernel.org \
--cc=mingo@redhat.com \
--cc=peterz@infradead.org \
--cc=rcu@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®