mirror of https://lore.kernel.org/lkml/
 help / color / mirror / Atom feed
From: Namhyung Kim <namhyung@kernel.org>
To: Ian Rogers <irogers@google.com>
Cc: acme@kernel.org, adrian.hunter@intel.com, james.clark@linaro.org,
	jolsa@kernel.org, linux-kernel@vger.kernel.org,
	linux-perf-users@vger.kernel.org, mingo@redhat.com,
	peterz@infradead.org, eranian@google.com, ddhariwal@google.com,
	rcu@vger.kernel.org
Subject: Re: [PATCH v4 2/7] perf bpf-filter: Support BPF sample filters on tracepoint events
Date: Mon, 19 Oct 2026 22:41:10 -0700	[thread overview]
Message-ID: <atb-9j8tLZ2rFtOm@z2> (raw)
In-Reply-To: <20261019220915.3943592-3-irogers@google.com>

On Mon, Oct 19, 2026 at 03:09:10PM -0700, Ian Rogers wrote:
> Commit 466db4275edd ("perf parse-events: Add parse_uid_filter helper")
> updated set_filter() to route non-tracepoint filter terms (such as uid
> and gid) on PERF_TYPE_TRACEPOINT events to evsel->bpf_filters instead
> of the ftrace tracepoint predicate filter.
> 
> However, in the kernel's __perf_event_set_bpf_prog()
> (kernel/events/core.c), attaching a BPF program to a perf_event fd
> branches on perf_event_is_tracing(event):
> - Non-tracing events (hardware PMU, software events, breakpoints) call
>   perf_event_set_bpf_handler(), which requires BPF_PROG_TYPE_PERF_EVENT
>   (SEC("perf_event")).
> - Tracepoint events (event->pmu == &perf_tracepoint) reject
>   BPF_PROG_TYPE_PERF_EVENT with -EINVAL and instead require
>   BPF_PROG_TYPE_TRACEPOINT (SEC("tracepoint")), which is attached to
>   event->tp_event->prog_array and executed in
>   perf_trace_run_bpf_submit() before perf_tp_event(), dropping the
>   sample if the BPF program returns 0. Furthermore, the
>   bpf_cast_to_kern_ctx() kfunc is only permitted in
>   BPF_PROG_TYPE_PERF_EVENT programs.
> 
> Add SEC("tracepoint") int perf_tp_sample_filter(void *ctx) in
> sample_filter.bpf.c to evaluate context-independent filter terms (uid,
> gid, tid, cpu, time, cgroup) using BPF helpers without calling
> bpf_cast_to_kern_ctx(). When preparing a BPF filter on a
> PERF_TYPE_TRACEPOINT evsel, autoload perf_tp_sample_filter instead of
> perf_sample_filter and attach it once to the shared trace_event_call.
> 
> Before:
>   # perf record -e kmem:mm_page_alloc --filter 'uid == 0' -- true
>   libbpf: prog 'perf_sample_filter': failed to attach to perf_event FD 3: Invalid argument
>   Failed to attach perf sample-filter program
>   failed to set filter "BPF" on event kmem:mm_page_alloc with 22 (Invalid argument)
> 
> After:
>   # perf record -e kmem:mm_page_alloc --filter 'uid == 0' -- true
>   [ perf record: Woken up 1 times to write data ]
>   [ perf record: Captured and wrote 0.024 MB perf.data (42 samples) ]
> 
> Fixes: 466db4275edd ("perf parse-events: Add parse_uid_filter helper")
> Signed-off-by: Ian Rogers <irogers@google.com>
> ---
>  tools/perf/util/bpf-filter.c                 | 136 ++++++++++++++++---
>  tools/perf/util/bpf_skel/sample_filter.bpf.c |  85 ++++++++++++
>  2 files changed, 201 insertions(+), 20 deletions(-)
> 
> diff --git a/tools/perf/util/bpf-filter.c b/tools/perf/util/bpf-filter.c
> index 72e83ac1d6a4..4e99af4764f1 100644
> --- a/tools/perf/util/bpf-filter.c
> +++ b/tools/perf/util/bpf-filter.c
> @@ -123,15 +123,26 @@ static int check_sample_flags(struct evsel *evsel, struct perf_bpf_filter_expr *
>  {
>  	const struct perf_sample_info *info;
>  
> -	if (expr->term >= PBF_TERM_SAMPLE_START && expr->term <= PBF_TERM_SAMPLE_END &&
> -	    (evsel->core.attr.sample_type & (1 << (expr->term - PBF_TERM_SAMPLE_START))))
> -		return 0;
> -
>  	if (expr->term == PBF_TERM_UID || expr->term == PBF_TERM_GID) {
>  		/* Not dependent on the sample_type as computed from a BPF helper. */
>  		return 0;
>  	}
>  
> +	if (evsel->core.attr.type == PERF_TYPE_TRACEPOINT) {
> +		if (expr->term == PBF_TERM_TID || expr->term == PBF_TERM_CPU ||
> +		    expr->term == PBF_TERM_TIME || expr->term == PBF_TERM_CGROUP)
> +			return 0;
> +		if (expr->op != PBF_OP_GROUP_BEGIN) {
> +			pr_err("Error: %s tracepoint event does not support BPF sample term %d\n",
> +			       evsel__name(evsel), expr->term);
> +			return -1;
> +		}
> +	}
> +
> +	if (expr->term >= PBF_TERM_SAMPLE_START && expr->term <= PBF_TERM_SAMPLE_END &&
> +	    (evsel->core.attr.sample_type & (1 << (expr->term - PBF_TERM_SAMPLE_START))))
> +		return 0;
> +
>  	if (expr->op == PBF_OP_GROUP_BEGIN) {
>  		struct perf_bpf_filter_expr *group;
>  
> @@ -427,6 +438,7 @@ int perf_bpf_filter__prepare(struct evsel *evsel, struct target *target)
>  	struct bpf_link *link;
>  	struct perf_bpf_filter_entry *entry;
>  	bool needs_idx_hash = !target__has_cpu(target);
> +	bool is_tracepoint = (evsel->core.attr.type == PERF_TYPE_TRACEPOINT);
>  #if LIBBPF_CURRENT_VERSION_GEQ(1, 7)
>  	DECLARE_LIBBPF_OPTS(bpf_perf_event_opts, pe_opts,
>  			    .dont_enable = true);
> @@ -444,9 +456,15 @@ int perf_bpf_filter__prepare(struct evsel *evsel, struct target *target)
>  		goto err;
>  	}
>  
> -	if (needs_idx_hash && geteuid() != 0) {
> +	if (needs_idx_hash && geteuid() != 0 && !perf_cap__capable(CAP_BPF)) {
>  		int zero = 0;
>  
> +		if (is_tracepoint) {
> +			pr_err("Error: Tracepoint BPF filter requires CAP_BPF capability\n");
> +			ret = -EPERM;
> +			goto err;
> +		}
> +
>  		/* The filters map is shared among other processes */
>  		ret = create_idx_hash(evsel, entry);
>  		if (ret < 0)
> @@ -484,8 +502,17 @@ int perf_bpf_filter__prepare(struct evsel *evsel, struct target *target)
>  		return 0;
>  	}
>  
> -	skel = sample_filter_bpf__open_and_load();
> +	skel = sample_filter_bpf__open();
>  	if (!skel) {
> +		ret = -errno;
> +		pr_err("Failed to open perf sample-filter BPF skeleton\n");
> +		goto err;
> +	}
> +
> +	bpf_program__set_autoload(skel->progs.perf_sample_filter, !is_tracepoint);
> +	bpf_program__set_autoload(skel->progs.perf_tp_sample_filter, is_tracepoint);
> +
> +	if (sample_filter_bpf__load(skel) < 0) {
>  		ret = -errno;
>  		pr_err("Failed to load perf sample-filter BPF skeleton\n");
>  		goto err;
> @@ -501,15 +528,35 @@ int perf_bpf_filter__prepare(struct evsel *evsel, struct target *target)
>  		goto err;
>  	}
>  
> -	prog = skel->progs.perf_sample_filter;
> -	for (x = 0; x < xyarray__max_x(evsel->core.fd); x++) {
> -		for (y = 0; y < xyarray__max_y(evsel->core.fd); y++) {
> -			link = bpf_program__attach_perf_event_opts(prog, FD(evsel, x, y),
> -								   &pe_opts);
> -			if (IS_ERR(link)) {
> -				pr_err("Failed to attach perf sample-filter program\n");
> -				ret = PTR_ERR(link);
> -				goto err;
> +	if (is_tracepoint) {
> +		/*
> +		 * For PERF_TYPE_TRACEPOINT, PERF_EVENT_IOC_SET_BPF attaches the
> +		 * BPF program to event->tp_event->prog_array on the shared
> +		 * trace_event_call, which perf_trace_run_bpf_submit() executes
> +		 * for all CPUs and tasks before iterating the per-CPU perf
> +		 * events. Attach once on the first FD so tp_event->prog_array
> +		 * does not get duplicate copies for each per-CPU FD.
> +		 */
> +		prog = skel->progs.perf_tp_sample_filter;
> +		link = bpf_program__attach_perf_event_opts(prog, FD(evsel, 0, 0),
> +							   &pe_opts);
> +		ret = libbpf_get_error(link);
> +		if (ret) {
> +			pr_err("Failed to attach perf tracepoint sample-filter program\n");
> +			goto err;
> +		}
> +		skel->links.perf_tp_sample_filter = link;
> +	} else {
> +		prog = skel->progs.perf_sample_filter;
> +		for (x = 0; x < xyarray__max_x(evsel->core.fd); x++) {
> +			for (y = 0; y < xyarray__max_y(evsel->core.fd); y++) {
> +				link = bpf_program__attach_perf_event_opts(prog, FD(evsel, x, y),
> +									   &pe_opts);

This link should be saves somewhere.  I've sent a fix for it.


> +				ret = libbpf_get_error(link);
> +				if (ret) {
> +					pr_err("Failed to attach perf sample-filter program\n");
> +					goto err;
> +				}
>  			}
>  		}
>  	}
> @@ -641,6 +688,45 @@ int perf_bpf_filter__parse(struct list_head *expr_head, const char *str)
>  	return ret;
>  }
>  
> +static int pin_filter_object(struct sample_filter_bpf *skel, const char *path)
> +{
> +	char *prog_path = NULL;
> +	int ret;
> +
> +	ret = bpf_object__pin_maps(skel->obj, path);
> +	if (ret < 0)
> +		return ret;
> +
> +	if (asprintf(&prog_path, "%s/perf_sample_filter", path) < 0) {
> +		bpf_object__unpin_maps(skel->obj, path);
> +		return -ENOMEM;
> +	}
> +
> +	ret = bpf_program__pin(skel->progs.perf_sample_filter, prog_path);
> +	if (ret < 0)
> +		bpf_object__unpin_maps(skel->obj, path);
> +
> +	free(prog_path);
> +	return ret;
> +}
> +
> +static int unpin_filter_object(struct sample_filter_bpf *skel, const char *path)
> +{
> +	char *prog_path = NULL;
> +	int ret, map_ret;
> +
> +	if (asprintf(&prog_path, "%s/perf_sample_filter", path) < 0) {
> +		bpf_object__unpin_maps(skel->obj, path);
> +		return -ENOMEM;
> +	}
> +
> +	ret = bpf_program__unpin(skel->progs.perf_sample_filter, prog_path);
> +	free(prog_path);
> +
> +	map_ret = bpf_object__unpin_maps(skel->obj, path);
> +	return ret < 0 ? ret : map_ret;
> +}
> +
>  int perf_bpf_filter__pin(void)
>  {
>  	struct sample_filter_bpf *skel;
> @@ -655,6 +741,7 @@ int perf_bpf_filter__pin(void)
>  	}
>  
>  	/* pinned program will use pid-hash */
> +	bpf_program__set_autoload(skel->progs.perf_tp_sample_filter, false);
>  	bpf_map__set_max_entries(skel->maps.filters, MAX_FILTERS);
>  	bpf_map__set_max_entries(skel->maps.event_hash, MAX_EVT_HASH);
>  	bpf_map__set_max_entries(skel->maps.idx_hash, MAX_IDX_HASH);
> @@ -674,7 +761,7 @@ int perf_bpf_filter__pin(void)
>  		goto err;
>  	}
>  
> -	ret = bpf_object__pin(skel->obj, path);
> +	ret = pin_filter_object(skel, path);

Why is this change needed?

Thanks,
Namhyung


>  	if (ret < 0) {
>  		pr_err("Failed to pin BPF filter objects\n");
>  		goto err;
> @@ -683,8 +770,8 @@ int perf_bpf_filter__pin(void)
>  	/* setup access permissions for the pinned objects */
>  	dir_fd = open(path, O_PATH);
>  	if (dir_fd < 0) {
> -		bpf_object__unpin(skel->obj, path);
> -		ret = dir_fd;
> +		ret = -errno;
> +		unpin_filter_object(skel, path);
>  		goto err;
>  	}
>  
> @@ -727,6 +814,8 @@ int perf_bpf_filter__pin(void)
>  
>  err_close:
>  	close(dir_fd);
> +	if (ret < 0)
> +		unpin_filter_object(skel, path);
>  
>  err:
>  	free(path);
> @@ -740,13 +829,20 @@ int perf_bpf_filter__unpin(void)
>  	char *path = NULL;
>  	int ret = -1;
>  
> -	skel = sample_filter_bpf__open_and_load();
> +	skel = sample_filter_bpf__open();
>  	if (!skel) {
>  		ret = -errno;
>  		pr_err("Failed to open perf sample-filter BPF skeleton\n");
>  		goto err;
>  	}
>  
> +	bpf_program__set_autoload(skel->progs.perf_tp_sample_filter, false);
> +	if (sample_filter_bpf__load(skel) < 0) {
> +		ret = -errno;
> +		pr_err("Failed to load perf sample-filter BPF skeleton\n");
> +		goto err;
> +	}
> +
>  	if (asprintf(&path, "%s/fs/bpf/%s", sysfs__mountpoint(),
>  		     PERF_BPF_FILTER_PIN_PATH) < 0) {
>  		ret = -errno;
> @@ -754,7 +850,7 @@ int perf_bpf_filter__unpin(void)
>  		goto err;
>  	}
>  
> -	ret = bpf_object__unpin(skel->obj, path);
> +	ret = unpin_filter_object(skel, path);
>  
>  err:
>  	free(path);
> diff --git a/tools/perf/util/bpf_skel/sample_filter.bpf.c b/tools/perf/util/bpf_skel/sample_filter.bpf.c
> index e5666d4c1722..576fbed270e5 100644
> --- a/tools/perf/util/bpf_skel/sample_filter.bpf.c
> +++ b/tools/perf/util/bpf_skel/sample_filter.bpf.c
> @@ -192,6 +192,28 @@ static inline __u64 perf_get_sample(struct bpf_perf_event_data_kern *kctx,
>  	return 0;
>  }
>  
> +static __always_inline __u64 perf_get_common_sample(struct perf_bpf_filter_entry *entry)
> +{
> +	switch (entry->term) {
> +	case PBF_TERM_TID:
> +		if (entry->part)
> +			return bpf_get_current_pid_tgid() >> 32;
> +		return (__u32)bpf_get_current_pid_tgid();
> +	case PBF_TERM_CPU:
> +		return bpf_get_smp_processor_id();
> +	case PBF_TERM_TIME:
> +		return bpf_ktime_get_ns();
> +	case PBF_TERM_CGROUP:
> +		return bpf_get_current_cgroup_id();
> +	case PBF_TERM_UID:
> +		return bpf_get_current_uid_gid() & 0xFFFFFFFF;
> +	case PBF_TERM_GID:
> +		return bpf_get_current_uid_gid() >> 32;
> +	default:
> +		return 0;
> +	}
> +}
> +
>  #define CHECK_RESULT(data, op, val)			\
>  	if (!(data op val)) {				\
>  		if (!in_group)				\
> @@ -295,4 +317,67 @@ int perf_sample_filter(void *ctx)
>  	return 0;
>  }
>  
> +/* BPF program to be called for tracepoint perf events */
> +SEC("tracepoint")
> +int perf_tp_sample_filter(void *ctx)
> +{
> +	struct perf_bpf_filter_entry *entry;
> +	__u64 sample_data;
> +	int in_group = 0;
> +	int group_result = 0;
> +	int i, k = 0;
> +	int *losts;
> +
> +	entry = bpf_map_lookup_elem(&filters, &k);
> +	if (entry == NULL)
> +		goto drop;
> +
> +	for (i = 0; i < MAX_FILTERS; i++) {
> +		sample_data = perf_get_common_sample(&entry[i]);
> +
> +		switch (entry[i].op) {
> +		case PBF_OP_EQ:
> +			CHECK_RESULT(sample_data, ==, entry[i].value)
> +			break;
> +		case PBF_OP_NEQ:
> +			CHECK_RESULT(sample_data, !=, entry[i].value)
> +			break;
> +		case PBF_OP_GT:
> +			CHECK_RESULT(sample_data, >, entry[i].value)
> +			break;
> +		case PBF_OP_GE:
> +			CHECK_RESULT(sample_data, >=, entry[i].value)
> +			break;
> +		case PBF_OP_LT:
> +			CHECK_RESULT(sample_data, <, entry[i].value)
> +			break;
> +		case PBF_OP_LE:
> +			CHECK_RESULT(sample_data, <=, entry[i].value)
> +			break;
> +		case PBF_OP_AND:
> +			CHECK_RESULT(sample_data, &, entry[i].value)
> +			break;
> +		case PBF_OP_GROUP_BEGIN:
> +			in_group = 1;
> +			group_result = 0;
> +			break;
> +		case PBF_OP_GROUP_END:
> +			if (group_result == 0)
> +				goto drop;
> +			in_group = 0;
> +			break;
> +		case PBF_OP_DONE:
> +			return 1;
> +		}
> +	}
> +	return 1;
> +
> +drop:
> +	losts = bpf_map_lookup_elem(&dropped, &k);
> +	if (losts != NULL)
> +		__sync_fetch_and_add(losts, 1);
> +
> +	return 0;
> +}
> +
>  char LICENSE[] SEC("license") = "Dual BSD/GPL";
> -- 
> 2.56.0.212.g129ede20d9-goog
> 

  reply	other threads:[~2026-10-20  5:41 UTC|newest]

Thread overview: 32+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-10-17  5:45 [PATCH v1 0/5] perf bpf-filter / lock contention: Add lock_held() sample filter and RCU/SRCU support Ian Rogers
2026-10-17  5:45 ` [PATCH v1 1/5] perf lock contention: Share common BPF and lock type definitions in lock_data.h Ian Rogers
2026-10-17  5:45 ` [PATCH v1 2/5] perf bpf-filter: Add lock_held() sample filter Ian Rogers
2026-10-17  5:45 ` [PATCH v1 3/5] perf test: Add tests for lock_held() BPF " Ian Rogers
2026-10-17  5:45 ` [PATCH v1 4/5] perf bpf-filter: Extend lock_held() to support RCU, Tasks Trace RCU, and SRCU Ian Rogers
2026-10-17  5:45 ` [PATCH v1 5/5] perf lock contention: Extend BPF lock contention to RCU " Ian Rogers
2026-10-17 17:14 ` [PATCH v2 0/6] perf bpf-filter / lock contention: Add lock_held() sample filter and RCU/SRCU support Ian Rogers
2026-10-17 17:14   ` [PATCH v2 1/6] perf lock contention: Share common BPF and lock type definitions in lock_data.h Ian Rogers
2026-10-17 17:14   ` [PATCH v2 2/6] perf bpf-filter: Add lock_held() sample filter Ian Rogers
2026-10-17 17:14   ` [PATCH v2 3/6] perf test: Add tests for lock_held() BPF " Ian Rogers
2026-10-17 17:14   ` [PATCH v2 4/6] perf bpf-filter: Extend lock_held() to support RCU, Tasks Trace RCU, and SRCU Ian Rogers
2026-10-17 17:14   ` [PATCH v2 5/6] perf lock contention: Extend BPF lock contention to RCU " Ian Rogers
2026-10-17 17:14   ` [PATCH v2 6/6] perf lock contention: Filter events before creating lock_stat Ian Rogers
2026-10-18  5:37   ` [PATCH v3 0/6] perf bpf-filter / lock contention: Add lock_held() sample filter and RCU/SRCU support Ian Rogers
2026-10-18  5:37     ` [PATCH v3 1/6] perf lock contention: Share common BPF and lock type definitions in lock_data.h Ian Rogers
2026-10-18  5:37     ` [PATCH v3 2/6] perf bpf-filter: Add lock_held() sample filter Ian Rogers
2026-10-18  5:37     ` [PATCH v3 3/6] perf test: Add tests for lock_held() BPF " Ian Rogers
2026-10-18  5:37     ` [PATCH v3 4/6] perf bpf-filter: Extend lock_held() to support RCU, Tasks Trace RCU, and SRCU Ian Rogers
2026-10-18  5:37     ` [PATCH v3 5/6] perf lock contention: Extend BPF lock contention to RCU " Ian Rogers
2026-10-18  5:37     ` [PATCH v3 6/6] perf lock contention: Filter events before creating lock_stat Ian Rogers
2026-10-19  7:00     ` [PATCH v3 0/6] perf bpf-filter / lock contention: Add lock_held() sample filter and RCU/SRCU support Namhyung Kim
2026-10-19 19:08       ` Ian Rogers
2026-10-19 22:09     ` [PATCH v4 0/7] " Ian Rogers
2026-10-19 22:09       ` [PATCH v4 1/7] perf lock contention: Filter events before creating lock_stat Ian Rogers
2026-10-20  4:34         ` Namhyung Kim
2026-10-19 22:09       ` [PATCH v4 2/7] perf bpf-filter: Support BPF sample filters on tracepoint events Ian Rogers
2026-10-20  5:41         ` Namhyung Kim [this message]
2026-10-19 22:09       ` [PATCH v4 3/7] perf lock contention: Share common BPF and lock type definitions in lock_data.h Ian Rogers
2026-10-19 22:09       ` [PATCH v4 4/7] perf bpf-filter: Add lock_held() sample filter Ian Rogers
2026-10-19 22:09       ` [PATCH v4 5/7] perf test: Add tests for lock_held() BPF " Ian Rogers
2026-10-19 22:09       ` [PATCH v4 6/7] perf bpf-filter: Extend lock_held() to support RCU, Tasks Trace RCU, and SRCU Ian Rogers
2026-10-19 22:09       ` [PATCH v4 7/7] perf lock contention: Extend BPF lock contention to RCU " Ian Rogers

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=atb-9j8tLZ2rFtOm@z2 \
    --to=namhyung@kernel.org \
    --cc=acme@kernel.org \
    --cc=adrian.hunter@intel.com \
    --cc=ddhariwal@google.com \
    --cc=eranian@google.com \
    --cc=irogers@google.com \
    --cc=james.clark@linaro.org \
    --cc=jolsa@kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-perf-users@vger.kernel.org \
    --cc=mingo@redhat.com \
    --cc=peterz@infradead.org \
    --cc=rcu@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox

all inboxes | Powered by JetHome®