From: Daniel Santos <daniel.santos@pobox.com>
To: LKML <linux-kernel@vger.kernel.org>,
Akinobu Mita <akinobu.mita@gmail.com>,
Andrea Arcangeli <aarcange@redhat.com>,
Andrew Morton <akpm@linux-foundation.org>,
Daniel Santos <daniel.santos@pobox.com>,
David Woodhouse <David.Woodhouse@intel.com>,
"H. Peter Anvin" <hpa@zytor.com>, Ingo Molnar <mingo@elte.hu>,
John Stultz <john.stultz@linaro.org>,
linux-doc@vger.kernel.org, Michel Lespinasse <walken@google.com>,
"Paul E. McKenney" <paul.mckenney@linaro.org>,
Paul Gortmaker <paul.gortmaker@windriver.com>,
Pavel Pisa <pisa@cmp.felk.cvut.cz>,
Peter Zijlstra <a.p.zijlstra@chello.nl>,
Rik van Riel <riel@redhat.com>, Rob Landley <rob@landley.net>
Subject: [PATCH v6 10/10] selftest: report generation script for test results
Date: Fri, 28 Sep 2012 18:48:46 -0500 [thread overview]
Message-ID: <1348876126-28792-5-git-send-email-daniel.santos@pobox.com> (raw)
In-Reply-To: <1348875625-28669-1-git-send-email-daniel.santos@pobox.com>
A script that uses sqlite to load test results and generates a report
showing differences in performance per compiler used.
Signed-off-by: Daniel Santos <daniel.santos@pobox.com>
---
tools/testing/selftests/grbtree/user/gen_report.sh | 129 ++++++++++++++++++++
1 files changed, 129 insertions(+), 0 deletions(-)
create mode 100755 tools/testing/selftests/grbtree/user/gen_report.sh
diff --git a/tools/testing/selftests/grbtree/user/gen_report.sh b/tools/testing/selftests/grbtree/user/gen_report.sh
new file mode 100755
index 0000000..a0ab88a
--- /dev/null
+++ b/tools/testing/selftests/grbtree/user/gen_report.sh
@@ -0,0 +1,129 @@
+#!/bin/bash
+
+dbfile=results.$$.db
+datafile=runtest.out
+
+die() {
+ echo "ERROR${@:+": "}$@" 1>&2
+ exit -1
+}
+
+find_sqlite() {
+ for suffix in "" 4 3; do
+ which sqlite${suffix} 2> /dev/null && return 0
+ done
+ return 1
+}
+
+sqlite=$(find_sqlite) || die "failed to find sqlite"
+
+${sqlite} "${dbfile}" << asdf
+/* .echo on */
+.headers on
+create table if not exists grbtest_result (
+ compiler varchar(255),
+ key_type varchar(255),
+ payload int,
+ userland tinyint,
+ use_generic tinyint,
+ use_leftmost tinyint,
+ use_rightmost tinyint,
+ use_count tinyint,
+ unique_keys tinyint,
+ insert_replaces tinyint,
+ debug tinyint,
+ debug_validate tinyint,
+ arch varchar(255),
+ arch_flags varchar(255),
+ processor varchar(255),
+ cc varchar(255),
+ cflags varchar(255),
+ test tinyint,
+ in_seed bigint,
+ seed bigint,
+ key_mask int,
+ object_count int,
+ pool_count int,
+ reps bigint,
+ node_size int,
+ object_size int,
+ pool_size int,
+ insertions bigint,
+ insertion_time bigint,
+ evictions bigint,
+ deletions bigint,
+ deletion_time bigint
+);
+.separator |
+.import ${datafile} grbtest_result
+/* .mode column */
+select distinct
+ key_type,
+ payload,
+ userland,
+ use_leftmost,
+ use_rightmost,
+ use_count,
+ unique_keys,
+ insert_replaces,
+ debug,
+ debug_validate,
+ arch,
+ arch_flags,
+ processor,
+ cc,
+ test,
+ in_seed,
+ seed,
+ key_mask,
+ object_count,
+ pool_count,
+ reps,
+ node_size,
+ object_size,
+ pool_size,
+ insertions,
+ evictions,
+ deletions
+from grbtest_result;
+
+select distinct
+ a.compiler as 'Compiler',
+ a.key_type,
+ a.payload,
+ a.userland,
+ (case when a.use_leftmost then 'L' else '.' end) ||
+ (case when a.use_rightmost then 'R' else '.' end) ||
+ (case when a.use_count then 'C' else '.' end) ||
+ (case when a.unique_keys then 'U' else '.' end) ||
+ (case when a.insert_replaces then 'I' else '.' end) ||
+ (case when a.debug then 'D' else '.' end) ||
+ (case when a.debug_validate then 'V' else '.' end)
+ as config,
+ a.insertion_time as 'Generic Insert Time',
+ b.insertion_time as 'Hand-Coded Insert Time',
+ 1.0 * a.insertion_time / b.insertion_time - 1.0 as 'Insert Diff',
+ a.deletion_time as 'Generic Delete Time',
+ b.deletion_time as 'Hand-Coded Delete Time',
+ 1.0 * a.deletion_time / b.deletion_time - 1.0 as 'Delete Diff'
+from
+ grbtest_result as a inner join grbtest_result as b on (
+ a.compiler = b.compiler
+ AND a.key_type = b.key_type
+ AND a.payload = b.payload
+ AND a.userland = b.userland
+ AND a.use_leftmost = b.use_leftmost
+ AND a.use_rightmost = b.use_rightmost
+ AND a.use_count = b.use_count
+ AND a.unique_keys = b.unique_keys
+ AND a.insert_replaces = b.insert_replaces
+ AND a.debug = b.debug
+ AND a.debug_validate = b.debug_validate
+ )
+where
+ a.use_generic == 1
+ and b.use_generic = 0;
+asdf
+
+rm "${dbfile}"
+
--
1.7.3.4
prev parent reply other threads:[~2012-09-28 23:49 UTC|newest]
Thread overview: 11+ messages / expand[flat|nested] mbox.gz Atom feed top
2012-09-28 23:40 [PATCH v6 0/10] Generic Red-Black Trees Daniel Santos
2012-09-28 23:40 ` [PATCH v6 1/10] rbtree.h: " Daniel Santos
2012-09-28 23:40 ` [PATCH v6 2/10] rbtree.h: include kconfig.h Daniel Santos
2012-09-28 23:40 ` [PATCH v6 3/10] Generate doc comments for rbtree.h in Kernel-API Daniel Santos
2012-09-28 23:40 ` [PATCH v6 4/10] rbtree.h: Add test & validation framework Daniel Santos
2012-09-28 23:40 ` [PATCH v6 5/10] rbtree.h: add doc comments for struct rb_node Daniel Santos
2012-09-28 23:48 ` [PATCH v6 6/10] selftest: Add generic tree self-test common code Daniel Santos
2012-09-28 23:48 ` [PATCH v6 7/10] selftest: Add userspace test program Daniel Santos
2012-09-28 23:48 ` [PATCH v6 8/10] selftest: Add script to compile & run " Daniel Santos
2012-09-28 23:48 ` [PATCH v6 9/10] selftest: Add basic compiler iterator test script Daniel Santos
2012-09-28 23:48 ` Daniel Santos [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1348876126-28792-5-git-send-email-daniel.santos@pobox.com \
--to=daniel.santos@pobox.com \
--cc=David.Woodhouse@intel.com \
--cc=a.p.zijlstra@chello.nl \
--cc=aarcange@redhat.com \
--cc=akinobu.mita@gmail.com \
--cc=akpm@linux-foundation.org \
--cc=hpa@zytor.com \
--cc=john.stultz@linaro.org \
--cc=linux-doc@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=mingo@elte.hu \
--cc=paul.gortmaker@windriver.com \
--cc=paul.mckenney@linaro.org \
--cc=pisa@cmp.felk.cvut.cz \
--cc=riel@redhat.com \
--cc=rob@landley.net \
--cc=walken@google.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®