From: Ingo Oeser <ioe-lkml@rameria.de>
To: trelane@digitasaru.net
Cc: Alex Belits <abelits@phobos.illtel.denver.co.us>,
Dax Kelson <dax@gurulabs.com>, Hans Reiser <reiser@namesys.com>,
andersen@codepoet.org, linux-kernel@vger.kernel.org
Subject: Re: Things that Longhorn seems to be doing right
Date: Thu, 30 Oct 2003 10:52:15 +0100 [thread overview]
Message-ID: <200310301052.15315.ioe-lkml@rameria.de> (raw)
In-Reply-To: <20031030031223.GA15309@digitasaru.net>
On Thursday 30 October 2003 04:12, Joseph Pingenot wrote:
> being in userspace. The cost is the context switching performance hit and
> the fact that each process that wants to index its stuff must tell the
> filesystem and the indexing service its data (effectively, two writes and a
> completely separate API). [I'm likely preaching to the choir here, but
> it's good to outline it]
To tell the data, you just have to create a mapping of a file and
pass that somehow. So you get it fresh from the pagecache.
Since the indexer will just read it, this mapping will be even shared,
which means it will not affect disk performance of the other
applications using this file.
Also notice, that no global index is needed, but per user ones, which
must be mergable with a global one.
Rationale: User A should not know the file contents of user B.
And currently indexing is sloooow. I tried glimpse and htdig and they
run several hours just for indexing the KDE and QT documentation.
This let me come to the conclusion that a small keyword generator
(strings?) run after fsync, which stores autogenerated keywords in the
nearest index (per file, per directory, per user, global) might be better.
Another interesting idea might be using existing indexes by letting
applications define a search handler. This might prove useful for
databases and will allow for unified search. But that might prove to be
quite hard.
Regards
Ingo Oeser
next prev parent reply other threads:[~2003-10-30 10:09 UTC|newest]
Thread overview: 83+ messages / expand[flat|nested] mbox.gz Atom feed top
2003-10-29 8:50 Hans Reiser
2003-10-29 22:42 ` Erik Andersen
2003-10-29 23:03 ` Hans Reiser
2003-10-29 22:25 ` Dax Kelson
2003-10-30 0:20 ` Joseph Pingenot
2003-10-30 0:54 ` Neil Brown
2003-10-30 1:34 ` Joseph Pingenot
2003-10-30 2:54 ` Bernd Eckenfels
2003-10-30 2:58 ` Arnaldo Carvalho de Melo
2003-10-30 3:16 ` Joseph Pingenot
2003-10-30 5:28 ` Jeff Garzik
2003-10-30 5:56 ` Valdis.Kletnieks
2003-10-30 3:16 ` Neil Brown
2003-10-30 3:39 ` Joseph Pingenot
2003-10-30 10:27 ` Thorsten Körner
2003-10-30 21:28 ` jlnance
2003-10-30 22:29 ` Måns Rullgård
2003-10-31 2:03 ` Daniel B.
2003-10-31 1:04 ` Clemens Schwaighofer
2003-10-30 2:09 ` Alex Belits
2003-10-30 3:12 ` Joseph Pingenot
2003-10-30 4:21 ` Scott Robert Ladd
2003-10-31 16:42 ` Timothy Miller
2003-10-31 19:15 ` Hans Reiser
2003-10-30 9:52 ` Ingo Oeser [this message]
2003-10-30 4:06 ` Scott Robert Ladd
2003-10-30 1:52 ` Theodore Ts'o
2003-10-30 2:03 ` Joseph Pingenot
2003-10-30 9:23 ` Ingo Oeser
2003-10-30 3:57 ` Scott Robert Ladd
2003-10-30 4:08 ` Larry McVoy
2003-10-30 13:46 ` Jesse Pollard
2003-10-31 4:50 ` Stephen Satchell
2003-10-30 7:33 ` Diego Calleja García
2003-10-30 8:43 ` Giuliano Pochini
2003-10-30 8:05 ` Hans Reiser
2003-10-30 8:17 ` Wichert Akkerman
2003-10-30 11:59 ` Hans Reiser
2003-10-30 9:14 ` Giuliano Pochini
2003-10-30 9:55 ` Hans Reiser
2003-10-30 17:48 ` Theodore Ts'o
2003-10-30 19:23 ` Hans Reiser
2003-10-30 20:31 ` Theodore Ts'o
2003-10-31 7:40 ` Hans Reiser
2003-10-31 19:30 ` Theodore Ts'o
2003-10-31 20:47 ` Hans Reiser
2003-10-31 13:59 ` Herman
2003-10-31 21:23 ` Richard B. Johnson
2003-11-01 18:30 ` Hans Reiser
2003-10-31 21:08 ` David S. Miller
2003-11-02 21:42 ` Hans Reiser
2003-11-03 12:42 ` Nikita Danilov
2003-11-03 16:58 ` Timothy Miller
2003-11-04 8:13 ` Hans Reiser
2003-11-05 13:51 ` Ingo Oeser
2003-11-05 2:07 ` Hans Reiser
2003-10-31 11:01 ` Kenneth Johansson
2003-10-31 13:52 ` Jesse Pollard
2003-10-30 11:21 ` Felipe Alfaro Solana
2003-10-30 7:25 ` Christian Axelsson
2003-10-30 8:10 ` Hans Reiser
[not found] ` <200311011731.10052.ioe-lkml@rameria.de>
[not found] ` <3FA3FF46.7010309@namesys.com>
2003-11-03 10:55 ` Ingo Oeser
2003-11-04 8:10 ` Hans Reiser
[not found] <LUlv.31e.5@gated-at.bofh.it>
[not found] ` <M7iG.41B.7@gated-at.bofh.it>
[not found] ` <MagC.82U.7@gated-at.bofh.it>
[not found] ` <Maqe.8l3.9@gated-at.bofh.it>
2003-10-30 11:10 ` Ihar 'Philips' Filipau
2003-10-30 17:23 ` Alex Belits
2003-10-31 1:46 ` Daniel B.
2003-10-31 1:57 ` Philippe Troin
[not found] ` <Mcig.2uf.1@gated-at.bofh.it>
[not found] ` <Mcs2.2FJ.5@gated-at.bofh.it>
2003-10-30 12:04 ` Ihar 'Philips' Filipau
[not found] ` <Mg2B.7wf.9@gated-at.bofh.it>
[not found] ` <Mh8n.BT.9@gated-at.bofh.it>
[not found] ` <MhLf.1pF.9@gated-at.bofh.it>
2003-10-30 12:16 ` Ihar 'Philips' Filipau
2003-11-02 13:11 Brian Beattie
2003-11-02 17:15 ` Valdis.Kletnieks
2003-11-03 19:35 ` Brian Beattie
2003-11-03 20:17 ` Richard B. Johnson
2003-11-03 20:23 ` Valdis.Kletnieks
2003-11-03 20:54 ` Richard B. Johnson
2003-11-03 21:01 ` Valdis.Kletnieks
2003-11-03 22:06 ` Måns Rullgård
2003-11-04 8:47 ` Michael Clark
2003-11-04 12:47 ` Richard B. Johnson
2003-11-04 14:02 ` Brian Beattie
2003-11-03 20:55 ` Roland Dreier
2003-11-04 0:35 ` Daniel B.
2003-11-04 14:05 ` Brian Beattie
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=200310301052.15315.ioe-lkml@rameria.de \
--to=ioe-lkml@rameria.de \
--cc=abelits@phobos.illtel.denver.co.us \
--cc=andersen@codepoet.org \
--cc=dax@gurulabs.com \
--cc=linux-kernel@vger.kernel.org \
--cc=reiser@namesys.com \
--cc=trelane@digitasaru.net \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®