Re: Compressed filesystems: Better compression?

["Jörn Engel" <joern@wohnheim.fh-wedel.de>]

On Tue, 28 September 2004 23:46:54 -0400, John Richard Moser wrote:
> 
> In my own personal tests, I've gotten a 6.25% increase in compression
> ratio over bzip2 using the above lzma code.  These were very weak tests
> involving simply bunzipping a 32MiB tar.bz2 of the Mozilla 1.7 source
> tree and recompressing it with lzma, which produced a 30MiB tar.lzma.  I
> tried, but could not get it to compress much better than that (I think I
> touched 29.5 at some point but not sure, it was a while ago).

Sounds sane.  bzip2 is really hurt by the hart limit of 900k for block
sorting.

Inside the kernel, other things start to matter, though.  If you
really want to impress me, take some large test data (your mozilla.tar
or whatever), cut it up into chunks of 4k and compress each chunk
individually.  Does lzma still beat gzip?

If you can at least get it to compress better for 64k chunks, that's
already quite interesting.  But excellent compression with infinite
chunk-size and infinite memory is quite pointless inside the kernel.
Such things should be left in userspace where they belong.

Jörn

-- 
The wise man seeks everything in himself; the ignorant man tries to get
everything from somebody else.
-- unknown