From: Pavel Machek <pavel@ucw.cz>
To: Jean Delvare <khali@linux-fr.org>
Cc: mirrors@kernel.org, lasse.collin@tukaani.org,
linux-kernel <linux-kernel@vger.kernel.org>,
users@kernel.org, "FTPAdmin Kernel.org" <ftpadmin@kernel.org>,
Linus Torvalds <torvalds@linux-foundation.org>,
Willy Tarreau <w@1wt.eu>
Subject: Re: [kernel.org users] XZ Migration discussion
Date: Tue, 16 Feb 2010 15:00:04 +0100 [thread overview]
Message-ID: <20100216140004.GB4821@elf.ucw.cz> (raw)
In-Reply-To: <20100214200803.4b2348ce@hyperion.delvare>
> > > I have an old, slow machine here which I am going to use to perform
> > > some real world testing, and I'll post the results when I'm done. But I
> > > suspect that building a kernel on this machine, even a small one with
> > > just the drivers it needs, will take much longer than unpacking the
> > > sources. So anyone worrying about performance would rather rely on
> > > cross-compilation, and in turn can afford whatever decompression tool
> > > is needed.
> >
> > On zaurus, kernel compilation takes 4 hours. (I.e. "one night"). So
> > that one is ... well ... done overnight.
>
> Out of curiosity, if it takes that long, why don't you use a
> cross-compiler?
Because I hack it on the go. First build is long and ugly, but
subsequent builds only take 5 minutes or so, so development is
possible.
(If I crosscompiled it, I'd have to crosscompile even the subsequent
builds, which is impossible -- no powerful machine nearby).
> > Untar is something I normally wait for, since you need to run
> > (interactive) oldconfig after that.
>
> You'll have to wait, no matter what compression format you use (and
> even if you don't compress the tarball). Judging by the duration of the
> build on your machine, I'd estimate the decompression time to 7 minutes
> for gz vs. 15 minutes for bz2 maybe? I doubt you sit in front of the
> machine for 7 minutes waiting for tar.gz to decompress, right? So I
> fail to see what difference it makes. You'll just do something else for
> 15 minutes instead of doing something else for 7 minutes.
Actually I do sit in front of the machine, reading mails while it
decompresses.
[I'll get some numbers.]
sh-3.2$ time bzip2 -d < ~/.ketchup/l^Ginux-2.6.31.tar.bz2 > delme.tar
485.73user 137.35system 683.32 (11m23.320s) elapsed 91.18%CPU
sh-3.2$ df -h^H^H^H^H^Htime cat delme.tar > /usr/src/delme.tar
0.57user 109.03system 381.13 (6m21.133s) elapsed 28.75%CPU
sh-3.2$ time zca^G^Gt delme.tar > /u ^H^H ^H^H ^H^H ^H^Hdelme.tar.gz
^H^H ^H^H ^H^H
+^H^H ^H^H ^H^H ^H^H ^H^H ^H^H ^H^H ^H^H ^H^H ^H^H.gz > delme.tar
43.97user 106.22system 223.26 (3m43.261s) elapsed 67.27%CPU
So... gzip is actually _faster_ than uncompressed data, while bzip is
twice slower. Don't know about xzip.
Anyway, gzip just makes sense. It is both smaller and faster than
alternatives, and nearly as portable.
> Anyway, as I have been saying several times already, nothing prevents
> you from repacking tarballs to gz before uploading it to your slow
> system if such is your desire. I can understand the portability
> argument, but the decompression time, no way.
Ok, so lets go by the portability argument.
Pavel
--
(english) http://www.livejournal.com/~pavelmachek
(cesky, pictures) http://atrey.karlin.mff.cuni.cz/~pavel/picture/horses/blog.html
next prev parent reply other threads:[~2010-02-16 14:00 UTC|newest]
Thread overview: 106+ messages / expand[flat|nested] mbox.gz Atom feed top
2010-02-11 18:36 J.H.
2010-02-11 19:44 ` david
2010-02-11 19:48 ` H. Peter Anvin
2010-02-12 0:14 ` [kernel.org mirrors] " Carlos Carvalho
2010-02-11 20:22 ` [kernel.org users] " Willy Tarreau
2010-02-11 20:51 ` Pavel Machek
2010-02-11 22:22 ` H. Peter Anvin
2010-02-12 14:35 ` Jean Delvare
2010-02-13 17:10 ` Jean Delvare
2010-02-13 18:49 ` Geert Uytterhoeven
2010-02-13 19:30 ` Randy Dunlap
2010-02-16 14:55 ` Steven Rostedt
2010-02-13 23:28 ` Stefan Richter
2010-02-14 9:07 ` Jean Delvare
2010-02-13 23:52 ` Phillip Lougher
2010-02-14 9:23 ` Jean Delvare
2010-02-14 9:33 ` Justin P. Mattock
2010-02-14 9:49 ` Willy Tarreau
2010-02-14 12:43 ` Jean Delvare
2010-02-15 21:31 ` James Cloos
2010-02-17 5:40 ` Willy Tarreau
2010-02-17 5:54 ` H. Peter Anvin
2010-02-17 10:22 ` Petri Kaukasoina
2010-02-17 10:25 ` Petri Kaukasoina
2010-02-14 9:56 ` Andi Kleen
2010-02-18 23:59 ` Jan Engelhardt
2010-02-14 10:16 ` Lasse Collin
2010-02-12 14:01 ` Jean Delvare
2010-02-12 15:21 ` Linus Torvalds
2010-02-12 19:02 ` J.H.
2010-02-12 19:23 ` Jean Delvare
2010-02-12 23:07 ` Willy Tarreau
2010-02-13 6:20 ` Pavel Machek
2010-02-13 10:06 ` Stefan Richter
2010-02-13 10:21 ` Stefan Richter
2010-02-14 9:56 ` Lasse Collin
2010-02-13 8:17 ` Jean Delvare
2010-02-13 9:59 ` Stefan Richter
2010-02-13 10:18 ` Avi Kivity
2010-02-13 21:37 ` [kernel] " Mr. James W. Laferriere
2010-02-13 22:39 ` Bernd Petrovitsch
2010-02-15 19:33 ` [kernel.org users] [kernel] " Steve French
2010-02-16 9:16 ` Bernd Petrovitsch
2010-02-16 15:13 ` J.H.
2010-02-14 17:13 ` [kernel.org users] " Pavel Machek
2010-02-14 17:33 ` Stefan Richter
2010-02-14 20:51 ` Pavel Machek
2010-02-15 8:48 ` Stefan Richter
2010-02-15 23:32 ` Tom Rini
2010-02-16 8:21 ` Stefan Richter
2010-02-14 17:07 ` Pavel Machek
2010-02-14 18:39 ` Stefan Richter
2010-02-14 21:04 ` david
2010-02-14 21:32 ` Jean Delvare
2010-02-14 18:59 ` H. Peter Anvin
2010-02-14 19:08 ` Jean Delvare
2010-02-15 15:15 ` tytso
2010-02-16 15:29 ` J.H.
2010-02-16 16:03 ` Jean Delvare
2010-02-17 1:36 ` David Rees
2010-02-16 14:00 ` Pavel Machek [this message]
2010-02-19 0:08 ` Jan Engelhardt
2010-02-19 4:38 ` J.H.
2010-02-12 15:25 ` Steven Rostedt
2010-02-12 16:11 ` Jean Delvare
2010-02-12 16:30 ` Steven Rostedt
2010-02-12 16:44 ` Jean Delvare
2010-02-12 20:34 ` Junio C Hamano
2010-02-12 21:16 ` Steven Rostedt
2010-02-16 15:39 ` ketchup was " Pavel Machek
2010-02-16 16:17 ` Steven Rostedt
2010-02-16 16:27 ` Pavel Machek
2010-02-21 13:53 ` Pavel Machek
2010-02-21 14:26 ` Jean Delvare
2010-02-21 19:28 ` Pavel Machek
2010-02-22 18:59 ` Pavel Machek
2010-02-23 13:14 ` Steven Rostedt
2010-02-23 20:32 ` Pavel Machek
2010-02-12 19:02 ` Phillip Lougher
2010-02-12 19:32 ` Jean Delvare
2010-02-12 19:57 ` Phillip Lougher
2010-02-12 21:59 ` Jean Delvare
2010-02-12 23:30 ` Phillip Lougher
2010-02-12 23:39 ` Phillip Lougher
2010-02-13 7:31 ` Jean Delvare
2010-02-13 22:37 ` Phillip Lougher
2010-02-14 9:32 ` Jean Delvare
2010-02-14 9:53 ` Justin P. Mattock
[not found] ` <20100212223547.GN5186@tux>
2010-02-13 7:20 ` Jean Delvare
2010-02-12 19:03 ` H. Peter Anvin
2010-02-12 20:25 ` Matthew Wilcox
2010-02-12 21:54 ` Greg KH
2010-02-12 21:58 ` Steven Rostedt
2010-02-14 14:49 ` Harald Arnesen
2010-02-14 18:34 ` H. Peter Anvin
2010-02-12 20:31 ` [kernel.org mirrors] " Sleddens, J.P.G.
2010-02-12 22:11 ` H. Peter Anvin
2010-02-12 23:14 ` [kernel.org users] [kernel.org mirrors] " Willy Tarreau
2010-02-13 7:42 ` [kernel.org users] " Tony Luck
2010-02-13 8:14 ` H. Peter Anvin
2010-02-13 8:53 ` Jean Delvare
2010-02-14 5:43 ` H. Peter Anvin
[not found] ` <987664A83D2D224EAE907B061CE93D53123E0ED5@orsmsx505.amr.corp.intel.com>
2010-02-17 0:11 ` H. Peter Anvin
2010-02-14 18:03 ` Eric W. Biederman
2010-02-14 22:27 ` Stephen Hemminger
2010-02-15 16:15 ` Jean Delvare
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20100216140004.GB4821@elf.ucw.cz \
--to=pavel@ucw.cz \
--cc=ftpadmin@kernel.org \
--cc=khali@linux-fr.org \
--cc=lasse.collin@tukaani.org \
--cc=linux-kernel@vger.kernel.org \
--cc=mirrors@kernel.org \
--cc=torvalds@linux-foundation.org \
--cc=users@kernel.org \
--cc=w@1wt.eu \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®