mirror of https://lore.kernel.org/lkml/
 help / color / mirror / Atom feed
From: John Cherry <cherry@osdl.org>
To: linux-kernel@vger.kernel.org
Cc: linstab@osdl.org
Subject: [STABILITY] Compile / STP metrics
Date: 06 Jan 2003 09:25:38 -0800	[thread overview]
Message-ID: <1041873937.17802.23.camel@cherrytest.pdx.osdl.net> (raw)

Compile statistics have been for kernel releases from 2.5.46 to 2.5.54
at: www.osdl.org/archive/cherry/stability

This page also has the beginnings of STP (Scalable Test Platform)
results for a number of tests (aim9, LTP, unixbench, contest, bonnie++,
debench (quick), hackbench, iozone, dbt1 (1-tier), lmbench (short)) for
recent kernel releases.

These metrics are simply one way to measure how 2.5 is converging.  Many
of the compilation errors are being addressed by various kernel
developers, so in some ways, these statics are restating the obvious.

Reasonable convergence of compile time warnings/errors was happening
until 2.5.54 was released.  However, 2.5.54 took a step backwards.  The
latest results show...

                           2.5.53                       2.5.54
                       ------------------------ ------------------------
bzImage (defconfig)      16 warnings/0 errors     68 warnings/0 errors
bzImage (allmodconfig)   31 warnings/9 errors     40 warnings/11 errors
modules (allmodconfig) 1843 warnings/118 errors 3223 warnings/208 errors

The script that generated this data is also at
www.osdl.org/archive/cherry/stability.  Detailed information on warnings
and errors can be found by following the links in the table, but a
summary of the 2.5.54 run is shown here....

Kernel version: 2.5.54
Kernel build: 
   Making bzImage (defconfig): 68 warnings, 0 errors
   Making bzImage (allmodconfig): 40 warnings, 11 errors
   Making modules (allmodconfig): 3223 warnings, 208 errors

Building directories:
   Building fs/autofs: clean
   Building fs/autofs4: clean
   Building fs/befs: 0 warnings, 2 errors
   Building fs/bfs: clean
   Building fs/devfs: clean
   Building fs/devpts: clean
   Building fs/efs: clean
   Building fs/exportfs: clean
   Building fs/ext2: clean
   Building fs/ext3: clean
   Building fs/fat: clean
   Building fs/hfs: clean
   Building fs/hpfs: clean
   Building fs/hugetlbfs: clean
   Building fs/intermezzo: 2 warnings, 0 errors
   Building fs/isofs: clean
   Building fs/jbd: clean
   Building fs/jffs: clean
   Building fs/jffs2: clean
   Building fs/jfs: clean
   Building fs/lockd: 4 warnings, 0 errors
   Building fs/ncpfs: clean
   Building fs/nfs: clean
   Building fs/nfsd: 2 warnings, 0 errors
   Building fs/nls: clean
   Building fs/ntfs: 3 warnings, 0 errors
   Building fs/openpromfs: clean
   Building fs/partitions: clean
   Building fs/proc: clean
   Building fs/qnx4: clean
   Building fs/reiserfs: 1 warnings, 0 errors
   Building fs/romfs: 0 warnings, 2 errors
   Building fs/smbfs: 2 warnings, 0 errors
   Building fs/sysfs: clean
   Building fs/sysv: clean
   Building fs/udf: clean
   Building fs/ufs: clean
   Building fs/umsdos: clean
   Building fs/vfat: clean
   Building fs/xfs: 2 warnings, 0 errors
   Building drivers/acorn: clean
   Building drivers/cdrom: 34 warnings, 0 errors
   Building drivers/ide: 45 warnings, 2 errors
   Building drivers/mca: clean
   Building drivers/net: 626 warnings, 20 errors
   Building drivers/pcmcia: 13 warnings, 0 errors
   Building drivers/sgi: clean
   Building drivers/acpi: clean
   Building drivers/char: 374 warnings, 8 errors
   Building drivers/ieee1394: 17 warnings, 2 errors
   Building drivers/md: 18 warnings, 0 errors
   Building drivers/nubus: clean
   Building drivers/pnp: clean
   Building drivers/tc: clean
   Building river/atm: clean
   Building drivers/dio: clean
   Building drivers/input: 5 warnings, 0 errors
   Building drivers/media: 176 warnings, 31 errors
   Building drivers/oprofile: clean
   Building drivers/s390: clean
   Building drivers/telephony: 15 warnings, 2 errors
   Building drivers/base: clean
   Building drivers/fc4: clean
   Building drivers/isdn: 477 warnings, 18 errors
   Building drivers/message: 18 warnings, 2 errors
   Building drivers/parisc: clean
   Building drivers/sbus: clean
   Building drivers/usb: 34 warnings, 0 errors
   Building drivers/block: 10 warnings, 2 errors
   Building drivers/hotplug: 10 warnings, 0 errors
   Building drivers/misc: clean
   Building drivers/parport: 10 warnings, 0 errors
   Building drivers/scsi/aacraid: 3 warnings, 0 errors
   Building drivers/scsi/aic7xxx: 1 warnings, 0 errors
   Building drivers/scsi/dpt: clean
   Building drivers/scsi/pcmcia: 24 warnings, 3 errors
   Building drivers/scsi/sym53c8xx_2: 1 warnings, 0 errors
   Building drivers/video/aty: 0 warnings, 2 errors
   Building drivers/video/console: 2 warnings, 0 errors
   Building drivers/video/matrox: 106 warnings, 20 errors
   Building drivers/video/riva: clean
   Building drivers/video/sis: 37 warnings, 3 errors
   Building drivers/bluetooth: 15 warnings, 0 errors
   Building drivers/i2c: 3 warnings, 0 errors
   Building drivers/mtd: 30 warnings, 4 errors
   Building drivers/pci: clean
   Building drivers/serial: 1 warnings, 0 errors
   Building drivers/zorro: clean
   Building sound/core: 2 warnings, 0 errors
   Building sound/drivers: 1 warnings, 0 errors
   Building sound/i2c: clean
   Building sound/isa: 105 warnings, 34 errors
   Building sound/oss: 159 warnings, 13 errors
   Building sound/pci: 8 warnings, 0 errors
   Building sound/synth: clean
   Building sound/usb: clean
   Building arch/i386: clean
   Building crypto: clean
   Building ipc: clean
   Building lib: clean
   Building mm: clean
   Building net: 311 warnings, 0 errors
   Building security: 2 warnings, 0 errors
   Building sound: 123 warnings, 47 errors
   Building drivers/video: 297 warnings, 35 errors
   Building usr: clean


Failure Summary:

   drivers/block: 10 warnings, 2 errors
   drivers/char: 374 warnings, 8 errors
   drivers/ide: 45 warnings, 2 errors
   drivers/ieee1394: 17 warnings, 2 errors
   drivers/isdn: 477 warnings, 18 errors
   drivers/media: 176 warnings, 31 errors
   drivers/message: 18 warnings, 2 errors
   drivers/mtd: 30 warnings, 4 errors
   drivers/net: 626 warnings, 20 errors
   drivers/scsi/pcmcia: 24 warnings, 3 errors
   drivers/telephony: 15 warnings, 2 errors
   drivers/video: 297 warnings, 35 errors
   drivers/video/aty: 0 warnings, 2 errors
   drivers/video/matrox: 106 warnings, 20 errors
   drivers/video/sis: 37 warnings, 3 errors
   fs/befs: 0 warnings, 2 errors
   fs/romfs: 0 warnings, 2 errors
   sound: 123 warnings, 47 errors
   sound/isa: 105 warnings, 34 errors
   sound/oss: 159 warnings, 13 errors


Warning Summary:

   drivers/bluetooth: 15 warnings, 0 errors
   drivers/cdrom: 34 warnings, 0 errors
   drivers/hotplug: 10 warnings, 0 errors
   drivers/i2c: 3 warnings, 0 errors
   drivers/input: 5 warnings, 0 errors
   drivers/md: 18 warnings, 0 errors
   drivers/parport: 10 warnings, 0 errors
   drivers/pcmcia: 13 warnings, 0 errors
   drivers/scsi/aacraid: 3 warnings, 0 errors
   drivers/scsi/aic7xxx: 1 warnings, 0 errors
   drivers/scsi/sym53c8xx_2: 1 warnings, 0 errors
   drivers/serial: 1 warnings, 0 errors
   drivers/usb: 34 warnings, 0 errors
   drivers/video/console: 2 warnings, 0 errors
   fs/intermezzo: 2 warnings, 0 errors
   fs/lockd: 4 warnings, 0 errors
   fs/nfsd: 2 warnings, 0 errors
   fs/ntfs: 3 warnings, 0 errors
   fs/reiserfs: 1 warnings, 0 errors
   fs/smbfs: 2 warnings, 0 errors
   fs/xfs: 2 warnings, 0 errors
   net: 311 warnings, 0 errors
   security: 2 warnings, 0 errors
   sound/core: 2 warnings, 0 errors
   sound/drivers: 1 warnings, 0 errors
   sound/pci: 8 warnings, 0 errors

John Cherry
OSDL




             reply	other threads:[~2003-01-06 17:06 UTC|newest]

Thread overview: 3+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2003-01-06 17:25 John Cherry [this message]
2003-01-06 19:21 ` Greg KH
2003-01-06 21:15   ` [Linstab] " John Cherry

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=1041873937.17802.23.camel@cherrytest.pdx.osdl.net \
    --to=cherry@osdl.org \
    --cc=linstab@osdl.org \
    --cc=linux-kernel@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox

all inboxes | Powered by JetHome®