System 1 (endeavour): > uname -a Linux endeavour 2.6.6-rc1 #1 SMP Sun Apr 25 22:01:39 MDT 2004 i686 Intel(R) Pentium(R) 4 CPU 2.80GHz GenuineIntel GNU/Linux > cat /proc/cpuinfo processor : 0 vendor_id : GenuineIntel cpu family : 15 model : 2 model name : Intel(R) Pentium(R) 4 CPU 2.80GHz stepping : 9 cpu MHz : 2793.876 cache size : 512 KB physical id : 0 siblings : 2 fdiv_bug : no hlt_bug : no f00f_bug : no coma_bug : no fpu : yes fpu_exception : yes cpuid level : 2 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe cid bogomips : 5521.40 processor : 1 vendor_id : GenuineIntel cpu family : 15 model : 2 model name : Intel(R) Pentium(R) 4 CPU 2.80GHz stepping : 9 cpu MHz : 2793.876 cache size : 512 KB physical id : 0 siblings : 2 fdiv_bug : no hlt_bug : no f00f_bug : no coma_bug : no fpu : yes fpu_exception : yes cpuid level : 2 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe cid bogomips : 5570.56 > lspci 0000:00:00.0 Host bridge: Intel Corp. 82865G/PE/P DRAM Controller/Host-Hub Interface (rev 02) 0000:00:01.0 PCI bridge: Intel Corp. 82865G/PE/P PCI to AGP Controller (rev 02) 0000:00:03.0 PCI bridge: Intel Corp. 82865G/PE/P PCI to CSA Bridge (rev 02) 0000:00:1d.0 USB Controller: Intel Corp. 82801EB/ER (ICH5/ICH5R) USB UHCI #1 (rev 02) 0000:00:1d.1 USB Controller: Intel Corp. 82801EB/ER (ICH5/ICH5R) USB UHCI #2 (rev 02) 0000:00:1d.2 USB Controller: Intel Corp. 82801EB/ER (ICH5/ICH5R) USB UHCI #3 (rev 02) 0000:00:1d.3 USB Controller: Intel Corp. 82801EB/ER (ICH5/ICH5R) USB UHCI #4 (rev 02) 0000:00:1d.7 USB Controller: Intel Corp. 82801EB/ER (ICH5/ICH5R) USB2 EHCI Controller (rev 02) 0000:00:1e.0 PCI bridge: Intel Corp. 82801BA/CA/DB/EB/ER Hub interface to PCI Bridge (rev c2) 0000:00:1f.0 ISA bridge: Intel Corp. 82801EB/ER (ICH5/ICH5R) LPC Bridge (rev 02) 0000:00:1f.1 IDE interface: Intel Corp. 82801EB/ER (ICH5/ICH5R) Ultra ATA 100 Storage Controller (rev 02) 0000:00:1f.2 IDE interface: Intel Corp. 82801EB (ICH5) Serial ATA 150 Storage Controller (rev 02) 0000:00:1f.3 SMBus: Intel Corp. 82801EB/ER (ICH5/ICH5R) SMBus Controller (rev 02) 0000:00:1f.5 Multimedia audio controller: Intel Corp. 82801EB/ER (ICH5/ICH5R) AC'97 Audio Controller (rev 02) 0000:02:01.0 Ethernet controller: Intel Corp. 82547EI Gigabit Ethernet Controller (LOM) 0000:03:00.0 VGA compatible controller: ATI Technologies Inc 3D Rage I/II 215GT [Mach64 GT] (rev 41) 0000:03:02.0 Ethernet controller: Intel Corp. 82557/8/9 [Ethernet Pro 100] (rev 0c) 0000:03:07.0 FireWire (IEEE 1394): Lucent Microelectronics FW323 (rev 61) > df -hT Filesystem Type Size Used Avail Use% Mounted on /dev/md1 reiserfs 112G 77G 35G 69% / > mdadm --query --detail /dev/md0 (this is the /boot partition) /dev/md0: Version : 00.90.01 Creation Time : Wed Nov 19 04:11:46 2003 Raid Level : raid1 Array Size : 96256 (94.00 MiB 98.57 MB) Device Size : 96256 (94.00 MiB 98.57 MB) Raid Devices : 2 Total Devices : 2 Preferred Minor : 0 Persistence : Superblock is persistent Update Time : Mon Jun 28 02:08:30 2004 State : clean, no-errors Active Devices : 2 Working Devices : 2 Failed Devices : 0 Spare Devices : 0 Number Major Minor RaidDevice State 0 8 17 0 active sync /dev/scsi/host1/bus0/target0/lun0/part1 1 8 1 1 active sync /dev/scsi/host0/bus0/target0/lun0/part1 UUID : 38f606a1:deb53258:1f13987d:866ec669 Events : 0.51 > mdadm --query --detail /dev/md1 /dev/md1: Version : 00.90.01 Creation Time : Wed Nov 19 04:11:59 2003 Raid Level : raid1 Array Size : 116824064 (111.41 GiB 119.63 GB) Device Size : 116824064 (111.41 GiB 119.63 GB) Raid Devices : 2 Total Devices : 2 Preferred Minor : 1 Persistence : Superblock is persistent Update Time : Mon Jun 28 23:16:11 2004 State : clean, no-errors Active Devices : 1 Working Devices : 1 Failed Devices : 1 Spare Devices : 0 Number Major Minor RaidDevice State 0 0 0 -1 removed 1 8 3 1 active sync /dev/scsi/host0/bus0/target0/lun0/part3 2 8 19 -1 faulty /dev/scsi/host1/bus0/target0/lun0/part3 UUID : 7355f40b:84ce0756:1fe5bc9a:559e7cd0 Events : 0.18698581 > dmesg scsi1: ERROR on channel 0, id 0, lun 0, CDB: 0x28 00 03 30 b7 74 00 00 7d 00 Current sdb: sense = 70 3 ASC=11 ASCQ= 4 Raw sense data:0x70 0x00 0x03 0x00 0x00 0x00 0x00 0x06 0x00 0x00 0x00 0x00 0x11 0x04 end_request: I/O error, dev sdb, sector 53524340 scsi1: ERROR on channel 0, id 0, lun 0, CDB: 0x28 00 03 30 b7 75 00 00 7c 00 Current sdb: sense = 70 3 ASC=11 ASCQ= 4 Raw sense data:0x70 0x00 0x03 0x00 0x00 0x00 0x00 0x06 0x00 0x00 0x00 0x00 0x11 0x04 end_request: I/O error, dev sdb, sector 53524341 scsi1: ERROR on channel 0, id 0, lun 0, CDB: 0x28 00 03 30 b7 76 00 00 7b 00 Current sdb: sense = 70 3 ASC=11 ASCQ= 4 Raw sense data:0x70 0x00 0x03 0x00 0x00 0x00 0x00 0x06 0x00 0x00 0x00 0x00 0x11 0x04 end_request: I/O error, dev sdb, sector 53524342 scsi1: ERROR on channel 0, id 0, lun 0, CDB: 0x28 00 03 30 b7 77 00 00 7a 00 Current sdb: sense = 70 3 ASC=11 ASCQ= 4 Raw sense data:0x70 0x00 0x03 0x00 0x00 0x00 0x00 0x06 0x00 0x00 0x00 0x00 0x11 0x04 end_request: I/O error, dev sdb, sector 53524343 scsi1: ERROR on channel 0, id 0, lun 0, CDB: 0x28 00 03 30 b7 78 00 00 79 00 Current sdb: sense = 70 3 ASC=11 ASCQ= 4 Raw sense data:0x70 0x00 0x03 0x00 0x00 0x00 0x00 0x06 0x00 0x00 0x00 0x00 0x11 0x04 end_request: I/O error, dev sdb, sector 53524344 raid1: Disk failure on sdb3, disabling device. Operation continuing on 1 devices raid1: sdb: unrecoverable I/O read error for block 52737152 md: md1: sync done. RAID1 conf printout: --- wd:1 rd:2 disk 0, wo:1, o:0, dev:sdb3 disk 1, wo:0, o:1, dev:sda3 RAID1 conf printout: --- wd:1 rd:2 disk 1, wo:0, o:1, dev:sda3 md: syncing RAID array md1 md: minimum _guaranteed_ reconstruction speed: 1000 KB/sec/disc. md: using maximum available idle IO bandwith (but not more than 200000 KB/sec) for reconstruction. md: using 128k window, over a total of 116824064 blocks. md: md1: sync done. RAID1 conf printout: --- wd:1 rd:2 disk 1, wo:0, o:1, dev:sda3 This raid volume is on two Seagate Barracuda 120 gig SATA drives running on the system's ICH5 SATA controller. ################################################################################# System 2 (castle): > uname -a Linux castle 2.6.7-gentoo-r6 #1 Mon Jun 28 10:39:39 MDT 2004 i686 AMD Athlon(tm) XP 2600+ AuthenticAMD GNU/Linux > cat /proc/cpuinfo processor : 0 vendor_id : AuthenticAMD cpu family : 6 model : 8 model name : AMD Athlon(tm) XP 2600+ stepping : 1 cpu MHz : 2089.340 cache size : 256 KB fdiv_bug : no hlt_bug : no f00f_bug : no coma_bug : no fpu : yes fpu_exception : yes cpuid level : 1 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 mmx fxsr sse syscall mmxext 3dnowext 3dnow bogomips : 4096.00 > lspci 0000:00:00.0 Host bridge: VIA Technologies, Inc. VT8377 [KT400/KT600 AGP] Host Bridge 0000:00:01.0 PCI bridge: VIA Technologies, Inc. VT8235 PCI Bridge 0000:00:06.0 VGA compatible controller: nVidia Corporation NV6 [Vanta/Vanta LT] (rev 15) 0000:00:08.0 RAID bus controller: CMD Technology Inc PCI0680 (rev 01) 0000:00:0b.0 Multimedia audio controller: Creative Labs SB Live! EMU10k1 (rev 08) 0000:00:0b.1 Input device controller: Creative Labs SB Live! MIDI/Game Port (rev 08) 0000:00:0d.0 RAID bus controller: Promise Technology, Inc. PDC20376 (rev 02) 0000:00:0e.0 FireWire (IEEE 1394): VIA Technologies, Inc. IEEE 1394 Host Controller (rev 46) 0000:00:0f.0 Ethernet controller: Broadcom Corporation NetXtreme BCM5702 Gigabit Ethernet (rev 02) 0000:00:10.0 USB Controller: VIA Technologies, Inc. VT6202 [USB 2.0 controller] (rev 80) 0000:00:10.1 USB Controller: VIA Technologies, Inc. VT6202 [USB 2.0 controller] (rev 80) 0000:00:10.3 USB Controller: VIA Technologies, Inc. USB 2.0 (rev 82) 0000:00:11.0 ISA bridge: VIA Technologies, Inc. VT8235 ISA Bridge 0000:00:11.1 IDE interface: VIA Technologies, Inc. VT82C586A/B/VT82C686/A/B/VT823x/A/C/VT8235 PIPC Bus Master IDE (rev 06) 0000:01:00.0 VGA compatible controller: nVidia Corporation NV28 [GeForce4 Ti 4800 SE] (rev a1) > df -hT Filesystem Type Size Used Avail Use% Mounted on /dev/sda1 reiserfs 150G 107G 44G 72% /pub/music /dev/sdb1 reiserfs 150G 140G 11G 94% /pub/video > dmesg Raw sense data:0x70 0x00 0x03 0x00 0x00 0x00 0x00 0x06 0x00 0x00 0x00 0x00 0x11 0x04 end_request: I/O error, dev sda, sector 91683284 scsi0: ERROR on channel 0, id 0, lun 0, CDB: 0x28 00 05 76 f9 d5 00 00 72 00 Current sda: sense = 70 3 ASC=11 ASCQ= 4 Raw sense data:0x70 0x00 0x03 0x00 0x00 0x00 0x00 0x06 0x00 0x00 0x00 0x00 0x11 0x04 end_request: I/O error, dev sda, sector 91683285 scsi0: ERROR on channel 0, id 0, lun 0, CDB: 0x28 00 05 76 f9 d6 00 00 71 00 Current sda: sense = 70 3 ASC=11 ASCQ= 4 Raw sense data:0x70 0x00 0x03 0x00 0x00 0x00 0x00 0x06 0x00 0x00 0x00 0x00 0x11 0x04 end_request: I/O error, dev sda, sector 91683286 scsi0: ERROR on channel 0, id 0, lun 0, CDB: 0x28 00 05 76 f9 d7 00 00 70 00 Current sda: sense = 70 3 ASC=11 ASCQ= 4 Raw sense data:0x70 0x00 0x03 0x00 0x00 0x00 0x00 0x06 0x00 0x00 0x00 0x00 0x11 0x04 end_request: I/O error, dev sda, sector 91683287 scsi0: ERROR on channel 0, id 0, lun 0, CDB: 0x28 00 05 76 f9 d8 00 00 6f 00 Current sda: sense = 70 3 ASC=11 ASCQ= 4 Raw sense data:0x70 0x00 0x03 0x00 0x00 0x00 0x00 0x06 0x00 0x00 0x00 0x00 0x11 0x04 end_request: I/O error, dev sda, sector 91683288 scsi0: ERROR on channel 0, id 0, lun 0, CDB: 0x28 00 05 76 f9 d9 00 00 6e 00 Current sda: sense = 70 3 ASC=11 ASCQ= 4 Raw sense data:0x70 0x00 0x03 0x00 0x00 0x00 0x00 0x06 0x00 0x00 0x00 0x00 0x11 0x04 end_request: I/O error, dev sda, sector 91683289 scsi0: ERROR on channel 0, id 0, lun 0, CDB: 0x28 00 05 76 f9 da 00 00 6d 00 Current sda: sense = 70 3 ASC=11 ASCQ= 4 Raw sense data:0x70 0x00 0x03 0x00 0x00 0x00 0x00 0x06 0x00 0x00 0x00 0x00 0x11 0x04 end_request: I/O error, dev sda, sector 91683290 This system has two Seagate Barracuda 160 gig SATA drives running on a PDC20376 SATA controller. I'm not sure if this is a problem with something I've done or a bug handling SATA in the kernel. I find it disturbing that both these systems have this problem with different hardware configurations but the same type of drives (only different sizes). The first system, endeavour, was up for over 30 days. It was then rebooted and has crashed for an unknown reason twice since and shows these dmesg entries after booting up. The second system, castle, gives me those messages when I try to copy some data from sda1 and hangs the process for a very long time while it keeps advancing 'bad sectors'. If there's anything else I can do to test this let me know. I'm attaching the kernel configs for both systems as well. -- Travis Morgan