-*- Mode: Text; fill-column: 72 -*- To mail to: linux-kernel@vger.kernel.org 1. PROBLEM: Kernel oops accompanied by complete system lock-up. 2. DESCRIPTION: * While scrolling through some text file with less(1) on the KDE 'konsole' using the down-arrow key, the system locked up completely. (No response whatsoever from keyboard or mouse.) I had to do a hard restart. Happily, I found an oops message in the system-log after reboot :) * I had ovserved a similar problem a while earlier, only that time there was no oops message logged. At that time, I was scrolling down with the down-arrow key while reading a PDF document using acroread. 3. KERNEL VERSION (/proc/version): Linux version 2.6.11-debug (root@gamma) (gcc version 3.3 20030226 (prerelease) (SuSE Linux)) #1 Sat Jun 11 00:49:21 EAT 2005 4(a) Oops message before running ksymoops: ---- BEGIN unprocessed oops message------------------- Jun 11 05:20:18 gamma kernel: Unable to handle kernel paging request at virtual address cf27154c Jun 11 05:20:18 gamma kernel: printing eip: Jun 11 05:20:18 gamma kernel: c01235f1 Jun 11 05:20:18 gamma kernel: *pde = 0a4b8067 Jun 11 05:20:18 gamma kernel: *pte = 00000000 Jun 11 05:20:18 gamma kernel: Oops: 0002 [#1] Jun 11 05:20:18 gamma kernel: PREEMPT Jun 11 05:20:18 gamma kernel: Modules linked in: i2c_prosavage i2c_algo_bit i2c_viapro ehci_hcd uhci_hcd usbcore 8250_pci 8250 serial_core tuner saa7134 video_buf v4l2_common v4l1_compat i2c_core ir_common videodev via_agp agpgart video fan button thermal processor via_rhine snd_pcm_oss snd_mixer_oss loop rtc pcspkr ide_cd cdrom slamr snd_via82xx snd_ac97_codec snd_pcm snd_timer snd_page_alloc snd_mpu401_uart snd_rawmidi snd_seq_device snd soundcore dm_mod Jun 11 05:20:18 gamma kernel: CPU: 0 Jun 11 05:20:18 gamma kernel: EIP: 0060:[del_timer+97/176] Tainted: P VLI Jun 11 05:20:18 gamma kernel: EIP: 0060:[] Tainted: P VLI Jun 11 05:20:18 gamma kernel: EFLAGS: 00010046 (2.6.11-debug) Jun 11 05:20:18 gamma kernel: EIP is at del_timer+0x61/0xb0 Jun 11 05:20:18 gamma kernel: eax: cf271548 ebx: 00000286 ecx: 00000001 edx: c0462538 Jun 11 05:20:18 gamma kernel: esi: c0461aa0 edi: c9a1feb4 ebp: c9a1fea0 esp: c9a1fe90 Jun 11 05:20:18 gamma kernel: ds: 007b es: 007b ss: 0068 Jun 11 05:20:18 gamma kernel: Process pickup (pid: 2284, threadinfo=c9a1e000 task=c91e6a20) Jun 11 05:20:18 gamma kernel: Stack: c91e6b70 00349e7f 00349e7f 00000007 c9a1fedc c0311224 c9a1feb4 00349e7f Jun 11 05:20:18 gamma kernel: c8c0e6d8 cf271548 c0462538 00349e7f 4b87ad6e c0123f60 c91e6a20 c0461aa0 Jun 11 05:20:18 gamma kernel: cc5e3580 00000000 00000000 c9a1ff54 c016f926 cc5e3580 00000000 00000000 Jun 11 05:20:18 gamma kernel: Call Trace: Jun 11 05:20:18 gamma kernel: [show_stack+171/192] show_stack+0xab/0xc0 Jun 11 05:20:18 gamma kernel: [] show_stack+0xab/0xc0 Jun 11 05:20:18 gamma kernel: [show_registers+343/464] show_registers+0x157/0x1d0 Jun 11 05:20:18 gamma kernel: [] show_registers+0x157/0x1d0 Jun 11 05:20:18 gamma kernel: [die+233/384] die+0xe9/0x180 Jun 11 05:20:18 gamma kernel: [] die+0xe9/0x180 Jun 11 05:20:18 gamma kernel: [do_page_fault+1340/1729] do_page_fault+0x53c/0x6c1 Jun 11 05:20:18 gamma kernel: [] do_page_fault+0x53c/0x6c1 Jun 11 05:20:18 gamma kernel: [error_code+43/48] error_code+0x2b/0x30 Jun 11 05:20:18 gamma kernel: [] error_code+0x2b/0x30 Jun 11 05:20:18 gamma kernel: [schedule_timeout+100/176] schedule_timeout+0x64/0xb0 Jun 11 05:20:18 gamma kernel: [] schedule_timeout+0x64/0xb0 Jun 11 05:20:18 gamma kernel: [do_select+662/736] do_select+0x296/0x2e0 Jun 11 05:20:18 gamma kernel: [] do_select+0x296/0x2e0 Jun 11 05:20:18 gamma kernel: [sys_select+649/1280] sys_select+0x289/0x500 Jun 11 05:20:18 gamma kernel: [] sys_select+0x289/0x500 Jun 11 05:20:18 gamma kernel: [syscall_call+7/11] syscall_call+0x7/0xb Jun 11 05:20:18 gamma kernel: [] syscall_call+0x7/0xb Jun 11 05:20:18 gamma kernel: Code: 3b 77 18 74 21 53 9d b8 01 00 00 00 e8 b9 33 ff ff b8 00 e0 ff ff 21 e0 8b 40 08 a8 08 74 cb e8 f6 d1 1e 00 eb c4 8b 57 04 8b 07 <89> 50 04 89 02 c7 47 04 00 02 20 00 c7 07 00 01 10 00 c7 47 18 Jun 11 05:20:18 gamma kernel: <6>note: pickup[2284] exited with preempt_count 1 ---END unprocessed oops message------------------- 4(b) Oops message after running ksymoops: ---BEGIN ksymoops output------------------------ ksymoops 2.4.9 on i686 2.6.11-debug. Options used -V (default) -k /proc/kallsyms (specified) -l /proc/modules (default) -o /lib/modules/2.6.11-debug/ (default) -m /boot/System.map-2.6.11-debug (default) Warning (read_ksyms): no kernel symbols in ksyms, is /proc/kallsyms a valid ksyms file? No modules in ksyms, skipping objects No ksyms, skipping lsmod Jun 11 05:20:18 gamma kernel: Unable to handle kernel paging request at virtual address cf27154c Jun 11 05:20:18 gamma kernel: c01235f1 Jun 11 05:20:18 gamma kernel: *pde = 0a4b8067 Jun 11 05:20:18 gamma kernel: Oops: 0002 [#1] Jun 11 05:20:18 gamma kernel: CPU: 0 Jun 11 05:20:18 gamma kernel: EIP: 0060:[del_timer+97/176] Tainted: P VLI Jun 11 05:20:18 gamma kernel: EIP: 0060:[] Tainted: P VLI Using defaults from ksymoops -t elf32-i386 -a i386 Jun 11 05:20:18 gamma kernel: EFLAGS: 00010046 (2.6.11-debug) Jun 11 05:20:18 gamma kernel: eax: cf271548 ebx: 00000286 ecx: 00000001 edx: c0462538 Jun 11 05:20:18 gamma kernel: esi: c0461aa0 edi: c9a1feb4 ebp: c9a1fea0 esp: c9a1fe90 Jun 11 05:20:18 gamma kernel: ds: 007b es: 007b ss: 0068 Jun 11 05:20:18 gamma kernel: Stack: c91e6b70 00349e7f 00349e7f 00000007 c9a1fedc c0311224 c9a1feb4 00349e7f Jun 11 05:20:18 gamma kernel: c8c0e6d8 cf271548 c0462538 00349e7f 4b87ad6e c0123f60 c91e6a20 c0461aa0 Jun 11 05:20:18 gamma kernel: cc5e3580 00000000 00000000 c9a1ff54 c016f926 cc5e3580 00000000 00000000 Jun 11 05:20:18 gamma kernel: Call Trace: Jun 11 05:20:18 gamma kernel: [] show_stack+0xab/0xc0 Jun 11 05:20:18 gamma kernel: [] show_registers+0x157/0x1d0 Jun 11 05:20:18 gamma kernel: [] die+0xe9/0x180 Jun 11 05:20:18 gamma kernel: [] do_page_fault+0x53c/0x6c1 Jun 11 05:20:18 gamma kernel: [] error_code+0x2b/0x30 Jun 11 05:20:18 gamma kernel: [] schedule_timeout+0x64/0xb0 Jun 11 05:20:18 gamma kernel: [] do_select+0x296/0x2e0 Jun 11 05:20:18 gamma kernel: [] sys_select+0x289/0x500 Jun 11 05:20:18 gamma kernel: [] syscall_call+0x7/0xb Jun 11 05:20:18 gamma kernel: Code: 3b 77 18 74 21 53 9d b8 01 00 00 00 e8 b9 33 ff ff b8 00 e0 ff ff 21 e0 8b 40 08 a8 08 74 cb e8 f6 d1 1e 00 eb c4 8b 57 04 8b 07 <89> 50 04 89 02 c7 47 04 00 02 20 00 c7 07 00 01 10 00 c7 47 18 >>EIP; c01235f1 <===== >>eax; cf271548 >>edx; c0462538 >>esi; c0461aa0 >>edi; c9a1feb4 >>ebp; c9a1fea0 >>esp; c9a1fe90 Trace; c0103f1b Trace; c01040a7 Trace; c01042c9 Trace; c0114c1c Trace; c0103b57 Trace; c0311224 Trace; c016f926 Trace; c016fc29 Trace; c010311f This architecture has variable length instructions, decoding before eip is unreliable, take these instructions with a pinch of salt. Code; c01235c6 00000000 <_EIP>: Code; c01235c6 0: 3b 77 18 cmp 0x18(%edi),%esi Code; c01235c9 3: 74 21 je 26 <_EIP+0x26> Code; c01235cb 5: 53 push %ebx Code; c01235cc 6: 9d popf Code; c01235cd 7: b8 01 00 00 00 mov $0x1,%eax Code; c01235d2 c: e8 b9 33 ff ff call ffff33ca <_EIP+0xffff33ca> Code; c01235d7 11: b8 00 e0 ff ff mov $0xffffe000,%eax Code; c01235dc 16: 21 e0 and %esp,%eax Code; c01235de 18: 8b 40 08 mov 0x8(%eax),%eax Code; c01235e1 1b: a8 08 test $0x8,%al Code; c01235e3 1d: 74 cb je ffffffea <_EIP+0xffffffea> Code; c01235e5 1f: e8 f6 d1 1e 00 call 1ed21a <_EIP+0x1ed21a> Code; c01235ea 24: eb c4 jmp ffffffea <_EIP+0xffffffea> Code; c01235ec 26: 8b 57 04 mov 0x4(%edi),%edx Code; c01235ef 29: 8b 07 mov (%edi),%eax This decode from eip onwards should be reliable Code; c01235f1 00000000 <_EIP>: Code; c01235f1 <===== 0: 89 50 04 mov %edx,0x4(%eax) <===== Code; c01235f4 3: 89 02 mov %eax,(%edx) Code; c01235f6 5: c7 47 04 00 02 20 00 movl $0x200200,0x4(%edi) Code; c01235fd c: c7 07 00 01 10 00 movl $0x100100,(%edi) Code; c0123603 12: c7 .byte 0xc7 Code; c0123604 13: 47 inc %edi Code; c0123605 14: 18 .byte 0x18 1 warning issued. Results may not be reliable. --- END ksymoops output-------------------- 5. SOFTWARE: *Running SuSE 8.2 Professional upgraded as per the Changes file to run Linux 2.6.x. * I notice that the oops message indicates that a process "pickup" was involved in the oops. "pickup" is part of POSTFIX (the MTA). My version of POSTFIX is what comes with SuSE 8.2: Version 2.0.6-8 * The following is the output from the "ver_linux" script: ---BEGIN ver_linux output----------------------- If some fields are empty or look unusual you may have an old version. Compare to the current minimal requirements in Documentation/Changes. Linux gamma 2.6.11-debug #1 Sat Jun 11 00:49:21 EAT 2005 i686 unknown unknown GNU/Linux Gnu C 3.3 Gnu make 3.80 binutils 2.13.90.0.18 util-linux 2.11z mount 2.11z module-init-tools 3.1 e2fsprogs 1.35 jfsutils 1.1.1 reiserfsprogs 3.6.4 reiser4progs line xfsprogs 2.6.25 quota-tools 3.11. PPP 2.4.1 nfs-utils 1.0.7 Linux C Library 14 02:33 /lib/libc.so.6 Dynamic linker (ldd) 2.3.2 Linux C++ Library 5.0.3 Procps 3.2.4 Net-tools 1.60 Kbd 1.06 Sh-utils 4.5.8 udev 056 Modules Loaded i2c_prosavage i2c_algo_bit i2c_viapro ehci_hcd uhci_hcd usbcore 8250_pci 8250 serial_core tuner saa7134 video_buf v4l2_common v4l1_compat i2c_core ir_common videodev via_agp agpgart video fan button thermal processor via_rhine snd_pcm_oss snd_mixer_oss loop rtc pcspkr ide_cd cdrom slamr snd_via82xx snd_ac97_codec snd_pcm snd_timer snd_page_alloc snd_mpu401_uart snd_rawmidi snd_seq_device snd soundcore dm_mod --- END ver_linux output---------------------- * My kernel is "tainted" by the module "slamr" which controls a SmartLink "soft" modem. I compiled this propreitery module from a Debian Source package: slmodem-2.9.9a.tar.gz 6. PROCESSOR: (/proc/cpuinfo) ---BEGIN cpuinfo----- processor : 0 vendor_id : GenuineIntel cpu family : 15 model : 2 model name : Intel(R) Celeron(R) CPU 2.00GHz stepping : 9 cpu MHz : 2660.348 cache size : 128 KB fdiv_bug : no hlt_bug : no f00f_bug : no coma_bug : no fpu : yes fpu_exception : yes cpuid level : 2 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe cid xtpr bogomips : 5242.88 ---END cpuinfo-------- 7. MODULE INFORMATION: (/proc/modules) ---BEGIN module information----- isofs 37560 0 - Live 0xcf2df000 zlib_inflate 18816 1 isofs, Live 0xcf2ab000 i2c_prosavage 4480 0 - Live 0xcf293000 i2c_algo_bit 10248 1 i2c_prosavage, Live 0xcf1bf000 i2c_viapro 8208 0 - Live 0xcf28f000 ehci_hcd 34184 0 - Live 0xcf29a000 uhci_hcd 34192 0 - Live 0xcf235000 usbcore 123768 3 ehci_hcd,uhci_hcd, Live 0xcf2b4000 8250_pci 18944 0 - Live 0xcf267000 8250 25796 1 8250_pci, Live 0xcf25f000 serial_core 23680 1 8250, Live 0xcf258000 tuner 23332 0 - Live 0xcf251000 saa7134 109012 1 - Live 0xcf273000 video_buf 22660 1 saa7134, Live 0xcf22e000 v4l2_common 6016 1 saa7134, Live 0xcf1a6000 v4l1_compat 14340 1 saa7134, Live 0xcf229000 i2c_core 23440 4 i2c_algo_bit,i2c_viapro,tuner,saa7134, Live 0xcf1c3000 ir_common 5252 1 saa7134, Live 0xcf1a9000 videodev 10368 2 saa7134, Live 0xcf1b7000 via_agp 9856 1 - Live 0xcf0b8000 agpgart 35752 1 via_agp, Live 0xcf1ad000 video 16388 0 - Live 0xcf181000 fan 4740 0 - Live 0xcf17e000 button 6800 0 - Live 0xcf059000 thermal 13704 0 - Live 0xcf196000 processor 23348 1 thermal, Live 0xcf090000 via_rhine 25092 0 - Live 0xcf176000 snd_pcm_oss 54944 0 - Live 0xcf187000 snd_mixer_oss 20608 1 snd_pcm_oss, Live 0xcf156000 loop 16776 0 - Live 0xcf150000 rtc 13624 0 - Live 0xcf070000 pcspkr 4068 0 - Live 0xcf06e000 ide_cd 42628 0 - Live 0xcf16a000 cdrom 41888 1 ide_cd, Live 0xcf15e000 slamr 376900 2 - Live 0xcf1cb000 snd_via82xx 28448 0 - Live 0xcf09f000 snd_ac97_codec 78584 1 snd_via82xx, Live 0xcf0d5000 snd_pcm 97828 3 snd_pcm_oss,snd_via82xx,snd_ac97_codec, Live 0xcf0bc000 snd_timer 27012 1 snd_pcm, Live 0xcf097000 snd_page_alloc 10244 2 snd_via82xx,snd_pcm, Live 0xcf06a000 snd_mpu401_uart 8448 1 snd_via82xx, Live 0xcf066000 snd_rawmidi 26016 1 snd_mpu401_uart, Live 0xcf085000 snd_seq_device 8972 1 snd_rawmidi, Live 0xcf062000 snd 58084 9 snd_pcm_oss,snd_mixer_oss,snd_via82xx,snd_ac97_codec,snd_pcm,snd_timer,snd_mpu401_uart,snd_rawmidi,snd_seq_device, Live 0xcf075000 soundcore 10464 2 saa7134,snd, Live 0xcf05e000 dm_mod 61820 9 - Live 0xce837000 ---END module information------ 8. DRIVER and HARDWARE INFORMATION (/proc/ioports and /proc/iomem) ---BEGIN /proc/ioports---- 0000-001f : dma1 0020-0021 : pic1 0040-0043 : timer0 0050-0053 : timer1 0060-006f : keyboard 0070-0077 : rtc 0080-008f : dma page reg 00a0-00a1 : pic2 00c0-00df : dma2 00f0-00ff : fpu 0170-0177 : ide1 01f0-01f7 : ide0 02f8-02ff : serial 0376-0376 : ide1 03c0-03df : vesafb 03f6-03f6 : ide0 03f8-03ff : serial 0400-0407 : viapro-smbus 0800-0803 : PM1a_EVT_BLK 0804-0805 : PM1a_CNT_BLK 0808-080b : PM_TMR 0810-0815 : ACPI CPU throttle 0820-0823 : GPE0_BLK 0cf8-0cff : PCI conf1 d800-d8ff : 0000:00:12.0 d800-d8ff : via-rhine dc00-dcff : 0000:00:11.5 dc00-dcff : VIA8233 e000-e01f : 0000:00:10.0 e000-e01f : uhci_hcd e400-e41f : 0000:00:10.1 e400-e41f : uhci_hcd e800-e81f : 0000:00:10.2 e800-e81f : uhci_hcd ec00-ecff : 0000:00:0b.0 ec00-ecff : SL1900 fc00-fc0f : 0000:00:11.1 fc00-fc07 : ide0 fc08-fc0f : ide1 ---END /proc/ioports------ ---BEGIN /proc/iomem------------ 00000000-0009fbff : System RAM 0009fc00-0009ffff : reserved 000a0000-000bffff : Video RAM area 000c0000-000cbfff : Video ROM 000f0000-000fffff : System ROM 00100000-0dfeffff : System RAM 00100000-00312b6b : Kernel code 00312b6c-00421bff : Kernel data 0dff0000-0dff7fff : ACPI Tables 0dff8000-0dffffff : ACPI Non-volatile Storage cfb00000-dfbfffff : PCI Bus #01 d0000000-d7ffffff : 0000:01:00.0 d0000000-d1eeffff : vesafb dfd00000-dfefffff : PCI Bus #01 dfe80000-dfefffff : 0000:01:00.0 dfffc000-dfffcfff : 0000:00:0b.0 dfffc000-dfffcfff : SL1900 dfffdc00-dfffdfff : 0000:00:0a.0 dfffdc00-dfffdfff : saa7130[0] dffffe00-dffffeff : 0000:00:12.0 dffffe00-dffffeff : via-rhine dfffff00-dfffffff : 0000:00:10.3 dfffff00-dfffffff : ehci_hcd e0000000-e3ffffff : 0000:00:00.0 fec00000-fec00fff : reserved fee00000-fee00fff : reserved fff80000-ffffffff : reserved ---END /proc/iomem-------- 9. PCI INFORMATION ('lspci -vvv') ----BEGIN lspci ------------------- 00:00.0 Host bridge: VIA Technologies, Inc. P4M266 Host Bridge Subsystem: VIA Technologies, Inc.: Unknown device 0000 Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- Status: Cap+ 66Mhz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- SERR- Capabilities: [c0] Power Management version 2 Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-) Status: D0 PME-Enable- DSel=0 DScale=0 PME- 00:01.0 PCI bridge: VIA Technologies, Inc. VT8633 [Apollo Pro266 AGP] (prog-if 00 [Normal decode]) Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- Status: Cap+ 66Mhz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- SERR- Reset- FastB2B- Capabilities: [80] Power Management version 2 Flags: PMEClk- DSI- D1+ D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-) Status: D0 PME-Enable- DSel=0 DScale=0 PME- 00:0a.0 Multimedia controller: Philips Semiconductors SAA7130 Video Broadcast Decoder (rev 01) Subsystem: Unknown device 4e42:0138 Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- Status: Cap+ 66Mhz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- SERR- TAbort- SERR- TAbort- SERR- TAbort- SERR- TAbort- SERR- TAbort- SERR- TAbort- SERR- TAbort- SERR- TAbort- SERR- TAbort- SERR- TAbort- SERR-