From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1752501AbZIQUFQ (ORCPT ); Thu, 17 Sep 2009 16:05:16 -0400 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1751749AbZIQUFO (ORCPT ); Thu, 17 Sep 2009 16:05:14 -0400 Received: from mail-yw0-f175.google.com ([209.85.211.175]:49018 "EHLO mail-yw0-f175.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751611AbZIQUFL (ORCPT ); Thu, 17 Sep 2009 16:05:11 -0400 DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type; b=LBHzg96ea0NC8WqZR9CqMjbsdmIjBh/M0Y1vSjKdbhjU150GWwnMiYfjQohdhAln5/ ZR6cM0CpTsX7b79Ldok+rcNXt7WRtIbOl0kJ21kKaBTxEBCBZ2bnPItjXkIXp5qvR9OB na9prVicfo8WG39VNyyKxHS0pS1zwQe0sHHOc= MIME-Version: 1.0 Date: Thu, 17 Sep 2009 22:05:14 +0200 Message-ID: <520f0cf10909171305j4b65b146sbc135afb335f2576@mail.gmail.com> Subject: 2.6.31-rt10 crash From: John Kacur To: RT , LKML , Thomas Gleixner Content-Type: text/plain; charset=ISO-8859-1 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org I was recompiling 2.6.31-rt10 on a system that was already running 2.6.31-rt10 (I wanted a kernel with trace options, and not so many debug options to measure latency with) I got the following during the sudo make modules_install install step BUG: unable to handle kernel paging request at 000000066d387ba0 IP: [] __schedule+0x650/0x8ef PGD 12bc16067 PUD 0 Thread overran stack, or stack corrupted Oops: 0000 [#1] PREEMPT SMP last sysfs file: /sys/class/power_supply/BAT0/energy_full CPU 1 Modules linked in: tun fuse i915 drm i2c_algo_bit ipt_MASQUERADE iptable_nat nf_ nat rfcomm bridge stp bnep sco l2cap sunrpc ipt_REJECT nf_conntrack_ipv4 nf_defr ag_ipv4 iptable_filter ip_tables ip6t_REJECT xt_tcpudp nf_conntrack_ipv6 xt_stat e ip6table_filter ip6_tables x_tables ipv6 cpufreq_ondemand acpi_cpufreq ext3 jb d mbcache dm_mirror dm_region_hash dm_log dm_multipath scsi_dh dm_mod kvm_intel kvm uinput arc4 ecb snd_hda_codec_conexant iwlagn iwlcore snd_hda_intel snd_hda_ codec mac80211 snd_hwdep snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq sn d_seq_device snd_pcm_oss snd_mixer_oss snd_pcm snd_timer e1000e sdhci_pci btusb sdhci thinkpad_acpi cfg80211 snd ppdev video parport_pc i2c_i801 ata_generic sr_ mod mmc_core firewire_ohci pata_acpi parport hwmon bluetooth firewire_core outpu t ricoh_mmc soundcore intel_agp i2c_core sg ac battery cdrom pcspkr iTCO_wdt iTC O_vendor_support button rfkill wmi snd_page_alloc crc_itu_t joydev ahci libata s d_mod scsi_mod crc_t10dif xfs exportfs uhci_hcd ohci_hcd ehci_hcd [last unloaded : microcode] Pid: 2602, comm: Xorg Not tainted 2.6.31-rt10 #1 2241B48 RIP: 0010:[] [] __schedule+0x650/0x8ef RSP: 0018:ffff88012b1221b8 EFLAGS: 00010083 RAX: 00000000dd79fbea RBX: ffff8801300fc700 RCX: ffff8801300fc700 RDX: 0000000000221a00 RSI: 00000000dd79fbea RDI: ffff88002c24c1a0 RBP: ffff88012b122268 R08: ffff88011d421a10 R09: 00000754f3bd1b47 R10: 00000000dd79fbea R11: 0000000000000000 R12: ffff8801300fc700 R13: ffff88002c248a80 R14: 0000000000000004 R15: ffff88002c24ba00 FS: 00007fc79b087790(0000) GS:ffff88002c02a000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 000000066d387ba0 CR3: 0000000138d67000 CR4: 00000000000026e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Process Xorg (pid: 2602, threadinfo ffff88012b122000, task ffff8801300fc700) Stack: ffff88002c248a80 0000000000000246 ffff88012b1222c8 ffffffff81412bb6 <0> ffff8801300fc700 ffff88013bb804c0 ffff8801300fcaa0 00000001814125f4 <0> ffffffff8141140f ffff88002c248a80 ffff88012b122238 ffffffff810e1574 Call Trace: [] ? trace_hardirqs_on_thunk+0x3a/0x3f [] ? preempt_schedule+0x55/0x98 [] ? trace_preempt_off+0x2f/0x70 [] preempt_schedule+0x68/0x98 [] ? _atomic_spin_unlock_irqrestore+0x55/0x91 [] _atomic_spin_unlock_irqrestore+0x76/0x91 [] rt_spin_lock_slowlock+0x255/0x29e [] ? rt_spin_lock_slowlock+0x0/0x29e [] rt_spin_lock_fastlock+0x67/0x82 [] rt_spin_lock+0x2e/0x68 [] _slab_irq_disable+0x4f/0x89 [] kmem_cache_alloc+0x7a/0x238 [] scsi_pool_alloc_command+0x36/0x8a [scsi_mod] [] ? trace_preempt_on+0x2c/0x6d [] scsi_host_alloc_command+0x2b/0x8c [scsi_mod] [] __scsi_get_command+0x24/0xb2 [scsi_mod] [] scsi_get_command+0x46/0xbf [scsi_mod] [] scsi_setup_fs_cmnd+0x7e/0xe3 [scsi_mod] [] sd_prep_fn+0x73/0x8b4 [sd_mod] [] ? cfq_dispatch_insert+0x4c/0x76 [] ? cfq_dispatch_requests+0x291/0x387 [] ? _atomic_spin_unlock_irqrestore+0x5f/0x91 [] blk_peek_request+0x136/0x216 [] scsi_request_fn+0x92/0x55f [scsi_mod] [] __blk_run_queue+0x4f/0x99 [] cfq_insert_request+0x30b/0x341 [] elv_insert+0x1ef/0x2b3 [] __elv_add_request+0xa9/0xc8 [] __make_request+0x3d6/0x46b [] generic_make_request+0x2e4/0x342 [] submit_bio+0xc8/0xe5 [] _xfs_buf_ioapply+0x231/0x273 [xfs] [] xfs_buf_iorequest+0x5a/0xa4 [xfs] [] ? xfs_buf_get_flags+0xda/0x170 [xfs] [] _xfs_buf_read+0x40/0x6d [xfs] [] xfs_buf_read_flags+0x65/0xb1 [xfs] [] xfs_trans_read_buf+0x1c8/0x2d8 [xfs] [] xfs_btree_read_buf_block+0x5c/0xb4 [xfs] [] ? rt_spin_lock_slowunlock+0x58/0x9c [] xfs_btree_lookup_get_block+0x97/0xd1 [xfs] [] xfs_btree_lookup+0x145/0x3fb [xfs] [] xfs_alloc_lookup_eq+0x27/0x3d [xfs] [] xfs_alloc_fixup_trees+0x80/0x2a0 [xfs] [] ? xfs_alloc_get_rec+0x31/0x72 [xfs] [] xfs_alloc_ag_vextent_size+0x342/0x43f [xfs] [] xfs_alloc_ag_vextent+0x38/0x11e [xfs] [] xfs_alloc_vextent+0x2f9/0x44d [xfs] [] ? xfs_inode_is_filestream+0x3a/0x85 [xfs] [] ? xfs_inode_is_filestream+0x49/0x85 [xfs] [] xfs_bmap_btalloc+0x53c/0x719 [xfs] [] xfs_bmap_alloc+0x1c/0x32 [xfs] [] xfs_bmapi+0x6f0/0xdf1 [xfs] [] xfs_iomap_write_allocate+0x21f/0x363 [xfs] [] ? rt_spin_unlock+0x57/0x72 [] xfs_iomap+0x21f/0x2a0 [xfs] [] xfs_map_blocks+0x37/0x54 [xfs] [] xfs_page_state_convert+0x2f0/0x5d7 [xfs] [] ? __dec_zone_state+0x9a/0xd9 [] ? trace_hardirqs_on+0x20/0x36 [] ? time_hardirqs_on+0x29/0x7d [] xfs_vm_writepage+0xbb/0x108 [xfs] [] shrink_page_list+0x3d1/0x6f0 [] ? trace_hardirqs_on+0x20/0x36 [] shrink_list+0x2e5/0x5b0 [] ? debug_rt_mutex_free_waiter+0x27/0xf0 [] ? trace_hardirqs_on+0x20/0x36 [] ? _atomic_spin_unlock_irqrestore+0x5f/0x91 [] ? trace_preempt_on+0x2c/0x6d [] shrink_zone+0x2af/0x38a [] ? try_to_free_pages+0xde/0x3cd [] ? count_vm_event+0x4e/0x8c [] ? sub_preempt_count+0xad/0xd7 [] try_to_free_pages+0x250/0x3cd [] ? isolate_pages_global+0x0/0x1fc [] __alloc_pages_nodemask+0x44a/0x640 [] alloc_pages_current+0xa9/0xca [] __get_free_pages+0x1c/0x6d [] __pollwait+0x71/0xfe [] sock_poll_wait+0x29/0x42 [] unix_poll+0x2b/0xc3 [] sock_poll+0x2e/0x44 [] do_select+0x3c0/0x5da [] ? __pollwait+0x0/0xfe [] ? pollwake+0x0/0x7c [] ? pollwake+0x0/0x7c [] ? pollwake+0x0/0x7c [] ? pollwake+0x0/0x7c [] ? pollwake+0x0/0x7c [] ? pollwake+0x0/0x7c [] ? pollwake+0x0/0x7c [] ? pollwake+0x0/0x7c [] ? pollwake+0x0/0x7c [] core_sys_select+0x1b8/0x271 [] ? unlock_kernel+0x54/0x6a [] ? poll_select_set_timeout+0x68/0x9f [] sys_select+0xa3/0xdf [] system_call_fastpath+0x16/0x1b Code: ff ff 48 89 85 78 ff ff ff 0f 84 25 03 00 00 48 8b 8d 70 ff ff ff 48 c7 c2 00 1a 22 00 48 8b 9d 70 ff ff ff 48 8b 41 08 8b 40 18 <48> 8b 04 c5 50 9c 68 81 48 8d 0c 02 48 3b 99 40 08 00 00 74 63 RIP [] __schedule+0x650/0x8ef RSP CR2: 000000066d387ba0 ---[ end trace 00b40f39bfa88a0d ]--- BUG: unable to handle kernel paging request at 00000000d9f9a490 IP: [] task_rq_lock+0x41/0x9c PGD 11311f067 PUD 0 Oops: 0000 [#2] PREEMPT SMP last sysfs file: /sys/class/power_supply/BAT0/energy_full CPU 0 Modules linked in: tun fuse i915 drm i2c_algo_bit ipt_MASQUERADE iptable_nat nf_ nat rfcomm bridge stp bnep sco l2cap sunrpc ipt_REJECT nf_conntrack_ipv4 nf_defr ag_ipv4 iptable_filter ip_tables ip6t_REJECT xt_tcpudp nf_conntrack_ipv6 xt_stat e ip6table_filter ip6_tables x_tables ipv6 cpufreq_ondemand acpi_cpufreq ext3 jb d mbcache dm_mirror dm_region_hash dm_log dm_multipath scsi_dh dm_mod kvm_intel kvm uinput arc4 ecb snd_hda_codec_conexant iwlagn iwlcore snd_hda_intel snd_hda_ codec mac80211 snd_hwdep snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq sn d_seq_device snd_pcm_oss snd_mixer_oss snd_pcm snd_timer e1000e sdhci_pci btusb sdhci thinkpad_acpi cfg80211 snd ppdev video parport_pc i2c_i801 ata_generic sr_ mod mmc_core firewire_ohci pata_acpi parport hwmon bluetooth firewire_core outpu t ricoh_mmc soundcore intel_agp i2c_core sg ac battery cdrom pcspkr iTCO_wdt iTC O_vendor_support button rfkill wmi snd_page_alloc crc_itu_t joydev ahci libata s d_mod scsi_mod crc_t10dif xfs exportfs uhci_hcd ohci_hcd ehci_hcd [last unloaded : microcode] Pid: 8, comm: sirq-block/0 Tainted: G D 2.6.31-rt10 #1 2241B48 RIP: 0010:[] [] task_rq_lock+0x41/0x9c RSP: 0018:ffff88013bb15a30 EFLAGS: 00010046 RAX: 000000002b122108 RBX: 0000000000221a00 RCX: ffff88013bb15bd0 RDX: 00000000bd4f4834 RSI: 0000000000000001 RDI: 0000000000000003 RBP: ffff88013bb15a60 R08: 0000000000000002 R09: 0000000000000001 R10: 0000000035ffad5e R11: 0000000000000046 R12: 0000000000221a00 R13: ffff88013bb15a88 R14: ffff8801300fc700 R15: ffff8801300fc700 FS: 0000000000000000(0000) GS:ffff88002be00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b CR2: 00000000d9f9a490 CR3: 0000000118cf2000 CR4: 00000000000026f0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000ffff4ff0 DR7: 0000000000000400 Process sirq-block/0 (pid: 8, threadinfo ffff88013bb14000, task ffff88013bb10200 ) Stack: ffff8801300fce60 00000000bd4f4834 0000000000000032 ffff8801300fc700 <0> ffff88013bb15b80 ffff880137c133b8 ffff88013bb15ac0 ffffffff810520ea <0> ffff88013bb15bb8 ffff8801300fcea0 ffffffff8142a700 0000000000000046 Call Trace: [] task_setprio+0x42/0x1d2 [] __rt_mutex_adjust_prio+0x2f/0x4a [] task_blocks_on_rt_mutex+0x13a/0x1b0 [] rt_spin_lock_slowlock+0x105/0x29e [] ? rt_spin_lock_slowlock+0x0/0x29e [] rt_spin_lock_fastlock+0x67/0x82 [] rt_spin_lock+0x2e/0x68 [] ? scsi_device_unbusy+0x3a/0xd1 [scsi_mod] [] scsi_device_unbusy+0x9e/0xd1 [scsi_mod] [] scsi_finish_command+0x36/0x11f [scsi_mod] [] scsi_softirq_done+0x133/0x153 [scsi_mod] [] blk_done_softirq+0x87/0xad [] ksoftirqd+0x160/0x28f [] ? ksoftirqd+0x0/0x28f [] ? ksoftirqd+0x0/0x28f [] kthread+0xad/0xb5 [] ? trace_hardirqs_on_thunk+0x3a/0x3f [] ? time_hardirqs_on+0x29/0x7d [] child_rip+0xa/0x20 [] ? restore_args+0x0/0x30 [] ? kthread+0x0/0xb5 [] ? child_rip+0x0/0x20 Code: 00 53 48 83 ec 10 65 48 8b 04 25 28 00 00 00 48 89 45 d8 31 c0 9c 58 fa 49 89 45 00 4c 89 e3 e8 c0 e6 04 00 49 8b 46 08 8b 40 18 <48> 03 1c c5 50 9c 68 81 48 89 df e8 92 dd 3c 00 49 8b 46 08 8b RIP [] task_rq_lock+0x41/0x9c RSP CR2: 00000000d9f9a490 ---[ end trace 00b40f39bfa88a0e ]--- note: sirq-block/0[8] exited with preempt_count 2 Kernel panic - not syncing: Fatal exception in interrupt BUG: spinlock lockup on CPU#1, Xorg/2602, ffff88002c24ba00 Pid: 2602, comm: Xorg Tainted: G D 2.6.31-rt10 #1 Call Trace: [] _raw_spin_lock+0x11c/0x15d [] _atomic_spin_lock+0x6b/0x94 [] ? scheduler_tick+0x55/0x280 [] ? sched_clock_tick+0x82/0x105 [] scheduler_tick+0x55/0x280 [] update_process_times+0x3f/0x80 [] tick_sched_timer+0x82/0xc2 [] ? _atomic_spin_unlock+0x56/0x71 [] ? tick_sched_timer+0x0/0xc2 [] __run_hrtimer+0x89/0xd5 [] ? hrtimer_interrupt+0xd0/0x1a9 [] hrtimer_interrupt+0x127/0x1a9 [] ? time_hardirqs_off+0x51/0x70 [] ? time_hardirqs_off+0x51/0x70 [] smp_apic_timer_interrupt+0x94/0xbe [] apic_timer_interrupt+0x13/0x20 BUG: spinlock lockup on CPU#0, depmod/1942, ffff88002c24ba00 Pid: 1942, comm: depmod Tainted: G D 2.6.31-rt10 #1 Call Trace: [] _raw_spin_lock+0x11c/0x15d [] _atomic_spin_lock+0x6b/0x94 [] ? sched_rt_period_timer+0xb3/0x1e4 [] ? _atomic_spin_unlock+0x56/0x71 [] sched_rt_period_timer+0xb3/0x1e4 [] ? sched_rt_period_timer+0x0/0x1e4 [] __run_hrtimer+0x89/0xd5 [] ? hrtimer_interrupt+0xd0/0x1a9 [] hrtimer_interrupt+0x127/0x1a9 [] smp_apic_timer_interrupt+0x94/0xbe [] apic_timer_interrupt+0x13/0x20 [] ? preempt_schedule+0x55/0x98 [] ? need_resched+0x0/0x4f [] ? preempt_schedule+0x78/0x98 [] ? _atomic_spin_unlock_irqrestore+0x76/0x91 [] ? rt_spin_lock_slowunlock+0x58/0x9c [] ? rt_spin_unlock+0x57/0x72 [] ? __remove_mapping+0x62/0x10e [] ? __remove_mapping+0xde/0x10e [] ? shrink_page_list+0x588/0x6f0 [] ? trace_hardirqs_on+0x20/0x36 [] ? trace_preempt_on+0x2c/0x6d [] ? sub_preempt_count+0xad/0xd7 [] ? shrink_list+0x2e5/0x5b0 [] ? trace_hardirqs_on+0x20/0x36 [] ? throttle_vm_writeout+0x43/0xb4 [] ? shrink_zone+0x2af/0x38a [] ? try_to_free_pages+0xde/0x3cd [] ? count_vm_event+0x4e/0x8c [] ? sub_preempt_count+0xad/0xd7 [] ? try_to_free_pages+0x250/0x3cd [] ? isolate_pages_global+0x0/0x1fc [] ? __alloc_pages_nodemask+0x44a/0x640 [] ? alloc_page_vma+0xda/0xf0 [] ? handle_mm_fault+0x190/0x68e [] ? rt_down_read_trylock+0x81/0xa1 [] ? do_page_fault+0x29f/0x2d1 [] ? trace_hardirqs_off_thunk+0x3a/0x3c [] ? page_fault+0x1f/0x30 [] ? file_read_actor+0x60/0x15f [] ? find_get_page+0x84/0xaa [] ? should_resched+0x1c/0x51 [] ? generic_file_aio_read+0x374/0x5cb [] ? xfs_read+0x183/0x205 [xfs] [] ? xfs_file_aio_read+0x7b/0x92 [xfs] [] ? do_sync_read+0xf9/0x152 [] ? kmem_cache_free+0x54/0xdf [] ? autoremove_wake_function+0x0/0x5e [] ? sub_preempt_count+0xad/0xd7 [] ? security_file_permission+0x24/0x3a [] ? trace_hardirqs_on_thunk+0x3a/0x3f [] ? vfs_read+0xbe/0x12f [] ? sys_read+0x59/0x99 [] ? system_call_fastpath+0x16/0x1b