From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1751130AbWG1JzI (ORCPT ); Fri, 28 Jul 2006 05:55:08 -0400 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1751990AbWG1JzI (ORCPT ); Fri, 28 Jul 2006 05:55:08 -0400 Received: from public.id2-vpn.continvity.gns.novell.com ([195.33.99.129]:15675 "EHLO emea1-mh.id2.novell.com") by vger.kernel.org with ESMTP id S1751130AbWG1JzG (ORCPT ); Fri, 28 Jul 2006 05:55:06 -0400 Message-Id: <44C9FB60.76E4.0078.0@novell.com> X-Mailer: Novell GroupWise Internet Agent 7.0.1 Date: Fri, 28 Jul 2006 10:56:16 +0100 From: "Jan Beulich" To: Cc: "Ingo Molnar" , "Andi Kleen" , "Andrew Morton" Subject: Fw: Re: 2.6.18-rc2-mm1 References: <20060728011938.fc6c2d6e.akpm@osdl.org> In-Reply-To: <20060728011938.fc6c2d6e.akpm@osdl.org> Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Content-Disposition: inline Sender: linux-kernel-owner@vger.kernel.org X-Mailing-List: linux-kernel@vger.kernel.org >>> Andrew Morton 28.07.06 10:19 >>> > >More unwinder problems. Seems to be specific to -mm. >(Followups on-list are preferred, thanks). That's another of the lose ends - while Andi and I had decided to put a proper stack frame in place for the switch to the irq stack in the interrupt macro, we had forgotten about doing something similar for call_softirq() - as the code is written currently, there simply is now way of annotating the code properly. If Andi is agreeable to this, then I'll just change the code so that it'll have a proper stack frame. The recursive traces appear to result from the fact that when we did the change to the interrupt macro, we neglected the fact that show_trace() expects to find the old stack pointer as the very first item on the interrupt stack, which isn't the case anymore. The value of where the subsequent stack access fails is a little strange, though. Making this assumption be true again would, however, require adding a push to both the interrupt macro and call_softirq. I'm afraid Andi's not going to be too happy about that, but on the other hand I can't see any other possible way that would get away without adding some code to these paths. Jan *************************************************** Begin forwarded message: Date: Fri, 28 Jul 2006 20:09:35 +1200 From: Reuben Farrelly To: Andrew Morton Cc: linux-kernel@vger.kernel.org, Linux Netdev List , herbert@gondor.apana.org.au Subject: Re: 2.6.18-rc2-mm1 On 27/07/2006 8:56 p.m., Andrew Morton wrote: > ftp://ftp.kernel.org/pub/linux/kernel/people/akpm/patches/2.6/2.6.18-rc2/2.6.18-rc2-mm1/ > > - git-klibc has been dropped due to very bad parallel-make problems. > > - Added a new line to the boilerplate, below! > > - Added Sam's lxdialog tree, as git-lxdialog.patch. You no longer need > x-ray spectacles to read the menuconfig screens. > > - Lots of random patches. Many of them are bugfixes and I shall, as usual, > go through them all identifying 2.6.18 material. But I can miss things, so > please don't be afraid to point 2.6.18 candidates out to me. > > I also have, as usual, a number of bugfixes agains the git trees. I'll > send these to the maintainers until they stick and then I lose track of > them. So don't be afraid to send reminders to the subsystem maintainers > either. Still seeing breakage with the e1000/NAT. Now the problem isn't so much that the bug exists, but that unlike in -rc1-mm2, the trace scrolls over and over and over (with some variation down into it) until the kernel completely panics and the box has to be rebooted. http://www.ussg.iu.edu/hypermail/linux/kernel/0607.1/2689.html from Herbert Xu talks about the original problem. It's a regression from the previous -mm whereby the trace would print out just once. Starting Dovecot Imap: [ OK ] Starting clamd: [ OK ] Starting amavisd: BUG: warning at net/core/dev.c:1168/skb_checksum_help() Call Trace: [] show_trace+0xb5/0x324 [] dump_stack+0x15/0x1c [] skb_checksum_help+0x63/0x13b [] :iptable_nat:ip_nat_fn+0x5f/0x1d2 [] :iptable_nat:ip_nat_local_fn+0x33/0xbc [] nf_iterate+0x5a/0x9b [] nf_hook_slow+0x60/0xcd [] ip_queue_xmit+0x444/0x4c0 [] tcp_transmit_skb+0x68f/0x6cf [] __tcp_push_pending_frames+0x867/0x95a [] tcp_rcv_established+0x72c/0x7c4 [] tcp_v4_do_rcv+0x2e/0x317 [] tcp_v4_rcv+0x9fc/0xa79 [] ip_local_deliver+0x199/0x270 [] ip_rcv+0x4d3/0x52b [] netif_receive_skb+0x1eb/0x27b [] e1000_clean_rx_irq_ps+0x5c1/0x6a0 [] e1000_clean+0x325/0x45b [] net_rx_action+0x8e/0x147 [] __do_softirq+0x78/0x105 [] call_softirq+0x1e/0x28 DWARF2 unwinder stuck at call_softirq+0x1e/0x28 Leftover inexact backtrace: [] do_softirq+0x39/0xa4 [] irq_exit+0x58/0x5a [] do_IRQ+0xb4/0xbe [] ret_from_intr+0x0/0xf <1>Unable to handle kernel paging request at ffffffff82800000 RIP: [] show_trace+0x2bf/0x324 PGD 203027 PUD 205027 PMD 0 Oops: 0000 [1] SMP last sysfs file: /class/net/sit0/address CPU 0 Modules linked in: hidp rfcomm l2cap bluetooth ipv6 ip_gre iptable_filter iptable_nat ip_nat ip_conntrack nfnetlink iptable_mangle ip_tables binfmt_misc iTCO_wdt i2c_i801 serio_raw Pid: 2127, comm: imap Not tainted 2.6.18-rc2-mm1 #1 RIP: 0010:[] [] show_trace+0x2bf/0x324 RSP: 0000:ffffffff806366f0 EFLAGS: 00010206 RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000004 RDX: 0000000000000010 RSI: ffff81003d95c840 RDI: ffff81003d95c140 RBP: ffffffff806367f0 R08: 0000000000000001 R09: 0000000000000001 R10: 0000000000000002 R11: 0000000000000001 R12: ffffffff827ffff9 R13: 0000000000000000 R14: 0000000000000000 R15: ffffffff80907000 FS: 00002ab5ab544860(0000) GS:ffffffff808b2000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b CR2: ffffffff82800000 CR3: 0000000029dea000 CR4: 00000000000006e0 Process imap (pid: 2127, threadinfo ffff810029e62000, task ffff81003d95c140) Stack: ffffffff806cec48 ffffffff80636fc0 0000000000000001 ffff81002c9d78f8 0000000000000000 0000000000000000 00007fffff571020 ffff810029e63f58 ffffffff80636f80 0000000000000046 0000000000000000 0000000000000000 Call Trace: [] dump_stack+0x15/0x1c [] skb_checksum_help+0x63/0x13b [] :iptable_nat:ip_nat_fn+0x5f/0x1d2 [] :iptable_nat:ip_nat_local_fn+0x33/0xbc [] nf_iterate+0x5a/0x9b [] nf_hook_slow+0x60/0xcd [] ip_queue_xmit+0x444/0x4c0 [] tcp_transmit_skb+0x68f/0x6cf [] __tcp_push_pending_frames+0x867/0x95a [] tcp_rcv_established+0x72c/0x7c4 [] tcp_v4_do_rcv+0x2e/0x317 [] tcp_v4_rcv+0x9fc/0xa79 [] ip_local_deliver+0x199/0x270 [] ip_rcv+0x4d3/0x52b [] netif_receive_skb+0x1eb/0x27b [] e1000_clean_rx_irq_ps+0x5c1/0x6a0 [] e1000_clean+0x325/0x45b [] net_rx_action+0x8e/0x147 [] __do_softirq+0x78/0x105 [] call_softirq+0x1e/0x28 DWARF2 unwinder stuck at call_softirq+0x1e/0x28 Leftover inexact backtrace: [] do_softirq+0x39/0xa4 [] irq_exit+0x58/0x5a [] do_IRQ+0xb4/0xbe [] ret_from_intr+0x0/0xf <1>Unable to handle kernel paging request at ffffffff82800000 RIP: [] show_trace+0x2bf/0x324 PGD 203027 PUD 205027 PMD 0 Oops: 0000 [2] SMP last sysfs file: /class/net/sit0/address CPU 0 Modules linked in: hidp rfcomm l2cap bluetooth ipv6 ip_gre iptable_filter iptable_nat ip_nat ip_conntrack nfnetlink iptable_mangle ip_tables binfmt_misc iTCO_wdt i2c_i801 serio_raw Pid: 2127, comm: imap Not tainted 2.6.18-rc2-mm1 #1 RIP: 0010:[] [] show_trace+0x2bf/0x324 RSP: 0000:ffffffff80636378 EFLAGS: 00010006 RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffffffff880a3808 RDX: ffff81003d95c140 RSI: 0000000000000001 RDI: 0000000000000000 RBP: ffffffff80636478 R08: 0000000000000000 R09: 0000000000000001 R10: ffffffff8029fae0 R11: 0000000000000000 R12: ffffffff827ffff9 R13: 0000000000000000 R14: 0000000000000000 R15: ffffffff80907000 FS: 00002ab5ab544860(0000) GS:ffffffff808b2000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b CR2: ffffffff82800000 CR3: 0000000029dea000 CR4: 00000000000006e0 Process imap (pid: 2127, threadinfo ffff810029e62000, task ffff81003d95c140) Stack: 000000000000000b ffffffff80636fc0 0000000080632fc0 0000000000000000 0000000000000000 0000000000000000 00007fffff571020 ffff810029e63f58 ffffffff80636f80 0000000000000046 0000000000000001 0000000000000002 Call Trace: [] _show_stack+0xef/0xfe [] show_registers+0x8c/0x101 [] __die+0xa0/0xe3 [] do_page_fault+0x785/0x89d [] error_exit+0x0/0x96 DWARF2 unwinder stuck at error_exit+0x0/0x96 Leftover inexact backtrace: [] show_trace+0x2bf/0x324 [] call_softirq+0x1e/0x28 [] dump_stack+0x15/0x1c [] skb_checksum_help+0x63/0x13b [] :iptable_nat:ip_nat_fn+0x5f/0x1d2 [] :iptable_nat:ip_nat_local_fn+0x33/0xbc [] nf_iterate+0x5a/0x9b [] dst_output+0x0/0x10 [] nf_hook_slow+0x60/0xcd [] dst_output+0x0/0x10 [] _spin_unlock_irqrestore+0x3f/0x47 [] ip_queue_xmit+0x444/0x4c0 [] tso_fragment+0x5d/0x20e [] __kmalloc_track_caller+0x109/0x11b [] tcp_transmit_skb+0x68f/0x6cf [] tso_fragment+0x1a6/0x20e [] __tcp_push_pending_frames+0x867/0x95a [] __kfree_skb+0xfc/0x101 [] tcp_data_queue+0x651/0xc39 [] tcp_rcv_established+0x72c/0x7c4 [] tcp_v4_do_rcv+0x2e/0x317 [] tcp_v4_rcv+0x9fc/0xa79 [] nf_hook_slow+0x60/0xcd [] ip_local_deliver_finish+0x0/0x1fb [] ip_local_deliver+0x199/0x270 [] ip_rcv+0x4d3/0x52b [] kfree_skb+0x2c/0x31 [] netif_receive_skb+0x1eb/0x27b [] e1000_clean_rx_irq_ps+0x5c1/0x6a0 [] e1000_clean+0x325/0x45b [] net_rx_action+0x8e/0x147 [] __do_softirq+0x64/0x105 [] __do_softirq+0x78/0x105 [] call_softirq+0x1e/0x28 [] do_softirq+0x39/0xa4 [] irq_exit+0x58/0x5a [] do_IRQ+0xb4/0xbe [] ret_from_intr+0x0/0xf <1>Unable to handle kernel paging request at ffffffff82800000 RIP: [] show_trace+0x2bf/0x324 PGD 203027 PUD 205027 PMD 0 Oops: 0000 [3] SMP last sysfs file: /class/net/sit0/address CPU 0 Modules linked in: hidp rfcomm l2cap bluetooth ipv6 ip_gre iptable_filter iptable_nat ip_nat ip_conntrack nfnetlink iptable_mangle ip_tables binfmt_misc iTCO_wdt i2c_i801 serio_raw Pid: 2127, comm: imap Not tainted 2.6.18-rc2-mm1 #1 RIP: 0010:[] [] show_trace+0x2bf/0x324 RSP: 0000:ffffffff80635ff8 EFLAGS: 00010006 RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffffffff880a3808 RDX: ffff81003d95c140 RSI: 0000000000000001 RDI: 0000000000000000 RBP: ffffffff806360f8 R08: 0000000000000000 R09: 0000000000000001 R10: ffffffff8029fae0 R11: 0000000000000000 R12: ffffffff827ffff9 R13: 0000000000000000 R14: 0000000000000000 R15: ffffffff80907000 FS: 00002ab5ab544860(0000) GS:ffffffff808b2000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b CR2: ffffffff82800000 CR3: 0000000029dea000 CR4: 00000000000006e0 Process imap (pid: 2127, threadinfo ffff810029e62000, task ffff81003d95c140) Stack: 000000000000000b ffffffff80636fc0 0000000080632fc0 0000000000000000 ffffffff80907000 0000000000000000 0000000000000000 ffffffff827ffff9 000000008025fa27 0000000000000001 0000000000000000 ffffffff8029fae0 Call Trace: [] _show_stack+0xef/0xfe [] show_registers+0x8c/0x101 [] __die+0xa0/0xe3 [] do_page_fault+0x785/0x89d [] error_exit+0x0/0x96 DWARF2 unwinder stuck at error_exit+0x0/0x96 Leftover inexact backtrace: [] module_text_address+0x16/0x46 [] show_trace+0x2bf/0x324 [] show_trace+0x2cb/0x324 [] call_softirq+0x1e/0x28 [] _show_stack+0xef/0xfe [] show_registers+0x8c/0x101 [] __die+0xa0/0xe3 [] do_page_fault+0x785/0x89d [] mark_held_locks+0x5d/0x96 [] trace_hardirqs_on+0xec/0x12c [] error_exit+0x0/0x96 [] show_trace+0x2bf/0x324 [] call_softirq+0x1e/0x28 [] dump_stack+0x15/0x1c [] skb_checksum_help+0x63/0x13b [] :iptable_nat:ip_nat_fn+0x5f/0x1d2 [] :iptable_nat:ip_nat_local_fn+0x33/0xbc [] nf_iterate+0x5a/0x9b [] dst_output+0x0/0x10 [] nf_hook_slow+0x60/0xcd [] dst_output+0x0/0x10 [] _spin_unlock_irqrestore+0x3f/0x47 [] ip_queue_xmit+0x444/0x4c0 [] tso_fragment+0x5d/0x20e [] __kmalloc_track_caller+0x109/0x11b [] tcp_transmit_skb+0x68f/0x6cf [] tso_fragment+0x1a6/0x20e [] __tcp_push_pending_frames+0x867/0x95a [] __kfree_skb+0xfc/0x101 [] tcp_data_queue+0x651/0xc39 [] tcp_rcv_established+0x72c/0x7c4 [] tcp_v4_do_rcv+0x2e/0x317 [] tcp_v4_rcv+0x9fc/0xa79 [] nf_hook_slow+0x60/0xcd [] ip_local_deliver_finish+0x0/0x1fb [] ip_local_deliver+0x199/0x270 [] ip_rcv+0x4d3/0x52b [] kfree_skb+0x2c/0x31 [] netif_receive_skb+0x1eb/0x27b [] e1000_clean_rx_irq_ps+0x5c1/0x6a0 [] e1000_clean+0x325/0x45b [] net_rx_action+0x8e/0x147 [] __do_softirq+0x64/0x105 [] __do_softirq+0x78/0x105 [] call_softirq+0x1e/0x28 [] do_softirq+0x39/0xa4 [] irq_exit+0x58/0x5a [] do_IRQ+0xb4/0xbe [] ret_from_intr+0x0/0xf <1>Unable to handle kernel paging request at ffffffff82800000 RIP: [] show_trace+0x2bf/0x324 PGD 203027 PUD 205027 PMD 0 Oops: 0000 [4] SMP last sysfs file: /class/net/sit0/address CPU 0 Modules linked in: hidp rfcomm l2cap bluetooth ipv6 ip_gre iptable_filter iptable_nat ip_nat ip_conntrack nfnetlink iptable_mangle ip_tables binfmt_misc iTCO_wdt i2c_i801 serio_raw Pid: 2127, comm: imap Not tainted 2.6.18-rc2-mm1 #1 RIP: 0010:[] [] show_trace+0x2bf/0x324 RSP: 0000:ffffffff80635c78 EFLAGS: 00010006 RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffffffff880a3808 RDX: ffff81003d95c140 RSI: 0000000000000001 RDI: 0000000000000000 RBP: ffffffff80635d78 R08: 0000000000000000 R09: 0000000000000001 R10: ffffffff8029fae0 R11: 0000000000000000 R12: ffffffff827ffff9 R13: 0000000000000000 R14: 0000000000000000 R15: ffffffff80907000 FS: 00002ab5ab544860(0000) GS:ffffffff808b2000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b CR2: ffffffff82800000 CR3: 0000000029dea000 CR4: 00000000000006e0 Process imap (pid: 2127, threadinfo ffff810029e62000, task ffff81003d95c140) Stack: 000000000000000b ffffffff80636fc0 0000000080632fc0 0000000000000000 ffffffff80907000 0000000000000000 0000000000000000 ffffffff827ffff9 000000008025fa27 0000000000000001 0000000000000000 ffffffff8029fae0 Call Trace: [] _show_stack+0xef/0xfe [] show_registers+0x8c/0x101 [] __die+0xa0/0xe3 [] do_page_fault+0x785/0x89d [] error_exit+0x0/0x96 DWARF2 unwinder stuck at error_exit+0x0/0x96 Leftover inexact backtrace: [] module_text_address+0x16/0x46 [] show_trace+0x2bf/0x324 [] show_trace+0x2cb/0x324 [] module_text_address+0x16/0x46 [] error_exit+0x0/0x96 [] _show_stack+0xef/0xfe [] show_registers+0x8c/0x101 [] __die+0xa0/0xe3 [] do_page_fault+0x785/0x89d [] vprintk+0x30f/0x35d [] kallsyms_lookup+0xea/0x1b5 [] call_softirq+0x1e/0x28 [] ret_from_intr+0x0/0xf [] ret_from_intr+0x0/0xf [] error_exit+0x0/0x96 [] module_text_address+0x16/0x46 [] show_trace+0x2bf/0x324 [] show_trace+0x2cb/0x324 [] call_softirq+0x1e/0x28 [] _show_stack+0xef/0xfe [] show_registers+0x8c/0x101 [] __die+0xa0/0xe3 [] do_page_fault+0x785/0x89d [] mark_held_locks+0x5d/0x96 [] trace_hardirqs_on+0xec/0x12c [] error_exit+0x0/0x96 [] show_trace+0x2bf/0x324 [] call_softirq+0x1e/0x28 [] dump_stack+0x15/0x1c [] skb_checksum_help+0x63/0x13b [] :iptable_nat:ip_nat_fn+0x5f/0x1d2 [] :iptable_nat:ip_nat_local_fn+0x33/0xbc [] nf_iterate+0x5a/0x9b [] dst_output+0x0/0x10 [] nf_hook_slow+0x60/0xcd [] dst_output+0x0/0x10 [] _spin_unlock_irqrestore+0x3f/0x47 [] ip_queue_xmit+0x444/0x4c0 [] tso_fragment+0x5d/0x20e [] __kmalloc_track_caller+0x109/0x11b [] tcp_transmit_skb+0x68f/0x6cf [] tso_fragment+0x1a6/0x20e [] __tcp_push_pending_frames+0x867/0x95a [] __kfree_skb+0xfc/0x101 [] tcp_data_queue+0x651/0xc39 [] tcp_rcv_established+0x72c/0x7c4 [] tcp_v4_do_rcv+0x2e/0x317 [] tcp_v4_rcv+0x9fc/0xa79 [] nf_hook_slow+0x60/0xcd [] ip_local_deliver_finish+0x0/0x1fb [] ip_local_deliver+0x199/0x270 [] ip_rcv+0x4d3/0x52b [] kfree_skb+0x2c/0x31 [] netif_receive_skb+0x1eb/0x27b [] e1000_clean_rx_irq_ps+0x5c1/0x6a0 [] e1000_clean+0x325/0x45b [] net_rx_action+0x8e/0x147 [] __do_softirq+0x64/0x105 [] __do_softirq+0x78/0x105 [] call_softirq+0x1e/0x28 [] do_softirq+0x39/0xa4 [] irq_exit+0x58/0x5a [] do_IRQ+0xb4/0xbe [] ret_from_intr+0x0/0xf <1>Unable to handle kernel paging request at ffffffff82800000 RIP: [] show_trace+0x2bf/0x324 PGD 203027 PUD 205027 PMD 0 Oops: 0000 [5] SMP last sysfs file: /class/net/sit0/address CPU 0 Modules linked in: hidp rfcomm l2cap bluetooth ipv6 ip_gre iptable_filter iptable_nat ip_nat ip_conntrack nfnetlink iptable_mangle ip_tables binfmt_misc iTCO_wdt i2c_i801 serio_raw Pid: 2127, comm: imap Not tainted 2.6.18-rc2-mm1 #1 RIP: 0010:[] [] show_trace+0x2bf/0x324 RSP: 0000:ffffffff806358f8 EFLAGS: 00010006 RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffffffff880a3808 RDX: ffff81003d95c140 RSI: 0000000000000001 RDI: 0000000000000000 RBP: ffffffff806359f8 R08: 0000000000000000 R09: 0000000000000001 R10: ffffffff8029fae0 R11: 0000000000000000 R12: ffffffff827ffff9 R13: 0000000000000000 R14: 0000000000000000 R15: ffffffff80907000 FS: 00002ab5ab544860(0000) GS:ffffffff808b2000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b CR2: ffffffff82800000 CR3: 0000000029dea000 CR4: 00000000000006e0 Process imap (pid: 2127, threadinfo ffff810029e62000, task ffff81003d95c140) Stack: 000000000000000b ffffffff80636fc0 0000000080632fc0 0000000000000000 ffffffff80907000 0000000000000000 0000000000000000 ffffffff827ffff9 000000008025fa27 0000000000000001 0000000000000000 ffffffff8029fae0 Call Trace: [] _show_stack+0xef/0xfe [] show_registers+0x8c/0x101 [] __die+0xa0/0xe3 [] do_page_fault+0x785/0x89d [] error_exit+0x0/0x96 DWARF2 unwinder stuck at error_exit+0x0/0x96 Leftover inexact backtrace: [] module_text_address+0x16/0x46 [] show_trace+0x2bf/0x324 [] show_trace+0x2cb/0x324 [] module_text_address+0x16/0x46 [] error_exit+0x0/0x96 [] _show_stack+0xef/0xfe [] show_registers+0x8c/0x101 [] __die+0xa0/0xe3 [] do_page_fault+0x785/0x89d [] vprintk+0x30f/0x35d [] :iptable_nat:ip_nat_local_fn+0x33/0xbc [] ret_from_intr+0x0/0xf [] ret_from_intr+0x0/0xf [] error_exit+0x0/0x96 [] module_text_address+0x16/0x46 [] show_trace+0x2bf/0x324 [] show_trace+0x2cb/0x324 [] module_text_address+0x16/0x46 [] error_exit+0x0/0x96 [] _show_stack+0xef/0xfe [] show_registers+0x8c/0x101 [] __die+0xa0/0xe3 [] do_page_fault+0x785/0x89d [] vprintk+0x30f/0x35d [] kallsyms_lookup+0xea/0x1b5 [] call_softirq+0x1e/0x28 [] ret_from_intr+0x0/0xf [] ret_from_intr+0x0/0xf [] error_exit+0x0/0x96 [] module_text_address+0x16/0x46 [] show_trace+0x2bf/0x324 [] show_trace+0x2cb/0x324 [] call_softirq+0x1e/0x28 [] _show_stack+0xef/0xfe [] show_registers+0x8c/0x101 [] __die+0xa0/0xe3 [] do_page_fault+0x785/0x89d [] mark_held_locks+0x5d/0x96 [] trace_hardirqs_on+0xec/0x12c [] error_exit+0x0/0x96 [] show_trace+0x2bf/0x324 [] call_softirq+0x1e/0x28 [] dump_stack+0x15/0x1c [] skb_checksum_help+0x63/0x13b [] :iptable_nat:ip_nat_fn+0x5f/0x1d2 [] :iptable_nat:ip_nat_local_fn+0x33/0xbc [] nf_iterate+0x5a/0x9b [] dst_output+0x0/0x10 [] nf_hook_slow+0x60/0xcd [] dst_output+0x0/0x10 [] _spin_unlock_irqrestore+0x3f/0x47 [] ip_queue_xmit+0x444/0x4c0 [] tso_fragment+0x5d/0x20e [] __kmalloc_track_caller+0x109/0x11b [] tcp_transmit_skb+0x68f/0x6cf [] tso_fragment+0x1a6/0x20e [] __tcp_push_pending_frames+0x867/0x95a [] __kfree_skb+0xfc/0x101 [] tcp_data_queue+0x651/0xc39 [] tcp_rcv_established+0x72c/0x7c4 [] tcp_v4_do_rcv+0x2e/0x317 [] tcp_v4_rcv+0x9fc/0xa79 [] nf_hook_slow+0x60/0xcd [] ip_local_deliver_finish+0x0/0x1fb [] ip_local_deliver+0x199/0x270 [] ip_rcv+0x4d3/0x52b [] kfree_skb+0x2c/0x31 [] netif_receive_skb+0x1eb/0x27b [] e1000_clean_rx_irq_ps+0x5c1/0x6a0 [] e1000_clean+0x325/0x45b [] net_rx_action+0x8e/0x147 [] __do_softirq+0x64/0x105 [] __do_softirq+0x78/0x105 [] call_softirq+0x1e/0x28 [] do_softirq+0x39/0xa4 [] irq_exit+0x58/0x5a [] do_IRQ+0xb4/0xbe [] ret_from_intr+0x0/0xf <1>Unable to handle kernel paging request at ffffffff82800000 RIP: [] show_trace+0x2bf/0x324 PGD 203027 PUD 205027 PMD 0 Oops: 0000 [6] SMP last sysfs file: /class/net/sit0/address CPU 0 Modules linked in: hidp rfcomm l2cap bluetooth ipv6 ip_gre iptable_filter iptable_nat ip_nat ip_conntrack nfnetlink iptable_mangle ip_tables binfmt_misc iTCO_wdt i2c_i801 serio_raw Pid: 2127, comm: imap Not tainted 2.6.18-rc2-mm1 #1 RIP: 0010:[] [] show_trace+0x2bf/0x324 RSP: 0000:ffffffff80635578 EFLAGS: 00010006 RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffffffff880a3808 RDX: ffff81003d95c140 RSI: 0000000000000001 RDI: 0000000000000000 RBP: ffffffff80635678 R08: 0000000000000000 R09: 0000000000000001 R10: ffffffff8029fae0 R11: 0000000000000000 R12: ffffffff827ffff9 R13: 0000000000000000 R14: 0000000000000000 R15: ffffffff80907000 FS: 00002ab5ab544860(0000) GS:ffffffff808b2000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b CR2: ffffffff82800000 CR3: 0000000029dea000 CR4: 00000000000006e0 Process imap (pid: 2127, threadinfo ffff810029e62000, task ffff81003d95c140) Stack: 000000000000000b ffffffff80636fc0 0000000080632fc0 0000000000000000 ffffffff80907000 0000000000000000 0000000000000000 ffffffff827ffff9 000000008025fa27 0000000000000001 0000000000000000 ffffffff8029fae0 Call Trace: [] _show_stack+0xef/0xfe [] show_registers+0x8c/0x101 [] __die+0xa0/0xe3 [] do_page_fault+0x785/0x89d [] error_exit+0x0/0x96 DWARF2 unwinder stuck at error_exit+0x0/0x96 Leftover inexact backtrace: [] module_text_address+0x16/0x46 [] show_trace+0x2bf/0x324 [] show_trace+0x2cb/0x324 [] module_text_address+0x16/0x46 [] error_exit+0x0/0x96 [] _show_stack+0xef/0xfe [] show_registers+0x8c/0x101 [] __die+0xa0/0xe3 [] do_page_fault+0x785/0x89d [] vprintk+0x30f/0x35d [] :iptable_nat:ip_nat_local_fn+0x33/0xbc [] ret_from_intr+0x0/0xf [] ret_from_intr+0x0/0xf [] error_exit+0x0/0x96 [] module_text_address+0x16/0x46 [] show_trace+0x2bf/0x324 [] show_trace+0x2cb/0x324 [] module_text_address+0x16/0x46 [] error_exit+0x0/0x96 [] _show_stack+0xef/0xfe [] show_registers+0x8c/0x101 [] __die+0xa0/0xe3 [] do_page_fault+0x785/0x89d [] vprintk+0x30f/0x35d [] :iptable_nat:ip_nat_local_fn+0x33/0xbc [] ret_from_intr+0x0/0xf [] ret_from_intr+0x0/0xf [] error_exit+0x0/0x96 [] module_text_address+0x16/0x46 [] show_trace+0x2bf/0x324 [] show_trace+0x2cb/0x324 [] module_text_address+0x16/0x46 [] error_exit+0x0/0x96 [] _show_stack+0xef/0xfe [] show_registers+0x8c/0x101 [] __die+0xa0/0xe3 [] do_page_fault+0x785/0x89d [] vprintk+0x30f/0x35d [] kallsyms_lookup+0xea/0x1b5 [] call_softirq+0x1e/0x28 [] ret_from_intr+0x0/0xf [] ret_from_intr+0x0/0xf [] error_exit+0x0/0x96 [] module_text_address+0x16/0x46 [] show_trace+0x2bf/0x324 [] show_trace+0x2cb/0x324 [] call_softirq+0x1e/0x28 [] _show_stack+0xef/0xfe [] show_registers+0x8c/0x101 [] __die+0xa0/0xe3 [] do_page_fault+0x785/0x89d [] mark_held_locks+0x5d/0x96 [] trace_hardirqs_on+0xec/0x12c [] error_exit+0x0/0x96 [] show_trace+0x2bf/0x324 [] call_softirq+0x1e/0x28 [] dump_stack+0x15/0x1c [] skb_checksum_help+0x63/0x13b [] :iptable_nat:ip_nat_fn+0x5f/0x1d2 [] :iptable_nat:ip_nat_local_fn+0x33/0xbc [] nf_iterate+0x5a/0x9b [] dst_output+0x0/0x10 [] nf_hook_slow+0x60/0xcd [] dst_output+0x0/0x10 [] _spin_unlock_irqrestore+0x3f/0x47 [] ip_queue_xmit+0x444/0x4c0 [] tso_fragment+0x5d/0x20e [] __kmalloc_track_caller+0x109/0x11b [] tcp_transmit_skb+0x68f/0x6cf [] tso_fragment+0x1a6/0x20e [] __tcp_push_pending_frames+0x867/0x95a [] __kfree_skb+0xfc/0x101 [] tcp_data_queue+0x651/0xc39 [] tcp_rcv_established+0x72c/0x7c4 [] tcp_v4_do_rcv+0x2e/0x317 [] tcp_v4_rcv+0x9fc/0xa79 [] nf_hook_slow+0x60/0xcd [] ip_local_deliver_finish+0x0/0x1fb [] ip_local_deliver+0x199/0x270 [] ip_rcv+0x4d3/0x52b [] kfree_skb+0x2c/0x31 [] netif_receive_skb+0x1eb/0x27b [] e1000_clean_rx_irq_ps+0x5c1/0x6a0 [] e1000_clean+0x325/0x45b [] net_rx_action+0x8e/0x147 [] __do_softirq+0x64/0x105 [] __do_softirq+0x78/0x105 [] call_softirq+0x1e/0x28 [] do_softirq+0x39/0xa4 [] irq_exit+0x58/0x5a [] do_IRQ+0xb4/0xbe [] ret_from_intr+0x0/0xf Thanks, Reuben