From: Jeff Layton <jlayton@samba.org>
To: Justin Piszcz <jpiszcz@lucidpixels.com>
Cc: Jesper Juhl <jj@chaosbits.net>,
linux-kernel@vger.kernel.org, Alan Piszcz <ap@solarrain.com>,
Steve French <sfrench@samba.org>,
linux-cifs@vger.kernel.org
Subject: Re: Kernel 3.0: Instant kernel crash when mounting CIFS (also crashes with linux-3.1-rc2
Date: Wed, 17 Aug 2011 16:13:49 -0400 [thread overview]
Message-ID: <20110817161349.072e1452@tlielax.poochiereds.net> (raw)
In-Reply-To: <alpine.DEB.2.02.1108171547110.5877@p34.internal.lan>
On Wed, 17 Aug 2011 15:47:23 -0400 (EDT)
Justin Piszcz <jpiszcz@lucidpixels.com> wrote:
>
>
> On Wed, 17 Aug 2011, Justin Piszcz wrote:
>
> >
> >
> > On Wed, 17 Aug 2011, Justin Piszcz wrote:
> >
> >>
> >>
> >> On Mon, 15 Aug 2011, Justin Piszcz wrote:
> >
> >
> > Better output of crash: (again)
> >
> > [ 214.557063] CIFS VFS: cifs_mount failed w/return code = -22
> > [ 216.607556] CIFS VFS: cifs_mount failed w/return code = -22
> > [ 222.637424] CIFS VFS: cifs_mount failed w/return code = -22
> > [ 228.988734] ------------[ cut here ]------------
> > [ 228.988752] kernel BUG at mm/slab.c:3111!
> > [ 228.988759] invalid opcode: 0000 [#1] SMP [ 228.988769] CPU 1 [
> > 228.988774] Modules linked in: netconsole rfcomm bnep bluetooth speedstep_lib
> > cryptd aes_x86_64 aes_generic configfs ath9k mac80211 uvcvideo ath9k_common
> > ath9k_hw ath ohci_hcd ssb videodev mmc_core edac_core v4l2_compat_ioctl32
> > i2c_piix4 edac_mce_amd k10temp battery ac cfg80211 pcmcia shpchp video rfkill
> > pci_hotplug wmi pcmcia_core
> > [ 228.988873] [ 228.988880] Pid: 2869, comm: mount Not tainted 3.1.0-rc2 #2
> > Acer Aspire 7551 /Aspire 7551 [ 228.988901]
> > RIP: 0010:[<ffffffff81646526>] [<ffffffff81646526>]
> > cache_alloc_refill+0x111/0x4a6
> > [ 228.988922] RSP: 0018:ffff8801322e3cf8 EFLAGS: 00010046
> > [ 228.988929] RAX: ffff8801399b9000 RBX: ffff88013f000080 RCX:
> > 0000000000000007
> > [ 228.988936] RDX: 0000000000000070 RSI: dead000000200200 RDI:
> > 0000000000000035
> > [ 228.988944] RBP: ffff8801322e3d58 R08: 0000000000000033 R09:
> > ffff88013f004450
> > [ 228.988950] R10: ffff88013f004460 R11: ffff8801322e3d60 R12:
> > 00000000000000d0
> > [ 228.988956] R13: ffff88013f0c1400 R14: 00000000000000d0 R15:
> > ffff88013f004440
> > [ 228.988964] FS: 00007f421e4957e0(0000) GS:ffff88013fc80000(0000)
> > knlGS:0000000000000000
> > [ 228.988972] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> > [ 228.988979] CR2: 000000000130d000 CR3: 0000000132205000 CR4:
> > 00000000000006e0
> > [ 228.988986] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
> > 0000000000000000
> > [ 228.988993] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
> > 0000000000000400
> > [ 228.989001] Process mount (pid: 2869, threadinfo ffff8801322e2000, task
> > ffff88013f278620)
> > [ 228.989005] Stack:
> > [ 228.989005] ffff8801322e3d28 000000000000003c 000000000000001c
> > 0000000000000000
> > [ 228.989005] 000000d00000001c 0000001000000000 ffff8801322e3dc8
> > 0000000000000010
> > [ 228.989005] 0000000000000202 ffff88013f000080 00000000000000d0
> > ffff880139a94940
> > [ 228.989005] Call Trace:
> > [ 228.989005] [<ffffffff810ae053>] __kmalloc+0xb3/0xe0
> > [ 228.989005] [<ffffffff810911e5>] kstrdup+0x35/0x60
> > [ 228.989005] [<ffffffff810d1e51>] alloc_vfsmnt+0xa1/0x190
> > [ 228.989005] [<ffffffff810d21dd>] vfs_kern_mount+0x2d/0xa0
> > [ 228.989005] [<ffffffff810d260f>] do_kern_mount+0x4f/0x100
> > [ 228.989005] [<ffffffff810d4002>] do_mount+0x532/0x830
> > [ 228.989005] [<ffffffff810d3955>] ? copy_mount_options+0x35/0x170
> > [ 228.989005] [<ffffffff810d46c3>] sys_mount+0x93/0xe0
> > [ 228.989005] [<ffffffff8164df3b>] system_call_fastpath+0x16/0x1b
> > [ 228.989005] Code: 00 e9 d2 00 00 00 49 8b 07 49 39 c7 75 15 49 8b 47 20 41
> > c7 47 60 01 00 00 00 4c 39 d0 0f 84 ad 00 00 00 8b 53 18 39 50 20 72 2f <0f>
> > 0b 44 8b 40 24 8b 53 0c ff c6 41 8b 7d 00 89 70 20 41 0f af [ 228.989005]
> > RIP [<ffffffff81646526>] cache_alloc_refill+0x111/0x4a6
> > [ 228.989005] RSP <ffff8801322e3cf8>
> > [ 228.989005] ---[ end trace 8859f1f50ceed0f6 ]---
> >
> > Justin.
> >
The crash is happening in the bowels of the slab allocator.
Specifically, it looks like it's hitting this:
/*
* The slab was either on partial or free list so
* there must be at least one object available for
* allocation.
*/
BUG_ON(slabp->inuse >= cachep->num);
...which looks like maybe the accounting of in-use objects is off. This
really sounds like some sort of memory corruption. I've not been able
to reproduce this so far, but I also had someone report panic here that
might be related:
https://bugzilla.redhat.com/show_bug.cgi?id=731278
One thing that might be helpful is turning on page poisoning and
redoing this test, that might make it crash sooner and point out the
source of the corruption.
Even better would be a bisect to track down the cause...
--
Jeff Layton <jlayton@samba.org>
next prev parent reply other threads:[~2011-08-17 20:13 UTC|newest]
Thread overview: 42+ messages / expand[flat|nested] mbox.gz Atom feed top
2011-08-15 9:10 Kernel 3.0: Instant kernel crash when mounting CIFS Justin Piszcz
2011-08-15 9:18 ` Jesper Juhl
2011-08-15 10:47 ` Jeff Layton
2011-08-15 10:54 ` Justin Piszcz
2011-08-15 18:01 ` Justin Piszcz
2011-08-15 18:09 ` Steve French
2011-08-15 19:31 ` Dave Jones
2011-08-17 19:16 ` Kernel 3.0: Instant kernel crash when mounting CIFS (also crashes with linux-3.1-rc2 Justin Piszcz
[not found] ` <alpine.DEB.2.02.1108171545190.5877@p34.internal.lan>
2011-08-17 19:47 ` Justin Piszcz
2011-08-17 20:13 ` Jeff Layton [this message]
2011-08-17 20:45 ` Justin Piszcz
2011-08-17 21:11 ` Arnaud Lacombe
2011-08-17 21:53 ` Justin Piszcz
2011-08-17 22:13 ` Justin Piszcz
2011-08-17 22:18 ` Justin Piszcz
2011-08-17 23:31 ` Valdis.Kletnieks
2011-08-18 3:19 ` J. R. Okajima
2011-08-18 10:35 ` Justin Piszcz
2011-08-18 12:14 ` Justin Piszcz
2011-08-18 12:22 ` Justin Piszcz
2011-08-18 13:11 ` Jeff Layton
2011-08-18 13:15 ` Justin Piszcz
2011-08-18 17:04 ` Jeff Layton
2011-08-18 17:15 ` Steve French
2011-08-18 17:16 ` Justin Piszcz
2011-08-18 17:25 ` Steve French
2011-08-18 17:33 ` Justin Piszcz
2011-08-18 17:43 ` Steve French
2011-08-18 18:18 ` Justin Piszcz
2011-08-18 18:52 ` Jeff Layton
2011-08-18 18:54 ` Justin Piszcz
2011-08-18 19:02 ` Steve French
2011-08-26 21:59 ` Jeff Layton
2011-08-26 22:57 ` Justin Piszcz
2011-08-26 23:05 ` Steve French
2011-08-26 23:16 ` Justin Piszcz
2011-08-27 14:31 ` Jeff Layton
2011-08-18 17:36 ` Kong Li
2011-08-18 18:33 ` Jeff Layton
2011-08-18 14:19 ` J. R. Okajima
2011-08-18 16:01 ` Steve French
2011-08-18 16:02 ` Steve French
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20110817161349.072e1452@tlielax.poochiereds.net \
--to=jlayton@samba.org \
--cc=ap@solarrain.com \
--cc=jj@chaosbits.net \
--cc=jpiszcz@lucidpixels.com \
--cc=linux-cifs@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=sfrench@samba.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®