From: Ingo Molnar <mingo@elte.hu>
To: Steven Rostedt <rostedt@goodmis.org>
Cc: linux-kernel@vger.kernel.org,
Andrew Morton <akpm@linux-foundation.org>,
Frederic Weisbecker <fweisbec@gmail.com>
Subject: Re: [PATCH 00/16] [GIT PULL] tracing: fixes/cleanups, no stop-machine, update stack tracer
Date: Mon, 2 Jan 2012 16:10:19 +0100 [thread overview]
Message-ID: <20120102151019.GA1875@elte.hu> (raw)
In-Reply-To: <20120102134856.GA32673@elte.hu>
As a next step i've merged in your 'fixes' tree as well, and the
crashes are occuring with a lot higher frequency.
I just got a softlockup one to the serial console - attached
below.
Thanks,
Ingo
[....]
[ 51.921290] geodewdt: probe of geodewdt rejects match -19
[ 51.921302] initcall geodewdt_init+0x0/0x81 returned 0 after 847 usecs
[ 51.921307] calling sc520_wdt_init+0x0/0xec @ 1
[ 51.921367] sc520_wdt: cannot register miscdev on minor=130 (err=-16)
[ 76.736054] BUG: soft lockup - CPU#0 stuck for 22s! [swapper/0:1]
[ 76.736056] Modules linked in:
[ 76.736059] irq event stamp: 2966956
[ 76.736062] hardirqs last enabled at (2966955): [<ffffffff83154b74>] restore_args+0x0/0x30
[ 76.736069] hardirqs last disabled at (2966956): [<ffffffff8315c86e>] apic_timer_interrupt+0x6e/0x80
[ 76.736076] softirqs last enabled at (2966954): [<ffffffff8109c2a8>] __do_softirq+0x20e/0x268
[ 76.736081] softirqs last disabled at (2966945): [<ffffffff8315d26c>] call_softirq+0x1c/0x30
[ 76.736087] CPU 0
[ 76.736089] Modules linked in:
[ 76.736092]
[ 76.736096] Pid: 1, comm: swapper/0 Tainted: G W 3.2.0-rc7-tip-02040-g8039fe3-dirty #166565 System manufacturer System Product Name/A8N-E
[ 76.736102] RIP: 0010:[<ffffffff810e985c>] [<ffffffff810e985c>] generic_exec_single+0x7c/0x95
[ 76.736110] RSP: 0018:ffff88003d32bca0 EFLAGS: 00000202
[ 76.736113] RAX: 0000000000000086 RBX: ffffffff83154b74 RCX: 0000000c16c17557
[ 76.736116] RDX: 0000000000000013 RSI: 0000000000000001 RDI: 0000000000000286
[ 76.736119] RBP: ffff88003d32bce0 R08: 0000000000000000 R09: 0000000000000000
[ 76.736122] R10: ffff88003d3308b8 R11: ffff88003d3308b8 R12: ffff88003d32bc18
[ 76.736125] R13: 3ffffffffffffffe R14: ffff88003d32a000 R15: 0000000000000000
[ 76.736128] FS: 0000000000000000(0000) GS:ffff88003e200000(0000) knlGS:0000000000000000
[ 76.736132] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 76.736134] CR2: 0000000000f06f53 CR3: 0000000004820000 CR4: 00000000000007f0
[ 76.736138] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 76.736141] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 76.736144] Process swapper/0 (pid: 1, threadinfo ffff88003d32a000, task ffff88003d330000)
[ 76.736147] Stack:
[ 76.736148] 0000000000000286 ffff88003e5d69c0 ffff88003d32bcd0 0000000000000001
[ 76.736154] ffffffff81076881 0000000000000001 0000000000000000 ffff88003d32bcf8
[ 76.736159] ffff88003d32bd50 ffffffff810e999d ffff88003d3308b8 ffff88003e5d69c0
[ 76.736165] Call Trace:
[ 76.736170] [<ffffffff81076881>] ? leave_mm+0x50/0x50
[ 76.736175] [<ffffffff810e999d>] smp_call_function_single+0x128/0x14c
[ 76.736180] [<ffffffff81076881>] ? leave_mm+0x50/0x50
[ 76.736184] [<ffffffff81076881>] ? leave_mm+0x50/0x50
[ 76.736188] [<ffffffff810e9abb>] smp_call_function_many+0xfa/0x1e9
[ 76.736193] [<ffffffff810e9be2>] smp_call_function+0x38/0x42
[ 76.736199] [<ffffffff81179f10>] ? find_vmap_area+0x4d/0x55
[ 76.736203] [<ffffffff81076881>] ? leave_mm+0x50/0x50
[ 76.736208] [<ffffffff810e9c16>] on_each_cpu+0x2a/0x7f
[ 76.736212] [<ffffffff81076b98>] flush_tlb_all+0x1c/0x20
[ 76.736217] [<ffffffff8117bf27>] remove_vm_area+0x79/0x9e
[ 76.736223] [<ffffffff810723af>] iounmap.part.2+0x89/0xa2
[ 76.736227] [<ffffffff8514b9ca>] ? geodewdt_init+0x81/0x81
[ 76.736232] [<ffffffff810723fd>] iounmap+0x35/0x37
[ 76.736236] [<ffffffff8514baaf>] sc520_wdt_init+0xe5/0xec
[ 76.736241] [<ffffffff81002089>] do_one_initcall+0x57/0x13a
[ 76.736247] [<ffffffff850d5d17>] kernel_init+0xea/0x164
[ 76.736253] [<ffffffff8315d174>] kernel_thread_helper+0x4/0x10
[ 76.736258] [<ffffffff83154b74>] ? retint_restore_args+0x13/0x13
[ 76.736263] [<ffffffff850d5c2d>] ? start_kernel+0x3ff/0x3ff
[ 76.736268] [<ffffffff8315d170>] ? gs_change+0x13/0x13
[ 76.736270] Code: da e8 e2 7f 61 00 48 8b 45 c0 4c 89 f7 48 89 c6 e8 9c af 06 02 48 39 5d c8 75 09 44 89 ef ff 15 eb 60 75 03 45 85 ff 75 04 eb 0a <f3> 90 41 f6 44 24 20 01 75 f6 48 83 c4 18 5b 41 5c 41 5d 41 5e
[ 76.736316] Call Trace:
[ 76.736320] [<ffffffff81076881>] ? leave_mm+0x50/0x50
[ 76.736324] [<ffffffff810e999d>] smp_call_function_single+0x128/0x14c
[ 76.736329] [<ffffffff81076881>] ? leave_mm+0x50/0x50
[ 76.736333] [<ffffffff81076881>] ? leave_mm+0x50/0x50
[ 76.736337] [<ffffffff810e9abb>] smp_call_function_many+0xfa/0x1e9
[ 76.736342] [<ffffffff810e9be2>] smp_call_function+0x38/0x42
[ 76.736346] [<ffffffff81179f10>] ? find_vmap_area+0x4d/0x55
[ 76.736350] [<ffffffff81076881>] ? leave_mm+0x50/0x50
[ 76.736355] [<ffffffff810e9c16>] on_each_cpu+0x2a/0x7f
[ 76.736359] [<ffffffff81076b98>] flush_tlb_all+0x1c/0x20
[ 76.736363] [<ffffffff8117bf27>] remove_vm_area+0x79/0x9e
[ 76.736368] [<ffffffff810723af>] iounmap.part.2+0x89/0xa2
[ 76.736372] [<ffffffff8514b9ca>] ? geodewdt_init+0x81/0x81
[ 76.736376] [<ffffffff810723fd>] iounmap+0x35/0x37
[ 76.736380] [<ffffffff8514baaf>] sc520_wdt_init+0xe5/0xec
[ 76.736384] [<ffffffff81002089>] do_one_initcall+0x57/0x13a
[ 76.736389] [<ffffffff850d5d17>] kernel_init+0xea/0x164
[ 76.736394] [<ffffffff8315d174>] kernel_thread_helper+0x4/0x10
[ 76.736399] [<ffffffff83154b74>] ? retint_restore_args+0x13/0x13
[ 76.736404] [<ffffffff850d5c2d>] ? start_kernel+0x3ff/0x3ff
[ 76.736408] [<ffffffff8315d170>] ? gs_change+0x13/0x13
[ 76.736412] Kernel panic - not syncing: softlockup: hung tasks
[ 76.736415] Pid: 1, comm: swapper/0 Tainted: G W 3.2.0-rc7-tip-02040-g8039fe3-dirty #166565
[ 76.736418] Call Trace:
[ 76.736420] <IRQ> [<ffffffff8308df39>] panic+0xa0/0x1c5
[ 76.736430] [<ffffffff81116bc0>] watchdog_timer_fn+0x12b/0x14d
[ 76.736436] [<ffffffff810ba965>] __run_hrtimer+0xeb/0x1dc
[ 76.736441] [<ffffffff81116a95>] ? __touch_watchdog+0x25/0x25
[ 76.736445] [<ffffffff810bb227>] hrtimer_interrupt+0xe0/0x1aa
[ 76.736451] [<ffffffff8315dbac>] smp_apic_timer_interrupt+0x77/0x8a
[ 76.736456] [<ffffffff8315c873>] apic_timer_interrupt+0x73/0x80
[ 76.736458] <EOI> [<ffffffff83154b74>] ? retint_restore_args+0x13/0x13
[ 76.736466] [<ffffffff810e985c>] ? generic_exec_single+0x7c/0x95
[ 76.736471] [<ffffffff81076881>] ? leave_mm+0x50/0x50
[ 76.736475] [<ffffffff810e999d>] smp_call_function_single+0x128/0x14c
[ 76.736480] [<ffffffff81076881>] ? leave_mm+0x50/0x50
next prev parent reply other threads:[~2012-01-02 15:12 UTC|newest]
Thread overview: 40+ messages / expand[flat|nested] mbox.gz Atom feed top
2011-12-21 12:36 Steven Rostedt
2011-12-21 12:36 ` [PATCH 01/16] ftrace: Fix unregister ftrace_ops accounting Steven Rostedt
2011-12-21 12:36 ` [PATCH 02/16] ftrace: Do not function trace inlined functions Steven Rostedt
2011-12-21 12:36 ` [PATCH 03/16] ftrace: Allow archs to modify code without stop machine Steven Rostedt
2011-12-21 12:36 ` [PATCH 04/16] ftrace: Remove usage of "freed" records Steven Rostedt
2011-12-21 12:36 ` [PATCH 05/16] ftrace: Allocate the mcount record pages as groups Steven Rostedt
2011-12-21 12:36 ` [PATCH 06/16] ftrace: Replace record newlist with record page list Steven Rostedt
2011-12-21 12:36 ` [PATCH 07/16] ftrace: Sort the mcount records on each page Steven Rostedt
2011-12-21 12:36 ` [PATCH 08/16] ftrace: Use bsearch to find record ip Steven Rostedt
2011-12-21 12:36 ` [PATCH 09/16] ftrace: Fix ftrace hash record update with notrace Steven Rostedt
2011-12-21 12:36 ` [PATCH 10/16] ftrace: Create ftrace_hash_empty() helper routine Steven Rostedt
2011-12-21 12:36 ` [PATCH 11/16] ftrace: Allow other users of function tracing to use the output listing Steven Rostedt
2011-12-21 12:36 ` [PATCH 12/16] ftrace: Decouple hash items from showing filtered functions Steven Rostedt
2011-12-21 12:36 ` [PATCH 13/16] tracing: Have stack_tracer use a separate list of functions Steven Rostedt
2011-12-21 12:36 ` [PATCH 14/16] ftrace: Allow access to the boot time function enabling Steven Rostedt
2011-12-21 12:36 ` [PATCH 15/16] tracing: Have stack tracing set filtered functions at boot Steven Rostedt
2011-12-21 12:36 ` [PATCH 16/16] tracing: Factorize filter creation Steven Rostedt
2012-01-01 18:09 ` [PATCH 00/16] [GIT PULL] tracing: fixes/cleanups, no stop-machine, update stack tracer Ingo Molnar
2012-01-02 10:58 ` Ingo Molnar
2012-01-02 13:48 ` Ingo Molnar
2012-01-02 15:10 ` Ingo Molnar [this message]
2012-01-04 0:02 ` Steven Rostedt
2012-01-04 0:12 ` Steven Rostedt
2012-01-04 5:01 ` Steven Rostedt
2012-01-04 14:11 ` Ingo Molnar
2012-01-04 17:05 ` Steven Rostedt
2012-01-04 18:39 ` Ingo Molnar
2012-01-05 9:19 ` Ingo Molnar
2012-01-05 11:46 ` Steven Rostedt
2012-01-05 12:16 ` Steven Rostedt
2012-01-06 4:58 ` Steven Rostedt
2012-01-06 8:51 ` Ingo Molnar
2012-01-06 12:10 ` Steven Rostedt
2012-01-06 15:29 ` Steven Rostedt
2012-01-07 12:20 ` Ingo Molnar
2012-01-07 12:25 ` Ingo Molnar
2012-01-07 22:32 ` Steven Rostedt
2012-01-08 11:38 ` Ingo Molnar
2012-01-02 19:33 ` Steven Rostedt
2012-01-06 5:04 ` Steven Rostedt
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20120102151019.GA1875@elte.hu \
--to=mingo@elte.hu \
--cc=akpm@linux-foundation.org \
--cc=fweisbec@gmail.com \
--cc=linux-kernel@vger.kernel.org \
--cc=rostedt@goodmis.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
Powered by JetHome