From: "Paul E. McKenney" <paulmck@linux.vnet.ibm.com>
To: Linus Torvalds <torvalds@linux-foundation.org>
Cc: Frederic Weisbecker <fweisbec@gmail.com>,
Thomas Gleixner <tglx@linutronix.de>,
Ingo Molnar <mingo@kernel.org>,
Peter Zijlstra <peterz@infradead.org>,
Dave Jones <davej@redhat.com>, Hugh Dickins <hughd@google.com>,
Linux Kernel Mailing List <linux-kernel@vger.kernel.org>,
Paul McKenney <paul.mckenney@linaro.org>
Subject: Re: Debugging Thinkpad T430s occasional suspend failure.
Date: Sat, 16 Feb 2013 11:25:54 -0800 [thread overview]
Message-ID: <20130216192554.GB7035@linux.vnet.ibm.com> (raw)
In-Reply-To: <CA+55aFyXo89LQ0mboxVYB5SJ08D8=Kv0=cqYHAd6-H7nmp=S-w@mail.gmail.com>
On Fri, Feb 15, 2013 at 10:50:31AM -0800, Linus Torvalds wrote:
> On Fri, Feb 15, 2013 at 10:35 AM, Linus Torvalds
> <torvalds@linux-foundation.org> wrote:
> > On Fri, Feb 15, 2013 at 10:34 AM, Linus Torvalds
> > <torvalds@linux-foundation.org> wrote:
> >>
> >> Something like this ENTIRELY UNTESTED patch.
> >
> > .. and let's actually attach the patch this time.
>
> That's odd. I got a "server error" from gmail. And again no attachment.
>
> Maybe THIS time.
Sorry for the delay in testing this, but there was a need to upgrade
my laptop, and bozo here figured "why not go to 64 bits while I am at
it?" -- and then proceeded to learn the hard way that it is necessary
to do "make mrproper" before doing a build in 64-bit mode. :-/
The kernel build system's way of telling you this at the moment is:
arch/x86/built-in.o:(.rodata+0x4990): undefined reference to `stub32_sigaltstack'
Anyway, with this patch, I see CPU stall warnings when running rcutorture
as shown below. This is not a hard failure:
[ 32.553647] rcu-torture: rtc: ffffffff836a57a0 ver: 131 tfle: 0 rta: 131 rtaf: 0 rtf: 93 rtmbe: 0 rtbke: 0 rtbre: 0 rtbf: 0 rtb: 0 nt: 27 onoff: 0/0:0/0 -1,0:-1,0 0:0 (HZ=1000) barrier: 6/7:0
Note the "ver: 131", which means that rcutorture successfully did 131
grace periods before the failure. It manages to offline a CPU subsequently,
but then appears to hang while onlining it.
Thanx, Paul
[ 23.706051] INFO: rcu_preempt self-detected stall on CPU[ 23.707053] INFO: rcu_preempt self-detected stall on CPU
[ 23.707053] 1: (20976 ticks this GP) idle=883/140000000000001/0 drain=5 . timer not pending
[ 23.707053] (t=21000 jiffies g=85 c=84 q=6756)
[ 23.707053] Pid: 606, comm: rcu_torture_rea Not tainted 3.8.0-rc7+ #2
[ 23.707053] Call Trace:
[ 23.707053] <IRQ> [<ffffffff810c12b2>] rcu_pending+0x192/0x7a0
[ 23.707053] [<ffffffff810c590b>] rcu_check_callbacks+0xbb/0x220
[ 23.707053] [<ffffffff8104c193>] update_process_times+0x43/0x80
[ 23.707053] [<ffffffff8108f901>] tick_sched_handle.isra.8+0x31/0x40
[ 23.707053] [<ffffffff8108f9f7>] tick_sched_timer+0x47/0x70
[ 23.707053] [<ffffffff8106619c>] __run_hrtimer+0x7c/0x240
[ 23.707053] [<ffffffff8108f9b0>] ? tick_nohz_handler+0xa0/0xa0
[ 23.707053] [<ffffffff81089617>] ? ktime_get_update_offsets+0x47/0xd0
[ 23.707053] [<ffffffff81066a37>] hrtimer_interrupt+0xf7/0x240
[ 23.707053] [<ffffffff81025883>] smp_apic_timer_interrupt+0x63/0xa0
[ 23.707053] [<ffffffff817b6e8a>] apic_timer_interrupt+0x6a/0x70
[ 23.707053] <EOI> [<ffffffff817af17d>] ? _raw_spin_unlock_irq+0xd/0x40
[ 23.707053] [<ffffffff817ae2aa>] __schedule+0x68a/0x790
[ 23.707053] [<ffffffff817ae4c4>] schedule+0x24/0x70
[ 23.707053] [<ffffffff810c05b7>] rcu_torture_reader+0xd7/0x2d0
[ 23.707053] [<ffffffff810c07b0>] ? rcu_torture_reader+0x2d0/0x2d0
[ 23.707053] [<ffffffff810c04e0>] ? rcutorture_trace_dump+0x50/0x50
[ 23.707053] [<ffffffff81061e6b>] kthread+0xbb/0xc0
[ 23.707053] [<ffffffff817a0000>] ? timer_cpu_notify+0x1e9/0x300
[ 23.707053] [<ffffffff81061db0>] ? flush_kthread_worker+0xa0/0xa0
[ 23.707053] [<ffffffff817b626c>] ret_from_fork+0x7c/0xb0
[ 23.707053] [<ffffffff81061db0>] ? flush_kthread_worker+0xa0/0xa0
[ 23.706051]
[ 23.706051] 0: (1 GPs behind) idle=429/140000000000001/0 drain=5 . timer not pending
[ 23.706051] (t=21000 jiffies g=85 c=84 q=6756)
[ 23.706051] Pid: 603, comm: rcu_torture_rea Not tainted 3.8.0-rc7+ #2
[ 23.706051] Call Trace:
[ 23.706051] <IRQ> [<ffffffff810c12b2>] rcu_pending+0x192/0x7a0
[ 23.706051] [<ffffffff810c590b>] rcu_check_callbacks+0xbb/0x220
[ 23.706051] [<ffffffff8104c193>] update_process_times+0x43/0x80
[ 23.706051] [<ffffffff8108f901>] tick_sched_handle.isra.8+0x31/0x40
[ 23.706051] [<ffffffff8108f9f7>] tick_sched_timer+0x47/0x70
[ 23.706051] [<ffffffff8106619c>] __run_hrtimer+0x7c/0x240
[ 23.706051] [<ffffffff8108f9b0>] ? tick_nohz_handler+0xa0/0xa0
[ 23.706051] [<ffffffff81089617>] ? ktime_get_update_offsets+0x47/0xd0
[ 23.706051] [<ffffffff81066a37>] hrtimer_interrupt+0xf7/0x240
[ 23.706051] [<ffffffff81025883>] smp_apic_timer_interrupt+0x63/0xa0
[ 23.706051] [<ffffffff817b6e8a>] apic_timer_interrupt+0x6a/0x70
[ 23.706051] <EOI> [<ffffffff817b2ae0>] ? add_preempt_count+0x30/0x90
[ 23.706051] [<ffffffff817adc5d>] __schedule+0x3d/0x790
[ 23.706051] [<ffffffff817ae4c4>] schedule+0x24/0x70
[ 23.706051] [<ffffffff810c05b7>] rcu_torture_reader+0xd7/0x2d0
[ 23.706051] [<ffffffff810c07b0>] ? rcu_torture_reader+0x2d0/0x2d0
[ 23.706051] [<ffffffff810c04e0>] ? rcutorture_trace_dump+0x50/0x50
[ 23.706051] [<ffffffff81061e6b>] kthread+0xbb/0xc0
[ 23.706051] [<ffffffff817a0000>] ? timer_cpu_notify+0x1e9/0x300
[ 23.706051] [<ffffffff81061db0>] ? flush_kthread_worker+0xa0/0xa0
[ 23.706051] [<ffffffff817b626c>] ret_from_fork+0x7c/0xb0
[ 23.706051] [<ffffffff81061db0>] ? flush_kthread_worker+0xa0/0xa0
next prev parent reply other threads:[~2013-02-16 19:26 UTC|newest]
Thread overview: 49+ messages / expand[flat|nested] mbox.gz Atom feed top
2013-02-12 19:39 Dave Jones
2013-02-12 20:13 ` Linus Torvalds
2013-02-13 0:26 ` Hugh Dickins
2013-02-13 0:40 ` Dave Jones
2013-02-13 0:56 ` Hugh Dickins
2013-02-13 4:16 ` Dave Jones
2013-02-13 5:37 ` Hugh Dickins
2013-02-13 19:34 ` Dave Jones
2013-02-13 19:56 ` Linus Torvalds
2013-02-13 20:53 ` Dave Jones
2013-02-16 20:54 ` Paul E. McKenney
2013-02-15 1:15 ` Dave Jones
2013-02-15 2:09 ` Linus Torvalds
2013-02-15 15:50 ` Ingo Molnar
2013-02-15 22:33 ` Dave Jones
2013-02-15 17:44 ` Paul E. McKenney
2013-02-15 18:34 ` Linus Torvalds
2013-02-15 18:35 ` Linus Torvalds
2013-02-15 18:50 ` Linus Torvalds
2013-02-16 19:25 ` Paul E. McKenney [this message]
2013-02-16 19:46 ` Linus Torvalds
2013-02-16 21:07 ` Paul E. McKenney
2013-02-16 21:53 ` H. Peter Anvin
2013-02-17 22:49 ` H. Peter Anvin
2013-02-18 8:41 ` Ingo Molnar
2013-02-19 8:50 ` Paul E. McKenney
2013-02-19 8:56 ` Ingo Molnar
2013-02-17 15:11 ` Frederic Weisbecker
2013-02-17 17:32 ` Linus Torvalds
2013-02-17 18:17 ` Frederic Weisbecker
2013-02-17 20:58 ` Frederic Weisbecker
2013-02-17 21:02 ` Frederic Weisbecker
2013-02-18 15:53 ` Frederic Weisbecker
2013-02-18 18:12 ` Linus Torvalds
2013-02-19 10:08 ` Frederic Weisbecker
2013-02-18 19:58 ` Thomas Gleixner
2013-02-19 10:38 ` Frederic Weisbecker
2013-02-19 10:44 ` Thomas Gleixner
2013-02-15 2:09 ` Hugh Dickins
2013-02-15 2:15 ` Linus Torvalds
2013-02-16 21:45 ` Hugh Dickins
2013-02-16 23:02 ` Linus Torvalds
2013-02-17 0:01 ` Hugh Dickins
2013-02-17 2:21 ` Hugh Dickins
2013-02-17 13:38 ` Daniel Vetter
2013-02-17 14:54 ` Daniel Vetter
2013-02-17 16:31 ` Hugh Dickins
2013-02-17 17:28 ` Daniel Vetter
2013-02-13 2:17 ` Dave Jones
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20130216192554.GB7035@linux.vnet.ibm.com \
--to=paulmck@linux.vnet.ibm.com \
--cc=davej@redhat.com \
--cc=fweisbec@gmail.com \
--cc=hughd@google.com \
--cc=linux-kernel@vger.kernel.org \
--cc=mingo@kernel.org \
--cc=paul.mckenney@linaro.org \
--cc=peterz@infradead.org \
--cc=tglx@linutronix.de \
--cc=torvalds@linux-foundation.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
Powered by JetHome