Hi Andi, Here is another bisect result with much earlier oops. commit b8a868e9ea876a1b40020397305533c095921d7a Author: Andi Kleen AuthorDate: Wed Apr 23 13:26:20 2014 -0700 Commit: Andi Kleen CommitDate: Fri Oct 3 15:19:56 2014 -0700 x86: Add support for rd/wr fs/gs base ... v2: Change to save/restore GS instead of using swapgs based on the value. Large scale changes. Signed-off-by: Andi Kleen Attached dmesg for the parent commit, too, to help confirm whether it is a noise error. +-------------------------------------------------------+------------+------------+------------------+ | | 598d570a05 | b8a868e9ea | v3.17-rc7_100409 | +-------------------------------------------------------+------------+------------+------------------+ | boot_successes | 207 | 24 | 17 | | boot_failures | 3 | 46 | 4 | | BUG:kernel_boot_crashed | 3 | | | | double_fault:ffff | 0 | 39 | 4 | | RIP:trace_hardirqs_off_thunk | 0 | 22 | 1 | | BUG:unable_to_handle_kernel | 0 | 17 | 1 | | Oops | 0 | 15 | 1 | | RIP:show_stack_log_lvl | 0 | 14 | 1 | | Kernel_panic-not_syncing:Fatal_exception_in_interrupt | 0 | 20 | 2 | | RIP:trace_hardirqs_off_caller | 0 | 6 | 1 | | BUG:kernel_boot_hang | 0 | 23 | 2 | | backtrace:rescuer_thread | 0 | 1 | | +-------------------------------------------------------+------------+------------+------------------+ [ 0.212404] regulator-dummy: no parameters [ 0.215602] NET: Registered protocol family 16 [ 0.215602] NET: Registered protocol family 16 [ 0.232049] double fault: ffff [#1] [ 0.232049] double fault: ffff [#1] PREEMPT PREEMPT SMP SMP DEBUG_PAGEALLOCDEBUG_PAGEALLOC [ 0.233000] CPU: 1 PID: 0 Comm: swapper/1 Not tainted 3.17.0-rc7-00004-gb8a868e #1 [ 0.233000] CPU: 1 PID: 0 Comm: swapper/1 Not tainted 3.17.0-rc7-00004-gb8a868e #1 [ 0.233000] task: ffff8800121ad500 ti: ffff88001234c000 task.ti: ffff88001234c000 [ 0.233000] task: ffff8800121ad500 ti: ffff88001234c000 task.ti: ffff88001234c000 [ 0.233000] RIP: 0010:[] [ 0.233000] RIP: 0010:[] [] trace_hardirqs_off_thunk+0x35/0x3c [] trace_hardirqs_off_thunk+0x35/0x3c [ 0.233000] RSP: 0000:ffff880012500000 EFLAGS: 00010086 [ 0.233000] RSP: 0000:ffff880012500000 EFLAGS: 00010086 [ 0.233000] RAX: 0000000082767ff0 RBX: 0000000000000001 RCX: ffffffff82767ff0 [ 0.233000] RAX: 0000000082767ff0 RBX: 0000000000000001 RCX: ffffffff82767ff0 [ 0.233000] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffffff82769326 [ 0.233000] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffffff82769326 [ 0.233000] RBP: ffff880012500110 R08: 0000000000000000 R09: 0000000000000001 [ 0.233000] RBP: ffff880012500110 R08: 0000000000000000 R09: 0000000000000001 [ 0.233000] R10: ffff880012503e98 R11: ffffffff838c7fb0 R12: 0000000000013ec0 [ 0.233000] R10: ffff880012503e98 R11: ffffffff838c7fb0 R12: 0000000000013ec0 [ 0.233000] R13: 0000000000013ec0 R14: 0000000000000000 R15: 0000000000000000 [ 0.233000] R13: 0000000000013ec0 R14: 0000000000000000 R15: 0000000000000000 BUG: kernel boot hang Elapsed time: 305 qemu-system-x86_64 -cpu kvm64 -enable-kvm -kernel /kernel/x86_64-randconfig-hsb0-10041007/b8a868e9ea876a1b40020397305533c095921d7a/vmlinuz-3.17.0-rc7-00004-gb8a868e -append 'hung_task_panic=1 earlyprintk=ttyS0,115200 debug apic=debug sysrq_always_enabled rcupdate.rcu_cpu_stall_timeout=100 panic=-1 softlockup_panic=1 nmi_watchdog=panic oops=panic load_ramdisk=2 prompt_ramdisk=0 console=ttyS0,115200 console=tty0 vga=normal root=/dev/ram0 rw link=/kbuild-tests/run-queue/kvm/x86_64-randconfig-hsb0-10041007/linux-devel:devel-hourly-2014100409:b8a868e9ea876a1b40020397305533c095921d7a:bisect-linux-3/.vmlinuz-b8a868e9ea876a1b40020397305533c095921d7a-20141004114524-27-lkp-nex04 branch=linux-devel/devel-hourly-2014100409 BOOT_IMAGE=/kernel/x86_64-randconfig-hsb0-10041007/b8a868e9ea876a1b40020397305533c095921d7a/vmlinuz-3.17.0-rc7-00004-gb8a868e drbd.minor_count=8' -initrd /kernel-tests/initrd/quantal-core-x86_64.cgz -m 320 -smp 2 -net nic,vlan=1,model=e1000 -net user,vlan=1 -boot order=nc -no-reboot -watchdog i6300esb -rtc base=localtime -pidfile /dev/shm/kboot/pid-quantal-lkp-nex04-129 -serial file:/dev/shm/kboot/serial-quantal-lkp-nex04-129 -daemonize -display none -monitor null git bisect start cd94c0185489f0cddcbfa80e86258bb4609b6e1d fe82dcec644244676d55a1384c958d5f67979adb -- git bisect good a3f8f887e2a36003026b5d3effdd418d507cf7c8 # 11:19 70+ 0 Merge 'spi/for-linus' into devel-hourly-2014100409 git bisect good 2e6b2ee6893da99e9a156087aee97f90b0c8429c # 11:26 70+ 0 Merge 'trace/for-next' into devel-hourly-2014100409 git bisect good 7ea38a3061ab82dcfb705c3f36f55ddd8c351c83 # 11:31 70+ 1 Merge 'usb/usb-next' into devel-hourly-2014100409 git bisect bad 6d3ac51e9688b5cc2d4a63ba5f2e9b057db75ac8 # 11:35 0- 24 Merge 'driver-core/driver-core-next' into devel-hourly-2014100409 git bisect bad a33db30bb2f4d53f325e1c465f594894f559843c # 11:39 0- 1 Merge 'ak/x86/fsgs-2' into devel-hourly-2014100409 git bisect bad b8a868e9ea876a1b40020397305533c095921d7a # 11:46 0- 23 x86: Add support for rd/wr fs/gs base git bisect good a0b0be64599f50dc2c9fa85734026701221f186a # 11:53 70+ 1 x86: Naturally align the debug IST stack git bisect good 598d570a05cd31500fb15a843a92f68ddb1b3618 # 11:59 70+ 0 x86: Add intrinsics/macros for new rd/wr fs/gs base instructions # first bad commit: [b8a868e9ea876a1b40020397305533c095921d7a] x86: Add support for rd/wr fs/gs base git bisect good 598d570a05cd31500fb15a843a92f68ddb1b3618 # 12:05 210+ 3 x86: Add intrinsics/macros for new rd/wr fs/gs base instructions git bisect bad cd94c0185489f0cddcbfa80e86258bb4609b6e1d # 12:05 0- 4 0day head guard for 'devel-hourly-2014100409' git bisect good 126d4576cb73c8a440adc37c129589cd66051bcc # 12:11 210+ 7 Merge branch 'i2c/for-current' of git://git.kernel.org/pub/scm/linux/kernel/git/wsa/linux git bisect good 2e1d004b9645628c64a2db55ef6b81fadf5e6e91 # 12:19 210+ 2 Add linux-next specific files for 20141003 This script may reproduce the error. ---------------------------------------------------------------------------- #!/bin/bash kernel=$1 kvm=( qemu-system-x86_64 -cpu kvm64 -enable-kvm -kernel $kernel -m 320 -smp 2 -net nic,vlan=1,model=e1000 -net user,vlan=1 -boot order=nc -no-reboot -watchdog i6300esb -rtc base=localtime -serial stdio -display none -monitor null ) append=( hung_task_panic=1 earlyprintk=ttyS0,115200 debug apic=debug sysrq_always_enabled rcupdate.rcu_cpu_stall_timeout=100 panic=-1 softlockup_panic=1 nmi_watchdog=panic oops=panic load_ramdisk=2 prompt_ramdisk=0 console=ttyS0,115200 console=tty0 vga=normal root=/dev/ram0 rw drbd.minor_count=8 ) "${kvm[@]}" --append "${append[*]}" ---------------------------------------------------------------------------- Thanks, Fengguang