Hi Eric, It seems there are still some problems with the initialization of the APICs in the second kernel. As you can see from the serial line captures below, early during the boot process the kernel is flooded with "unexpected IRQ trap at vector ##" errors and fails to boot. Some basic details about the machine: - Dual Xeon Hyper-Threading 2.4GHz - 1GB RAM In this particular machine the problem could be solved by reintroducing the APICs shutdown patch. The drawback with this approach is that LAPIC/IOAPIC registers setup for the legacy PIC mode differs a lot between mother boards and the somewhat hackish shutdown code fails to set the APICs properly under certain configurations. In "mkdump" we take a different method that solves these problems: save the original state of the APICs (i.e. as configured by the BIOS) before they are reconfigured by the kernel, and restore the APICs to that original state before kexecing the second kernel. I feel this is the safest (and most paranoid) solution. But, of course, I concede that it would be preferable to avoid touching the APICs in the reboot patch to the second kernel if possible. I hope we can get the "moving apic init in init_IRQs" patches to work reliably. The APICs save/restore approach was originally proposed by Jan Kratochvil in the Fastboot mailing list: http://lists.osdl.org/pipermail/fastboot/2005-May/001383.html I have prepared "LAPIC/IO-APIC save/restore" patches against "linux-2.6.15-rc1" (attached). I would appreciate comments on this problematic regarding the APICs. Regards, Fernando ******** WITH ACPI ENABLED # kexec -p linux-2.6.15-rc1-cptr/vmlinux --args-linux --append="root=/dev/sda1 init 1 irqpoll console=ttyS0,38400 console=tty0" # SysRq : Trigger a crashdump Linux version 2.6.15-rc1-cptr (fewy@nexus) (gcc version 4.0.3 20051023 (prerelease) (Debian 4.0.2-3)) #1 PREEMPT Thu Nov 17 11:19:24 JST 2005 BIOS-provided physical RAM map: BIOS-e820: 0000000000000100 - 000000000009f800 (usable) BIOS-e820: 000000000009f800 - 00000000000a0000 (reserved) BIOS-e820: 0000000000100000 - 000000003fee0000 (usable) BIOS-e820: 000000003fee0000 - 000000003fee3000 (ACPI NVS) BIOS-e820: 000000003fee3000 - 000000003fef0000 (ACPI data) BIOS-e820: 000000003fef0000 - 000000003ff00000 (reserved) BIOS-e820: 00000000fec00000 - 0000000100000000 (reserved) user-defined physical RAM map: user: 0000000000000000 - 00000000000a0000 (usable) user: 0000000001000000 - 000000000128a000 (usable) user: 000000000132a400 - 0000000005000000 (usable) 0MB HIGHMEM available. 80MB LOWMEM available. found SMP MP-table at 000f5750 DMI 2.3 present. ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) Processor #0 15:2 APIC version 20 ACPI: LAPIC (acpi_id[0x01] lapic_id[0x06] enabled) Processor #6 15:2 APIC version 20 WARNING: NR_CPUS limit of 1 reached. Processor ignored. ACPI: LAPIC (acpi_id[0x02] lapic_id[0x07] enabled) Processor #7 15:2 APIC version 20 WARNING: NR_CPUS limit of 1 reached. Processor ignored. ACPI: LAPIC (acpi_id[0x03] lapic_id[0x01] enabled) Processor #1 15:2 APIC version 20 WARNING: NR_CPUS limit of 1 reached. Processor ignored. ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) ACPI: IOAPIC (id[0x04] address[0xfec00000] gsi_base[0]) IOAPIC[0]: apic_id 4, version 32, address 0xfec00000, GSI 0-23 ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) Enabling APIC mode: Flat. Using 1 I/O APICs Using ACPI (MADT) for SMP configuration information Allocating PCI resources starting at 10000000 (gap: 05000000:fb000000) Built 1 zonelists Kernel command line: root=/dev/sda1 init 1 irqpoll console=ttyS0,38400 console=tty0 memmap=exactmap memmap=640K@0K memmap=2600K@16384K memmap=62295K@19625K elfcorehdr=19624K Misrouted IRQ fixup and polling support enabled This may significantly impact system performance Initializing CPU#0 CPU 0 irqstacks, hard=c124e000 soft=c124d000 PID hash table entries: 512 (order: 9, 8192 bytes) Detected 2405.933 MHz processor. Using tsc for high-res timesource Console: colour VGA+ 80x25 unexpected IRQ trap at vector 89 unexpected IRQ trap at vector 29 unexpected IRQ trap at vector 89 unexpected IRQ trap at vector 19 ..................... ******** WITH ACPI DISABLED # kexec -p linux-2.6.15-rc1-cptr/vmlinux --args-linux --append="root=/dev/sda1 init 1 irqpoll console=ttyS0,38400 console=tty0" # SysRq : Trigger a crashdump Linux version 2.6.15-rc1-cptr (fewy@nexus) (gcc version 4.0.3 20051023 (prerelease) (Debian 4.0.2-3)) #1 Thu Nov 17 15:46:25 JST 2005 BIOS-provided physical RAM map: BIOS-e820: 0000000000000100 - 000000000009f800 (usable) BIOS-e820: 000000000009f800 - 00000000000a0000 (reserved) BIOS-e820: 0000000000100000 - 000000003fee0000 (usable) BIOS-e820: 000000003fee0000 - 000000003fee3000 (ACPI NVS) BIOS-e820: 000000003fee3000 - 000000003fef0000 (ACPI data) BIOS-e820: 000000003fef0000 - 000000003ff00000 (reserved) BIOS-e820: 00000000fec00000 - 0000000100000000 (reserved) user-defined physical RAM map: user: 0000000000000000 - 00000000000a0000 (usable) user: 0000000001000000 - 000000000123c000 (usable) user: 00000000012dc400 - 0000000005000000 (usable) 0MB HIGHMEM available. 80MB LOWMEM available. found SMP MP-table at 000f5750 DMI 2.3 present. Intel MultiProcessor Specification v1.4 Virtual Wire compatibility mode. OEM ID: OEM00000 Product ID: PROD00000000 APIC at: 0xFEE00000 Processor #0 15:2 APIC version 17 Processor #6 15:2 APIC version 17 WARNING: NR_CPUS limit of 1 reached. Processor ignored. I/O APIC #4 Version 17 at 0xFEC00000. Enabling APIC mode: Flat. Using 1 I/O APICs Processors: 1 Allocating PCI resources starting at 10000000 (gap: 05000000:fb000000) Built 1 zonelists Kernel command line: root=/dev/sda1 init 1 irqpoll console=ttyS0,38400 console=tty0 memmap=exactmap memmap=640K@0K memmap=2288K@16384K memmap=62607K@19313K elfcorehdr=19312K Misrouted IRQ fixup and polling support enabled This may significantly impact system performance Initializing CPU#0 PID hash table entries: 512 (order: 9, 8192 bytes) Detected 2405.819 MHz processor. Using tsc for high-res timesource Console: colour VGA+ 80x25 unexpected IRQ trap at vector 89 unexpected IRQ trap at vector 29 unexpected IRQ trap at vector 89 ..................... -- Fernando Luis Vázquez Cao @ NTT Data Intellilink