* [PATCH v2 0/2] apic: Fix error interrupt report at all APs when boot @ 2011-01-07 16:36 Youquan Song 2011-01-07 16:36 ` [PATCH v2 1/2] apic: Fix error interrupt report at all APs Youquan Song 0 siblings, 1 reply; 5+ messages in thread From: Youquan Song @ 2011-01-07 16:36 UTC (permalink / raw) To: linux-kernel, hpa, suresh.b.siddha Cc: yong.y.wang, joe, jbaron, arjan, trenn, kent.liu, chaohong.guo, Youquan Song, Youquan Song Recently, customer report that once machine boot, there are many error interrupt reported with exact number of all APs. The root cause is Local APIC will generate error interrupt when it detect the illegal vector (one in 0 ~ 15) in an interrupt message received or interrupt generate from local vector table or self IPI. SDM3A.chapter 10. AP LAPIC thermal sensor register will be reset to 0x10000, if thermal throttling interrupt take over by BIOS, it need restore AP with the thermal sensor register value of geting from BSP, otherwise cause system issue. If BIOS does not take over the thermal interrupt, The restore value will be CPU rest value of 0x10000, which means the interrupt vector is zero. After writing 0x10000 to thermal sensor LVT, the processor will recieve the error interrupt report if the APIC error interrupt is also set. This patch add check the BIOS whether take over the thermal interrupt by look at interrupt delivery mode not fixed mode(BIOS handle will be SMI mode) before restore AP's thermal LVT. So the agony noise of error interrupt will dismiss when boot on machine that BIOS does not handle thermal interrupt.. Also add print out error interrupt reason debug information. ^ permalink raw reply [flat|nested] 5+ messages in thread
* [PATCH v2 1/2] apic: Fix error interrupt report at all APs 2011-01-07 16:36 [PATCH v2 0/2] apic: Fix error interrupt report at all APs when boot Youquan Song @ 2011-01-07 16:36 ` Youquan Song 2011-01-07 16:36 ` [PATCH v2 2/2] apic: Add print error interrupt reason Youquan Song 2011-01-07 18:41 ` [PATCH v2 1/2] apic: Fix error interrupt report at all APs Suresh Siddha 0 siblings, 2 replies; 5+ messages in thread From: Youquan Song @ 2011-01-07 16:36 UTC (permalink / raw) To: linux-kernel, hpa, suresh.b.siddha Cc: yong.y.wang, joe, jbaron, arjan, trenn, kent.liu, chaohong.guo, Youquan Song, Youquan Song Recently, customer report that once machine boot, there are many error interrupt reported with exact number of all APs. The root cause is Local APIC will generate error interrupt when it detect the illegal vector (one in 0 ~ 15) in an interrupt message received or interrupt generate from local vector table or self IPI. SDM3A.chapter 10. AP LAPIC thermal sensor register will be reset to 0x10000, if thermal throttling interrupt take over by BIOS, it need restore AP with the thermal sensor register value of geting from BSP, otherwise cause system issue. If BIOS does not take over the thermal interrupt, The restore value will be CPU rest value of 0x10000, which means the interrupt vector is zero. After writing 0x10000 to thermal sensor LVT, the processor will recieve the error interrupt report if the APIC error interrupt is also set. This patch add check the BIOS whether take over the thermal interrupt by look at interrupt delivery mode not fixed mode(BIOS handle will be SMI mode) before restore AP's thermal LVT. So the agony noise of error interrupt will dismiss when boot on machine that BIOS does not handle thermal interrupt.. Signed-off-by: Youquan Song <youquan.song@intel.com> --- arch/x86/include/asm/apicdef.h | 1 + arch/x86/kernel/cpu/mcheck/therm_throt.c | 12 +++++++----- 2 files changed, 8 insertions(+), 5 deletions(-) diff --git a/arch/x86/include/asm/apicdef.h b/arch/x86/include/asm/apicdef.h index a859ca4..f587be0 100644 --- a/arch/x86/include/asm/apicdef.h +++ b/arch/x86/include/asm/apicdef.h @@ -78,6 +78,7 @@ #define APIC_DEST_LOGICAL 0x00800 #define APIC_DEST_PHYSICAL 0x00000 #define APIC_DM_FIXED 0x00000 +#define APIC_DM_FIXED_MASK 0x00700 #define APIC_DM_LOWEST 0x00100 #define APIC_DM_SMI 0x00200 #define APIC_DM_REMRD 0x00300 diff --git a/arch/x86/kernel/cpu/mcheck/therm_throt.c b/arch/x86/kernel/cpu/mcheck/therm_throt.c index 4b68326..ecd6992 100644 --- a/arch/x86/kernel/cpu/mcheck/therm_throt.c +++ b/arch/x86/kernel/cpu/mcheck/therm_throt.c @@ -405,18 +405,20 @@ void intel_init_thermal(struct cpuinfo_x86 *c) */ rdmsr(MSR_IA32_MISC_ENABLE, l, h); + h = lvtthmr_init; /* * The initial value of thermal LVT entries on all APs always reads * 0x10000 because APs are woken up by BSP issuing INIT-SIPI-SIPI * sequence to them and LVT registers are reset to 0s except for * the mask bits which are set to 1s when APs receive INIT IPI. - * Always restore the value that BIOS has programmed on AP based on - * BSP's info we saved since BIOS is always setting the same value - * for all threads/cores + * If BIOS take over the thermal interrupt and set its interrupt + * delivery mode to SMI not fixed, it restore the value that BIOS has + * programmed on AP based on BSP's info we saved since BIOS is always + * setting the same value for all threads/cores. */ - apic_write(APIC_LVTTHMR, lvtthmr_init); + if (h & APIC_DM_FIXED_MASK) + apic_write(APIC_LVTTHMR, lvtthmr_init); - h = lvtthmr_init; if ((l & MSR_IA32_MISC_ENABLE_TM1) && (h & APIC_DM_SMI)) { printk(KERN_DEBUG -- 1.6.4.2 ^ permalink raw reply [flat|nested] 5+ messages in thread
* [PATCH v2 2/2] apic: Add print error interrupt reason 2011-01-07 16:36 ` [PATCH v2 1/2] apic: Fix error interrupt report at all APs Youquan Song @ 2011-01-07 16:36 ` Youquan Song 2011-01-07 18:41 ` [PATCH v2 1/2] apic: Fix error interrupt report at all APs Suresh Siddha 1 sibling, 0 replies; 5+ messages in thread From: Youquan Song @ 2011-01-07 16:36 UTC (permalink / raw) To: linux-kernel, hpa, suresh.b.siddha Cc: yong.y.wang, joe, jbaron, arjan, trenn, kent.liu, chaohong.guo, Youquan Song, Youquan Song End user worry about the error interrupt information and intend to know what kind of error interrupts are generated, so this patch add printing out the detail debug information of error interrupt. Signed-off-by: Youquan Song <youquan.song@intel.com> --- arch/x86/kernel/apic/apic.c | 29 ++++++++++++++++++++++++++++- 1 files changed, 28 insertions(+), 1 deletions(-) diff --git a/arch/x86/kernel/apic/apic.c b/arch/x86/kernel/apic/apic.c index 3f838d5..f0f2809 100644 --- a/arch/x86/kernel/apic/apic.c +++ b/arch/x86/kernel/apic/apic.c @@ -1794,6 +1794,32 @@ void smp_spurious_interrupt(struct pt_regs *regs) irq_exit(); } +static const char * const error_interrupt_reason[] = { + "Send CS error", + "Receive CS error", + "Send accept error", + "Receive accept error", + "Redirectable IPI", + "Send illegal vector", + "Received illegal vector", + "Illegal register address", +}; + +static void print_error_interrupt_reason(u32 reason) +{ + u32 i = 0; + reason = reason & 0xff; + do { + if (reason & 0x1) + apic_printk(APIC_DEBUG, " : %s", + error_interrupt_reason[i]); + i++; + reason >>= 1; + } while (reason > 0); + + apic_printk(APIC_DEBUG, "\n"); +} + /* * This interrupt should never happen with our APIC/SMP architecture */ @@ -1821,8 +1847,9 @@ void smp_error_interrupt(struct pt_regs *regs) * 6: Received illegal vector * 7: Illegal register address */ - pr_debug("APIC error on CPU%d: %02x(%02x)\n", + apic_printk(APIC_DEBUG, "APIC error on CPU%d: %02x(%02x)", smp_processor_id(), v , v1); + print_error_interrupt_reason(v1); irq_exit(); } -- 1.6.4.2 ^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: [PATCH v2 1/2] apic: Fix error interrupt report at all APs 2011-01-07 16:36 ` [PATCH v2 1/2] apic: Fix error interrupt report at all APs Youquan Song 2011-01-07 16:36 ` [PATCH v2 2/2] apic: Add print error interrupt reason Youquan Song @ 2011-01-07 18:41 ` Suresh Siddha 2011-01-08 0:58 ` Yong Wang 1 sibling, 1 reply; 5+ messages in thread From: Suresh Siddha @ 2011-01-07 18:41 UTC (permalink / raw) To: Song, Youquan Cc: linux-kernel, hpa, yong.y.wang, joe, jbaron, arjan, trenn, Liu, Kent, Guo, Chaohong, Youquan Song On Fri, 2011-01-07 at 08:36 -0800, Song, Youquan wrote: > Recently, customer report that once machine boot, there are many error interrupt > reported with exact number of all APs. > > The root cause is Local APIC will generate error interrupt when it detect > the illegal vector (one in 0 ~ 15) in an interrupt message received or > interrupt generate from local vector table or self IPI. SDM3A.chapter 10. > > AP LAPIC thermal sensor register will be reset to 0x10000, if thermal throttling > interrupt take over by BIOS, it need restore AP with the thermal sensor register > value of geting from BSP, otherwise cause system issue. If BIOS does not take > over the thermal interrupt, The restore value will be CPU rest value of 0x10000, > which means the interrupt vector is zero. After writing 0x10000 to thermal > sensor LVT, the processor will recieve the error interrupt report if the APIC > error interrupt is also set. > > This patch add check the BIOS whether take over the thermal interrupt by look > at interrupt delivery mode not fixed mode(BIOS handle will be SMI mode) before > restore AP's thermal LVT. So the agony noise of error interrupt will dismiss > when boot on machine that BIOS does not handle thermal interrupt.. > > > Signed-off-by: Youquan Song <youquan.song@intel.com> > --- > arch/x86/include/asm/apicdef.h | 1 + > arch/x86/kernel/cpu/mcheck/therm_throt.c | 12 +++++++----- > 2 files changed, 8 insertions(+), 5 deletions(-) > > diff --git a/arch/x86/include/asm/apicdef.h b/arch/x86/include/asm/apicdef.h > index a859ca4..f587be0 100644 > --- a/arch/x86/include/asm/apicdef.h > +++ b/arch/x86/include/asm/apicdef.h > @@ -78,6 +78,7 @@ > #define APIC_DEST_LOGICAL 0x00800 > #define APIC_DEST_PHYSICAL 0x00000 > #define APIC_DM_FIXED 0x00000 > +#define APIC_DM_FIXED_MASK 0x00700 It should be called APIC_DM_MASK. Other than that this patch looks good. Acked-by: Suresh Siddha <suresh.b.siddha@intel.com> > #define APIC_DM_LOWEST 0x00100 > #define APIC_DM_SMI 0x00200 > #define APIC_DM_REMRD 0x00300 > diff --git a/arch/x86/kernel/cpu/mcheck/therm_throt.c b/arch/x86/kernel/cpu/mcheck/therm_throt.c > index 4b68326..ecd6992 100644 > --- a/arch/x86/kernel/cpu/mcheck/therm_throt.c > +++ b/arch/x86/kernel/cpu/mcheck/therm_throt.c > @@ -405,18 +405,20 @@ void intel_init_thermal(struct cpuinfo_x86 *c) > */ > rdmsr(MSR_IA32_MISC_ENABLE, l, h); > > + h = lvtthmr_init; > /* > * The initial value of thermal LVT entries on all APs always reads > * 0x10000 because APs are woken up by BSP issuing INIT-SIPI-SIPI > * sequence to them and LVT registers are reset to 0s except for > * the mask bits which are set to 1s when APs receive INIT IPI. > - * Always restore the value that BIOS has programmed on AP based on > - * BSP's info we saved since BIOS is always setting the same value > - * for all threads/cores > + * If BIOS take over the thermal interrupt and set its interrupt > + * delivery mode to SMI not fixed, it restore the value that BIOS has > + * programmed on AP based on BSP's info we saved since BIOS is always > + * setting the same value for all threads/cores. > */ > - apic_write(APIC_LVTTHMR, lvtthmr_init); > + if (h & APIC_DM_FIXED_MASK) > + apic_write(APIC_LVTTHMR, lvtthmr_init); > > - h = lvtthmr_init; > > if ((l & MSR_IA32_MISC_ENABLE_TM1) && (h & APIC_DM_SMI)) { > printk(KERN_DEBUG ^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: [PATCH v2 1/2] apic: Fix error interrupt report at all APs 2011-01-07 18:41 ` [PATCH v2 1/2] apic: Fix error interrupt report at all APs Suresh Siddha @ 2011-01-08 0:58 ` Yong Wang 0 siblings, 0 replies; 5+ messages in thread From: Yong Wang @ 2011-01-08 0:58 UTC (permalink / raw) To: Suresh Siddha Cc: Song, Youquan, linux-kernel, hpa, yong.y.wang, joe, jbaron, arjan, trenn, Liu, Kent, Guo, Chaohong, Youquan Song > > --- a/arch/x86/include/asm/apicdef.h > > +++ b/arch/x86/include/asm/apicdef.h > > @@ -78,6 +78,7 @@ > > #define APIC_DEST_LOGICAL 0x00800 > > #define APIC_DEST_PHYSICAL 0x00000 > > #define APIC_DM_FIXED 0x00000 > > +#define APIC_DM_FIXED_MASK 0x00700 > > It should be called APIC_DM_MASK. Other than that this patch looks good. > Right, since every delivery mode uses the same mask. Acked-by: Yong Wang <yong.y.wang@intel.com> -Yong ^ permalink raw reply [flat|nested] 5+ messages in thread
end of thread, other threads:[~2011-01-08 1:25 UTC | newest] Thread overview: 5+ messages (download: mbox.gz / follow: Atom feed) -- links below jump to the message on this page -- 2011-01-07 16:36 [PATCH v2 0/2] apic: Fix error interrupt report at all APs when boot Youquan Song 2011-01-07 16:36 ` [PATCH v2 1/2] apic: Fix error interrupt report at all APs Youquan Song 2011-01-07 16:36 ` [PATCH v2 2/2] apic: Add print error interrupt reason Youquan Song 2011-01-07 18:41 ` [PATCH v2 1/2] apic: Fix error interrupt report at all APs Suresh Siddha 2011-01-08 0:58 ` Yong Wang
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®