From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1751541AbdFGOeU (ORCPT ); Wed, 7 Jun 2017 10:34:20 -0400 Received: from mx1.redhat.com ([209.132.183.28]:36964 "EHLO mx1.redhat.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751485AbdFGOdB (ORCPT ); Wed, 7 Jun 2017 10:33:01 -0400 DMARC-Filter: OpenDMARC Filter v1.3.2 mx1.redhat.com A89A5C0587D8 Authentication-Results: ext-mx08.extmail.prod.ext.phx2.redhat.com; dmarc=none (p=none dis=none) header.from=redhat.com Authentication-Results: ext-mx08.extmail.prod.ext.phx2.redhat.com; spf=pass smtp.mailfrom=pbonzini@redhat.com DKIM-Filter: OpenDKIM Filter v2.11.0 mx1.redhat.com A89A5C0587D8 Subject: Re: [PATCH CFT 0/4] VT-d PI fixes To: "Gonglei (Arei)" , "linux-kernel@vger.kernel.org" , "kvm@vger.kernel.org" Cc: longpeng , "Huangweidong (C)" , "wangxin (U)" , =?UTF-8?B?UmFkaW0gS3LEjW3DocWZ?= References: <20170606105707.23207-1-pbonzini@redhat.com> <33183CC9F5247A488A2544077AF19020DA2C98CC@DGGEMA505-MBX.china.huawei.com> From: Paolo Bonzini Message-ID: <99efdb7d-b8a8-866f-d070-1f7c09af82d6@redhat.com> Date: Wed, 7 Jun 2017 16:32:55 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.1.0 MIME-Version: 1.0 In-Reply-To: <33183CC9F5247A488A2544077AF19020DA2C98CC@DGGEMA505-MBX.china.huawei.com> Content-Type: text/plain; charset=iso-8859-2 Content-Language: en-US Content-Transfer-Encoding: 8bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.5.110.32]); Wed, 07 Jun 2017 14:33:00 +0000 (UTC) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 07/06/2017 11:33, Gonglei (Arei) wrote: > >> -----Original Message----- >> From: Paolo Bonzini [mailto:paolo.bonzini@gmail.com] On Behalf Of Paolo >> Bonzini >> Sent: Tuesday, June 06, 2017 6:57 PM >> To: linux-kernel@vger.kernel.org; kvm@vger.kernel.org >> Cc: longpeng; Huangweidong (C); Gonglei (Arei); wangxin (U); Radim Krèmáø >> Subject: [PATCH CFT 0/4] VT-d PI fixes >> >> These should fix, or at least help, the kernel panic reported by Longpeng >> with VT-d posted interrupts. >> >> CONFIG_DEBUG_LIST reports a double add, meaning that pi_pre_block ran >> twice >> without pi_post_block deleting the vCPU from the blocked_on_vcpu list. >> The only possibility that I could think of is that this: >> >> if (!kvm_arch_has_assigned_device(vcpu->kvm) || >> !irq_remapping_cap(IRQ_POSTING_CAP) || >> !kvm_vcpu_apicv_active(vcpu)) >> return; >> >> was false in pi_post_block. In turn, I can only think of hot-unplug as >> the cause of this imbalance, but maybe there is another way to reach it >> just via repeated startup and shutdown. Gonglei reported problems with >> hot-unplug offlist too, so this is a start. >> >> In any case, patch 2 replaces it with a check on vcpu->pre_pcpu. >> A similar change is done in patch 3 to vmx_vcpu_pi_load. I don't >> have hardware easily accessible with VT-d PI, so these patches are >> compile-tested only. I apologize for any stupid mistakes. >> > Hi Paolo, > > We are testing your patch, but maybe need some time to report > the results because it's not an inevitable problem. Of course! I guess it should run for at least a couple days before deeming it fixed. If you didn't find any immediate showstopper bugs, that's already good. :) Paolo > Meanwhile we also try to find a possible scenario of non-hotplugging to > explain the double-add warnings. > > We found that some other VMs start failed before the kernel painc: > > 2017-06-02T12:27:49.972583Z qemu-kvm: -device vfio-pci,host=0b:10.4,id=hostdev0,bus=pci.0,addr=0x5: vfio: error getting device 0000: > 0b:10.4 from group 97: No such device > Verify all devices in group 97 are bound to vfio- or pci-stub and not already in use > 2017-06-02T12:27:49.975925Z qemu-kvm: -device vfio-pci,host=0b:10.4,id=hostdev0,bus=pci.0,addr=0x5: vfio: failed to get device 0000: > 0b:10.4 > 2017-06-02T12:27:51.246385Z qemu-kvm: -device vfio-pci,host=0b:10.4,id=hostdev0,bus=pci.0,addr=0x5: Device initialization failed > 2017-06-02 12:27:53.628: shutting down, reason=crashed > 2017-06-02 12:30:48.723: shutting down, reason=failed > > But we don't think those failure will cause the unequal of kvm->arch.assigned_device_count > between pi_pre_block and pi_post_block. Am I right? > > Thanks, > -Gonglei > >