From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1753435AbdEPARu (ORCPT ); Mon, 15 May 2017 20:17:50 -0400 Received: from mail-dm3nam03on0082.outbound.protection.outlook.com ([104.47.41.82]:49888 "EHLO NAM03-DM3-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1753336AbdEPARr (ORCPT ); Mon, 15 May 2017 20:17:47 -0400 Authentication-Results: google.com; dkim=none (message not signed) header.d=none;google.com; dmarc=none action=none header.from=cavium.com; From: David Daney To: Bjorn Helgaas , linux-pci@vger.kernel.org Cc: linux-kernel@vger.kernel.org, linux-arm-kernel@lists.infradead.org, Jon Masters , Robert Richter , David Daney Subject: [PATCH 0/2] PCI: Workaround for bus reset on Cavium cn8xxx root ports Date: Mon, 15 May 2017 17:17:34 -0700 Message-Id: <20170516001736.4001-1-david.daney@cavium.com> X-Mailer: git-send-email 2.9.4 MIME-Version: 1.0 Content-Type: text/plain X-Originating-IP: [50.233.148.156] X-ClientProxiedBy: SN1PR0701CA0062.namprd07.prod.outlook.com (10.163.126.30) To MWHPR07MB3501.namprd07.prod.outlook.com (10.164.192.28) X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 8185a923-c9e3-42c8-9cd6-08d49bf0f9d5 X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:(22001)(201703131423075)(201703031133081);SRVR:MWHPR07MB3501; X-Microsoft-Exchange-Diagnostics: 1;MWHPR07MB3501;3:h1DMOW2T7IoiVHLSKFpCDW4tqUCPfMwPtsiELjCjPDQsL6gzCTMbzrvbtjbAJUs3UrAdk2sByzmP4wVANgAqCrWZyXP+jJgTy2Q94P/uv5yKDud6hbIXEuw99TwIyNkQU51uO0qLY7dOdrQoECXkdoeC8OECSVKU0D9kM4ucIOYU6HJK0GWKS9IFhxm64+aTqhp5xD/bvV5FT5aFOVz5IJBtNfZ05wVDmEl/y0nAUy4H6/NyBYFITUgQhNrC1E164E+AYMzy2ozi5Bmb3KrSbd84MOwEGn/SBmRMHA7uSgJMIh4Ap1S17Re0IYwGJbRsgNp5FkkjJ767s4Ln7twzgQ==;25:/6eVl1PBZtV3V+0b0jecSVHVw084RPNAuCgJrRNueHaCI3nydyUNEBGqGajHDhnMxWbdOXoM/QFP2xPmYFMzKXO8Li13ExQU8w8uulWF251Ud/woZYoHNkPVfwamLsxF7k+8mpPnujJEiQ3EjeLoBsPyeUjnz4QaXdngVDFrXTiSuK2uv14qD/XHm/W0Vj8u2VbbAf82ZtfeAykZHQSlowFv+J4+2sQp0fNdakKS2MSNVC0WxIo24Q/449lRVZ83OMnTiqnviZfn8ty7I6aLDN1RhWQgGELtoIQmK+xRUC5AeSEm3NrRRZh4Ui0MOjjMvtMrvyEtpga14nMe22fuei73G3l2yjEKLYU7cRRcyW8bgu60ALm/TicD18RjDhgr1fBlnGCyWAONdd1yqVMaeWsCqZsE+7kkcuESXko4JJm7xi/lxY1AN5Kw9UEh/WoPOgjfKkoOLOsDmbL7twpbwp5FSAnkoM5kJfJHjO5vj9U= X-Microsoft-Exchange-Diagnostics: 1;MWHPR07MB3501;31:oZuSX6GnGFQml/MKMVX2M7Fwinyvyohy7/k0nsr647KnbPjnq169nYnZIn+geuloSWUr7P56goODjFzavuLWHZ/RkiQafnvatp4vEEWTXnBd8CJRMkkPguQe0OtYX1se2V+lVl7orxqqa6XAfuYmW0aYWnaSsgvh+rMovEIcV5ayFlLCgw050MIlHP4MqWZp7nsK4BZyek3pEnS/Ywmz6eOyvJTEUoZsA0lFxgfiC0Q=;20:BYk/armNqahAJfIYkHZmkkprQ3S6OdLPUNUO7OEGhROygYYJJO86T+eJzt7iRsas+cOzYtFsmnDBUdHYWzah2uFfnoA/tzy2jvacUV5qfP76qR3J+vySiyzHxcUlG1+XT4zNSqARVNpVZhDVjyRff8LcmPXI78maB3SeCASsfQK4f65DA9/avxhkwR3hnjr1DMSzb9nwHTMbVby3mUPIasw7RdYNFixOAvFAlBtFPPJl7jX4ufN7dOQ6R58VhylNqJlZQ1X+Z663N5HYlKZPQWn9N5wagS+B9dinVLzknBbxUBy3C8D+cVMQQXJo5sm1cbTt1hbwDF0EXz+ey5y1DKUEnVhdvsUJ23T/lQGS8fNziE4t4C6uSMIo/KOlVofVTS0h2LmxBOFkKg7Kji9bVLiiwf/1687HYZbNR3K68Qo4IUY2V40ebnzsmb0wS+/6rKrariKse/G9j83VTK1zjk9UGxEafhhnn6SEetq9YKHDihmEDZ2t5E8invQsvcan X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0;PCL:0;RULEID:(6040450)(601004)(2401047)(5005006)(8121501046)(10201501046)(3002001)(93006095)(93001095)(6041248)(20161123558100)(20161123560025)(20161123555025)(20161123562025)(201703131423075)(201702281528075)(201703061421075)(201703061406153)(20161123564025)(6072148);SRVR:MWHPR07MB3501;BCL:0;PCL:0;RULEID:;SRVR:MWHPR07MB3501; X-Microsoft-Exchange-Diagnostics: 1;MWHPR07MB3501;4:C3B84RikTPmfmzPRDSK9A7Ea+qilDDCs4L3qlLqjgztnssXXwSTcZ/U998FygnrmwiDzfehGZS/gx8GGgWaQwpVwTkMR0W1AOJ8/xVWKf3xbEG/h0PBT+dEER/eqheSyHKNmqxbyFFOGnnW/8pnoNT72qQjXTo1HU0PJpbHxuPXP3olAFP/j+yHnUdy8XIwqvu8HBd+8g7gW3Zic3UCSabuJvvS+5tSLw86L6FmXF3SFox7NZMEgKQGq/7ddlyK1O47+4YQ7kn7Ri5PWDX9MZtLLvgZJqW3XgjEm1wgZgYTJzvg6Ui3MNwbumtOuF8JTcGvXmHJzMhcOn+qFsq0efyyhlHu08QHryXiaqAIo43xKp8lwCmLxykSMal+tHybq8h41bTHsswRLMIYjwyoBNI+gqG7dauRKiuOQHqc6vY0kFOVthItxMEyxDPTbOCuEO9LBhSufXOCYz6x6ncUwsxOiTkm9HXLoW5npmUwep9/sCKE7sauohl6pc3vnmfbxypEil8CzDEMmVPUzqRyiBVAtdyot9m8usVnf240trRkeuUfcfMlhZZZT7P2n86AR6JjncWa9fWnHVeYqrjgtprMAcBsD5Oo3r7g+EUVPGNT+wAmLhC32UhuZkq3uPFk0p3kfd8FPH6L07bBPcKM/kSPVNNmGZpVw23fQiWTB43KwPSMdi0tMOidEkIXo6shye0Jm1EI1PSzIGhwz5onoBmroz5GmHuvFmKK1ePPfTfHMmAQGtoOaKiIend3smQVJfvAaMnVa3DR03V/c8KUnQ/v8ymH00KnTzusTLvoFjGk= X-Forefront-PRVS: 03094A4065 X-Forefront-Antispam-Report: SFV:NSPM;SFS:(10009020)(4630300001)(6009001)(39450400003)(39840400002)(39400400002)(39410400002)(39850400002)(50226002)(81166006)(25786009)(8676002)(5003940100001)(33646002)(50986999)(53416004)(189998001)(6486002)(53936002)(2906002)(6512007)(6666003)(42186005)(110136004)(107886003)(38730400002)(5660300001)(305945005)(7736002)(4326008)(86362001)(47776003)(478600001)(66066001)(1076002)(3846002)(6116002)(54906002)(72206003)(36756003)(50466002)(6506006)(32563001);DIR:OUT;SFP:1101;SCL:1;SRVR:MWHPR07MB3501;H:ddl.caveonetworks.com;FPR:;SPF:None;MLV:sfv;LANG:en; X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1;MWHPR07MB3501;23:dH9RsA/3HPdFfc/FqHZoiwH244WnyCWHDSUeSom0t?= =?us-ascii?Q?Sb0C8dbFKhVa4sIzT02MIt0NI5KI9je6+meX4k3lCbmmUij+UiBwTZSWrNZn?= =?us-ascii?Q?c/qFo2M+FYvSW3P1Ka5Z+o6n5qR57pLtvv/p5PHrVtx8ElSeh7jyzjQcunwp?= =?us-ascii?Q?ouO54VLXoAgARYdp3R+HjSMXArwQ6PkRNuRSdMps5GS1iMxK2MagmmrhmSPx?= =?us-ascii?Q?SB/axG2rmmeoNzBvkBgiATCONoOL7hZRYlS6IqFie/GAPyAreZzZuNWVZgxk?= =?us-ascii?Q?jcCdT/Oa43riECEs/OdlurV0ME6Kx7Dy5cBVV0z396lHBnV2rLgqZCNId828?= =?us-ascii?Q?LU0FAHxM0Mr9wSAsBQeZaQP2y/mOXG8TfpYg8dVrm0fbKzJk873RmvOBLvgb?= =?us-ascii?Q?WDIpfGrx8ZnPFRZzUfNLu9KJenlmNLzDNmgqQjCdKM8W2wj/yw3eN7aL80zP?= =?us-ascii?Q?wiSLbf1DQO5VTsDcMLIrK5ti7cda1tx1o4kMnNk4fQjI2PbNKH69eW0jx4qc?= =?us-ascii?Q?6GH8aMr7awDy43etMcTzgIEZYIQOieCr8Ye+mffiRbuf10DtXBMRf/sL+WzD?= =?us-ascii?Q?5+bLFTMVYJBJyDP0egJ1kRaqboJVE6m2OERHZ5/L/3iQXkuSc5xnD008qUsU?= =?us-ascii?Q?d7+XCGK1CIFUAzn7800iVXs3hFpaX8p6eilhknSxPnzUtFjPthjkZ4/DWLPh?= =?us-ascii?Q?yZSWbeuXFO2xYEi9Trzvqw9G2EvIFK8H50WcpPuHyFECf2XrQKB2KBQxZpVl?= =?us-ascii?Q?XGilpUMJnPNux5AHaBzBHy2Ijxi/WvvRjCC15jY6WmJ8Y7ydDURP3OcJ/wYe?= =?us-ascii?Q?qon/rmL5q3YleNhXpZMW5O7rZNFvBpyuwd1txn34W86GMJY/cjPXcqMIsi1y?= =?us-ascii?Q?hXQ//SLMeD5s8jzgBgRGlhIgcYKZPv11K7DCqBr60m4W6+ybeqiiRu1XbXvo?= =?us-ascii?Q?UsyJd52fZCrPKiDOrVknpjzewvDQkXlzyQZ19sL0AQ7PCX04gUkHkTzloW1X?= =?us-ascii?Q?T5oIBS0qNDmXrVLqSSrK0rHDXUI5mCnSFDJfzbtDygECARpT1AaJuxyUyx1I?= =?us-ascii?Q?SHCGglQBL6PYFWWQsU0aGfp4JBq?= X-Microsoft-Exchange-Diagnostics: 1;MWHPR07MB3501;6:RtMdd50OOKC3GBUXCXrF7Q7dspjEn92yYO7jpp4n9uRaUXrHsCWIsajqOSivQnGkatpm1kEi/24UhO1tenPsu1edIYas6YaO+0okM1F8JNHnXvyn8rI2rtyHiH7Inc5NZP5lg1fjXTqr+KbAIHyULqJv5RX3joansbwMtHx4xVL0A+MAEeF3oxee9vP2O/V2X0g2rnrf8bEuTY3f2RmELIDd8em79Uf8mR0GzhM+aAxWxAu0SPQCCCBZrafdVDvglHkQ8oR5FGTr9fNjrAw6LklexfdMfonhgJ6OOUFYkZLj5bvFbmzpTVllqYx0P3ZON6IlcxVn7uc63FFCDvGEM9I9RZBP3g+qLRqwzaKhamg0m1XRXCQTTYmttDheOMlLzVLm5SZ/mwlkUJgRQhhn1SHvizY+H6l5HVwB/641sKTopDXw6Bv0rZhO3TzStKP7mBryzuPZnmTZWpZv+lxcBOcBWeGkqA/h/UUswFheme6tXK7aYaImAfCbtlQNyFCkcPGHJeTnfZe/L0plsYGUAw==;5:CAFmY2BhWHY1P2gEdHFpce64xjujS9SpEH/ywGYj6yqQpweHoLIQ/bsWKZp++yJ5N8TDa0wPWQCpp06I2ViOIYJGrC/y03OOUv1TZovGAPyTpM3yzxwbUSKV1qmbtjNFZ1vlULaD139qQSu0XKt2WQ==;24:ee30cjcz/Rvw7hPLHWCM1z9b9Npiu9Rf90Y0ok1YzEx3lJ1LawubeZp2FmztwliYf/9Fjqnu7PQ80gqOSoSZYErvczcIbuG+EWGmIRM/nCE= SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-Microsoft-Exchange-Diagnostics: 1;MWHPR07MB3501;7:vpKgwYC/SWbPZCbAI/qqMfrpuLY2QVnnAyYpBQ3zAYCqjvxn3HZMdPAyJhoVJIf3WfwFlPsY8k8sap2qKwCxFz4bMWefCZmwaiHHU7i2DufW5DMyFGOfG3oy4+mVD2UvJixUGtOWN5fDx7k0w6jZ4e2tMJmhjrZyjA2kcM69H7zNTz/hZZeej7HPeSYxDOsgeog0sFwj9LNPYXsVhZY2fMFIFwetLrxGRR9plc6t+4h7aik8nFaKxTEWwu1XMvCLiZRro7bcXh1yCkG6VdNI7huBA2YeNjyeVdAGujZPSjIV26o9TgJhxmEMLaZGZZhN7ABe+CYAtN+dqc5F70Jr0g== X-OriginatorOrg: cavium.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 16 May 2017 00:17:44.4259 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: MWHPR07MB3501 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org With the recent improvements in arm64 and vfio-pci, we are seeing failures like this (on cn8890 based systems): [ 235.622361] Unhandled fault: synchronous external abort (0x96000210) at 0xfffffc00c1000100 [ 235.630625] Internal error: : 96000210 [#1] PREEMPT SMP . . . [ 236.208820] [] pci_generic_config_read+0x38/0x9c [ 236.214992] [] thunder_pem_config_read+0x54/0x1e8 [ 236.221250] [] pci_bus_read_config_dword+0x74/0xa0 [ 236.227596] [] pci_find_next_ext_capability.part.15+0x40/0xb8 [ 236.234896] [] pci_find_ext_capability+0x20/0x30 [ 236.241068] [] pci_restore_vc_state+0x34/0x88 [ 236.246979] [] pci_restore_state.part.37+0x2c/0x1fc [ 236.253410] [] pci_dev_restore+0x4c/0x50 [ 236.258887] [] pci_bus_restore+0x24/0x4c [ 236.264362] [] pci_try_reset_bus+0x7c/0xa0 [ 236.270021] [] vfio_pci_ioctl+0xc34/0xc3c [vfio_pci] [ 236.276547] [] vfio_device_fops_unl_ioctl+0x20/0x30 [vfio] [ 236.283587] [] do_vfs_ioctl+0xac/0x744 [ 236.288890] [] SyS_ioctl+0x84/0x98 [ 236.293846] [] __sys_trace_return+0x0/0x4 These are caused by the inability of the PCIe root port and Intel e1000e to sucessfully do a bus reset. The proposed fix is to not do a bus reset on these systems. David Daney (2): PCI: Allow PCI_DEV_FLAGS_NO_BUS_RESET to be used on bus device. PCI: Avoid bus reset for Cavium cn8xxx root ports. drivers/pci/pci.c | 4 ++++ drivers/pci/quirks.c | 8 ++++++++ 2 files changed, 12 insertions(+) -- 2.9.4