From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1754833AbcIHVMc (ORCPT ); Thu, 8 Sep 2016 17:12:32 -0400 Received: from mx0a-00082601.pphosted.com ([67.231.145.42]:42258 "EHLO mx0a-00082601.pphosted.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1753271AbcIHVM3 (ORCPT ); Thu, 8 Sep 2016 17:12:29 -0400 From: Josef Bacik To: , , , , Subject: [RESEND][PATCH 0/5] nbd improvements Date: Thu, 8 Sep 2016 17:12:05 -0400 Message-ID: <1473369130-22986-1-git-send-email-jbacik@fb.com> X-Mailer: git-send-email 2.5.5 MIME-Version: 1.0 Content-Type: text/plain X-Originating-IP: [2620:10d:c091:180::1:8c0f] X-ClientProxiedBy: DM5PR03CA0021.namprd03.prod.outlook.com (10.175.104.31) To DM5PR15MB1321.namprd15.prod.outlook.com (10.173.210.11) X-MS-Office365-Filtering-Correlation-Id: 8d52be3f-30fb-4bfa-4f50-08d3d82ccf8b X-Microsoft-Exchange-Diagnostics: 1;DM5PR15MB1321;2:pQuvc5Z+89Zf5IRyRkrGunAbPL/eFGV8MneL0ayMM3EJEVIoILXsyUicYm/15UGMYFFEgkV++7fB8GHMh17ZZMk86U1A9T0G19HuVTK+bmSNWp0+X+TSxas2LPmSP/YAP13i0YbhxwyGyXWl190C9VWdB6Hj4Y4qZRwL22YAf1tJKldD3txVjbxPXk0mlhXu;3:87RmP0LXOFQNOam/FUm7NfdOVjQD46Me320T5YCHykFewjiyvxtdsYf7FetldAmVWHVedd1VnDvBlFFkJaBE1PjUzVi2mizeXlV4Bap5PmaRC22O8fSVZSopYKzBCu53;25:yYL6x7tL2wpfGi9ENR8LG96jD1w32XKnwnv+ewctrg+gwPVjosCEuNABrIy7IIyrTGslixp4t/Sb2t4Ofg2keP1jBS4aDTRVQNZ4DVFISIqs8rRzyOhnWr8DyEYxNWv0RQyW5LLsUPXHlPzaI02cq29rwBCPUq2qoOqZqGL9EbsnrQgE3MJvy9zEUj0tXgfOdqLt65fOS2nKPxCAWSkHWmK/9+9cTPQJ592tmnUyg4nX06Dtz7kWFXfVjen9BEXuBKSLKv4EmBJbybgIVwTJKPdX8tZ+qa+X301taRtjNxs5yqPqGFKCOjrAi/g8EEL9zHnI6Q/8oNjaPgZkjhO3kPxM6pBB6oykEP3wPJL39EEQGrEk3yu3QhIL0TlzZySHCtRRIbD68LDjuvFNviZePg==;31:9tk5tjszpRZzOl3G8NtuniyoM897i/mK3yzWHx1YUfS2ylcngnnif5PNLkxe+cg8Epmi/9BP3yyqFjpj7mAKASX4OwgEEA3Pmh4iz3We/a9TNkYhehDfoDVQg279kqa58a07mTBbaZxRmJ34GQThk+MHPkVZbhYYonJwxptmk0kWzr6ZwRJhNmfKr8srscwThqn7nE12BglAxgBwQY+gH9W1bsVn1y65CjJHt2llvVI= X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:DM5PR15MB1321; X-LD-Processed: 8ae927fe-1255-47a7-a2af-5f3a069daaa2,ExtAddr X-Microsoft-Exchange-Diagnostics: 1;DM5PR15MB1321;20:m3QiQxreUmGRUfgXdJeFZ2hOHUCZyB9U1jHrHIT3SczBbOYxPKLh0kz9uNSVV/OB5tVSqRsjDVEJIW5F2UootkltOiHeGfUu82xtYs1njYURCIF9iRmZs8p+nPJqkjB7prJGkxbNKl+aigoe8X/t1Owh3kNWKRohYJblnNvK/1w=;4:mloQeekkzOy9QJFPbG4dITlkP7+5IpqGbaECXqX9xyhg+NdMZasoXwLYBLUiml5aZfWAiWNeCvje8slo0SHgIZe+xvpPnaxB8KAC8TQUyt/9cL7+EmeRxJDq/RFZ5RjjhItNtjCqOOJ0RV6UfaMRxzLwXmLGEq85O41PoNMVyojS1flzjYv5MzXCEZr8FsUW2HLAVEe1J3O0YnKLoql2oHnHr11yun73tJBjeIsUXB51YEYCvB3F0sh35zFEmF8AYfzPU0BrnxpjuwVfsJucBb6okvj2MzsW6bKfDsBtmBqJRFOuQJMj6n4xUGHiUsBbw1LAWaaAdrF9pts69TozCtzT+s/7cH94h4yhcOqJz/XRi//AuOuku3Ej3FiFPKjViZQvLMvAJEmVuUYmnMAOy5ME6tkEEfioL6xEF3ZYklU+SYB/0pilmVACbaaCTdtjyWvRdi2FFo78wIG6AoP15w== X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:(158342451672863)(166708455590820); X-Exchange-Antispam-Report-CFA-Test: BCL:0;PCL:0;RULEID:(6040176)(601004)(2401047)(8121501046)(5005006)(10201501046)(3002001);SRVR:DM5PR15MB1321;BCL:0;PCL:0;RULEID:;SRVR:DM5PR15MB1321; X-Forefront-PRVS: 00594E8DBA X-Forefront-Antispam-Report: SFV:NSPM;SFS:(10019020)(4630300001)(6069001)(6009001)(7916002)(199003)(189002)(8676002)(97736004)(107886002)(36756003)(5001770100001)(6116002)(305945005)(5003940100001)(42186005)(81166006)(81156014)(50986999)(76506005)(7736002)(48376002)(7846002)(50466002)(33646002)(106356001)(586003)(47776003)(5660300001)(50226002)(92566002)(229853001)(68736007)(77096005)(19580395003)(86362001)(31430400001)(15975445007)(2201001)(105586002)(101416001)(2906002)(189998001)(3826002);DIR:OUT;SFP:1102;SCL:1;SRVR:DM5PR15MB1321;H:localhost;FPR:;SPF:None;PTR:InfoNoRecords;A:1;MX:1;LANG:en; X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1;DM5PR15MB1321;23:AhcEOo/ghUaOtS6yDFrIE/6zMoOOMIL/u2fQkr4xM?= =?us-ascii?Q?P7YeJwxU0+2d8siHX9PCp9Z112iE+JDcwsRne0b/tsbH6dyeQCuKM9rlL0SD?= =?us-ascii?Q?bqGzij247nfe9Kx56Ebx+1m6CrL5xYW5CzophWW8OosdAZ2ue9S4SwZxHnBS?= =?us-ascii?Q?fFTbvEMHypCHvY2DFZKALslOet6UvtEA/y4bDF3vsdCth1d+piLhA2N995fN?= =?us-ascii?Q?xUTS16OptMFY8CRPsyu9pgHdDVSXDTtqjyfXCH/3GzKNJOu1JhDCI1mR8dm7?= =?us-ascii?Q?o03OmX+Qm4LVqRL9SVmgXiSFa+xMxujpa2crZviBqxhkNCA/osru8jhHrbUU?= =?us-ascii?Q?W9c5WwsZ/RDzJSYXCTq1VfgpeGxf8RY5QJeV51z+TLwp5y9nxoolEQ92wsPP?= =?us-ascii?Q?jsUWM0TDNlUO6RzGw9Flz0aj7fsY8DXcx1Pn6XZQH0O3+WtIBmmJjDeYo7tF?= =?us-ascii?Q?i6jd6XqBWnLIJ0BSK5c1jIxyshYl0rNNFADnG30zPYxdj+4O2ZFaKvZLhavL?= =?us-ascii?Q?I/xVHLbpMUDGTEy25TP4TSNxEOvIB0BxKfTQ58D12iL882dRNI1599diA9He?= =?us-ascii?Q?xstA2mO0HyA8Ii5PlnfiT8LK8y0dpHUVK0Cw9AxrHxjFeI/I8oxEfgvlfzPc?= =?us-ascii?Q?tjQiwDYh/5AD0qt3jg/DYYkj2RDn0hxMjZURCYn2SNXXXYF2r0iQHtK5Jp6O?= =?us-ascii?Q?AI50eXpUqix7q6gBIRDgz6btX3ZpBMd8nmrGFCSYGchMadL305HZ52GXbPCC?= =?us-ascii?Q?4hvGbBGNywUyqMYveXiNRFi4IyKzjYtSzVfWTZVtYnRW7nE2dzbfyE6IuTnQ?= =?us-ascii?Q?Vb76Jm24jfBADbM12oacBzaC1NFsR+iWzzh92gzKVfI4TNdQzZNHs4Vu7ntX?= =?us-ascii?Q?l3+whGZrju2JcOpx4PnBHsA9YVD8oACGxfIC7NlBH7LscaMUrrvnurxXx2hJ?= =?us-ascii?Q?ZXNWakb65S7CwpW9wSJ1AjAx5R7lfLIpLo3pEIipTLrh3UCrS8pwinIwISw9?= =?us-ascii?Q?uoETXBErh0SidzMymZMRx52ArlvPlOqE/NcTnJNVoBD93uwEWNwOUArhcgZB?= =?us-ascii?Q?udBRCZbC75hdKwDh6zG5b+rzlfEk4KBU0juo7nZAjaeGNkGJA=3D=3D?= X-Microsoft-Exchange-Diagnostics: 1;DM5PR15MB1321;6:G151hzMUwnWhu2OayWE5uHMh2YOfpaI7j+ybIIFDo2jgus68kEFHPHncqeYjBV1S+aE2mS24KAWQWUTPaxmGXt+oqfWW1W/pXkgzF1Q3BA+YVJTqu3pY87oZJV+Ma+ZivRjxLabFlsedsSdfcxhczKUkq+pPTUQZ65XA5Db6GFvsI0mnaccM0H80QOrfFmorpESUfxqGwbcAqCajGDoGb37lku0yrPPeU7GJXMzlRQzouEAHqwMudjnauuWx5w+Wbs+vjykrh5KIXGOrXPkwQjq32AT1EOyadC3mgCU42pw=;5:7POeZo0Bj97b6jX3Z+PractK7tGXLkaAlAhGxaLbSGbw1qp7N7BEcQIDXeMlS2A1eh1rVYmEzuISwNc/e6g9GMHN6Da7jLR0RI774t+0syv7Cv6JH/cgrRXk+xXu5Mof50ibEtacFIMc8zKgFiypjg==;24:67tkn2UA7XkrDUFv31Vxg/pSZHCXrKL+TN6llusSWadCEA+PAzGkxAcAD8ahGd/pU/V+mLc6ermVGAtt9WpwZ4xbYfVhHNVcyyvAAnS6gu0=;7:w/RMV290ykWNx2bvL/2qCecoM64fZJDuDr303cHB//EwSGTeCkBEHGWrF7k8Y2TuOO73VGAnPpwGY68TYJK7j568LHfPEpc8Gj7VEmv4bDbv6ZWJYI7YTTXB1AZaBiVTndk3yIyW226pXqqeUd6q4pBvDQ0fK0Wb+MeIhuJf3PJA8qFabA8/SQEKJaW9ue6t7e2dsztI6NBW+CuQLWKWVscZWteBCVFIbxLncptsjCOsgxn1ZBp9Rk5r64Dl+npi SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-Microsoft-Exchange-Diagnostics: 1;DM5PR15MB1321;20:r8DL//UuOQm0UXUQg+tbfG2CoYhFo2tV5nqhD1m64ZhLjnxeWPhPsSY43N+C1qCuFkb/xy5WkdH56BQzJneHZo+lXFfgTpAee9HZ8eKdA/LWa5G73pGDl7WlLfP00PFYeZNB2s2sDoTnLTHuPsv48K5Qlai8iUU1D3p9lQEoYDM= X-MS-Exchange-CrossTenant-OriginalArrivalTime: 08 Sep 2016 21:12:15.9104 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM5PR15MB1321 X-OriginatorOrg: fb.com X-Proofpoint-Spam-Reason: safe X-FB-Internal: Safe X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:,, definitions=2016-09-08_10:,, signatures=0 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Apologies if you are getting this a second time, it appears vger ate my last submission. ---------------------------------------------------------------------- This is a patch series aimed at bringing NBD into 2016. The two big components of this series is converting nbd over to using blkmq and then allowing us to provide more than one connection for a nbd device. The NBD user space server doesn't care about how many connections it has to a particular device, so we can easily open multiple connections to the server and allow blkmq to handle multi-plexing over the different connections. This drastically improves performance with multi-threaded workloads over NBD. The multi-connection support requires some changes to the NBD userspace client code, and you can find that code here https://github.com/josefbacik/nbd I have been testing this for a few months and it is pretty solid and gives excellent performance improvements. Thanks, Josef