From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1756745AbdDPUiG (ORCPT ); Sun, 16 Apr 2017 16:38:06 -0400 Received: from mx0a-00082601.pphosted.com ([67.231.145.42]:50713 "EHLO mx0a-00082601.pphosted.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1756609AbdDPUiB (ORCPT ); Sun, 16 Apr 2017 16:38:01 -0400 Authentication-Results: vger.kernel.org; dkim=none (message not signed) header.d=none;vger.kernel.org; dmarc=none action=none header.from=fb.com; Subject: Re: [GIT PULL 00/19] LightNVM patches for 4.12. To: =?UTF-8?Q?Matias_Bj=c3=b8rling?= References: <20170415185553.16098-1-matias@cnexlabs.com> CC: , From: Jens Axboe Message-ID: <38deae6f-7978-189d-b4b2-c37719ba807e@fb.com> Date: Sun, 16 Apr 2017 14:37:20 -0600 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 In-Reply-To: <20170415185553.16098-1-matias@cnexlabs.com> Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 8bit X-Originating-IP: [189.177.245.201] X-ClientProxiedBy: MWHPR10CA0010.namprd10.prod.outlook.com (10.172.48.20) To CY4PR15MB1191.namprd15.prod.outlook.com (10.172.177.13) X-MS-Office365-Filtering-Correlation-Id: ef7481f2-125c-402b-33e9-08d485086936 X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:(22001)(201703131423075)(201703031133081);SRVR:CY4PR15MB1191; X-Microsoft-Exchange-Diagnostics: 1;CY4PR15MB1191;3:Yo+VaXQUMBG9hPWdBg+JXU9vicCWop0pCTkbpM6+OXIXoNphi+x1d/1ze4zoIiEQrvomkuY6BAN/WUDQ7EG5x5YcT1ddU/oyLUH6ILUCSQcmoIZsr4lPhxDwk0uVfbztnq9VCDJo2jxH1ZfR6WcQpxaOXLr+EoV6bLNvpLbFzBwtSRAZUf5tM7o+YJzNqlkzz6vJUEEJJ3oI3PWfwFZFRKcRXibr6LSa8p5hO+nWZTXJUwVYc11g39hJUCAPil1pspfo+onBro59anFSH7US6WEdLJVTOzOK3Z+m5zHpJyA5esbvKam2Jx0RnC8F91RKD0jS9hUoSGH2PjGgQx7BbQ==;25:/w2dDYzy8ZpP54iIZhbABx4G7EPbtEPK9Y+9qR+0Xq48bYkJSzB0AK0V74NWkXHBMrXOWgF9CG/BifZqRXFFWuU0nnvLG6SDKQiv2JcfKCsFlEoYT9w5f8Vkw14SA6StX722YYjUjFwC4KvEejF+WV0Q1i2i52MeHH40Klh/cdVuVEFlKtYfT1PkHrZiIXBiv2VhS4l0u33ld3sibFqjkP4spzN/WI4s/zcQQkOJn89IY55XNRh1pClELjUgbT3bV1DNiog+job3nrYxglWBCEtix2/DxGgjxHrCXn/lDKZfKlQnGx+5SEz850LUXxerSGgHLXjrO0YE2QDLTOI7Fk8lS3Uw56URbUXpZWphFvUN5DPxTToyKVrG9REAuowP5wcOfEnfJmEAW2dVpoKP3CDueqNEYlWg4sspRdrweo7D/jQv7YILFWQib5McOmHCuK0WAtoBiRBGXh2iUI1tHw== X-Microsoft-Exchange-Diagnostics: 1;CY4PR15MB1191;31:VjW3po/bXwX5B+v2YcoBwDf9pBlZBAeoqn7gHPbHKUe+H32935CVgiIEUO5pY2eD/XAmFw6K0iMFw+tJdR2rV6jkTjL8fqphZrp8L0iXGSx6K4KKPJOkSDb8WEY8kjpqYYph4xyxOiYR09at9x39t+XHoz0++VPMHZ/0Gi4tBfe2mL8P7P2srxVx5Fr0QrpnO9bQNyx4TfIiijxFaYZu1Q434QfU5x6fWiTPOP1rO6iIuEb1Xm9WunvqNywxgdf8fNJ0UaxYAzNDEmwvcH8mA2w2wKr3DUmsdfMPDxvysfo=;20:u1qrlaC+WJjC9Y/y7pDslssUB75RGP5j0Cmpfgyleoc1zDxh7i9UeY0bzYTG+lYo1qIyrsnzez2jbdD2L7qq7+qLDzTPrYgVadts5KO79KgxCETxvOwwytEXpBV1kCcpzfE+oWIUeck+dSSEE4me7AeLvH8GF4I3KHNMoXOsbblAZRAdj13reE72cJKOYAey2cS3avk0XmbO/ONl6Hicvp4C4Sf0cGd5/aYy8y9zULCO7w0uzrh/869VZG8UliAyFfur2whMM4W2im+loTuNOIAZeH4H567Y+OAs/3eV5ncVLILq0Sp+QoXeCM+eb7l0/tRgG/5UXKmHsycDsSd+q4oAo6HegkkeDEm5w0ZDC4eqWTfuwJmimVMOXRQpnH9icvF8+RyNXDQ9AD5Ah5Zjrq+0T6/p8yoQ9wayc+41PQx9+ooLhg4zRI7KNxurxj6I4dHZ9RoVJ6X7uomHEfViapp3GDT2rex/Cbm31LG4mKXnioffO9kqDqAbzvHRU/+6 X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:(166708455590820); X-Exchange-Antispam-Report-CFA-Test: BCL:0;PCL:0;RULEID:(6040450)(601004)(2401047)(5005006)(8121501046)(10201501046)(3002001)(93006095)(93001095)(6041248)(20161123562025)(20161123555025)(20161123560025)(201703131423075)(201702281528075)(201703061421075)(20161123564025)(6072148);SRVR:CY4PR15MB1191;BCL:0;PCL:0;RULEID:;SRVR:CY4PR15MB1191; X-Microsoft-Exchange-Diagnostics: 1;CY4PR15MB1191;4:qskcVS1MW7/cPSS8EAOz9qPWu3dqr/B8x4KF2szFLBRaLkY9V89o4m7ArxGbsAFkB88b9wVPKwGl8ImmCBzZBNeWrF0XG/P6Wa7qB68uN61k6AyTfZ+o3MNycTAJxa/YaJRMuegIxIJ4UjIctSLjrBd3/+X+T6Q4WQ4XsCf8tk1FgvWrPG3ZBFUSCBt/PKDrLetoMNX6jH3inXs+J9xSuWBirvW0NzUe98rvbzyvCIUGr0Ohk3f+9JdLJ4kvH6PzPVLFnnenjZc1RXGh89vI/Ph8BdP2dcdtW14/bBzgPHO6FfzeHkVuJcmX76gAFTMgX6agzrTXEKsoS7u5F/4T8Rzt0KpvDbmcKt0JSgNXZijyNYJL3sM8xmIfuVtEj2xbsviudEKPN7zsQ5kHUtTg90SGeLZzM30Ab7Ezh9Kgtr1cgPvE9RuXd1ro+b1nmuMIF170aplgaXdyGVSHqm/JPgKQOacZTSpxRED6eVn0xsM/II95K+tCWO7absk6mqDkWJ4gT0rHr4+sPI1ps9bo7cNO2xM9s0MLZJT5FRfwR/WCBeT0qHDtxYfgR2+Vo9dLn83OpuMDpcSi9ycMpzaorsTlPLuZZ8lZTaPLjMwE+0tPNA23IGNyWpW7VRxfGRUpC5xh8YS4VVrFx8U+tzUSHkHZnYPNWVBe2G/a1yazId426JgPIJ/bVoqywSmpWfYBGXnVUwE1/+KZnsbKsGrym/4co6m261YJma7jDDKzim3IerjH1KGcAnq2K2Il6OGekhmFrPlLaVuOPWS3rsoxzA== X-Forefront-PRVS: 0279B3DD0D X-Forefront-Antispam-Report: SFV:NSPM;SFS:(10019020)(4630300001)(6049001)(6009001)(39410400002)(39400400002)(39450400003)(39850400002)(39840400002)(377454003)(24454002)(110136004)(6116002)(81166006)(2906002)(42186005)(8676002)(31686004)(3846002)(64126003)(50466002)(53936002)(38730400002)(54906002)(6306002)(31696002)(77096006)(6916009)(2950100002)(6486002)(86362001)(54356999)(117156002)(6666003)(4001350100001)(36756003)(83506001)(5660300001)(189998001)(6246003)(65956001)(33646002)(2870700001)(66066001)(65806001)(76176999)(53546009)(4326008)(50986999)(305945005)(47776003)(7736002)(25786009)(23676002)(217873001);DIR:OUT;SFP:1102;SCL:1;SRVR:CY4PR15MB1191;H:[192.168.1.105];FPR:;SPF:None;MLV:sfv;LANG:en; X-Microsoft-Exchange-Diagnostics: =?utf-8?B?MTtDWTRQUjE1TUIxMTkxOzIzOjRINWNLS3FVdndGS3UwZjhnL2hjVmdDYmtF?= =?utf-8?B?TGpkWVI3M0NlQXNvZE4ra1hiUi8zNjlJdmd2MDEwZTkwc0Q3TzlIcElaTHpr?= =?utf-8?B?c1hMVnNSNWNTa0NqNXdsNTVsRTh6Tklib2d1dll3MStlNGVyT0VMR2NIRTkv?= =?utf-8?B?RGtPVW1td25MVGhiNytOdHhUUWRvKzMrd2hDK0J6azMwV1FrWUo1MGU2SE4r?= =?utf-8?B?anYycW1uODZ2cE1peElJalV1bkJYbGFWUGpvL3dkMHNRZEdvQmxyOVB5aFFP?= =?utf-8?B?ZHFnTkdzdnBrbWdEMFFFaGIxcTd6K3U1UWRtdXV3QXpMejRwZjR1Y2szemNt?= =?utf-8?B?T3Y3NnFYeWhZTEx0R1FaRGtadnRhUlNDTFRWUTVhbUZBMXdvVzRWNVB6aVZ0?= =?utf-8?B?cWlIeWQ5eG5JaktXWWF4b2hHOXZpNEZvNDBKejlkdXdpeUhLQStIWnlqbXNH?= =?utf-8?B?T0FSTGlET1lnTWlmaG9NbEJXbWxpaGZWZkc0aUNwS0tJblhwcDZDZFFvY3BC?= =?utf-8?B?M0Jha0NQaTBpU01TVXcrT3pNeWJoZmNGaTZOUjZHRkw1L1FRWE9nV21NTnlP?= =?utf-8?B?NFJ0eHpGVUJjc2RvUWZ5SWRTWmFHdVJOM3BFWFBCTEVCSTBRcStiQzhFZXFj?= =?utf-8?B?dlh1QjBsVjJVUGYzTCsxdlUydDhSRjkxeWZ1RGFQZ1lUdUtxeitsb2J1RGJ2?= =?utf-8?B?SzNFUDBuSDFGR2pKVzN0RlhRZVk1WkVxT01kQVlCNDZFMTVtRG14anBWUUQr?= =?utf-8?B?Z1lDc0hDRWVkeER0MnE4cEtlVlhWQUlhRVV2MkNuaGRQTk9aWXpyQ004RUNy?= =?utf-8?B?T09yN0Yybm5vUzk0M1NzUGhuVzZndlMrWUdTQzJoQzRzNlcxQWRUc2dnUXdy?= =?utf-8?B?enlrMDJvMWtuY0dDV3p2UEVqTHhtQXZkZjl2dkZROUNGdmVmbmtpeExBSjNC?= =?utf-8?B?Z0VoZzVCZWttVk54bW1UUmVWNW8xUlNiVDgzaFJycGZ2TlRiMzZmYzNFaTlz?= =?utf-8?B?MHhDbGd5VzBiSDJiTUp1N3I4YmJsWVNlcW9xWlB4TUxvZGlwUXI0TEdpZVJm?= =?utf-8?B?WmFEZmVyMlZWNFU2MXcwQTBHZVdSeDBLMWpVTUFXN2tucUs5U0JKeG9iNDJn?= =?utf-8?B?Uml6dHpFUmUwUGw0SGMvRFVURGNYSHdSbENGQlFKcGptT1FzKzJiYWoveE1Y?= =?utf-8?B?cGlFcTZIdWhGRTVsc1N4VGJYUVdHTXlFeTVvS0N6TDhnUlFjSDQ0UjhCeGZH?= =?utf-8?B?Q0ZRUzIvU1RIZnBmNkVRYWh6bWx0bUZyMFJmVHgway9ucVMxdkx5SXdQclhk?= =?utf-8?B?TmpQQVJTNWJqK0tuYVRzZTFQTUdlSmc1MnRJOVltL3EwQWdjLzB2UWVqa1lk?= =?utf-8?B?T2RQTWxCOGhPUmtCdVdUNGhxaWpRWk4zMGlCVXp2anhTK3YxUW1zTFY2d1Zh?= =?utf-8?B?T2Q1NFNmNkEvZkx5bEw5dC94cnpsZSt3QlRyQjlpdzJSS3JUZGpFdUZhTW5t?= =?utf-8?B?MFNlT2ZTWS9kb2NzQWZGRWExQ0pJY2kxclA1MVdBcmdQcHI3YnY4MUZnejQw?= =?utf-8?B?Rm4wcFU1YUx2cTM3SldMN04va0ZkeEt2RG41MTZXVXU4bk83MjlOdlZ5clJ0?= =?utf-8?B?NUFrMzltNUhvZTdudFMyM3AwM3dZck9jdlF0U0ozMVNEQXpJZ0FhU0xESWRK?= =?utf-8?B?ZTBYT3Baa3FkUGtjQnREVDloUFZXaWpmV1JCUTU3aUZuNzNtWmlqaEpBWnZ6?= =?utf-8?B?Z3ovNGZNVkR1YUlNT1dJT2tZc3lWTVFXK0g1Si9MeU5ITjhubCtMdDcrWnBs?= =?utf-8?Q?Ab4NQyrjDMMs6?= X-Microsoft-Exchange-Diagnostics: 1;CY4PR15MB1191;6:7tyou1o2kN5EEZh0g8T8tvEOQhCafKJsFWG2amMa091zengqy5JxRDekx/eR1Byg4YMpAP6DECZMN/OOnGJCkQdM96P3EHQ9MerV1mtVl6XRiJppj/3c4pFzT33po/9Ea42JCPgFCIfRKiRjtMiJpYsnPLPyqkbOGO3zwK/q4ErdoV7+wLWQ0IGZndPy1vvWk/zsI/XwqxAWWUGXNfcbKA/C08TRGbbPZylvixanh0RseXX1Kg4kqu9tD69Xn0irt3Q97di3Q47MIDAej7ZdAn7TJo9GSGQVLEZvV5oPz/2Pg0ccHcR6umnvlCjo3OW+AH4ohOpMO1G7scRKo4elRTBH0C+bWdxtlmleNWMAPUy5LDgDC9CNzGFYM+rUIyf21eRXg6ztrAvB3OQQxzcSWCNXHTmkdUY6DGwW8uxaQSZZqJ7iEBT1F1VBTZTB5d89FYWNbLQshDBStFkZS4e7Cw==;5:P6L0rkixb3G1ewh0+rRo1MPoL9SKQC6UUfInd8E3pxjbxuQxkmcwazcFZvdsjHe1HSfBquYunIwQweE+06QoYd5Rq64nk6EIDT5gNq5ssjZ7PF2cyEkLASBJk008e0Tyh+cgUHDSLAlj/1wD4fbexA==;24:LrFnXNJeI7o0u+iKLG7fKzHBqQGg1IZokHZJ0EPorTPMd3G7k360uFSc64P4/4b1Bl/4Z5OXu8NBPc4Cjwl64gKeHSD2TL4a+/q2+DvFy1o= SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-Microsoft-Exchange-Diagnostics: 1;CY4PR15MB1191;7:zZdQ584Uq1wCFnRzhFBDetcOZ3Jj55s3zsl7ze0PyGPQNzqJxmmUtILWaIeAC660X1RlBOAR7z/srVj0dy6j8Zxj/u+BEq5Xan8KRJVeJnkjxxJLxSz3MBX/CUqTJF7FPbXebX77epeuFfvE6YVNRddF13LR3WHToXgZ/sQhC/zC0Sb2pihp0Bj+48caTRB+J+B2pUCERXQi5DCMKNyJM3b0vqAb/Hd+GfdW7BEC7ay20DVhMLAPPdeIXBwt6zjsoWANux2KyPOeqryS8MwrSuA6ikHbsSJKF84p+FPnIMKkybLX39JxGLF4fReTHyhf1kQq6saMDjMtdvGuP00k7A==;20:AvkEbapV51aUkZ8i6myCAR6qOHm4HaCjaQfIs6z+LCRegQ0eBuoBS+4t3ZXFL/VsCclVZwjF85m0CtCScGKonKCQhLS5mqdDbnoBGKKrg/EUBC2ZVmx6+KauQLMk+ld2qMXeoVfMIq9SYKGZBm5amsWS1K8za7ILpDFWfBb/zwE= X-MS-Exchange-CrossTenant-OriginalArrivalTime: 16 Apr 2017 20:37:24.5130 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY4PR15MB1191 X-OriginatorOrg: fb.com X-Proofpoint-Spam-Reason: safe X-FB-Internal: Safe X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:,, definitions=2017-04-16_19:,, signatures=0 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 04/15/2017 12:55 PM, Matias Bjørling wrote: > Hi Jens, > > With this merge window, we like to push pblk upstream. It is a new > host-side translation layer that implements support for exposing > Open-Channel SSDs as block devices. > > We have described pblk in the LightNVM paper "LightNVM: The Linux > Open-Channel SSD Subsystem" that was accepted at FAST 2017. The paper > defines open-channel SSDs, the subsystem, pblk and has an evaluation as > well. Over the past couple of kernel versions we have shipped the > support patches for pblk, and we are now comfortable pushing the core of > pblk upstream. > > The core contains the logic to control data placement and I/O scheduling > on open-channel SSDs. Including implementation of translation table > management, GC, recovery, rate-limiting, and similar components. It > assumes that the SSD is media-agnostic, and runs on both 1.2 and 2.0 of > the Open-Channel SSD specification without modifications. > > I want to point out two neat features of pblk. First, pblk can be > instantiated multiple times on the same SSD, enabling I/O isolation > between tenants, and makes it able to fulfill strict QoS requirements. > We showed results from this at the NVMW '17 workshop this year, while > presenting the "Multi-Tenant I/O Isolation with Open-Channel SSDs" talk. > Second, now that a full host-side translation layer is implemented, one > can begin to optimize its data placement and I/O scheduling algorithms > to match user workloads. We have shown a couple of the benefits in the > LightNVM paper, and we know of a couple of companies and universities > that have begun making new algorithms. > > In detail, this pull request contains: > > - The new host-side FTL pblk from Javier, and other contributors. > > - Add support to the "create" ioctl to force a target to be > re-initialized at using "factory" flag from Javier. > > - Fix various errors in LightNVM core from Javier and me. > > - An optimization from Neil Brown to skip error checking on mempool > allocations that can sleep. > > - A buffer overflow fix in nvme_nvm_identify from Scott Bauer. > > - Fix for bad block discovery handle error handling from Christophe > Jaillet. > > - Fixes from Dan Carpenter to pblk after it went into linux-next. > > Please pull from the for-jens branch or apply the patches posted with > this mail: > > https://github.com/OpenChannelSSD/linux.git for-jens Applied for 4.12, thanks Matias. -- Jens Axboe