From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1757419AbcIVOYy (ORCPT ); Thu, 22 Sep 2016 10:24:54 -0400 Received: from mx0b-00082601.pphosted.com ([67.231.153.30]:57454 "EHLO mx0a-00082601.pphosted.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1756956AbcIVOYt (ORCPT ); Thu, 22 Sep 2016 10:24:49 -0400 Subject: Re: [PATCH v4 0/3] nvme power saving To: Andy Lutomirski , Keith Busch References: CC: , Christoph Hellwig , , J Freyensee From: Jens Axboe Message-ID: <13b0fe95-01b8-89d7-df76-efc1aa14b27a@fb.com> Date: Thu, 22 Sep 2016 08:23:35 -0600 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.2.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset="windows-1252"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [216.160.245.98] X-ClientProxiedBy: DM3PR20CA0019.namprd20.prod.outlook.com (10.165.25.32) To BN6PR15MB1188.namprd15.prod.outlook.com (10.172.205.142) X-MS-Office365-Filtering-Correlation-Id: a61a0686-0bef-4e81-6b66-08d3e2f40c68 X-Microsoft-Exchange-Diagnostics: 1;BN6PR15MB1188;2:Tery8TS2LVUkHHMFD/5VTnYhQygEhKm9chX7oz9i/PTkKuX0JqvDR9AYGfTw0rOo2/nP8cLaFTOG9JyxsHd6VcXQ034hlwq9Jt0wvZPTuQytGOGk/YfLJ9vUBDf5d2OTL9Ep4JQQ80liCC+iNIP+BhLzrqDoUcew+xCJg4LsmVWPS6Bi3H7ytN3qAC7a1I06;3:WKj833W14HSqqCVGdCdU1p6iZFC/25rxKOVBf1pb5OZdQWwwDfw4YsLgM8mM93rQT8IhEw63U+fp2drOeuiTlipn4a1xezx752CSOAhMt8kxJwwqDDVTOqtQfnQII2X9;25:sZzRdtuwJz5IRKiQIG12USAewj/o8FEcnzPG/q2Cxkr2ddhxBZ1cWc/rd2PzSuC4ii72SiaFNzKHOfcxm16xZi/BmI8/yMLhOZxSNLkCuNKiahpkSPMxBSQ9+t/Q9TELJzJr6ZcK9i9lEmM6I5UD9Bc867ED8WCVJEhhPWubyoIf8tGz1Q0cMdMu6sAL+KeGPd6PwMdtIQb3+Ezm+GhzHIsI991QVyuLQs2doa2O0i9c3wiLLbW1yS4CVUuCD/cAjU5wKy2qBL0HEC1Ib+2V1v9ywr3ltkRQ2QgK1sXXr9KUUohY35p4artiNxtGhUsxzpDeCfvSl7XXdSKjDuOHVKrguWtVpLoFvY1F2TxRruFMgOZ6qUOyJi3ChEGk4DzBuI0LlKAfhDrkkSAa+a4DmT4FSY6aN61jqoeq0Ub9OkU= X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:BN6PR15MB1188; X-Microsoft-Exchange-Diagnostics: 1;BN6PR15MB1188;31:MrtWk/6Bt8FiCJMPWMRMqiBKBlPa2Gdrz1pbto6xkYxYSARlgRCOmjE5Tij2lbihE/3e9Ca17snNWNGtPsTKrr4sugCdT/vFnMxC1/e12H4HQP4psOHUQd6egSL9WAkqBrt1qhwU31BK2/H0uRxu1s3zi2eYBqPmshkrSaI7/ILv9VuxZDHGOl0ywRZADLCUauyZCy2c8XYzn/3S5961cgV+NJ2rfSdq6JXQ6GRjYIo=;20:uKkO2CnmcDFibPQkOvcpCrWLN8aZrdRHl3Vy6XWlKtMjtaZQyjRL6CYJBKLaSGovfWrw/qVLhuDPgNR4xIqw6tsi5smfh70qouMotGy5PC9df4gODpdi+LPCo2Q53MsM6MSww6np4DhUQCD+IyWK6vWo/jCM597c9RL+zVEtjIk=;4:fX3WRkPkZm7TnMwi0SldYUBaq6cG/N+Lp1sRWveYkLh192AUKJPr8ys+Ve82FEDtyDWbMlSufHFbQ8AtdSCrxZjUjbNSJucnQHd8MRC3eNb9TnxElK+Cjiw+m7qZMxOHUn1PQfajGjqmXvV6VP7FiY2+pPuDGv8/4oi1sEOCDflKL/hF6SlnmrLtWrkcru+dqSBglkpQIJA9hbZYLRR7QlxPkagduDSqt19Lqa1c5trbdOWElsm6xIaecgy7tBzoyGlQPd0r8UBf9/K+H4lCJAXWF93tNqdxYfnQ+POlzsYVTOWujmBgOY1Wcu75d12J9WUWeCoaYD3gpQt9eS+ByuWWy2OXKGXfxCar8CyI0a+bc58073ZrmP0bvvjQ6Ud38E9B3hMeGbFirVHqyvecwg== X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0;PCL:0;RULEID:(6040176)(601004)(2401047)(8121501046)(5005006)(10201501046)(3002001);SRVR:BN6PR15MB1188;BCL:0;PCL:0;RULEID:;SRVR:BN6PR15MB1188; X-Forefront-PRVS: 0073BFEF03 X-Forefront-Antispam-Report: SFV:NSPM;SFS:(10019020)(4630300001)(6049001)(6009001)(7916002)(53754006)(199003)(377454003)(24454002)(189002)(65956001)(23746002)(66066001)(31686004)(83506001)(305945005)(47776003)(7846002)(50986999)(64126003)(65806001)(5660300001)(68736007)(77096005)(7736002)(2950100001)(54356999)(50466002)(6116002)(101416001)(76176999)(86362001)(4326007)(2906002)(586003)(3846002)(105586002)(92566002)(4001350100001)(5001770100001)(97736004)(189998001)(36756003)(42186005)(31696002)(8676002)(65826007)(230700001)(33646002)(81156014)(106356001)(81166006)(117156001);DIR:OUT;SFP:1102;SCL:1;SRVR:BN6PR15MB1188;H:[192.168.1.153];FPR:;SPF:None;PTR:InfoNoRecords;A:1;MX:1;LANG:en; X-Microsoft-Exchange-Diagnostics: =?Windows-1252?Q?1;BN6PR15MB1188;23:B4YDCvkSKQzhmqbZye2ZV3kFvaISYJl7Ybqpe?= =?Windows-1252?Q?ibIN8rJnwSEY6iQqZUfpTeHrzsmvW8fM69iyIJsyuSXoHJ1kew6TmBh9?= =?Windows-1252?Q?jSeXgg1U139lPYvPmtJ5h87+wKJQ24HU8uinm9/09g9/Ywrm/0l5XHnM?= =?Windows-1252?Q?41Ci0HXgNk05fI3OM4UWYTLeCTbQhp7OvcHt9qwmB2Pfywc415ZAaO5H?= =?Windows-1252?Q?qSmFHFZEFJs+AjEjYW1nx6hz0ltO8FNOWmhqu7uhUsTsA6B2zddic3Wf?= =?Windows-1252?Q?4cVnS46SdMN7pFX2OuxsW9CXSQ9cXyJMYsZaE+2QtZOwRyZgxld0WoVW?= =?Windows-1252?Q?9Qm7ECG+v2Xgn3C8UkJ0AYnXUXlEvNvodV8t2s7D/YSc5vKygUpgT69C?= =?Windows-1252?Q?BoUjYyIrIMsMh8nBPCwP+ca0cyYGEuPkp+2ogQmepNLNb94QZvH1sUUg?= =?Windows-1252?Q?jeDF0r15jqEEpIBOJyYV5h1U8VErZiNAIdhVXBnfRYhoD6S0QHRKs1aV?= =?Windows-1252?Q?GoYCfjt8EPUZqHTaOCCTDWhil/9ALJYasVQ23spxw3LTTFeVd92ZVc8o?= =?Windows-1252?Q?mCaEVdXEJXRA0L8XIS1WlVLFmSQzfTxJ4P9XUFEymb0FNEVG8s3YEQK+?= =?Windows-1252?Q?KgTAcgV2Z/SEy9fQisjvVmMzh4tE4H6HOjB6+MTkOuxabZUcw+ORCzv1?= =?Windows-1252?Q?q+10LOPBYA82Y4hi2kyLPM+5kB/4Mc2NFRkEJIM74hbB288MXuaxuq1W?= =?Windows-1252?Q?s386trbGsLZ/E/kATwSDxbCidodvn0QL8Lk6JNm8qXCXFHB0xlmfPMy7?= =?Windows-1252?Q?CDouEyVHwO4fQsivAKWYsGgtJCPI6jBglj9bBXd8KegKsdNKtdHLT/kF?= =?Windows-1252?Q?2dENluF0BELlR08z2jCg5lcrGWaBcgycnLaad8nSRnHhPniVGTJjBl6N?= =?Windows-1252?Q?zwoUXGAddV4SNCG2f7N/7kdWHnBhkb2dZsC1N694rg8H8UlrAmCnYUWn?= =?Windows-1252?Q?EprpsjgUuL/5Ur/rr/NRXryiclHVDITBQAB8QYUGVPq07+NGkvgbCz2E?= =?Windows-1252?Q?Lg/nf446Be0IAWXojoumh8qR4K/MAo5vuSONNUkyvJZalUmeKlX+CHwt?= =?Windows-1252?Q?Km+vWgxXOzYZaNA/cF3iATYSeybVP9CCEZCUOBL7MM9VSs04iYxpPDJ1?= =?Windows-1252?Q?hEFFpTaME91AhkARN3NiMzLAFo0PQ05jYPWy14y6iwijUW68WHpoEmNG?= =?Windows-1252?Q?r94BNmicELFoyL0UglCM6jUvLVJCCgzpqvfS5TYUZV0dotOn12NOc3Ug?= =?Windows-1252?Q?ciYYoNmG3BapO18GNBf1Yn5HME4EFZlpyulzRm+z0J5FAATmKLOrZ9+2?= =?Windows-1252?Q?stVQ2wfftWwVvvaHmw0dn2YJPORm8dzIg=3D=3D?= X-Microsoft-Exchange-Diagnostics: 1;BN6PR15MB1188;6:YEMPnTsiihr0fL1G/hDynx27MaWTg1TJptSdBV/4NQMFpm+EExcJVhzFmoBI89PzGzprHITb7fKnY93+iPGlnpaZDC11thiRtwP+DQMnJyhPXcJ0BvtuL9rzNhwYJc1CvHDOTezteadXYdYY6SZYJYOgwJ9E3pQ70eB8oJWSOFEOMsdd6ttMFIZQUN//ZKsiuvK6oiarT+cm6ffYn59Z5BkAE2D6oSzgCtmToqwtcxRAUPn4YynkOJVUhcbbRHQcpGNrwsgbaoErDFEOP1H4YB12yQiamOomS1uIzhw8u/s=;5:/FB/SD4dG8fgTdw4f+beeSAQJgc+2SP3+piHey9itN/8RTLo5f8qel55sEDiRxm2/4ZEOUkpK2PmktWPl8l8SqapGK0yAVkLwlmneCXXY4GlpCw70V1Kmgm0JCwLbNZmYtdCrz+1aIkvf+P3AUSz9w==;24:91oz4OrmsODRMFpv1fZoYWuuvYk3cNFUzaO1cCW1pGCkXeyxmY254En+jhWftyD5MBmgTqikaU7WccEZ/JUlsu5k1hJQ0HHcueWcMV8Jqp0=;7:QCr9WiEbZ+YTGvxXJ3H3CnPLcIfozd/E6oWkCRbQJRhHtclilp7u6q0PIm9+hPu7HNYNnHv8ASr5GXxPW2B0kOlC/0igD6CbkEC8Gk0P7PqZU1YglidRb+36bzw5tYugcL1LEbnIxFaY07LhBZRY5+OReEnMMh2enFif5semJxxDZuu5jJkpu76eCqIvr8ADptMwerYh+fNx0DnGu5BsU8+HPE5Y0TLeutIDChR/y1yET/STnFuGke3C3bu8Z28GiBqast8HyAAMD108fQLXCGhX3vEWYlsrtvj8P8k3ejoQqmqMZS+EqJ01dQcCvk/w SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-Microsoft-Exchange-Diagnostics: 1;BN6PR15MB1188;20:07j2jXN6aCSvrVifEOzl9Az5eQpz+/PuAlFYpIqhegIBoevxtEXReucycAed2JoIvGxBMvBsqum7XGB67V/3Tav+0jNQ900TGTw2XLQXyEUX4Upr7S72cJOD+FL219FDMJXsivrirWKQGhEjb0scXsnMvhPREVvmTlXJSYV2u6Y= X-MS-Exchange-CrossTenant-OriginalArrivalTime: 22 Sep 2016 14:23:39.1394 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN6PR15MB1188 X-OriginatorOrg: fb.com X-Proofpoint-Spam-Reason: safe X-FB-Internal: Safe X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:,, definitions=2016-09-22_07:,, signatures=0 Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 09/16/2016 12:16 PM, Andy Lutomirski wrote: > Hi all- > > Here's v4 of the APST patch set. The biggest bikesheddable thing (I > think) is the scaling factor. I currently have it hardcoded so that > we wait 50x the total latency before entering a power saving state. > On my Samsung 950, this means we enter state 3 (70mW, 0.5ms entry > latency, 5ms exit latency) after 275ms and state 4 (5mW, 2ms entry > latency, 22ms exit latency) after 1200ms. I have the default max > latency set to 25ms. > > FWIW, in practice, the latency this introduces seems to be well > under 22ms, but my benchmark is a bit silly and I might have > measured it wrong. I certainly haven't observed a slowdown just > using my laptop. > > This time around, I changed the names of parameters after Jay > Frayensee got confused by the first try. Now they are: > > - ps_max_latency_us in sysfs: actually controls it. > - nvme_core.default_ps_max_latency_us: sets the default. > > Yeah, they're mouthfuls, but they should be clearer now. The only thing I don't like about this is the fact that's it's a driver private thing. Similar to ALPM on SATA, it's yet another knob that needs to be set. It we put it somewhere generic, then at least we could potentially use it in a generic fashion. Additionally, it should not be on by default. -- Jens Axboe