From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from NAM11-DM6-obe.outbound.protection.outlook.com (mail-dm6nam11on2067.outbound.protection.outlook.com [40.107.223.67]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id F00A221ADD3 for ; Fri, 24 Jan 2025 11:41:47 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=40.107.223.67 ARC-Seal:i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1737718909; cv=fail; b=b13HCquxcwkfAyupKqfgzCq64fShUqPs/IfkLVEWGMG3aTaWrV5YTSAhnaFMgTanBub0VXTpRxiasuO6UtkexsSIKyTVD3Gqps1pZQaXB7L/z3KuqlNW0J71UnUdxC+1QUrgoq5zDGm26JE8bMV9zlcqOxJFB96LaIY40U7RVMc= ARC-Message-Signature:i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1737718909; c=relaxed/simple; bh=l7Vt652ZizAIiZmD6hfYR+3raH01AwqESIB2TrVrdT4=; h=Message-ID:Date:Subject:To:Cc:References:From:In-Reply-To: Content-Type:MIME-Version; b=GYnl8qRMTUyouYC/VejNvQQw0KYhCDAx5//5NpRISA5VKP9Uu+DyVyY1adHTq0x7E9ga9Hq0gvq8lrwBO0pAgSEQBL+0SsttJGahXlyfq4JWKtOBE9IpJD6vQsQPFrGjDDE8YCXPmgxeRKS4PFDNCj95YGCOgJVghLOMSwWdVqs= ARC-Authentication-Results:i=2; smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=amd.com; spf=fail smtp.mailfrom=amd.com; dkim=pass (1024-bit key) header.d=amd.com header.i=@amd.com header.b=u3HeAr62; arc=fail smtp.client-ip=40.107.223.67 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=amd.com Authentication-Results: smtp.subspace.kernel.org; spf=fail smtp.mailfrom=amd.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=amd.com header.i=@amd.com header.b="u3HeAr62" ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=Yleq+DwYuFZoani5a37jbTn2n2bmchWLgAUi9vLspihwUjDQKge/ScGTLZ/haIVRKvtj+cJxlPJqiUzb7DJ8Z+0rnXwgQMEiTtCEEU4/rbncak/vktv7ZCXt4oC7WquDNoJBqX36ltIXdby2Tc7n7aP/7uyN2OJu7PUuPausDm9d8bdXa9Wq8+DSvRatw201itriM+Fyl+s6ReNm7KkhyzDbCaOZuaLFSvi/Ex9uoxWvRxouOEja3bv0Xx+fDwYhFMdCcZSaTHyFgTVg329ycFxNcYfBses3XSJ1Qd9rR2EyMaJnXW+CHIwR2Cbv3lekSswK5comltJ06X+0+LZyxw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=uZ0ftIHGzGHRGBi5Lqc3kRCjz8jqsT1RZwXu0PuGKHg=; b=o30L8J5bd1aRyixPXvnY9r4tlcSZk8xWTYjQd/Hl87p68uT10Wth1uxik/gz7pcGhs6j62rfucFbRKYXgNBmyZk0nRT6qhz/EBq10ueervYpiCFU2WYbs3ML5TjAsd1ngY6rMEmsLs6jPAi3raSWAHkYfOeKUgfrm5tiwz5hURuT5XkG04MeLYNx5O7N8vhO2JXgsyyDZ0uO0op7ut+9RnuIu9sYTb0T2rQJOaDHSvbKu/7D2eybcarV4vqSAQXISjrHeVtLAey1m2MTeu4bZYHZ2wCYIKmJdMddTzy+IYcRKGjxLEeu0miI/PsXsZdLsS3+cPv/chc1SPRujZP98A== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=amd.com; dmarc=pass action=none header.from=amd.com; dkim=pass header.d=amd.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amd.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=uZ0ftIHGzGHRGBi5Lqc3kRCjz8jqsT1RZwXu0PuGKHg=; b=u3HeAr62UVAuU9Ew7if8xZ/HfXzDm0PD3WcxrpXDX5/+f/F4bDrsE2D2hnMDoU8OPKkh1NmWc2EJfiHomxh5NjNc5xVchKrrPeFz6SSYmFYXMS64oDhTETqXFfyddDAyVCpGRpTEJpr8VrBQnM+9qD18rDHie96lP4gRSuY3W24= Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=amd.com; Received: from DS7PR12MB6214.namprd12.prod.outlook.com (2603:10b6:8:96::13) by IA0PR12MB7554.namprd12.prod.outlook.com (2603:10b6:208:43e::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8377.17; Fri, 24 Jan 2025 11:41:45 +0000 Received: from DS7PR12MB6214.namprd12.prod.outlook.com ([fe80::17e6:16c7:6bc1:26fb]) by DS7PR12MB6214.namprd12.prod.outlook.com ([fe80::17e6:16c7:6bc1:26fb%4]) with mapi id 15.20.8356.020; Fri, 24 Jan 2025 11:41:45 +0000 Message-ID: <431442a7-e62b-4892-9f3c-6fbdb97a7722@amd.com> Date: Fri, 24 Jan 2025 17:11:34 +0530 User-Agent: Mozilla Thunderbird Subject: Re: [PATCH v6 00/12] AMD broadcast TLB invalidation To: Rik van Riel , x86@kernel.org Cc: linux-kernel@vger.kernel.org, bp@alien8.de, peterz@infradead.org, dave.hansen@linux.intel.com, zhengqi.arch@bytedance.com, nadav.amit@gmail.com, thomas.lendacky@amd.com, kernel-team@meta.com, linux-mm@kvack.org, akpm@linux-foundation.org, jannh@google.com, mhklinux@outlook.com, andrew.cooper3@citrix.com, Manali Shukla References: <20250120024104.1924753-1-riel@surriel.com> Content-Language: en-US From: Manali Shukla In-Reply-To: <20250120024104.1924753-1-riel@surriel.com> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-ClientProxiedBy: PN2PR01CA0205.INDPRD01.PROD.OUTLOOK.COM (2603:1096:c01:e9::12) To DS7PR12MB6214.namprd12.prod.outlook.com (2603:10b6:8:96::13) Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: DS7PR12MB6214:EE_|IA0PR12MB7554:EE_ X-MS-Office365-Filtering-Correlation-Id: f4279082-e8ae-40c8-a763-08dd3c6c1433 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|1800799024|376014|7416014|366016; X-Microsoft-Antispam-Message-Info: =?utf-8?B?QmVJUjRPUHVYVTR2cXJobzZyVWZ5QjQ1dzNHU0RlUmMrRWVNenBTLzlJWDNt?= =?utf-8?B?WC9EWHBGQWEyc1RhM2VhQXBZU2hLUEc5ZVdIRVRhNUhaOWFDOE5qMCtwZVI1?= =?utf-8?B?SWdLNlFLYThsNmxYSSsrM1VlYzY3Z2RpbzF3YjhiK09JWW9uVWI5TEtzRTk3?= =?utf-8?B?QVZvRFpRWXRWNTFzajJJeXVCQnRvZmovTDNSdFE4YW1yODhhMFE4b0lEaTll?= =?utf-8?B?TTNKMWI3NmZBUGdlenhUT0NVUXZrdkJxOXAwUEltSjVJK0RySGNEZnJXWUI5?= =?utf-8?B?ZnpnZEVVREhrdXJaU2NvTkwvK3lMYmNPZmNZWXVjUzFBVzlVRURzS0hvVkh5?= =?utf-8?B?SExwOXJPZytnaDFWYjY3U1pJM1U3YTJZZDduM2FhdjRlZUh2a0hnQnVjTnRZ?= =?utf-8?B?VzNLRWxIVDlxL0ZqTGZIckZSU2t4aU43Wjh4c0tBMzA1aVRvbVhXUDhZZm1W?= =?utf-8?B?dXdlcXpNRDBzdEVjOEJLaHNpWG4vQ0NFbmNTUEpxM1BaVHozeTNXQlZ0RVVv?= =?utf-8?B?VmVTV0NWVTRvdDI2NnBxZjRjVWZaUjFNYm4yNWQ3aEdzNDFWRkFRRVNXZFht?= =?utf-8?B?cFFubnB2RXI4dEZVZTBwRE5iZk5QUy9EZ0RZZUhpVjZZcmhZY3Rud0pRWWt1?= =?utf-8?B?bFB1YVFoVTdid3haYTF1V2pQUnZHdklyWktRTjMzbmtEMnNSM1pZT0MzOXl6?= =?utf-8?B?NkhCbzRHUnBPazNkRk5zODVjNVZoL3RRSU5sUFFpc0ZNOFUxblVSVkFHRzB6?= =?utf-8?B?b3ZzM1hPcW9UVGxzWHhEaW10ZnBxNWt2VXFWL2xyOWF3YUtIcFNrdHpXREJk?= =?utf-8?B?bmhmWHFKWGhxNlA0YnBJelAyRUdacXZWYy9PN1UwSjlRc3BEQU1BanllK1Bw?= =?utf-8?B?bXVoU2s2VkJ0dVo0RWh1cUY2WjhRdEVzM2J4Snlmcy9WVVpEYWxRMmlwVFlC?= =?utf-8?B?SmpNQlJFZjh5MnhqVHV2Z2ZwN3U3SDlYblV2cjFXdjIzQWlBRC9HN3ROMFRW?= =?utf-8?B?cnc4TzNhM0txcTY4SXhSWWRpQUlrUjhEbk0xYkM5UHdTaC9YWEtuUndHTEZW?= =?utf-8?B?YksxeHd1ZEpQT2F0TXNQRzZ2TlpoS1VMd2xaaHZjTTE3ZVYxOHp5Mm1ZZitH?= =?utf-8?B?VnBGTFlaSjc0d1pTN2d1bU96V1BwU0dOdHhKQ1I4bHRyelVYZThKQ0JNODls?= =?utf-8?B?TnB3dnBrdkdKaXVRQXdyQmZBWlpUNzRKTVBpRjN5aXJLUEFUUERLOUovK2cw?= =?utf-8?B?Wm8vbENWbnJxaVc0ckZsMmJxSG91c21iNEdCcEhmN0hWNm9pcVFJMGd4cEhI?= =?utf-8?B?SG9PaXEyTXkzU1FRVzRJRE5jWWhLUTlKNUpqcHBxUHNmNDVMVlRuZCtnaXFw?= =?utf-8?B?ejBSUGtwTmJ2Tk93bGo5TzFpTUk5VkVIOU4xa2NYbGlnOThKRXlPMVhlTzRw?= =?utf-8?B?QUFOME5QY0hRcWlCYUcxTWM4MEIrSmVsQ3h6Z1VGeTkveTJJQ1pJTnBuR1Vj?= =?utf-8?B?SmtZZ2dYaUdCeDUrMU8wbG9DSlcwV2MxZC9vcERoU0pwUVpBWVNWQUVHU1pH?= =?utf-8?B?M2x6eEN3clVJSUhOcm05eFljK1F0ejhza1dNSUZqR05VL0cxcS9Od3RUVDRm?= =?utf-8?B?dHJETGdPa2xUUHd2Si9wNS9JL3BLN2UvenM5YkRZdEpxQ2dQK2NZOThrKzdR?= =?utf-8?B?NjFzblZnLzRHZm1QNWROSWx0NU8yUE1OM0YxZ2xoQzltY0hrSzdJM25pV0Jw?= =?utf-8?B?MHNRcy9qT2JlYlhrYXQ3TzJYK3RXZE1FZTBVdEFaNWd4bEh2Nm9LaGY0Zzcz?= =?utf-8?B?REpPbGV1a3YxNXdrTWdwdz09?= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:DS7PR12MB6214.namprd12.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(1800799024)(376014)(7416014)(366016);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?TDc2NlBNbVpUM2tGQVVBSkxhMmliQkNhWndBblBtTjFuSlFSN1pFbndXaVJW?= =?utf-8?B?QWRNRk9JbkNKZStHMmxLdUsyRDlsODg1NG5WeGhWd2RCdXdMaCttQVdDRFkw?= =?utf-8?B?dm1pL25OOHM3UUxaMmRaU2ovTS83bUFlMytEZTdkWlNSdHpuVys4VjcvaW94?= =?utf-8?B?SVFEZkFINTBtUmg2NDZzT0tVNi85bVI0MXQzSDB0cnNKOVI4TG04SXBXaC9a?= =?utf-8?B?dFBPMThuUWh0bnZXMVI1YnlneGNLdS96dGN4OW4zOVZ0eXpNUTE1SmpJcE1R?= =?utf-8?B?dUxiY25JcjRqL2tOdHBnRTdrNmkvVzE0TVVJUEs0TnN1UUQ4c1dQclc4Mnd0?= =?utf-8?B?MTgwR1VrNEJabytWNDhQVWFSS282NnE0b3lreFc5K1NDVjNjV2hpQXVjaTZ1?= =?utf-8?B?cHBpeFV2SVgvaHZpeXZObUNDeDd0TFpTOTFMZFRhd2tlOXprb3N6Y1dvbmdw?= =?utf-8?B?ZGpCMExzMHE4TWlBeitvWHlTclJRK3Bkb1paTDU5MHRqNjhERGw0V1Rkbml2?= =?utf-8?B?NHRqaXI0dVcxMVpHWFl3SytDOG1hWHBqYkFjaFBsbHdRMktyb3hoSGdUc1Jh?= =?utf-8?B?NFRKUGNObXhhaW9DejZoaHdweXB0MFVNSWVBYWN3TGs2djNKTDZJREJIbUtt?= =?utf-8?B?MXFZYXpJYzh4Q29ScWQ1UERGR25yQ2pnRTFkTzdCOXYrK3JFMGQ3Vm13ZmNt?= =?utf-8?B?S1BZWVdLSERkbnBHdU5tYVVYeGtFZjNodWQwTTZLMkIrVzdZUlJsbzVUeXY0?= =?utf-8?B?Zmw1M3NsakpGRmxMUks0VGNuMlVvR0k5M2dpTllvQkYwc2xhSk05Wkk1Nisr?= =?utf-8?B?TEIrY0lOcmJJblpxa3hrenJQeSs4ZTdXbXhqUFdVaVIvMFY0dGVlWjV2dFEz?= =?utf-8?B?MVlBSmtxeDVaMTZLRjc5WWFQT0d3d0dGOTkrS2NxRWFyTmhZanUweXBjY2xr?= =?utf-8?B?eFg0YXA3RWhmeGlOUXZNcUFTMmc5ZlhOT0FQb2N4cUJVaDFNYmp2QWxFRlZW?= =?utf-8?B?TFpkZTBlTHhjV2o1NXZLeXB1TXZrZExIdUNZYkt0eTk2OFJoNWhuaWlQZkV3?= =?utf-8?B?a2ZMRlJ1eU1ORjFUdFU4WCtYbkFGejNHVUtudzhVd3llYmd5K25ZNG9XUUVK?= =?utf-8?B?Zmp4NlY1QTl1V2lNc1hBZisraU8vMmpweTltY1pwZFNWc09vajB6L2k3cHVV?= =?utf-8?B?OGRvRGZDY3VKbjFSK1NMY21xc2xOVVpZamI5bVJXWU1WdE9rTXVBOU9IYldK?= =?utf-8?B?YzFIc2dralZhdnAreVppQ1J1YUM2cVlNNjhIL2RRV1RML0I0cXk5T3JIWHU0?= =?utf-8?B?VnphZktwdWVVZ0lrNDhmMEFRV284L3FkVDQ2T1hRTzEzLzB0SWcxQytFNnJX?= =?utf-8?B?TW5OS0c3cFREZmhuTWRtUFE2S0ZaL0xwMkppU2paOHJoZ1VRdk9TTWFMcEJt?= =?utf-8?B?aXYvdzAxVWs0V0lXWGJIUmdnUXRhUGNLckJEOWhKejFwQUV6dVJZK3Q4RGpo?= =?utf-8?B?VUpvZDNoZFJ5L0VZM1VGUXJiWUcvcjlTdng2ZE1LMUhIK25XdUYxYmJyRzhs?= =?utf-8?B?bUZIOE5rcXVTamppVGNzNlpTbjlhRk5CamVJbmhjNFhCbWNNM2d0NG52ejNl?= =?utf-8?B?aE5FcHpaelg5TXNVczFycllQYUUwZ091OU5udFpiZjhNVG1FQ0UyVU0ySytv?= =?utf-8?B?NU5Qam9PaTRTQmtpTXluRVRuSzJ3RmRwSndpQnExUWhFeCtrY21MSE03M2VY?= =?utf-8?B?RVFidk1GMWU2NEUzNVRVUmhZdllLWTB1QitCV3pTV3A4YUc1eVhhL0F4Wnov?= =?utf-8?B?V28wNDNsZUh4eHhhNTFVVzlhWEJrK2VFbVU5S2J3amVWZ0tndC85Rk9RSmE4?= =?utf-8?B?bDArUDBqZ2tyVXo5TmlETjhpR3dqa1lPRHFsQ0dMdjcxVE5WSDBvVXYzemJ3?= =?utf-8?B?ZGxudUNVYW5uOTArWWFxUXZBZWJXT25leXpQSG9CVTdTcGFtOE9KL3ZtaFJF?= =?utf-8?B?MzYzcWQ5MzBOM2hkekdLYW9keVFhZXhpUVl3RUpuaVp6b2gvNXRtQi9VcFZh?= =?utf-8?B?RXNaY0FTU2Zxb0ZERGluNEh3MkdkdnM5UFZtSVBNclVnNTdrZm5YRmU1Znl1?= =?utf-8?Q?OEPJ/IqQgOCZvnh0oiqFWU96d?= X-OriginatorOrg: amd.com X-MS-Exchange-CrossTenant-Network-Message-Id: f4279082-e8ae-40c8-a763-08dd3c6c1433 X-MS-Exchange-CrossTenant-AuthSource: DS7PR12MB6214.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 24 Jan 2025 11:41:45.5848 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: PM5H/faaBtvFCI/RJj6vxe0wDlOxftHQBfwVDV4IsUoh0imAmXv9xOkFn6thTNfezUkD57vt1F78T5GzZVxm/w== X-MS-Exchange-Transport-CrossTenantHeadersStamped: IA0PR12MB7554 On 1/20/2025 8:10 AM, Rik van Riel wrote: > Add support for broadcast TLB invalidation using AMD's INVLPGB instruction. > > This allows the kernel to invalidate TLB entries on remote CPUs without > needing to send IPIs, without having to wait for remote CPUs to handle > those interrupts, and with less interruption to what was running on > those CPUs. > > Because x86 PCID space is limited, and there are some very large > systems out there, broadcast TLB invalidation is only used for > processes that are active on 3 or more CPUs, with the threshold > being gradually increased the more the PCID space gets exhausted. > > Combined with the removal of unnecessary lru_add_drain calls > (see https://lkml.org/lkml/2024/12/19/1388) this results in a > nice performance boost for the will-it-scale tlb_flush2_threads > test on an AMD Milan system with 36 cores: > > - vanilla kernel: 527k loops/second > - lru_add_drain removal: 731k loops/second > - only INVLPGB: 527k loops/second > - lru_add_drain + INVLPGB: 1157k loops/second > > Profiling with only the INVLPGB changes showed while > TLB invalidation went down from 40% of the total CPU > time to only around 4% of CPU time, the contention > simply moved to the LRU lock. > > Fixing both at the same time about doubles the > number of iterations per second from this case. > > Some numbers closer to real world performance > can be found at Phoronix, thanks to Michael: > > https://www.phoronix.com/news/AMD-INVLPGB-Linux-Benefits > > My current plan is to implement support for Intel's RAR > (Remote Action Request) TLB flushing in a follow-up series, > after this thing has been merged into -tip. Making things > any larger would just be unwieldy for reviewers. > > v6: > - fix info->end check in flush_tlb_kernel_range (Michael) > - disable broadcast TLB flushing on 32 bit x86 > v5: > - use byte assembly for compatibility with older toolchains (Borislav, Michael) > - ensure a panic on an invalid number of extra pages (Dave, Tom) > - add cant_migrate() assertion to tlbsync (Jann) > - a bunch more cleanups (Nadav) > - key TCE enabling off X86_FEATURE_TCE (Andrew) > - fix a race between reclaim and ASID transition (Jann) > v4: > - Use only bitmaps to track free global ASIDs (Nadav) > - Improved AMD initialization (Borislav & Tom) > - Various naming and documentation improvements (Peter, Nadav, Tom, Dave) > - Fixes for subtle race conditions (Jann) > v3: > - Remove paravirt tlb_remove_table call (thank you Qi Zheng) > - More suggested cleanups and changelog fixes by Peter and Nadav > v2: > - Apply suggestions by Peter and Borislav (thank you!) > - Fix bug in arch_tlbbatch_flush, where we need to do both > the TLBSYNC, and flush the CPUs that are in the cpumask. > - Some updates to comments and changelogs based on questions. > > > I have collected the performance data using will-it-scale tlb_flush2_threads test and AMD broadcast TLB invalidations v6 + LRU drain removal patches on my AMD Milan, Genoa and Turin machines. I have not observed any discrepancy in the data. As seen in the below table, LRU drain removal and INVLPGB patches combined is giving nice performance boost as expected. Since v7 has already been posted, I plan to collect the similar data for V7 too. ------------------------------------------------------------------------------------------------------------------------------------------------ | ./tlb_flush2_threads -s 5 -t 128 | Milan 1P (NPS1) | Milan 1P (NPS2) | Genoa 1P (NPS1) | Genoa 1P (NPS2) | Turin 2P (NPS1) | Turin 2P (NPS2) | ------------------------------------------------------------------------------------------------------------------------------------------------ | Vanila | 369880 | 399732 | 311936 | 326639 | 371146 | 377428 | ------------------------------------------------------------------------------------------------------------------------------------------------ | LRU drain removal | 781684 | 794648 | 541434 | 531191 | 549773 | 487340 | ------------------------------------------------------------------------------------------------------------------------------------------------ | INVLPGB | 554438 | 937696 | 501677 | 565055 | 531544 | 487342 | ------------------------------------------------------------------------------------------------------------------------------------------------ | LRU drain removal + INVLPGB | 1091792 | 1096667 | 971744 | 956330 | 1387741 | 1388581 | ------------------------------------------------------------------------------------------------------------------------------------------------ | LRU drain vs. Vanila | 52.68% | 49.70% | 42.39% | 38.51% | 32.49% | 22.55% | ------------------------------------------------------------------------------------------------------------------------------------------------ | INVLPGB vs. Vanila | 33.29% | 57.37% | 37.82% | 42.19% | 30.18% | 22.55% | ------------------------------------------------------------------------------------------------------------------------------------------------ | (LRU drain + INVLPGB) vs. Vanila | 66.12% | 63.55% | 67.90% | 65.84% | 73.26% | 72.82% | ------------------------------------------------------------------------------------------------------------------------------------------------ -Manali