From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mgamail.intel.com (mgamail.intel.com [192.198.163.13]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 158CC14BF86; Mon, 5 Aug 2024 20:26:24 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=192.198.163.13 ARC-Seal:i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1722889586; cv=fail; b=NsWen+A/buAoIxf8nhCRTzh+ci12YUGshYlrG68znQqbEXe+vueu6BDZqnXFqxwp2+GKUtZ/qoqEyp7FlqL5mNmTbZqZt6MfK6EQHgngggzD4AwvU06ouMRutOP8KvgcuDuC+SWQECwm0/k1mEHqPiSXTCjXu4JYSFRF5R/6lqw= ARC-Message-Signature:i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1722889586; c=relaxed/simple; bh=NPalB0dL4Gm3cP8Ax/Da+Dk/ksh/LGkkgSWDud5FFMg=; h=Date:From:To:CC:Subject:Message-ID:References:Content-Type: Content-Disposition:In-Reply-To:MIME-Version; b=jI422lgwzL+HR2Va0P0LrOa+T179c174ClzK4udqyxVczONI7vc5yX3mwCE0okim9v6PwDGa22SKd8hfe+wP4vmKVqb1UqTm1hKrvl1tJ9QIdICRL/6JbDHMcR0jGbxgBQXNMovRH7lHvpsq1OSMXJvT/1RgmaT0puWwUH9xD7s= ARC-Authentication-Results:i=2; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=intel.com; spf=pass smtp.mailfrom=intel.com; dkim=pass (2048-bit key) header.d=intel.com header.i=@intel.com header.b=fUUOjNQ5; arc=fail smtp.client-ip=192.198.163.13 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=intel.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=intel.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=intel.com header.i=@intel.com header.b="fUUOjNQ5" DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1722889585; x=1754425585; h=date:from:to:cc:subject:message-id:references: in-reply-to:mime-version; bh=NPalB0dL4Gm3cP8Ax/Da+Dk/ksh/LGkkgSWDud5FFMg=; b=fUUOjNQ5GgmSLo96V5a2qXCr8HqhcPLiYLAuQ8Zcjs11ns5aIJjvmMJO Q46Nbp9cYlfxvZy4AhITybmJe5YSNFEpT/keCFiwy4u/yGqdhhO89yi0/ 6ZFImaM4m/0tk9pxbYVLSnzUJRjuxtuMKHDUf64eUiAGYX1fNpuQ5Hj4g rI85E+AWoq96H55okarFpGS+09Rijj2mN3UpyIh+nnsoiTyPsCRJtRCCm uW5jflUw0QhNTA+ejaZtAvv+LtR+Y7PLbLBzlNO5QkRPrXVj7mxBr699G XjnMIm16+nQv8OTaIJgVa1OunOjh6jcTwhvDi+hCLJ+MagpWxJx/L/h0C w==; X-CSE-ConnectionGUID: 8XGMf6K/SwSnIRteFCjRxA== X-CSE-MsgGUID: OKHeHd5YR6uxsGJFsMixwg== X-IronPort-AV: E=McAfee;i="6700,10204,11155"; a="23789562" X-IronPort-AV: E=Sophos;i="6.09,265,1716274800"; d="scan'208";a="23789562" Received: from orviesa003.jf.intel.com ([10.64.159.143]) by fmvoesa107.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 05 Aug 2024 13:26:24 -0700 X-CSE-ConnectionGUID: nqiOt7XhS7CPFtskWU1i7w== X-CSE-MsgGUID: BUZ7RhCxTBuDQiTjXeuoYQ== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="6.09,265,1716274800"; d="scan'208";a="61094202" Received: from orsmsx603.amr.corp.intel.com ([10.22.229.16]) by orviesa003.jf.intel.com with ESMTP/TLS/AES256-GCM-SHA384; 05 Aug 2024 13:26:24 -0700 Received: from orsmsx611.amr.corp.intel.com (10.22.229.24) by ORSMSX603.amr.corp.intel.com (10.22.229.16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.39; Mon, 5 Aug 2024 13:26:23 -0700 Received: from orsmsx610.amr.corp.intel.com (10.22.229.23) by ORSMSX611.amr.corp.intel.com (10.22.229.24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.39; Mon, 5 Aug 2024 13:26:22 -0700 Received: from orsedg603.ED.cps.intel.com (10.7.248.4) by orsmsx610.amr.corp.intel.com (10.22.229.23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.39 via Frontend Transport; Mon, 5 Aug 2024 13:26:22 -0700 Received: from NAM10-BN7-obe.outbound.protection.outlook.com (104.47.70.47) by edgegateway.intel.com (134.134.137.100) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2507.39; Mon, 5 Aug 2024 13:26:22 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=VY8kq/VPIDFkn2epkAHy43BjLUD9/jiF/y2xMXL/UQ5DzqzUejFFIlGSIO1DVZZvvhpZ32CLUchI0dD2TK3yjHNva6Qc+7uQKJAEDHhMhgzZF2YEcjJL1xanUxDbZbf7dh4B7iVeS2k2XIXMwaJOk0WfGfQkjnThI9DWHLz8mEw9UsXUiVV8FYNKnprYOsYDHPkPZzx4oi4rBGDKzYa3U1+6NzwmO+lMHu+nyJmRKRXezvNJVOjMMlIrE/pw241DinUtD/I7olYV5ViV7y84AoAcIx81OksGBsu4/hItgzkOhv/vUK79iPF7TY4ChFpfMqklZIGSHcWx2+H2D427Sw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=JP9A5FmudYehYnHl82tb4FTAOigIeMbpmD/vInFfAP0=; b=s7bFWfs8SA4bGCzPrSovPYwldWF618vqTEKrUTM1DgkCDDHeDQvWHtDkmyVvaoITkOcchcMzngSEAzsHN6IX6p5+YwWvhmS1jHURXGi/hZpoA68jiX3/qCt+DUoEp31tfkzkdFiWd9ZlK4Slbjw+3fCe1kAEDAO2JZq45GC+7nUGyIHTenim2cGrFFHtLvRB0/aFIYA9iKkesLwR3bxh8qhM9eaaPZO5XkopdzOporVowp8GfuZ6faovarmYf8vNEQH3uQ3A1+yLSUEaFvnaorAHpMnLb5289vi13lMYyFbO8rmX70S/DM8ZnEbKWfhDlYw3sQNxhVCaqCz9nhotew== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=intel.com; Received: from PH8PR11MB8107.namprd11.prod.outlook.com (2603:10b6:510:256::6) by LV8PR11MB8772.namprd11.prod.outlook.com (2603:10b6:408:200::7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7828.27; Mon, 5 Aug 2024 20:26:19 +0000 Received: from PH8PR11MB8107.namprd11.prod.outlook.com ([fe80::6b05:74cf:a304:ecd8]) by PH8PR11MB8107.namprd11.prod.outlook.com ([fe80::6b05:74cf:a304:ecd8%4]) with mapi id 15.20.7828.021; Mon, 5 Aug 2024 20:26:19 +0000 Date: Mon, 5 Aug 2024 13:26:13 -0700 From: Dan Williams To: Dan Williams , Mike Rapoport , CC: Alexander Gordeev , Andreas Larsson , Andrew Morton , "Arnd Bergmann" , Borislav Petkov , Catalin Marinas , Christophe Leroy , Dan Williams , Dave Hansen , David Hildenbrand , "David S. Miller" , Davidlohr Bueso , "Greg Kroah-Hartman" , Heiko Carstens , Huacai Chen , Ingo Molnar , Jiaxun Yang , "John Paul Adrian Glaubitz" , Jonathan Cameron , Jonathan Corbet , "Michael Ellerman" , Mike Rapoport , "Palmer Dabbelt" , "Rafael J. Wysocki" , "Rob Herring" , Samuel Holland , Thomas Bogendoerfer , Thomas Gleixner , Vasily Gorbik , Will Deacon , Zi Yan , , , , , , , , , , , , , , , , Subject: Re: [PATCH v3 00/26] mm: introduce numa_memblks Message-ID: <66b135659ad15_c14482941a@dwillia2-xfh.jf.intel.com.notmuch> References: <20240801060826.559858-1-rppt@kernel.org> <66b12ad232a7_c14482943e@dwillia2-xfh.jf.intel.com.notmuch> Content-Type: text/plain; charset="us-ascii" Content-Disposition: inline In-Reply-To: <66b12ad232a7_c14482943e@dwillia2-xfh.jf.intel.com.notmuch> X-ClientProxiedBy: MW4PR04CA0062.namprd04.prod.outlook.com (2603:10b6:303:6b::7) To PH8PR11MB8107.namprd11.prod.outlook.com (2603:10b6:510:256::6) Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: PH8PR11MB8107:EE_|LV8PR11MB8772:EE_ X-MS-Office365-Filtering-Correlation-Id: 94b0f811-4971-4af2-8b5e-08dcb58cdd17 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|7416014|376014|366016|1800799024; X-Microsoft-Antispam-Message-Info: =?us-ascii?Q?YERVX2wVlYt+ysS2EoF4EsZHqd+7xH/7VzDgDIHF3JQxgOK+urMQZvDZ2HMm?= =?us-ascii?Q?h/krpIz524sjPumhxFf7RZGKqgcYDyEkdxfsdu8Ypw0DH3ADukZoM8//glei?= =?us-ascii?Q?/hKcb6o6uSI+uqshYYdtdq199zdUQJYnabTQmP9uh+uvRBr5RsKpgK83nSft?= =?us-ascii?Q?tSYu0a5wtSZavhFeOYARRl6xcNUltMn5lKJlgDs5FWuydL/4VtM71k+BeQ5d?= =?us-ascii?Q?bXhIc0EKyIxQQPADwvl6B3c9bxxw0n56T441PIvI9lIqmoh1n9wZpEXjxEmt?= =?us-ascii?Q?mYkNd1+HLSQCmAPRkd9+R9CiC3e2xrj0NSLfjKqwJGN58RxPX18Nf910RdWM?= =?us-ascii?Q?ih0jSLyRfoXhUo8hZGlASsS03YfWmymU6Rc5SICUnUez/UsAB93LX676s75a?= =?us-ascii?Q?SoI3Y2R35F5Yt2ScaGTvFLTwjERBIArlYeYTILXnmCsFspbYYIsay6rdRvGu?= =?us-ascii?Q?Z8OfriDY3DdkRJ7KN01cuIcOINPhmLYm82JfRbJCLYkLYnWzzHNirf3p6QF8?= =?us-ascii?Q?Q6QqaOWGhBwffYg/aaSa5CsjuT+IgJYxKFLT4PuvXV3T/+AcYo5vfO/vsnov?= =?us-ascii?Q?1XuAW0JjO1AvZGLhaXQznLPxid2rQP0ApIuHTwQaJw+PdKgo1bO9izq/4sO5?= =?us-ascii?Q?Z7dNeKmoVENgwgW2VCM9zHHhRRQwNJtxUa4Wpb/tVxoM0V1IxBZ0dfpdQ8bQ?= =?us-ascii?Q?XxNw+boMrdDhD97zBQF+kgxy1BdoCxsZj6oTztGtW2erzCj9eWuXbj9HK11Z?= =?us-ascii?Q?5Gh/+KoNtUZzVl+GgokypNLnJVfAzPmIqgH2CqzgMMX+1Ci+PyOod16mjB+h?= =?us-ascii?Q?KmV7XTeJ2FaxzhzdwAH2irlEFyfSG2sHJFCwGIpnW1X+UzB7q+KMAUEDyP4v?= =?us-ascii?Q?EUm7qOXXSawBs3+H2bgAnm6xTYcfRI7GA9YYUl2OEExKmfXcOdEkkTWyjDfa?= =?us-ascii?Q?TwuxjwpTG1/NC/4a9M8sUaFjlIdjQ9H3YnpdUt/grEb8bewUAjew0lfBZ5H/?= =?us-ascii?Q?Q3h+9L2csShM1yOZd/ko8ze2CRCCgdOwEGyLq4SHbpKU1WOKZTsP6f/iLXkH?= =?us-ascii?Q?0SQfFLaMDdXnYmXN3/rq6GfhoEfZz2x4dBZLZxGrHUsPpJw1vK9L2ANDiqes?= =?us-ascii?Q?0LF62DzlzQnf8Rm7cXLDucT0/Yl6E9qemDB505pMjK0kojz3BsADY1QYbr0c?= =?us-ascii?Q?nt9B911GDUunqfy4wiuVpL2AIKssITuaCje+7oOqq4a1ax2x0SdRH8zKONC7?= =?us-ascii?Q?O5fYkrxJBkr8N0ruYfgermP4y1fsh7IhQlSt5G+sHWzBBntJWtqyNGRUnu9T?= =?us-ascii?Q?YoQxWlmAasdzbguDDo0z+olS/sLdAQch22wV9qIrMW7mnw=3D=3D?= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:PH8PR11MB8107.namprd11.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(7416014)(376014)(366016)(1800799024);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?VfSolK1oQra9tIDD1NEdQw+q+Xxf1iqUpZqG6D5Asxa6rVCS65jt61NbWXgv?= =?us-ascii?Q?eYvwRnE6m8+1AM2kvNrhyPPhknV/U3H3LRsAWKIigYzhX9vP2GLI7iH4sNDy?= =?us-ascii?Q?EdkWSeliPs2xPOLgr7EJz2OoAHGUSb6D0x23nv9X+WhV3tRoNpEct6NPd7VJ?= =?us-ascii?Q?ldk2AQUcF5D7o0eU8fxNNO4EmNyj4C+KGyh9yBc5zSXyD44GQI5aRwzPnWpm?= =?us-ascii?Q?cVOVTC3vGHQrrWyneYyiyuYbbeORNTM7ztOlMVx16KoUUJwQplBnIiBQGKTX?= =?us-ascii?Q?3XK8u7Hs2Ef9WHo73r/yLFgpMDPV4Jwx0ypg/3DIMnCVLPtPZdO1uIqfEPMZ?= =?us-ascii?Q?Cc4bhoAWPginMW8r+qJwnFHiqXYbhI4j6V6RZbQ3k75DGC97U7u4ANi2NBOj?= =?us-ascii?Q?wDSv7eE92Gnx2Zty+NyR5WEDfNMqqLWTAtu3Y1aQIt1aN8WrU1QFuvW9DNp3?= =?us-ascii?Q?PhQwcpai5DWakCL2oPG+pnuHzALSwfgA/gnkoVArtlGTfxaQsW5vyS6CCZvV?= =?us-ascii?Q?TF0GVRnRffdIV9Qx0GpdMp58LhjFOCmKyNqXjL96hegTOI+3VvUUuszCIF27?= =?us-ascii?Q?cOSEq1s+qeSxuLBOReYjXZy/TAS6VQfmwBQxgYSFSixfflgEshfBsQF+k52B?= =?us-ascii?Q?1BNAGX11HsV0GGRQp05jffzMsgzi14UfE4c41XxxVyJOyeZ0dKiY4DsGz//U?= =?us-ascii?Q?5jfrtCEIoYQstmURfu1JoJFCgU6yNnpVnkp7VfqU/JUvhXpZEgZdlroOehIZ?= =?us-ascii?Q?+Oretl5ZUzgR9Z+ZdNLBmatqxBK+mhVEnr3xp6gtBGE3+4MOe6jCgU69ps/V?= =?us-ascii?Q?KujNoMVu4vAV2BsOL8+/cCWP6dpX/XBbDtgsbRnxN+YnYJbUtc80JygYztME?= =?us-ascii?Q?JLqpnggrJiMwuY2ZUcvXYEU8PEAsbgvUc8Jkz1cWpEbrBq7qAUqazKWopCiJ?= =?us-ascii?Q?vffSomSCkCLPIudATbfWdEg0D/z+4Q1h3CCdCUKeR/kCg6WaTXrN7RhEcK9j?= =?us-ascii?Q?Vgr/Skjib5YxTnecjlG+0vffls5VwZvvlwHiLuZovfriZw7/jmKTjxs6CRDL?= =?us-ascii?Q?Vz1C+wJyYv5DoQNtNiL3ZWW/D/OiJZENpQPpWCAlPABxQLfPkgo8QFd5kGpj?= =?us-ascii?Q?dvD+cIXcCRjwOOJLDdX/c85ssCD8/3jaxCgNkPOb3cGYOGn2btyuKzPIeo9+?= =?us-ascii?Q?IZuLSKOMxoT6kiQYlPXbPsKoJQ0U8T2QhBjMsRA3TnnMmjdB2MyM7cQkGyjh?= =?us-ascii?Q?tEfcHiVstgu6wExS471cpGZ3AfJJH948ZhTMinUqGetmraoe0bzQkWXpSEyv?= =?us-ascii?Q?sRk42DwBk24Unt52myINGfJDhBbc1RxSi+uKXI2k6pa6/v2N5Ff9+H97aa3a?= =?us-ascii?Q?zTmafi4ZIZcNMwpMKxCoDOulDUpSeDuRDDD2xGzMy969vXBrmCkYXz/JApTu?= =?us-ascii?Q?7LIe58d6DGwmKUC+4gPNkA48yT3qlN0Imj6gtVeJVG13LoXKs5SWg603ltSQ?= =?us-ascii?Q?InNOb8CH0EbJUsLKyYwGOYHsLE0U4o0bb6L8HD31Y1lOiNKx2HUxBEn4njUV?= =?us-ascii?Q?xW6JyCESP9fp8OBmwy+O0goqZ/+RhNwpYloZH4pKntIXNJRuX70ZD5E3OQQG?= =?us-ascii?Q?tQ=3D=3D?= X-MS-Exchange-CrossTenant-Network-Message-Id: 94b0f811-4971-4af2-8b5e-08dcb58cdd17 X-MS-Exchange-CrossTenant-AuthSource: PH8PR11MB8107.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 05 Aug 2024 20:26:19.0701 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: PfToQGCd3Q5fNawrKolrB4LBs88jgJxexZ24u2ypnw0dJkyvJMsY+zfDDNrw067Jri1Xyn1O5U960fBkm+5QrkPP1Vo/xZj3ECFVSpbTK+Q= X-MS-Exchange-Transport-CrossTenantHeadersStamped: LV8PR11MB8772 X-OriginatorOrg: intel.com Dan Williams wrote: > Mike Rapoport wrote: > > From: "Mike Rapoport (Microsoft)" > > > > Hi, > > > > Following the discussion about handling of CXL fixed memory windows on > > arm64 [1] I decided to bite the bullet and move numa_memblks from x86 to > > the generic code so they will be available on arm64/riscv and maybe on > > loongarch sometime later. > > > > While it could be possible to use memblock to describe CXL memory windows, > > it currently lacks notion of unpopulated memory ranges and numa_memblks > > does implement this. > > > > Another reason to make numa_memblks generic is that both arch_numa (arm64 > > and riscv) and loongarch use trimmed copy of x86 code although there is no > > fundamental reason why the same code cannot be used on all these platforms. > > Having numa_memblks in mm/ will make it's interaction with ACPI and FDT > > more consistent and I believe will reduce maintenance burden. > > > > And with generic numa_memblks it is (almost) straightforward to enable NUMA > > emulation on arm64 and riscv. > > Hey Mike, > > So interesting to see this come full circle and instead of moving > numa_memblks to memblock, just uplevel numa_memblks. From the > perspective of having numa_memblks enhancements work for more > architectures this gets an enthusiastic thumbs up from me. Let me go > look at the details... For the series you can add: Acked-by: Dan Williams