From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from linux.microsoft.com (linux.microsoft.com [13.77.154.182]) by smtp.subspace.kernel.org (Postfix) with ESMTP id 6BEDE470EB6; Thu, 17 Sep 2026 20:11:04 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=13.77.154.182 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1789675875; cv=none; b=Djx86qV3i6wSUQDKNEmCQ5jmonMsCkwniuC7gBSE20x2QvVGCjzayZ2ymQ1DoAqTeuobtgi0KKWgJ6WWZUKOYki57FYsyyDVk2rrd7YRl5JsheYBgDl2XWFKWGN6XtEqpiK1sISGVFl71eZ4tdyWRL4oMRtyYxoMog4FcoXK5II= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1789675875; c=relaxed/simple; bh=qVRJfinOkKGEsLurt9NE3NHzXR6ieyQbEYI9sUl7KQE=; h=From:To:Cc:Subject:Date:Message-Id:MIME-Version; b=m1lhrXHN7NrgZnG4qv1PNcr+hNV0A0b69jNflWbhHC6DFT3XzqYIFTymDpSUgK3TCqkkmIM0RfaXrmh8Ize5jXAbCCQG+pmzBhyMrGwz/+LOPpKFYxwxeRpxAOYaAhAyF9lvaYE/lu6XJ/N2o1y/XeOB7skrCbBYyofwf9d8XoU= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linux.microsoft.com; spf=pass smtp.mailfrom=linux.microsoft.com; dkim=pass (1024-bit key) header.d=linux.microsoft.com header.i=@linux.microsoft.com header.b=P2M4eg3d; arc=none smtp.client-ip=13.77.154.182 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linux.microsoft.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=linux.microsoft.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=linux.microsoft.com header.i=@linux.microsoft.com header.b="P2M4eg3d" Received: from DESKTOP-TUU1E5L.fritz.box (p3e9c0608.dip0.t-ipconnect.de [62.156.6.8]) by linux.microsoft.com (Postfix) with ESMTPSA id A6F3320B7166; Thu, 17 Sep 2026 13:10:12 -0700 (PDT) DKIM-Filter: OpenDKIM Filter v2.11.0 linux.microsoft.com A6F3320B7166 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linux.microsoft.com; s=default; t=1789675815; bh=wfkzm/MaGtBi0cGbet1CRM8jaGbBmSfienEvT5Oc2rs=; h=From:To:Cc:Subject:Date:From; b=P2M4eg3dajSp0YxCCH9FwGnGw9ouXURZZayNzG2Z115Ju3VPiN7YBU8amNLDd2P3f 1WWIOI1bwt1nzQcBx+oHolgR4S1Tpa0dqWUrx41JZHNVCqSvg1FDHc+FGEpO7KE86p WvT6V5bHp5vJt2jflzgkYIAFnThbCQkT0fqJoXNU= From: Magnus Kulke To: linux-hyperv@vger.kernel.org Cc: Paolo Bonzini , Souradeep Chakrabarti , Wei Liu , Haiyang Zhang , Dexuan Cui , Magnus Kulke , Long Li , linux-arch@vger.kernel.org, "K. Y. Srinivasan" , Anirudh Rayabharam , Arnd Bergmann , linux-kernel@vger.kernel.org, Wei Liu Subject: [PATCH v3] drivers/hv: remove deposited pages from direct map Date: Thu, 17 Sep 2026 22:10:52 +0200 Message-Id: <20260917201052.2123701-1-magnuskulke@linux.microsoft.com> X-Mailer: git-send-email 2.34.1 Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit hv_call_deposit_pages() donates pages (deposit) to hypervisor for L2 guest on L1VH systems via HVCALL_DEPOSIT_MEMORY. The hypervisor takes ownership of those pages and per contract revokes root partition access to them, raising a #GP on access from the L1VH root partition. However, the pages remain mapped in the kernel direct map, so kernel code may still access them even though the hypervisor has revoked access. Helpers such as "load_unaligned_zeropad()" deliberately read past the end of a buffer and across page boundaries. A read into an unmapped page is tolerated and triggers a #PF, for which the kernel executed a fixup in the exception table. If such a call steps into a page that has been deposited, the access raises a #GP by the hypervisor from which the above handler cannot recover and the kernel panics: Oops: general protection fault, maybe for address 0xff1100941a3dfffc RIP: 0010:csum_partial+0xe5/0x110 This condition will appear on L1VH system that have created L2 partitions (and hence deposited pages) and exercise networking code paths such as csum_partial() can trigger this condition when a buffer ends close to a page boundary (e.g fffc in the above example). The fix is to remove the deposited pages from the direct map before they are passed to the hypervisor, and restore them when the hypervisor returns them again. We want to avoid flushing the TLB in the loop, so we use the _noflush() variant of set_direct_map_valid() when marking a deposited page invalid and flush the affected page ranges in one go ourselves. In the opposite direction this is not required: > If a paging-structure entry is modified to change the P flag from > 0 to 1, no invalidation is necessary. This is because no TLB entry > or paging-structure cache entry is created with information from a > paging-structure entry in which the P flag is 0. (Intel SDM Vol. 3, 4.10.4.3) Signed-off-by: Magnus Kulke --- Changes since v2: - Checkpatch format fix Changes since RFC: - Handle direct-map restoration failures without returning unmapped pages to the allocator. - Move freeing of withdrawn pages into the restoration helper. --- drivers/hv/hv_proc.c | 77 +++++++++++++++++++++++++++++++++- drivers/hv/mshv_root_hv_call.c | 4 +- include/asm-generic/mshyperv.h | 4 ++ 3 files changed, 81 insertions(+), 4 deletions(-) diff --git a/drivers/hv/hv_proc.c b/drivers/hv/hv_proc.c index 57b2c64197cb..2a392b45205d 100644 --- a/drivers/hv/hv_proc.c +++ b/drivers/hv/hv_proc.c @@ -7,7 +7,9 @@ #include #include #include +#include #include +#include /* * See struct hv_deposit_memory. The first u64 is partition ID, the rest @@ -15,6 +17,35 @@ */ #define HV_DEPOSIT_MAX (HV_HYP_PAGE_SIZE / sizeof(u64) - 1) +/* + * Add or remove a set of physically contiguous page runs from the kernel + * direct map. Once a page has been deposited the hypervisor owns it and + * revokes root partition access to it. + */ +static int hv_deposit_update_direct_map(struct page **pages, int *counts, + int num_allocations, bool valid) +{ + int i, err, ret = 0; + + for (i = 0; i < num_allocations; ++i) { + err = set_direct_map_valid_noflush(pages[i], counts[i], valid); + if (err && !ret) + ret = err; + } + + if (valid) + return ret; + + for (i = 0; i < num_allocations; ++i) { + unsigned long addr = (unsigned long)page_address(pages[i]); + unsigned long size = (unsigned long)counts[i] << PAGE_SHIFT; + + flush_tlb_kernel_range(addr, addr + size); + } + + return ret; +} + /* Deposits exact number of pages. Must be called with interrupts enabled. */ int hv_call_deposit_pages(int node, u64 partition_id, u32 num_pages) { @@ -72,6 +103,10 @@ int hv_call_deposit_pages(int node, u64 partition_id, u32 num_pages) } num_allocations = i; + ret = hv_deposit_update_direct_map(pages, counts, num_allocations, false); + if (ret) + goto err_restore_direct_map; + local_irq_save(flags); input_page = *this_cpu_ptr(hyperv_pcpu_input_arg); @@ -90,12 +125,23 @@ int hv_call_deposit_pages(int node, u64 partition_id, u32 num_pages) if (!hv_result_success(status)) { hv_status_err(status, "\n"); ret = hv_result_to_errno(status); - goto err_free_allocations; + goto err_restore_direct_map; } ret = 0; goto free_buf; +err_restore_direct_map: + /* + * We don't want to return pages to the allocator if weren't able to + * mark them valid in the direct map. + */ + if (hv_deposit_update_direct_map(pages, counts, num_allocations, true)) { + WARN(1, "leaking %d page block(s) that could not be set to valid\n", + num_allocations); + goto free_buf; + } + err_free_allocations: for (i = 0; i < num_allocations; ++i) { base_pfn = page_to_pfn(pages[i]); @@ -110,6 +156,35 @@ int hv_call_deposit_pages(int node, u64 partition_id, u32 num_pages) } EXPORT_SYMBOL_GPL(hv_call_deposit_pages); +/* + * Put withdrawn pages back in the direct map. Counterpart to the direct map + * removal done by hv_call_deposit_pages(). + */ +void hv_restore_withdrawn_pages(const u64 *pfns, int count) +{ + int i, ret = 0; + struct page *page; + + for (i = 0; i < count; ++i) { + page = pfn_to_page(pfns[i]); + ret = set_direct_map_valid_noflush(page, 1, true); + /* + * HV_DEPOSIT_MAX is capped at 511, so a deposit range cannot cover + * a 2MiB page, so deposited pages are of 4k granularity and cannot + * be collapses into a 2MiB page, which would require an allocation + * and can potentially fail. + * + * Should it fail anyway we leak the page, if we would hand it + * back to the allocator we would introduce faults into random other + * parts. + */ + if (WARN_ON_ONCE(ret)) + continue; + __free_page(page); + } +} +EXPORT_SYMBOL_GPL(hv_restore_withdrawn_pages); + int hv_deposit_memory_node(int node, u64 partition_id, u64 hv_status) { diff --git a/drivers/hv/mshv_root_hv_call.c b/drivers/hv/mshv_root_hv_call.c index cb55d4d4be2e..150a0c63ebc8 100644 --- a/drivers/hv/mshv_root_hv_call.c +++ b/drivers/hv/mshv_root_hv_call.c @@ -46,7 +46,6 @@ int hv_call_withdraw_memory(u64 count, int node, u64 partition_id) struct page *page; u16 completed; u64 status, withdrawn = 0; - int i; unsigned long flags; page = alloc_page(GFP_KERNEL); @@ -69,8 +68,7 @@ int hv_call_withdraw_memory(u64 count, int node, u64 partition_id) completed = hv_repcomp(status); - for (i = 0; i < completed; i++) - __free_page(pfn_to_page(output_page->gpa_page_list[i])); + hv_restore_withdrawn_pages(output_page->gpa_page_list, completed); if (!hv_result_success(status)) { if (hv_result(status) == HV_STATUS_NO_RESOURCES) diff --git a/include/asm-generic/mshyperv.h b/include/asm-generic/mshyperv.h index bf601d67cecb..397c8ec0ce9a 100644 --- a/include/asm-generic/mshyperv.h +++ b/include/asm-generic/mshyperv.h @@ -346,6 +346,7 @@ static inline bool hv_parent_partition(void) bool hv_result_needs_memory(u64 status); int hv_deposit_memory_node(int node, u64 partition_id, u64 status); int hv_call_deposit_pages(int node, u64 partition_id, u32 num_pages); +void hv_restore_withdrawn_pages(const u64 *pfns, int count); int hv_call_add_logical_proc(int node, u32 lp_index, u32 acpi_id); int hv_call_notify_all_processors_started(void); bool hv_lp_exists(u32 lp_index); @@ -364,6 +365,9 @@ static inline int hv_call_deposit_pages(int node, u64 partition_id, u32 num_page { return -EOPNOTSUPP; } + +static inline void hv_restore_withdrawn_pages(const u64 *pfns, int count) { } + static inline int hv_call_add_logical_proc(int node, u32 lp_index, u32 acpi_id) { return -EOPNOTSUPP; -- 2.34.1