From: Suzuki K Poulose <suzuki.poulose@arm.com>
To: Gavin Shan <gshan@redhat.com>,
kvm@vger.kernel.org, kvmarm@lists.linux.dev
Cc: maz@kernel.org, will@kernel.org, catalin.marinas@arm.com,
linux-kernel@vger.kernel.org,
linux-arm-kernel@lists.infradead.org, steven.price@arm.com,
aneesh.kumar@kernel.org, oupton@kernel.org, joey.gouly@arm.com,
tabba@google.com, yuzenghui@huawei.com,
linux-coco@lists.linux.dev, gankulkarni@os.amperecomputing.com,
sdonthineni@nvidia.com, alpergun@google.com,
fj0570is@fujitsu.com, WeiLin.Chang@arm.com,
lpieralisi@kernel.org, enju.kohei@fujitsu.com,
sudeep.holla@arm.com, jonathan.cameron@oss.qualcomm.com
Subject: Re: [PATCH v19 0/7] firmware: arm_rmm: Add RMM v2.0 base RMI support
Date: Fri, 25 Sep 2026 10:03:23 +0100 [thread overview]
Message-ID: <0c41a8a4-c4b5-4ca7-b1c9-8aaa1958e4bb@arm.com> (raw)
In-Reply-To: <fd404549-9c40-4fdf-9259-104c28b64c76@redhat.com>
On 25/09/2026 07:29, Gavin Shan wrote:
> On 9/24/26 11:51 PM, Suzuki K Poulose wrote:
>> This series adds the generic firmware layer for talking to the Realm
>> Management Monitor (RMM), as specified by the RMM v2.0-bet3
>> specification[1]. It is the first part of the Arm CCA host support that
>> was previously posted as part of the larger KVM series.
>>
>> The split allows this RMM support to be used as a base for other work,
>> including Aneesh's PCI IDE support with Arm CCA RMM as the TSM,
>> without depending on the KVM Realm support that will follow as separate
>> series. (See more on that below)
>>
>> The series adds:
>>
>> * The RMI SMC definitions and direct-call wrappers.
>>
>> * RMM discovery and version checks during firmware init.
>>
>> * RMM host configuration, including the host page size.
>>
>> * Stateful RMI Operation (SRO) infrastructure for commands which the
>> RMM
>> can complete across multiple SMC calls while requesting or returning
>> memory to the host.
>>
>> * Verification that granule tracking is available at fine granularity.
>> Fine-grained tracking allows each granule in the system to be tracked
>> independently, which is required before individual granules can be
>> delegated. A future series will add support for dynamically supplying
>> memory to the RMM for this tracking.
>>
>> * Support for fully firmware-managed systems, where the Granule
>> Protection
>> Tables for memory regions are allocated and managed by firmware.
>> RMM v2.0
>> also allows dynamic GPT creation on demand; support for that will
>> be added
>> in a later series.
>>
>> * Wrappers for the RMI commands that are used for managing the
>> "Realm VM"
>> lifecycle. This is added in to make it easier for the on-going KVM
>> support
>> to evolve in parallel pieces.
>>
>> If the platform firmware cannot manage the granule tracking or the
>> GPTs, we
>> bail out and deactivate the RMM, reclaiming any memory that we have
>> donated.
>>
>> The RMM v2.0 spec introduces Stateful RMI Operations (SROs), which allow
>> the RMM to complete an operation over several SMC calls while requesting
>> or returning memory to the host. This allows interrupts to be handled in
>> the middle of an operation and lets the RMM dynamically allocate memory
>> for internal tracking purposes. For example, RMI_REC_CREATE no longer
>> needs auxiliary granules to be provided up front, and can instead
>> request memory during the operation.
>>
>> This series applies on v7.3-rc2 and a branch is available at [2]. The KVM
>> CCA support that builds on this series is available at [3] as an
>> integration
>> branch. The KVM support depends on guest-memfd-in-place conversion
>> support v13
>> from Ackerley [4], we plan to split that into parts, which apply
>> cleanly on
>> v7.3-rcx without any dependency and is in progress. This will be made
>> available
>> as soon as it is ready. Until then [3] shows how this base series
>> enables KVM
>> CCA support. You may find the tf-RMM [5] and kvmtool support [6] below.
>>
>> [1] RMM spec : https://support.arm.com/documentation/den0137/2-0bet3/
>> [2] This series: https://gitlab.arm.com/linux-arm/linux-cca.git cca/
>> cca-host/fw_rmm/v19
>> [3] KVM CCA v17 integration branch: https://gitlab.arm.com/linux-arm/
>> linux-cca.git cca/cca/cca-host/kvm-v20/integration
>
> s/v17/v20 ?
Yikes, I have pushed this in the kvm-v20, with the changes to the
RMI_RESULT instead of RMI_RETURN etc. So the branch is correct, but the
description is not. I will rectify that
>> [4] Gmem inplace conversion https://github.com/googleprodkernel/linux-
>> cc/tree/guest_memfd-inplace-conversion-v13
>> [5] TF-RMM https://git.trustedfirmware.org/TF-RMM/tf-rmm.git main
>> (commit: 134266ae)
>> [6] kvmtool https://gitlab.arm.com/linux-arm/kvmtool-cca.git tag:cca-
>> kvm-v20 (Also cca/kvm-v18)
>>
>> Known issues: RMMv2.0 spec.
>> * RmiOpMemDonateReq:count (Uint14) is incompatible with
>> RmiAddrRangeDesc4KB
>> (Uint10) and RmiAddrRangeDesc16KB (Uint12). i.e., a larger
>> contiguous request
>> may not be satisfiable by the host. This is resolved in the RMM
>> spec, by clamping
>> the upper limit on the number to match the RmiAddrRangeDesc* and
>> will be published
>> in the next release.
>> * RMM to clarify the scenarios that triggers the RMI_BLOCKED and the
>> recommendations to limit the cases.
>>
>
> Applied this series on top of upstream linux v7.3.rc4. The built kernel
> can boot up on
> GH200 machine and CCA host emulated by QEMU with various combinations:
> 4KB or 64KB base
> page size, CONFIG_ARM_RMM_RMI is {Y, N}. The RMI is only detected and
> configured on CCA
> host when the base page size is 4KB because RMM only support 4KB granule
> size at present.
> Details can be found from TF-RMM/runtime/rmi/
> granule.c::smc_rmm_config_set(). Besides,
> some of the added functions based on the RMI calls aren't covered by the
> tests obviously.
> So I think this series doesn't introduce regressions at least.
>
> Tested-by: Gavin Shan <gshan@redhat.com>
Thanks Gavin ! Much appreciated
Cheers
Suzuki
prev parent reply other threads:[~2026-09-25 9:03 UTC|newest]
Thread overview: 28+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-09-24 13:51 Suzuki K Poulose
2026-09-24 13:51 ` [PATCH v19 1/7] firmware: arm_rmm: Add SMC definitions for calling the RMM Suzuki K Poulose
2026-09-24 16:57 ` Jonathan Cameron
2026-09-24 22:15 ` Suzuki K Poulose
2026-09-24 17:05 ` Ackerley Tng
2026-09-24 22:49 ` Suzuki K Poulose
2026-09-24 13:51 ` [PATCH v19 2/7] firmware: arm_rmm: Check for RMI support at init Suzuki K Poulose
2026-09-24 16:58 ` Jonathan Cameron
2026-09-25 0:00 ` Gavin Shan
2026-09-25 8:51 ` Suzuki K Poulose
2026-09-25 5:43 ` Gavin Shan
2026-09-25 8:50 ` Suzuki K Poulose
2026-09-25 10:42 ` Catalin Marinas
2026-09-24 13:51 ` [PATCH v19 3/7] firmware: arm_rmm: Configure the RMM with the host's page size Suzuki K Poulose
2026-09-24 17:03 ` Jonathan Cameron
2026-09-25 0:03 ` Gavin Shan
2026-09-24 13:51 ` [PATCH v19 4/7] firmware: arm_rmm: Add support for SRO Suzuki K Poulose
2026-09-24 19:13 ` Jonathan Cameron
2026-09-24 23:10 ` Suzuki K Poulose
2026-09-25 5:24 ` Gavin Shan
2026-09-24 13:51 ` [PATCH v19 5/7] firmware: arm_rmm: Activate the RMM Suzuki K Poulose
2026-09-24 13:52 ` [PATCH v19 6/7] firmware: arm_rmm: Ensure the RMM has GPT entries for memory Suzuki K Poulose
2026-09-24 21:38 ` Jonathan Cameron
2026-09-24 23:30 ` Suzuki K Poulose
2026-09-25 0:07 ` Gavin Shan
2026-09-24 13:52 ` [PATCH v19 7/7] firmware: arm_rmm: Add wrappers for Realm related RMI commands Suzuki K Poulose
2026-09-25 6:29 ` [PATCH v19 0/7] firmware: arm_rmm: Add RMM v2.0 base RMI support Gavin Shan
2026-09-25 9:03 ` Suzuki K Poulose [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=0c41a8a4-c4b5-4ca7-b1c9-8aaa1958e4bb@arm.com \
--to=suzuki.poulose@arm.com \
--cc=WeiLin.Chang@arm.com \
--cc=alpergun@google.com \
--cc=aneesh.kumar@kernel.org \
--cc=catalin.marinas@arm.com \
--cc=enju.kohei@fujitsu.com \
--cc=fj0570is@fujitsu.com \
--cc=gankulkarni@os.amperecomputing.com \
--cc=gshan@redhat.com \
--cc=joey.gouly@arm.com \
--cc=jonathan.cameron@oss.qualcomm.com \
--cc=kvm@vger.kernel.org \
--cc=kvmarm@lists.linux.dev \
--cc=linux-arm-kernel@lists.infradead.org \
--cc=linux-coco@lists.linux.dev \
--cc=linux-kernel@vger.kernel.org \
--cc=lpieralisi@kernel.org \
--cc=maz@kernel.org \
--cc=oupton@kernel.org \
--cc=sdonthineni@nvidia.com \
--cc=steven.price@arm.com \
--cc=sudeep.holla@arm.com \
--cc=tabba@google.com \
--cc=will@kernel.org \
--cc=yuzenghui@huawei.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®