From: John Hubbard <jhubbard@nvidia.com>
To: Danilo Krummrich <dakr@kernel.org>,
Alexandre Courbot <acourbot@nvidia.com>
Cc: "Joel Fernandes" <joelagnelf@nvidia.com>,
"Timur Tabi" <ttabi@nvidia.com>,
"Alistair Popple" <apopple@nvidia.com>,
"Eliot Courtney" <ecourtney@nvidia.com>,
"Zhi Wang" <zhiw@nvidia.com>, "David Airlie" <airlied@gmail.com>,
"Simona Vetter" <simona@ffwll.ch>,
"Bjorn Helgaas" <bhelgaas@google.com>,
"Miguel Ojeda" <ojeda@kernel.org>,
"Alex Gaynor" <alex.gaynor@gmail.com>,
"Boqun Feng" <boqun.feng@gmail.com>,
"Gary Guo" <gary@garyguo.net>,
"Björn Roy Baron" <bjorn3_gh@protonmail.com>,
"Benno Lossin" <lossin@kernel.org>,
"Andreas Hindborg" <a.hindborg@kernel.org>,
"Alice Ryhl" <aliceryhl@google.com>,
"Trevor Gross" <tmgross@umich.edu>,
nouveau@lists.freedesktop.org, rust-for-linux@vger.kernel.org,
LKML <linux-kernel@vger.kernel.org>,
"John Hubbard" <jhubbard@nvidia.com>
Subject: [PATCH v3 00/30] gpu: nova-core: firmware: Hopper/Blackwell support
Date: Thu, 5 Feb 2026 20:20:53 -0800 [thread overview]
Message-ID: <20260206042123.303281-1-jhubbard@nvidia.com> (raw)
Hi,
This is based on today's (Feb 5, 2026) linux-next, and re-tested on
Ampere (GA104) and Blackwell (GB202) RTX GPUs here, and it looks nice.
Since posting v2, I learned that there are some IOMMU page faults
happening when IOMMU is enabled, but only for the Blackwell GPU--Ampere
doesn't have the issue. And the Blackwell GPU firmware/GSP still boots
up in this case, so it's not fatal, but something is not quite set up
yet. I'm troubleshooting these now.
Data center GPUs remain as TODO items: GA100 needs some additional code,
Hopper/GH100 might work but is not yet tested, and I haven't even
thought about Blackwell data center GPUs.
So even though many patches say Hopper/Blackwell, there may be some
test-and-fix work remaining there.
Changes in v3:
* Rebased onto linux-next (20260205), which includes several
rust-for-linux updates that affected nova-core.
* Removed redundant .as_ref() from dev_*!() macro call sites, since the
dev_printk!() macro now calls .as_ref() internally (Gary Guo's
"remove redundant .as_ref() for dev_* print" series).
* Added a `use kernel::io::Io` import in regs.rs, needed after the
upstream separation of generic I/O helpers from the MMIO
implementation.
Changes in v2:
v2 is here:
https://lore.kernel.org/20260131005604.454172-1-jhubbard@nvidia.com
* GA100 (an Ampere chip whose firmware boot steps are closer to Turing,
than to other Amperes) returns ENOTSUPP for now because it is *known*
to not work yet.
* FSP: use the new Chipset::fsp_cot_version() method instead of a
hardcoded constant. This fixes a known wrongness on GH100.
* Changed to a HAL approach to handle the slightly different non-WPR
heap sizes, for Hopper vs. Blackwell.
* Return Option instead of Result from get_gsp_sigs_section() since
the failure case is simply "not found".
* Return DmaMask directly from dma_mask() instead of returning a bit
count.
* Change fmc_full from DmaObject to KVec<u8> since it's only used for
CPU-side signature extraction and is never submitted to hardware
(only fmc_image is). This eliminates the need for unsafe code and
the associated SAFETY comment entirely.
* Use as_bytes_mut() instead of unsafe core::slice::from_raw_parts_mut()
for copying FMC signature data (hash, public_key, signature arrays).
* Refactor wait_for_gsp_lockdown_release() to use early return with ?
instead of chained .inspect_err().map().and_then() pattern.
* Removed many dev_dbg! statements.
* Use IEC binary prefix "MiB" instead of "MB" for memory size output.
Also improved display of small sizes (e.g., "24 KiB" instead of
"0 MB") and fixed a typo ("suprising" -> "surprising").
* Reordered the "skip GFW boot waiting" commit to appear earlier in the
series.
* Series has been reduced from 31 to 30 patches, because the "needs
large reserved mem" patch was absorbed into the non-WPR heap size
patch.
John Hubbard (30):
gpu: nova-core: print FB sizes, along with ranges
gpu: nova-core: add FbRange.len() and use it in boot.rs
gpu: nova-core: Hopper/Blackwell: basic GPU identification
gpu: nova-core: factor .fwsignature* selection into a new
get_gsp_sigs_section()
gpu: nova-core: use GPU Architecture to simplify HAL selections
gpu: nova-core: apply the one "use" item per line policy to
commands.rs
gpu: nova-core: set DMA mask width based on GPU architecture
gpu: nova-core: Hopper/Blackwell: skip GFW boot waiting
gpu: nova-core: move firmware image parsing code to firmware.rs
gpu: nova-core: factor out a section_name_eq() function
gpu: nova-core: don't assume 64-bit firmware images
gpu: nova-core: add support for 32-bit firmware images
gpu: nova-core: add auto-detection of 32-bit, 64-bit firmware images
gpu: nova-core: Hopper/Blackwell: add FMC firmware image, in support
of FSP
gpu: nova-core: Hopper/Blackwell: add FSP falcon engine stub
gpu: nova-core: Hopper/Blackwell: add FSP falcon EMEM operations
gpu: nova-core: Hopper/Blackwell: add FSP message infrastructure
gpu: nova-core: Hopper/Blackwell: calculate reserved FB heap size
gpu: nova-core: Hopper/Blackwell: add FSP secure boot completion
waiting
gpu: nova-core: Hopper/Blackwell: add FSP message structures
gpu: nova-core: Hopper/Blackwell: add FMC signature extraction
gpu: nova-core: Hopper/Blackwell: add FSP send/receive messaging
gpu: nova-core: Hopper/Blackwell: add FSP Chain of Trust boot
gpu: nova-core: Hopper/Blackwell: larger non-WPR heap
gpu: nova-core: Hopper/Blackwell: larger WPR2 (GSP) heap
gpu: nova-core: refactor SEC2 booter loading into run_booter() helper
gpu: nova-core: Hopper/Blackwell: add GSP lockdown release polling
gpu: nova-core: Hopper/Blackwell: add FSP Chain of Trust boot path
gpu: nova-core: Hopper/Blackwell: new location for PCI config mirror
gpu: nova-core: clarify the GPU firmware boot steps
drivers/gpu/nova-core/driver.rs | 35 +-
drivers/gpu/nova-core/falcon.rs | 1 +
drivers/gpu/nova-core/falcon/fsp.rs | 163 +++++++
drivers/gpu/nova-core/falcon/hal.rs | 20 +-
drivers/gpu/nova-core/fb.rs | 118 ++++-
drivers/gpu/nova-core/fb/hal.rs | 30 +-
drivers/gpu/nova-core/fb/hal/ga102.rs | 2 +-
drivers/gpu/nova-core/fb/hal/gb100.rs | 37 ++
drivers/gpu/nova-core/fb/hal/gh100.rs | 37 ++
drivers/gpu/nova-core/firmware.rs | 186 ++++++++
drivers/gpu/nova-core/firmware/fsp.rs | 47 ++
drivers/gpu/nova-core/firmware/gsp.rs | 138 ++----
drivers/gpu/nova-core/fsp.rs | 580 +++++++++++++++++++++++
drivers/gpu/nova-core/gpu.rs | 87 +++-
drivers/gpu/nova-core/gsp/boot.rs | 337 ++++++++++---
drivers/gpu/nova-core/gsp/commands.rs | 8 +-
drivers/gpu/nova-core/gsp/fw.rs | 61 ++-
drivers/gpu/nova-core/gsp/fw/commands.rs | 32 +-
drivers/gpu/nova-core/nova_core.rs | 1 +
drivers/gpu/nova-core/num.rs | 10 +
drivers/gpu/nova-core/regs.rs | 57 +++
21 files changed, 1722 insertions(+), 265 deletions(-)
create mode 100644 drivers/gpu/nova-core/falcon/fsp.rs
create mode 100644 drivers/gpu/nova-core/fb/hal/gb100.rs
create mode 100644 drivers/gpu/nova-core/fb/hal/gh100.rs
create mode 100644 drivers/gpu/nova-core/firmware/fsp.rs
create mode 100644 drivers/gpu/nova-core/fsp.rs
base-commit: 9845cf73f7db6094c0d8419d6adb848028f4a921
--
2.53.0
next reply other threads:[~2026-02-06 4:21 UTC|newest]
Thread overview: 44+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-02-06 4:20 John Hubbard [this message]
2026-02-06 4:20 ` [PATCH v3 01/30] gpu: nova-core: print FB sizes, along with ranges John Hubbard
2026-02-06 4:20 ` [PATCH v3 02/30] gpu: nova-core: add FbRange.len() and use it in boot.rs John Hubbard
2026-02-06 4:20 ` [PATCH v3 03/30] gpu: nova-core: Hopper/Blackwell: basic GPU identification John Hubbard
2026-02-06 4:20 ` [PATCH v3 04/30] gpu: nova-core: factor .fwsignature* selection into a new get_gsp_sigs_section() John Hubbard
2026-02-06 4:20 ` [PATCH v3 05/30] gpu: nova-core: use GPU Architecture to simplify HAL selections John Hubbard
2026-02-06 18:02 ` Timur Tabi
2026-02-09 1:47 ` John Hubbard
2026-02-06 4:20 ` [PATCH v3 06/30] gpu: nova-core: apply the one "use" item per line policy to commands.rs John Hubbard
2026-02-06 4:21 ` [PATCH v3 07/30] gpu: nova-core: set DMA mask width based on GPU architecture John Hubbard
2026-02-06 4:21 ` [PATCH v3 08/30] gpu: nova-core: Hopper/Blackwell: skip GFW boot waiting John Hubbard
2026-02-06 4:21 ` [PATCH v3 09/30] gpu: nova-core: move firmware image parsing code to firmware.rs John Hubbard
2026-02-06 4:21 ` [PATCH v3 10/30] gpu: nova-core: factor out a section_name_eq() function John Hubbard
2026-02-06 4:21 ` [PATCH v3 11/30] gpu: nova-core: don't assume 64-bit firmware images John Hubbard
2026-02-06 4:21 ` [PATCH v3 12/30] gpu: nova-core: add support for 32-bit " John Hubbard
2026-02-06 4:21 ` [PATCH v3 13/30] gpu: nova-core: add auto-detection of 32-bit, 64-bit " John Hubbard
2026-02-06 4:21 ` [PATCH v3 14/30] gpu: nova-core: Hopper/Blackwell: add FMC firmware image, in support of FSP John Hubbard
2026-02-06 4:21 ` [PATCH v3 15/30] gpu: nova-core: Hopper/Blackwell: add FSP falcon engine stub John Hubbard
2026-02-06 4:21 ` [PATCH v3 16/30] gpu: nova-core: Hopper/Blackwell: add FSP falcon EMEM operations John Hubbard
2026-02-06 18:07 ` Timur Tabi
2026-02-09 1:56 ` John Hubbard
2026-02-06 4:21 ` [PATCH v3 17/30] gpu: nova-core: Hopper/Blackwell: add FSP message infrastructure John Hubbard
2026-02-06 4:21 ` [PATCH v3 18/30] gpu: nova-core: Hopper/Blackwell: calculate reserved FB heap size John Hubbard
2026-02-06 4:21 ` [PATCH v3 19/30] gpu: nova-core: Hopper/Blackwell: add FSP secure boot completion waiting John Hubbard
2026-02-06 4:21 ` [PATCH v3 20/30] gpu: nova-core: Hopper/Blackwell: add FSP message structures John Hubbard
2026-02-06 19:41 ` Timur Tabi
2026-02-09 1:59 ` John Hubbard
2026-02-06 4:21 ` [PATCH v3 21/30] gpu: nova-core: Hopper/Blackwell: add FMC signature extraction John Hubbard
2026-02-06 4:21 ` [PATCH v3 22/30] gpu: nova-core: Hopper/Blackwell: add FSP send/receive messaging John Hubbard
2026-02-06 4:21 ` [PATCH v3 23/30] gpu: nova-core: Hopper/Blackwell: add FSP Chain of Trust boot John Hubbard
2026-02-06 4:21 ` [PATCH v3 24/30] gpu: nova-core: Hopper/Blackwell: larger non-WPR heap John Hubbard
2026-02-06 4:21 ` [PATCH v3 25/30] gpu: nova-core: Hopper/Blackwell: larger WPR2 (GSP) heap John Hubbard
2026-02-06 19:03 ` Timur Tabi
2026-02-09 2:05 ` John Hubbard
2026-02-06 4:21 ` [PATCH v3 26/30] gpu: nova-core: refactor SEC2 booter loading into run_booter() helper John Hubbard
2026-02-06 4:21 ` [PATCH v3 27/30] gpu: nova-core: Hopper/Blackwell: add GSP lockdown release polling John Hubbard
2026-02-06 4:21 ` [PATCH v3 28/30] gpu: nova-core: Hopper/Blackwell: add FSP Chain of Trust boot path John Hubbard
2026-02-06 4:21 ` [PATCH v3 29/30] gpu: nova-core: Hopper/Blackwell: new location for PCI config mirror John Hubbard
2026-02-06 4:21 ` [PATCH v3 30/30] gpu: nova-core: clarify the GPU firmware boot steps John Hubbard
2026-02-06 18:43 ` Timur Tabi
2026-02-09 2:14 ` John Hubbard
2026-02-09 2:22 ` John Hubbard
2026-02-09 4:24 ` Timur Tabi
2026-02-09 8:05 ` John Hubbard
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20260206042123.303281-1-jhubbard@nvidia.com \
--to=jhubbard@nvidia.com \
--cc=a.hindborg@kernel.org \
--cc=acourbot@nvidia.com \
--cc=airlied@gmail.com \
--cc=alex.gaynor@gmail.com \
--cc=aliceryhl@google.com \
--cc=apopple@nvidia.com \
--cc=bhelgaas@google.com \
--cc=bjorn3_gh@protonmail.com \
--cc=boqun.feng@gmail.com \
--cc=dakr@kernel.org \
--cc=ecourtney@nvidia.com \
--cc=gary@garyguo.net \
--cc=joelagnelf@nvidia.com \
--cc=linux-kernel@vger.kernel.org \
--cc=lossin@kernel.org \
--cc=nouveau@lists.freedesktop.org \
--cc=ojeda@kernel.org \
--cc=rust-for-linux@vger.kernel.org \
--cc=simona@ffwll.ch \
--cc=tmgross@umich.edu \
--cc=ttabi@nvidia.com \
--cc=zhiw@nvidia.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox
all inboxes | Powered by JetHome®