mirror of https://lore.kernel.org/lkml/
 help / color / mirror / Atom feed
From: "John Groves" <john@jagalactic.com>
To: "John Groves" <John@Groves.net>,
	"Miklos Szeredi" <miklos@szeredi.hu>,
	"Dan Williams" <dan.j.williams@intel.com>,
	"Bernd Schubert" <bschubert@ddn.com>,
	"Alison Schofield" <alison.schofield@intel.com>
Cc: "John Groves" <jgroves@micron.com>,
	"Jonathan Corbet" <corbet@lwn.net>,
	"Shuah Khan" <skhan@linuxfoundation.org>,
	"Vishal Verma" <vishal.l.verma@intel.com>,
	"Dave Jiang" <dave.jiang@intel.com>,
	"Matthew Wilcox" <willy@infradead.org>, "Jan Kara" <jack@suse.cz>,
	"Alexander Viro" <viro@zeniv.linux.org.uk>,
	"David Hildenbrand" <david@kernel.org>,
	"Christian Brauner" <brauner@kernel.org>,
	"Darrick J . Wong" <djwong@kernel.org>,
	"Randy Dunlap" <rdunlap@infradead.org>,
	"Jeff Layton" <jlayton@kernel.org>,
	"Amir Goldstein" <amir73il@gmail.com>,
	"Jonathan Cameron" <Jonathan.Cameron@huawei.com>,
	"Stefan Hajnoczi" <shajnocz@redhat.com>,
	"Joanne Koong" <joannelkoong@gmail.com>,
	"Josef Bacik" <josef@toxicpanda.com>,
	"Bagas Sanjaya" <bagasdotme@gmail.com>,
	"Chen Linxuan" <chenlinxuan@uniontech.com>,
	"James Morse" <james.morse@arm.com>,
	"Fuad Tabba" <tabba@google.com>,
	"Sean Christopherson" <seanjc@google.com>,
	"Shivank Garg" <shivankg@amd.com>,
	"Ackerley Tng" <ackerleytng@google.com>,
	"Gregory Price" <gourry@gourry.net>,
	"Aravind Ramesh" <arramesh@micron.com>,
	"Ajay Joshi" <ajayjoshi@micron.com>,
	"venkataravis@micron.com" <venkataravis@micron.com>,
	"linux-doc@vger.kernel.org" <linux-doc@vger.kernel.org>,
	"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
	"nvdimm@lists.linux.dev" <nvdimm@lists.linux.dev>,
	"linux-cxl@vger.kernel.org" <linux-cxl@vger.kernel.org>,
	"linux-fsdevel@vger.kernel.org" <linux-fsdevel@vger.kernel.org>,
	"John Groves" <john@groves.net>
Subject: [PATCH V9 09/10] famfs_fuse: Add famfs fmap metadata documentation
Date: Tue, 24 Mar 2026 00:42:10 +0000	[thread overview]
Message-ID: <0100019d1d4abe66-c9d5af46-d96d-41c7-a0bb-8aa4c6fbe086-000000@email.amazonses.com> (raw)
In-Reply-To: <0100019d1d48b7e8-4468329f-b446-43f1-87db-3c7e1ff6f28b-000000@email.amazonses.com>

From: John Groves <John@Groves.net>

This describes the fmap metadata - both simple and interleaved

Reviewed-by: Dave Jiang <dave.jiang@intel.com>
Signed-off-by: John Groves <john@groves.net>
---
 fs/fuse/famfs_kfmap.h | 73 +++++++++++++++++++++++++++++++++++++++++++
 1 file changed, 73 insertions(+)

diff --git a/fs/fuse/famfs_kfmap.h b/fs/fuse/famfs_kfmap.h
index 0fff841f5a9e..970ad802b492 100644
--- a/fs/fuse/famfs_kfmap.h
+++ b/fs/fuse/famfs_kfmap.h
@@ -7,6 +7,79 @@
 #ifndef FAMFS_KFMAP_H
 #define FAMFS_KFMAP_H
 
+/* KABI version 43 (aka v2) fmap structures
+ *
+ * The location of the memory backing for a famfs file is described by
+ * the response to the GET_FMAP fuse message (defined in
+ * include/uapi/linux/fuse.h
+ *
+ * There are currently two extent formats: Simple and Interleaved.
+ *
+ * Simple extents are just (devindex, offset, length) tuples, where devindex
+ * references a devdax device that must be retrievable via the GET_DAXDEV
+ * message/response.
+ *
+ * The extent list size must be >= file_size.
+ *
+ * Interleaved extents merit some additional explanation. Interleaved
+ * extents stripe data across a collection of strips. Each strip is a
+ * contiguous allocation from a single devdax device - and is described by
+ * a simple_extent structure.
+ *
+ * Interleaved_extent example:
+ *   ie_nstrips = 4
+ *   ie_chunk_size = 2MiB
+ *   ie_nbytes = 24MiB
+ *
+ * ┌────────────┐────────────┐────────────┐────────────┐
+ * │Chunk = 0   │Chunk = 1   │Chunk = 2   │Chunk = 3   │
+ * │Strip = 0   │Strip = 1   │Strip = 2   │Strip = 3   │
+ * │Stripe = 0  │Stripe = 0  │Stripe = 0  │Stripe = 0  │
+ * │            │            │            │            │
+ * └────────────┘────────────┘────────────┘────────────┘
+ * │Chunk = 4   │Chunk = 5   │Chunk = 6   │Chunk = 7   │
+ * │Strip = 0   │Strip = 1   │Strip = 2   │Strip = 3   │
+ * │Stripe = 1  │Stripe = 1  │Stripe = 1  │Stripe = 1  │
+ * │            │            │            │            │
+ * └────────────┘────────────┘────────────┘────────────┘
+ * │Chunk = 8   │Chunk = 9   │Chunk = 10  │Chunk = 11  │
+ * │Strip = 0   │Strip = 1   │Strip = 2   │Strip = 3   │
+ * │Stripe = 2  │Stripe = 2  │Stripe = 2  │Stripe = 2  │
+ * │            │            │            │            │
+ * └────────────┘────────────┘────────────┘────────────┘
+ *
+ * * Data is laid out across chunks in chunk # order
+ * * Columns are strips
+ * * Strips are contiguous devdax extents, normally each coming from a
+ *   different memory device
+ * * Rows are stripes
+ * * The number of chunks is (int)((file_size + chunk_size - 1) / chunk_size)
+ *   (and obviously the last chunk could be partial)
+ * * The stripe_size = (nstrips * chunk_size)
+ * * chunk_num(offset) = offset / chunk_size    //integer division
+ * * strip_num(offset) = chunk_num(offset) % nchunks
+ * * stripe_num(offset) = offset / stripe_size  //integer division
+ * * ...You get the idea - see the code for more details...
+ *
+ * Some concrete examples from the layout above:
+ * * Offset 0 in the file is offset 0 in chunk 0, which is offset 0 in
+ *   strip 0
+ * * Offset 4MiB in the file is offset 0 in chunk 2, which is offset 0 in
+ *   strip 2
+ * * Offset 15MiB in the file is offset 1MiB in chunk 7, which is offset
+ *   3MiB in strip 3
+ *
+ * Notes about this metadata format:
+ *
+ * * For various reasons, chunk_size must be a multiple of the applicable
+ *   PAGE_SIZE
+ * * Since chunk_size and nstrips are constant within an interleaved_extent,
+ *   resolving a file offset to a strip offset within a single
+ *   interleaved_ext is order 1.
+ * * If nstrips==1, a list of interleaved_ext structures degenerates to a
+ *   regular extent list (albeit with some wasted struct space).
+ */
+
 /*
  * The structures below are the in-memory metadata format for famfs files.
  * Metadata retrieved via the GET_FMAP response is converted to this format
-- 
2.53.0



  parent reply	other threads:[~2026-03-24  0:42 UTC|newest]

Thread overview: 48+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
     [not found] <20260324003630.4930-1-john@jagalactic.com>
2026-03-24  0:36 ` [PATCH BUNDLE v9] famfs: Fabric-Attached Memory File System John Groves
     [not found]   ` <20260324003702.4952-1-john@jagalactic.com>
2026-03-24  0:37     ` [PATCH V9 0/8] dax: prepare for famfs John Groves
     [not found]       ` <20260324003743.4973-1-john@jagalactic.com>
2026-03-24  0:37         ` [PATCH V9 1/8] dax: move dax_pgoff_to_phys from [drivers/dax/] device.c to bus.c John Groves
2026-03-24 14:18           ` Jonathan Cameron
2026-03-24 23:44             ` Ira Weiny
2026-03-25 11:55               ` Jonathan Cameron
     [not found]       ` <20260324003756.4990-1-john@jagalactic.com>
2026-03-24  0:38         ` [PATCH V9 2/8] dax: Factor out dax_folio_reset_order() helper John Groves
2026-03-24 14:23           ` Jonathan Cameron
     [not found]       ` <20260324003818.5009-1-john@jagalactic.com>
2026-03-24  0:38         ` [PATCH V9 3/8] dax: add fsdev.c driver for fs-dax on character dax John Groves
2026-03-24 14:39           ` Jonathan Cameron
2026-03-25 12:43             ` John Groves
2026-03-25 16:04               ` Ira Weiny
2026-03-26 14:33                 ` John Groves
2026-03-26 22:46                   ` Ira Weiny
2026-03-27  0:56                     ` John Groves
2026-03-27 16:40                       ` Ira Weiny
2026-03-24 15:19           ` Dave Jiang
2026-03-25  4:48           ` Ira Weiny
     [not found]       ` <20260324003833.5027-1-john@jagalactic.com>
2026-03-24  0:38         ` [PATCH V9 4/8] dax: Save the kva from memremap John Groves
2026-03-24 14:40           ` Jonathan Cameron
     [not found]       ` <20260324003851.5045-1-john@jagalactic.com>
2026-03-24  0:39         ` [PATCH V9 5/8] dax: Add dax_operations for use by fs-dax on fsdev dax John Groves
2026-03-24 14:51           ` Jonathan Cameron
2026-03-24 15:23           ` Dave Jiang
2026-03-25 21:28           ` Dave Jiang
2026-03-27 14:06             ` John Groves
2026-03-25 22:40           ` Dave Jiang
2026-03-27 14:14             ` John Groves
     [not found]       ` <20260324003906.5083-1-john@jagalactic.com>
2026-03-24  0:39         ` [PATCH V9 6/8] dax: Add dax_set_ops() for setting dax_operations at bind time John Groves
2026-03-24 14:53           ` Jonathan Cameron
     [not found]       ` <20260324003919.5106-1-john@jagalactic.com>
2026-03-24  0:39         ` [PATCH V9 7/8] dax: Add fs_dax_get() func to prepare dax for fs-dax usage John Groves
2026-03-24 15:05           ` Jonathan Cameron
2026-03-27 14:45             ` John Groves
2026-03-24 15:25           ` Dave Jiang
     [not found]       ` <20260324003933.5127-1-john@jagalactic.com>
2026-03-24  0:39         ` [PATCH V9 8/8] dax: export dax_dev_get() John Groves
2026-03-24 15:06           ` Jonathan Cameron
     [not found]   ` <20260324003946.5148-1-john@jagalactic.com>
2026-03-24  0:39     ` [PATCH V9 00/10] famfs: port into fuse John Groves
     [not found]       ` <20260324004026.5170-1-john@jagalactic.com>
2026-03-24  0:40         ` [PATCH V9 01/10] famfs_fuse: Update macro s/FUSE_IS_DAX/FUSE_IS_VIRTIO_DAX/ John Groves
2026-03-24 15:12           ` Jonathan Cameron
2026-03-27 14:52             ` John Groves
     [not found]       ` <20260324004039.5188-1-john@jagalactic.com>
2026-03-24  0:40         ` [PATCH V9 02/10] famfs_fuse: Basic fuse kernel ABI enablement for famfs John Groves
     [not found]       ` <20260324004049.5205-1-john@jagalactic.com>
2026-03-24  0:40         ` [PATCH V9 03/10] famfs_fuse: Plumb the GET_FMAP message/response John Groves
     [not found]       ` <20260324004100.5223-1-john@jagalactic.com>
2026-03-24  0:41         ` [PATCH V9 04/10] famfs_fuse: Create files with famfs fmaps John Groves
     [not found]       ` <20260324004110.5240-1-john@jagalactic.com>
2026-03-24  0:41         ` [PATCH V9 05/10] famfs_fuse: GET_DAXDEV message and daxdev_table John Groves
     [not found]       ` <20260324004120.5281-1-john@jagalactic.com>
2026-03-24  0:41         ` [PATCH V9 06/10] famfs_fuse: Plumb dax iomap and fuse read/write/mmap John Groves
     [not found]       ` <20260324004129.5303-1-john@jagalactic.com>
2026-03-24  0:41         ` [PATCH V9 07/10] famfs_fuse: Add holder_operations for dax notify_failure() John Groves
     [not found]       ` <20260324004148.5320-1-john@jagalactic.com>
2026-03-24  0:41         ` [PATCH V9 08/10] famfs_fuse: Add DAX address_space_operations with noop_dirty_folio John Groves
     [not found]       ` <20260324004203.5338-1-john@jagalactic.com>
2026-03-24  0:42         ` John Groves [this message]
     [not found]       ` <20260324004213.5356-1-john@jagalactic.com>
2026-03-24  0:42         ` [PATCH V9 10/10] famfs_fuse: Add documentation John Groves

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=0100019d1d4abe66-c9d5af46-d96d-41c7-a0bb-8aa4c6fbe086-000000@email.amazonses.com \
    --to=john@jagalactic.com \
    --cc=John@Groves.net \
    --cc=Jonathan.Cameron@huawei.com \
    --cc=ackerleytng@google.com \
    --cc=ajayjoshi@micron.com \
    --cc=alison.schofield@intel.com \
    --cc=amir73il@gmail.com \
    --cc=arramesh@micron.com \
    --cc=bagasdotme@gmail.com \
    --cc=brauner@kernel.org \
    --cc=bschubert@ddn.com \
    --cc=chenlinxuan@uniontech.com \
    --cc=corbet@lwn.net \
    --cc=dan.j.williams@intel.com \
    --cc=dave.jiang@intel.com \
    --cc=david@kernel.org \
    --cc=djwong@kernel.org \
    --cc=gourry@gourry.net \
    --cc=jack@suse.cz \
    --cc=james.morse@arm.com \
    --cc=jgroves@micron.com \
    --cc=jlayton@kernel.org \
    --cc=joannelkoong@gmail.com \
    --cc=josef@toxicpanda.com \
    --cc=linux-cxl@vger.kernel.org \
    --cc=linux-doc@vger.kernel.org \
    --cc=linux-fsdevel@vger.kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=miklos@szeredi.hu \
    --cc=nvdimm@lists.linux.dev \
    --cc=rdunlap@infradead.org \
    --cc=seanjc@google.com \
    --cc=shajnocz@redhat.com \
    --cc=shivankg@amd.com \
    --cc=skhan@linuxfoundation.org \
    --cc=tabba@google.com \
    --cc=venkataravis@micron.com \
    --cc=viro@zeniv.linux.org.uk \
    --cc=vishal.l.verma@intel.com \
    --cc=willy@infradead.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox