From patchwork Wed Feb 8 10:57:37 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Johannes Thumshirn X-Patchwork-Id: 13132966 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id C5865C636CC for ; Wed, 8 Feb 2023 10:58:00 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229796AbjBHK57 (ORCPT ); Wed, 8 Feb 2023 05:57:59 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:35878 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229589AbjBHK56 (ORCPT ); Wed, 8 Feb 2023 05:57:58 -0500 Received: from esa4.hgst.iphmx.com (esa4.hgst.iphmx.com [216.71.154.42]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id BB765113EC for ; Wed, 8 Feb 2023 02:57:56 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=wdc.com; i=@wdc.com; q=dns/txt; s=dkim.wdc.com; t=1675853876; x=1707389876; h=from:to:cc:subject:date:message-id:mime-version: content-transfer-encoding; bh=7JbwWm504Z3fyMQBrTWXWqK8RUzX0jbhIaQkHC/zit4=; b=cNVaRP4rNdN5MduPh4yDv36Eydhr+LE96aIonVitZYBF699rMInTHeie DjsQ5iqxX3zovtoPToHcDiUjBW6xDwCKLEEHXzta+0h4wdy9Ls1UNdFLD 1sgyVlyvZLabYuUPmf8FXP26VzHM6/ZeAgCeeScE7vSbKNvD3yi0SJrfB ifrma5rGgXuY+AixSh9tw/SW7VW7glpSvyEVJXqdHWL59Pgbq2pfYtM85 UJGXoQDM602rpU/Mm2XZIhZTxDMmBjhmVUrgDviyLH2Q49r0dAMdnXlDJ rDEeV1zjpAQ1VVRKvGOEFeNR8Gvbwi4r3pqAUY5hjjeJXZgy2H6HEu32i A==; X-IronPort-AV: E=Sophos;i="5.97,280,1669046400"; d="scan'208";a="221115623" Received: from h199-255-45-14.hgst.com (HELO uls-op-cesaep01.wdc.com) ([199.255.45.14]) by ob1.hgst.iphmx.com with ESMTP; 08 Feb 2023 18:57:55 +0800 IronPort-SDR: VqkmyGiNeaIODR0vcQSPS54IUXZhVddm5+Bk+z4vDXsdK060+XcNJ4OWeeYq7jeLdpeu+WmRa4 DX5hTNAWNpcriWG47bsifF/Rb5MeKBVIkazSX00sVakY6zPSjSPdQF/Xe68xzgrYGd00rSOnE7 gh/UREij3wjiHLqqxrKqyBULfi8NJGXRAPaNpSgml95n0zo3UxMd4OY4C36EIsU/+PwMGZ5R0l yLRTXTCHDNpietLo851dQG6UnBc2lWpj5mih2T0LdWuf0jL+FmB8Wl0Pgqtz63PQtkQQ5COtRo siQ= Received: from uls-op-cesaip02.wdc.com ([10.248.3.37]) by uls-op-cesaep01.wdc.com with ESMTP/TLS/ECDHE-RSA-AES128-GCM-SHA256; 08 Feb 2023 02:15:11 -0800 IronPort-SDR: KVtnDSOx2WN9voCoR6qAAkvWAUchxkhw4VCDroiI8fY5xfWpkxeWQchI5E5LU5dbP5KcDowG4p NZ/XvzArMHVwyCZsj203JvZa4Q+YQnSmyEMd+asGt42eWuAUnz1EC2ahuwKCOfyTq6DgqGffF9 oB1ifVMbNQwdu1d4LFQ/7AdGiEyO6tzQxiq0/02EjXuVks/rb6pREAxIhJ2kq239j494LJFOkd 8D9kYidTEmF9t7C+6N02soXNJHvE4BmEK7Ped26lafk1sy/fGOo0JBUFMcyVfcuS5pUeg9avEi rdo= WDCIronportException: Internal Received: from unknown (HELO redsun91.ssa.fujisawa.hgst.com) ([10.149.66.72]) by uls-op-cesaip02.wdc.com with ESMTP; 08 Feb 2023 02:57:55 -0800 From: Johannes Thumshirn To: linux-btrfs@vger.kernel.org Cc: Johannes Thumshirn Subject: [PATCH v5 00/13] btrfs: introduce RAID stripe tree Date: Wed, 8 Feb 2023 02:57:37 -0800 Message-Id: X-Mailer: git-send-email 2.39.0 MIME-Version: 1.0 Precedence: bulk List-ID: X-Mailing-List: linux-btrfs@vger.kernel.org Updates of the raid-stripe-tree are done at delayed-ref time to safe on bandwidth while for reading we do the stripe-tree lookup on bio mapping time, i.e. when the logical to physical translation happens for regular btrfs RAID as well. The stripe tree is keyed by an extent's disk_bytenr and disk_num_bytes and it's contents are the respective physical device id and position. For an example 1M write (split into 126K segments due to zone-append) rapido2:/home/johannes/src/fstests# xfs_io -fdc "pwrite -b 1M 0 1M" -c fsync /mnt/test/test wrote 1048576/1048576 bytes at offset 0 1 MiB, 1 ops; 0.0065 sec (151.538 MiB/sec and 151.5381 ops/sec) The tree will look as follows: rapido2:/home/johannes/src/fstests# btrfs inspect-internal dump-tree -t raid_stripe /dev/nullb0 btrfs-progs v5.16.1 raid stripe tree key (RAID_STRIPE_TREE ROOT_ITEM 0) leaf 805847040 items 9 free space 15770 generation 9 owner RAID_STRIPE_TREE leaf 805847040 flags 0x1(WRITTEN) backref revision 1 checksum stored 1b22e13800000000000000000000000000000000000000000000000000000000 checksum calced 1b22e13800000000000000000000000000000000000000000000000000000000 fs uuid e4f523d1-89a1-41f9-ab75-6ba3c42a28fb chunk uuid 6f2d8aaa-d348-4bf2-9b5e-141a37ba4c77 item 0 key (939524096 RAID_STRIPE_KEY 126976) itemoff 16251 itemsize 32 stripe 0 devid 1 offset 939524096 stripe 1 devid 2 offset 536870912 item 1 key (939651072 RAID_STRIPE_KEY 126976) itemoff 16219 itemsize 32 stripe 0 devid 1 offset 939651072 stripe 1 devid 2 offset 536997888 item 2 key (939778048 RAID_STRIPE_KEY 126976) itemoff 16187 itemsize 32 stripe 0 devid 1 offset 939778048 stripe 1 devid 2 offset 537124864 item 3 key (939905024 RAID_STRIPE_KEY 126976) itemoff 16155 itemsize 32 stripe 0 devid 1 offset 939905024 stripe 1 devid 2 offset 537251840 item 4 key (940032000 RAID_STRIPE_KEY 126976) itemoff 16123 itemsize 32 stripe 0 devid 1 offset 940032000 stripe 1 devid 2 offset 537378816 item 5 key (940158976 RAID_STRIPE_KEY 126976) itemoff 16091 itemsize 32 stripe 0 devid 1 offset 940158976 stripe 1 devid 2 offset 537505792 item 6 key (940285952 RAID_STRIPE_KEY 126976) itemoff 16059 itemsize 32 stripe 0 devid 1 offset 940285952 stripe 1 devid 2 offset 537632768 item 7 key (940412928 RAID_STRIPE_KEY 126976) itemoff 16027 itemsize 32 stripe 0 devid 1 offset 940412928 stripe 1 devid 2 offset 537759744 item 8 key (940539904 RAID_STRIPE_KEY 32768) itemoff 15995 itemsize 32 stripe 0 devid 1 offset 940539904 stripe 1 devid 2 offset 537886720 total bytes 26843545600 bytes used 1245184 uuid e4f523d1-89a1-41f9-ab75-6ba3c42a28fb A design document can be found here: https://docs.google.com/document/d/1Iui_jMidCd4MVBNSSLXRfO7p5KmvnoQL/edit?usp=sharing&ouid=103609947580185458266&rtpof=true&sd=true Changes to v4: - Added patch to check for RST feature in sysfs - Added RST lookups for scrubbing - Fixed the error handling bug Josef pointed out - Only check if we need to write out a RST once per delayed_ref head - Added support for zoned data DUP with RST Changes to v3: - Rebased onto 20221120124734.18634-1-hch@lst.de - Incorporated Josef's review - Merged related patches v3 of the patchset can be found here: https://lore/kernel.org/linux-btrfs/cover.1666007330.git.johannes.thumshirn@wdc.com Changes to v2: - Bug fixes - Rebased onto 20220901074216.1849941-1-hch@lst.de - Added tracepoints - Added leak checker - Added RAID0 and RAID10 v2 of the patchset can be found here: https://lore.kernel.org/linux-btrfs/cover.1656513330.git.johannes.thumshirn@wdc.com Changes to v1: - Write the stripe-tree at delayed-ref time (Qu) - Add a different write path for preallocation v1 of the patchset can be found here: https://lore.kernel.org/linux-btrfs/cover.1652711187.git.johannes.thumshirn@wdc.com/ Johannes Thumshirn (13): btrfs: re-add trans parameter to insert_delayed_ref btrfs: add raid stripe tree definitions btrfs: read raid-stripe-tree from disk btrfs: add support for inserting raid stripe extents btrfs: delete stripe extent on extent deletion btrfs: lookup physical address from stripe extent btrfs: add raid stripe tree pretty printer btrfs: zoned: allow zoned RAID btrfs: check for leaks of ordered stripes on umount btrfs: add tracepoints for ordered stripes btrfs: announce presence of raid-stripe-tree in sysfs btrfs: consult raid-stripe-tree when scrubbing btrfs: add raid-stripe-tree to features enabled with debug fs/btrfs/Makefile | 2 +- fs/btrfs/accessors.h | 29 +++ fs/btrfs/bio.c | 29 +++ fs/btrfs/bio.h | 2 + fs/btrfs/block-rsv.c | 1 + fs/btrfs/delayed-ref.c | 13 +- fs/btrfs/delayed-ref.h | 2 + fs/btrfs/disk-io.c | 30 ++- fs/btrfs/disk-io.h | 5 + fs/btrfs/extent-tree.c | 68 ++++++ fs/btrfs/fs.h | 8 +- fs/btrfs/inode.c | 15 +- fs/btrfs/print-tree.c | 21 ++ fs/btrfs/raid-stripe-tree.c | 415 ++++++++++++++++++++++++++++++++ fs/btrfs/raid-stripe-tree.h | 87 +++++++ fs/btrfs/scrub.c | 33 ++- fs/btrfs/super.c | 1 + fs/btrfs/sysfs.c | 3 + fs/btrfs/volumes.c | 39 ++- fs/btrfs/volumes.h | 12 +- fs/btrfs/zoned.c | 49 +++- include/trace/events/btrfs.h | 50 ++++ include/uapi/linux/btrfs.h | 1 + include/uapi/linux/btrfs_tree.h | 20 +- 24 files changed, 905 insertions(+), 30 deletions(-) create mode 100644 fs/btrfs/raid-stripe-tree.c create mode 100644 fs/btrfs/raid-stripe-tree.h