[GIT,PULL,05/16] xfs: online repair of realtime summaries

Message ID	171322716349.141687.11762646937801715481.stg-ugh@frogsfrogsfrogs (mailing list archive)
State	New
Headers	show Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 20A76386 for <linux-xfs@vger.kernel.org>; Tue, 16 Apr 2024 00:28:41 +0000 (UTC) Date: Mon, 15 Apr 2024 17:28:41 -0700 Subject: [GIT PULL 05/16] xfs: online repair of realtime summaries From: "Darrick J. Wong" <djwong@kernel.org> To: chandanbabu@kernel.org, djwong@kernel.org Cc: hch@lst.de, linux-xfs@vger.kernel.org Message-ID: <171322716349.141687.11762646937801715481.stg-ugh@frogsfrogsfrogs> Precedence: bulk MIME-Version: 1.0 In-Reply-To: <20240416002427.GB11972@frogsfrogsfrogs> References: <20240416002427.GB11972@frogsfrogsfrogs> Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit
Series	[GIT,PULL,01/16] xfs: improve log incompat feature handling \| expand [GIT,PULL,01/16] xfs: improve log incompat feature handling [GIT,PULL,02/16] xfs: refactorings for atomic file content exchanges [GIT,PULL,03/16] xfs: atomic file content exchanges [GIT,PULL,04/16] xfs: create temporary files for online repair [GIT,PULL,05/16] xfs: online repair of realtime summaries [GIT,PULL,06/16] xfs: set and validate dir/attr block owners [GIT,PULL,07/16] xfs: online repair of extended attributes [GIT,PULL,08/16] xfs: online repair of inode unlinked state [GIT,PULL,09/16] xfs: online repair of directories [GIT,PULL,10/16] xfs: move orphan files to lost and found [GIT,PULL,11/16] xfs: online repair of symbolic links [GIT,PULL,12/16] xfs: online fsck of iunlink buckets [GIT,PULL,13/16] xfs: inode-related repair fixes [GIT,PULL,14/16] xfs: less heavy locks during fstrim [GIT,PULL,15/16] xfs: design documentation for online fsck, part 2 [GIT,PULL,16/16] xfs: retain ILOCK during directory updates

Message ID

171322716349.141687.11762646937801715481.stg-ugh@frogsfrogsfrogs (mailing list archive)

State

New

Headers

Date: Mon, 15 Apr 2024 17:28:41 -0700
Subject: [GIT PULL 05/16] xfs: online repair of realtime summaries
From: "Darrick J. Wong" <djwong@kernel.org>
To: chandanbabu@kernel.org, djwong@kernel.org
Cc: hch@lst.de, linux-xfs@vger.kernel.org
Message-ID: <171322716349.141687.11762646937801715481.stg-ugh@frogsfrogsfrogs>
Precedence: bulk
MIME-Version: 1.0
In-Reply-To: <20240416002427.GB11972@frogsfrogsfrogs>
References: <20240416002427.GB11972@frogsfrogsfrogs>
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: 7bit

Series

[GIT,PULL,01/16] xfs: improve log incompat feature handling | expand

Message

Darrick J. Wong April 16, 2024, 12:28 a.m. UTC

Hi Chandan,

Please pull this branch with changes for xfs for 6.10-rc1.

As usual, I did a test-merge with the main upstream branch as of a few
minutes ago, and didn't see any conflicts.  Please let me know if you
encounter any problems.

--D

The following changes since commit 5befb047b9f4de1747bf48c63cab997a97e0088b:

xfs: add the ability to reap entire inode forks (2024-04-15 14:58:49 -0700)

are available in the Git repository at:

https://git.kernel.org/pub/scm/linux/kernel/git/djwong/xfs-linux.git tags/repair-rtsummary-6.10_2024-04-15

for you to fetch changes up to abf039e2e4afde98e448253f9a7ecc784a87924d:

xfs: online repair of realtime summaries (2024-04-15 14:58:49 -0700)

----------------------------------------------------------------
xfs: online repair of realtime summaries [v30.3 05/16]

We now have all the infrastructure we need to repair file metadata.
We'll begin with the realtime summary file, because it is the least
complex data structure.  To support this we need to add three more
pieces to the temporary file code from the previous patchset --
preallocating space in the temp file, formatting metadata into that
space and writing the blocks to disk, and swapping the fork mappings
atomically.

After that, the actual reconstruction of the realtime summary
information is pretty simple, since we can simply write the incore
copy computed by the rtsummary scrubber to the temporary file, swap the
contents, and reap the old blocks.

This has been running on the djcloud for months with no problems.  Enjoy!

Signed-off-by: Darrick J. Wong <djwong@kernel.org>

----------------------------------------------------------------
Darrick J. Wong (3):
xfs: support preallocating and copying content into temporary files
xfs: teach the tempfile to set up atomic file content exchanges
xfs: online repair of realtime summaries

fs/xfs/Makefile                 |   1 +
fs/xfs/scrub/common.c           |   1 +
fs/xfs/scrub/repair.h           |   3 +
fs/xfs/scrub/rtsummary.c        |  33 ++--
fs/xfs/scrub/rtsummary.h        |  37 ++++
fs/xfs/scrub/rtsummary_repair.c | 177 ++++++++++++++++++
fs/xfs/scrub/scrub.c            |  11 +-
fs/xfs/scrub/scrub.h            |   7 +
fs/xfs/scrub/tempexch.h         |  21 +++
fs/xfs/scrub/tempfile.c         | 388 ++++++++++++++++++++++++++++++++++++++++
fs/xfs/scrub/tempfile.h         |  15 ++
fs/xfs/scrub/trace.h            |  40 +++++
12 files changed, 715 insertions(+), 19 deletions(-)
create mode 100644 fs/xfs/scrub/rtsummary.h
create mode 100644 fs/xfs/scrub/rtsummary_repair.c
create mode 100644 fs/xfs/scrub/tempexch.h

[GIT,PULL,05/16] xfs: online repair of realtime summaries

Pull-request

Message