From patchwork Thu Nov 25 07:47:47 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Shiyang Ruan X-Patchwork-Id: 12638601 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id A54C0C433F5 for ; Thu, 25 Nov 2021 07:58:00 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S240021AbhKYIBK (ORCPT ); Thu, 25 Nov 2021 03:01:10 -0500 Received: from mail.cn.fujitsu.com ([183.91.158.132]:17619 "EHLO heian.cn.fujitsu.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S240121AbhKYH7K (ORCPT ); Thu, 25 Nov 2021 02:59:10 -0500 IronPort-Data: A9a23:fYrVYqB/yL+IwBVW/zXhw5YqxClBgxIJ4g17XOLfDQfrhThx0zNWz2JJCjrVPf/eNzOje4wkbY++9UoEuMSAx9UxeLYW3SszFioV86IpJjg4wn/YZnrUdouaJK5ex512huLocYZkERcwmj/3auK49CAmiPnRLlbBILWs1h5ZFFYMpBgJ2UoLd94R2uaEsPDha++/kYqaT/73ZDdJ7wVJ3lc8sMpvnv/AUMPa41v0tnRmDRxCUcS3e3M9VPrzLonpR5f0rxU9IwK0ewrD5OnREmLx9BFrBM6nk6rgbwsBRbu60Qqm0yIQAvb9xEMZ4HFaPqUTbZLwbW9NljyPhME3xtNWqbS+VAUoIrbR3u8aVnG0FgknZPIWqeeZcCPXXcu7iheun2HX6/t1EEwtIZYw5Ol6GydN+OYeJTRLaQqM799aaprTpvJE35xldZe0ethE/CwI8N0QNt5+KbirfkkAzYMwMO8Mu/1z IronPort-HdrOrdr: A9a23:YV2ru6skSgmwcpnX23wlZwr27skDWNV00zEX/kB9WHVpmwKj9/xH158gpGbJYVcqKRYdcL+7Scu9qB/nm6KdwLNhRYtKPzOW3FdATrsSiLcLwlXbalbDH4dmvM8KT0EUMqySMbEMt6rHCWeDcurIuuPszEnRv5a5854wd3ARV0ga1WpE4rvxKCJLeDU= X-IronPort-AV: E=Sophos;i="5.87,262,1631548800"; d="scan'208";a="117890693" Received: from unknown (HELO cn.fujitsu.com) ([10.167.33.5]) by heian.cn.fujitsu.com with ESMTP; 25 Nov 2021 15:48:05 +0800 Received: from G08CNEXMBPEKD06.g08.fujitsu.local (unknown [10.167.33.206]) by cn.fujitsu.com (Postfix) with ESMTP id 360EE4D138C3 for ; Thu, 25 Nov 2021 15:48:00 +0800 (CST) Received: from G08CNEXJMPEKD02.g08.fujitsu.local (10.167.33.202) by G08CNEXMBPEKD06.g08.fujitsu.local (10.167.33.206) with Microsoft SMTP Server (TLS) id 15.0.1497.23; Thu, 25 Nov 2021 15:47:58 +0800 Received: from G08CNEXCHPEKD09.g08.fujitsu.local (10.167.33.85) by G08CNEXJMPEKD02.g08.fujitsu.local (10.167.33.202) with Microsoft SMTP Server (TLS) id 15.0.1497.23; Thu, 25 Nov 2021 15:48:00 +0800 Received: from irides.mr.mr.mr (10.167.225.141) by G08CNEXCHPEKD09.g08.fujitsu.local (10.167.33.209) with Microsoft SMTP Server id 15.0.1497.23 via Frontend Transport; Thu, 25 Nov 2021 15:47:58 +0800 From: Shiyang Ruan To: Subject: [PATCH v2 11/16] generic: add buffered-io CoW test for mixed&source extents Date: Thu, 25 Nov 2021 15:47:47 +0800 Message-ID: <20211125074752.274176-12-ruansy.fnst@fujitsu.com> X-Mailer: git-send-email 2.34.0 In-Reply-To: <20211125074752.274176-1-ruansy.fnst@fujitsu.com> References: <20211125074752.274176-1-ruansy.fnst@fujitsu.com> MIME-Version: 1.0 X-yoursite-MailScanner-ID: 360EE4D138C3.AFE06 X-yoursite-MailScanner: Found to be clean X-yoursite-MailScanner-From: ruansy.fnst@fujitsu.com Precedence: bulk List-ID: X-Mailing-List: fstests@vger.kernel.org Ensuring that copy on write in buffered mode works when the CoW range originally covers multiple extents, mixed with reflinked, unwritten, hole, regular and delalloc blocks. Signed-off-by: Shiyang Ruan --- common/reflink | 54 +++++++++++++++++++++++++++++++++++ tests/generic/910 | 66 +++++++++++++++++++++++++++++++++++++++++++ tests/generic/910.out | 12 ++++++++ 3 files changed, 132 insertions(+) create mode 100755 tests/generic/910 create mode 100644 tests/generic/910.out diff --git a/common/reflink b/common/reflink index e304ddc8..cca43393 100644 --- a/common/reflink +++ b/common/reflink @@ -435,3 +435,57 @@ _sweave_reflink_holes_delalloc() { $FILEFRAG_PROG -v $sfile 2>&1 | grep -q delalloc || \ _notrun "test requires delayed allocation writes" } + +# Create a file of interleaved holes, unwritten blocks, regular blocks, and +# reflinked blocks +_sweave_reflink_rainbow() { + blksz=$1 + nr=$2 + sfile=$3 + dfile=$4 + + $XFS_IO_PROG -f -c "truncate $((blksz * nr))" $sfile + _pwrite_byte 0x00 0 $((blksz * nr)) $sfile.chk + _pwrite_byte 0x61 0 $((blksz * nr)) $dfile + seq 0 5 $((nr - 1)) | while read i; do + _pwrite_byte 0x61 $((blksz * i)) $blksz $sfile + _pwrite_byte 0x61 $((blksz * i)) $blksz $sfile.chk + done + # 0 blocks are reflinked + seq 0 5 $((nr - 1)) | while read i; do + _reflink_range $sfile $((blksz * i)) $dfile $((blksz * i)) $blksz + _pwrite_byte 0x61 $((blksz * i)) $blksz $sfile.chk + done + # 1 blocks are unwritten + seq 1 5 $((nr - 1)) | while read i; do + $XFS_IO_PROG -f -c "falloc $((blksz * i)) $blksz" $sfile + _pwrite_byte 0x00 $((blksz * i)) $blksz $sfile.chk + done + # 2 blocks are holes + seq 2 5 $((nr - 1)) | while read i; do + _pwrite_byte 0x00 $((blksz * i)) $blksz $sfile.chk + done + # 3 blocks are regular + seq 3 5 $((nr - 1)) | while read i; do + _pwrite_byte 0x71 $((blksz * i)) $blksz $sfile + _pwrite_byte 0x71 $((blksz * i)) $blksz $sfile.chk + done + # 4 blocks will be delalloc later +} + +# For a file created with _sweave_reflink_rainbow, fill the holes with delalloc +# extents +_sweave_reflink_rainbow_delalloc() { + blksz=$1 + nr=$2 + dfile=$3 + + # 4 blocks are delalloc (do later) + seq 4 5 $((nr - 1)) | while read i; do + _pwrite_byte 0x62 $((blksz * i)) $blksz $sfile + _pwrite_byte 0x62 $((blksz * i)) $blksz $sfile.chk + done + # make sure we actually got delalloc block + $FILEFRAG_PROG -v $sfile 2>&1 | grep -q delalloc || \ + _notrun "test requires delayed allocation writes" +} diff --git a/tests/generic/910 b/tests/generic/910 new file mode 100755 index 00000000..8d731a2d --- /dev/null +++ b/tests/generic/910 @@ -0,0 +1,66 @@ +#! /bin/bash +# SPDX-License-Identifier: GPL-2.0 +# +# FS QA Test No. 910 +# +# Ensuring that copy on write in buffered mode works when the CoW +# range originally covers multiple extents, mixed with reflinked, unwritten, +# hole, regular and delalloc blocks. +# - Create a file with the following repeating sequence of blocks: +# 1. reflinked +# 2. unwritten +# 3. hole +# 4. regular block +# 5. delalloc +# - CoW across the halfway mark, starting with the unwritten extent. +# - Check that the files are now different where we say they're different. +# +. ./common/preamble +_begin_fstest auto quick clone punch + +# Import common functions. +. ./common/filter +. ./common/reflink + +# real QA test starts here +_require_scratch_reflink +_require_xfs_io_command "falloc" +_require_xfs_io_command "fpunch" +_require_cp_reflink +_require_odirect + +echo "Format and mount" +_scratch_mkfs > $seqres.full 2>&1 +_scratch_mount >> $seqres.full 2>&1 + +testdir=$SCRATCH_MNT/test-$seq +mkdir $testdir + +echo "Create the original files" +blksz=65536 +nr=64 +filesize=$((blksz * nr)) +_sweave_reflink_rainbow $blksz $nr $testdir/file1 $testdir/file3 >> $seqres.full +_scratch_cycle_mount + +echo "Compare files" +md5sum $testdir/file1 | _filter_scratch +md5sum $testdir/file3 | _filter_scratch +md5sum $testdir/file1.chk | _filter_scratch + +echo "CoW across the transition" +cowoff=$((filesize / 4)) +cowsz=$((filesize / 2)) +_sweave_reflink_rainbow_delalloc $blksz $nr $testdir/file1 >> $seqres.full +# now cow +$XFS_IO_PROG -f -c "pwrite -S 0x63 -b $cowsz $cowoff $cowsz" $testdir/file1 >> $seqres.full +_pwrite_byte 0x63 $cowoff $cowsz $testdir/file1.chk >> $seqres.full +_scratch_cycle_mount + +echo "Compare files" +md5sum $testdir/file1 | _filter_scratch +md5sum $testdir/file3 | _filter_scratch +md5sum $testdir/file1.chk | _filter_scratch + +# success, all done +status=0 diff --git a/tests/generic/910.out b/tests/generic/910.out new file mode 100644 index 00000000..12956584 --- /dev/null +++ b/tests/generic/910.out @@ -0,0 +1,12 @@ +QA output created by 910 +Format and mount +Create the original files +Compare files +6366fd359371414186688a0ef6988893 SCRATCH_MNT/test-910/file1 +bdbcf02ee0aa977795a79d25fcfdccb1 SCRATCH_MNT/test-910/file3 +6366fd359371414186688a0ef6988893 SCRATCH_MNT/test-910/file1.chk +CoW across the transition +Compare files +26aa3a0749b867ec58363c8539ee5471 SCRATCH_MNT/test-910/file1 +bdbcf02ee0aa977795a79d25fcfdccb1 SCRATCH_MNT/test-910/file3 +26aa3a0749b867ec58363c8539ee5471 SCRATCH_MNT/test-910/file1.chk