From patchwork Tue Sep 5 19:11:17 2017 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Amir Goldstein X-Patchwork-Id: 9939543 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork.web.codeaurora.org (Postfix) with ESMTP id 778DA60350 for ; Tue, 5 Sep 2017 19:11:20 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 68555289F2 for ; Tue, 5 Sep 2017 19:11:20 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id 5D7EF28A00; Tue, 5 Sep 2017 19:11:20 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-6.5 required=2.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID, DKIM_VALID_AU, FREEMAIL_FROM, RCVD_IN_DNSWL_HI, RCVD_IN_SORBS_SPAM autolearn=unavailable version=3.3.1 Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id C47EF289F2 for ; Tue, 5 Sep 2017 19:11:19 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1752748AbdIETLQ (ORCPT ); Tue, 5 Sep 2017 15:11:16 -0400 Received: from mail-wr0-f194.google.com ([209.85.128.194]:35052 "EHLO mail-wr0-f194.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752591AbdIETLI (ORCPT ); Tue, 5 Sep 2017 15:11:08 -0400 Received: by mail-wr0-f194.google.com with SMTP id a47so2135101wra.2; Tue, 05 Sep 2017 12:11:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references; bh=m+aTA/3GxH4wa1A7/7teKd88xi6hjHgSIblv1HqI9dM=; b=KgRYauJKBi4r9dTjixa4K2mtgxm9n15b9pTQmt6cBSdCDPbj8Y3WWBEKEEiBISS2yE YcjKZly9XA/WPwfwGTjRJ4pXPPBE8RcY92vrR5eA5GYyfkQ4gM/lm2gQUBwUhGrosrdP Eku9UpiwygpxL+pwCDpoZ5fywCEOUu3a3YZeOx+ssO8qosbJ46gyr0DtB8oIRX8GNdGQ CV4divoT10zGMYcvuWC43UuF83Gcaw/X+CsaR6W8UqOCiZL0183TEKI9UjCbwKyr4bda z8WthrCr4zMcImmpZJ7ok43PLB22PVvBHc64ihKg0SXSKlRwaTKsVkHAP99tACfnvuN0 Oh9g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references; bh=m+aTA/3GxH4wa1A7/7teKd88xi6hjHgSIblv1HqI9dM=; b=jVZgF4e1xL50fVFdZICO/FmvodVoam9yU6FyEC2myvP1HlgIXGx5R+TzeJCzAOurso yF3pPSgV153R5NkcXhjKfwLyw/2gTF7ceN7fMybQs6lyd+b5cv3Rbvofq2uJ0lt7k1Mw J1xuesRXrljXR8y5yyeHyBodqeGWNerHmVZgJsRLzB1Yw3yh9ddJWsJIA6GiLzddSZec p0U9XkHt6jQrF6dszMNyyV9wjLnKuAzSu0gj995BfGb0wnTFlcoUnO1L4RjyGWDfGexR oMIc4TY52p8jdmmvKkFmEbK5BCvAUDuSlvt9C0hS2oBO6lPqJCd8yddci6T8WK7tSXrm 0KdA== X-Gm-Message-State: AHPjjUjHi1VEaVUszkk6+otGJFFmbkD/UepobqXrK48OWIJpkTDkRCZH ztg1PkLaKi4WiA== X-Google-Smtp-Source: ADKCNb5r4QTD9bNTr5V6sqfit7qAaF/NicvWjq/0AXrSqpoJqQ6QkCXQNdruHBgRKDI7XbpLi/45gg== X-Received: by 10.223.197.13 with SMTP id q13mr56856wrf.80.1504638666600; Tue, 05 Sep 2017 12:11:06 -0700 (PDT) Received: from localhost.localdomain (bzq-79-182-137-119.red.bezeqint.net. [79.182.137.119]) by smtp.gmail.com with ESMTPSA id 30sm1829015wry.34.2017.09.05.12.11.05 (version=TLS1_2 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Tue, 05 Sep 2017 12:11:06 -0700 (PDT) From: Amir Goldstein To: Eryu Guan Cc: Josef Bacik , fstests@vger.kernel.org, linux-fsdevel@vger.kernel.org Subject: [PATCH v3 10/13] fstests: crash consistency fsx test using dm-log-writes Date: Tue, 5 Sep 2017 22:11:17 +0300 Message-Id: <1504638680-25682-11-git-send-email-amir73il@gmail.com> X-Mailer: git-send-email 2.7.4 In-Reply-To: <1504638680-25682-1-git-send-email-amir73il@gmail.com> References: <1504638680-25682-1-git-send-email-amir73il@gmail.com> Sender: linux-fsdevel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-fsdevel@vger.kernel.org X-Virus-Scanned: ClamAV using ClamSMTP Cherry-picked the test from commit 70d41e17164b in Josef Bacik's fstests tree (https://github.com/josefbacik/fstests). Quoting from Josef's commit message: The test just runs some ops and exits, then finds all of the good buffers in the directory we provided and: - replays up to the mark given - mounts the file system and compares the md5sum - unmounts and fsck's to check for metadata integrity dm-log-writes will pretend to do discard and the replay-log tool will replay it properly depending on the underlying device, either by writing 0's or actually calling the discard ioctl, so I've enabled discard in the test for maximum fun. [Amir:] - Removed unneeded _test_falloc_support dynamic FSX_OPTS - Fold repetitions into for loops - Added place holders for using constant random seeds - Add pre umount checkpint - Add test to new 'replay' group - Address review comments by Eryu Guan Cc: Josef Bacik Signed-off-by: Amir Goldstein --- tests/generic/500 | 135 ++++++++++++++++++++++++++++++++++++++++++++++++++ tests/generic/500.out | 2 + tests/generic/group | 1 + 3 files changed, 138 insertions(+) create mode 100755 tests/generic/500 create mode 100644 tests/generic/500.out diff --git a/tests/generic/500 b/tests/generic/500 new file mode 100755 index 0000000..82f7a93 --- /dev/null +++ b/tests/generic/500 @@ -0,0 +1,135 @@ +#! /bin/bash +# FS QA Test No. 500 +# +# Run fsx with log writes to verify power fail safeness. +# +#----------------------------------------------------------------------- +# Copyright (c) 2015 Facebook. All Rights Reserved. +# +# This program is free software; you can redistribute it and/or +# modify it under the terms of the GNU General Public License as +# published by the Free Software Foundation. +# +# This program is distributed in the hope that it would be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. +# +# You should have received a copy of the GNU General Public License +# along with this program; if not, write the Free Software Foundation, +# Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA +#----------------------------------------------------------------------- +# + +seq=`basename $0` +seqres=$RESULT_DIR/$seq +echo "QA output created by $seq" + +here=`pwd` +status=1 # failure is the default! + +_cleanup() +{ + _log_writes_cleanup +} +trap "_cleanup; exit \$status" 0 1 2 3 15 + +# get standard environment, filters and checks +. ./common/rc +. ./common/filter +. ./common/dmlogwrites + +# real QA test starts here +_supported_fs generic +_supported_os Linux +_require_test +_require_scratch_nocheck +_require_log_writes + +rm -f $seqres.full + +check_files() +{ + local name=$1 + + # Now look for our files + for i in $(find $SANITY_DIR -type f | grep $name | grep mark) + do + local filename=$(basename $i) + local mark="${filename##*.}" + echo "checking $filename" >> $seqres.full + _log_writes_replay_log $filename + _scratch_mount + local expected_md5=$(_md5_checksum $i) + local md5=$(_md5_checksum $SCRATCH_MNT/$name) + [ "${md5}" != "${expected_md5}" ] && _fail "$filename md5sum mismatched" + _scratch_unmount + _check_scratch_fs + done +} + +SANITY_DIR=$TEST_DIR/fsxtests +rm -rf $SANITY_DIR +mkdir $SANITY_DIR + +# Create the log +_log_writes_init + +_log_writes_mkfs >> $seqres.full 2>&1 + +# Log writes emulates discard support, turn it on for maximum crying. +_log_writes_mount -o discard + +NUM_FILES=4 +NUM_OPS=200 +FSX_OPTS="-N $NUM_OPS -d -P $SANITY_DIR -i $LOGWRITES_DMDEV" +# Set random seeds for fsx runs (0 for timestamp + pid) +seeds=(0 0 0 0) +# Run fsx for a while +for j in `seq 0 $((NUM_FILES-1))` +do + run_check $here/ltp/fsx $FSX_OPTS -S ${seeds[$j]} -j $j $SCRATCH_MNT/testfile$j & +done +wait + +test_md5=() +for j in `seq 0 $((NUM_FILES-1))` +do + test_md5[$j]=$(_md5_checksum $SCRATCH_MNT/testfile$j) +done + +# Unmount the scratch dir and tear down the log writes target +_log_writes_mark last +_log_writes_unmount +_log_writes_mark end +_log_writes_remove +_check_scratch_fs + +# check pre umount +echo "checking pre umount" >> $seqres.full +_log_writes_replay_log last +_scratch_mount +_scratch_unmount +_check_scratch_fs + +for j in `seq 0 $((NUM_FILES-1))` +do + check_files testfile$j +done + +# Check the end +echo "checking post umount" >> $seqres.full +_log_writes_replay_log end +_scratch_mount +for j in `seq 0 $((NUM_FILES-1))` +do + md5=$(_md5_checksum $SCRATCH_MNT/testfile$j) + [ "${md5}" != "${test_md5[$j]}" ] && _fail "testfile$j end md5sum mismatched" +done +_scratch_unmount +_check_scratch_fs + +echo "Silence is golden" +status=0 +exit + diff --git a/tests/generic/500.out b/tests/generic/500.out new file mode 100644 index 0000000..883b2ca --- /dev/null +++ b/tests/generic/500.out @@ -0,0 +1,2 @@ +QA output created by 500 +Silence is golden diff --git a/tests/generic/group b/tests/generic/group index 1894de0..c857153 100644 --- a/tests/generic/group +++ b/tests/generic/group @@ -457,3 +457,4 @@ 452 auto quick 453 auto quick dir 454 auto quick attr +500 auto log replay