From patchwork Mon Apr 8 16:08:41 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Luis Henriques X-Patchwork-Id: 10889813 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id D3D991708 for ; Mon, 8 Apr 2019 16:08:48 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id BDB3D286E2 for ; Mon, 8 Apr 2019 16:08:48 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id B1F7A286E6; Mon, 8 Apr 2019 16:08:48 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-7.9 required=2.0 tests=BAYES_00,LOTS_OF_MONEY, MAILING_LIST_MULTI,RCVD_IN_DNSWL_HI autolearn=ham version=3.3.1 Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 4A96C286E2 for ; Mon, 8 Apr 2019 16:08:48 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728682AbfDHQIs (ORCPT ); Mon, 8 Apr 2019 12:08:48 -0400 Received: from mx2.suse.de ([195.135.220.15]:53862 "EHLO mx1.suse.de" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1726968AbfDHQIr (ORCPT ); Mon, 8 Apr 2019 12:08:47 -0400 X-Virus-Scanned: by amavisd-new at test-mx.suse.de Received: from relay2.suse.de (unknown [195.135.220.254]) by mx1.suse.de (Postfix) with ESMTP id 93639AD5D; Mon, 8 Apr 2019 16:08:45 +0000 (UTC) From: Luis Henriques To: fstests@vger.kernel.org Cc: "Yan, Zheng" , Dave Chinner , Eryu Guan , ceph-devel@vger.kernel.org, Luis Henriques Subject: [PATCH v3 1/2] ceph: test basic ceph.quota.max_files quota Date: Mon, 8 Apr 2019 17:08:41 +0100 Message-Id: <20190408160842.23649-2-lhenriques@suse.com> In-Reply-To: <20190408160842.23649-1-lhenriques@suse.com> References: <20190408160842.23649-1-lhenriques@suse.com> MIME-Version: 1.0 Sender: fstests-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: fstests@vger.kernel.org X-Virus-Scanned: ClamAV using ClamSMTP Simple set of checks for CephFS max_files directory quota implementation. Signed-off-by: Luis Henriques --- tests/ceph/001 | 88 +++++++++++++++++++++++++++++++++++++++++++++ tests/ceph/001.out | 9 +++++ tests/ceph/Makefile | 20 +++++++++++ tests/ceph/group | 1 + 4 files changed, 118 insertions(+) create mode 100755 tests/ceph/001 create mode 100644 tests/ceph/001.out create mode 100644 tests/ceph/Makefile create mode 100644 tests/ceph/group diff --git a/tests/ceph/001 b/tests/ceph/001 new file mode 100755 index 000000000000..bbffe75aa7b2 --- /dev/null +++ b/tests/ceph/001 @@ -0,0 +1,88 @@ +#! /bin/bash +# SPDX-License-Identifier: GPL-2.0 +# Copyright (c) 2019 SUSE LLC. All Rights Reserved. +# +# FS QA Test No. 001 +# +# Test basic ceph.quota.max_files quota features. +# + +seq=`basename $0` +seqres=$RESULT_DIR/$seq +echo "QA output created by $seq" + +workdir=$TEST_DIR/$seq + +tmp=/tmp/$$ +status=1 # failure is the default! +trap "_cleanup; exit \$status" 0 1 2 3 15 + +_cleanup() +{ + cd / + rm -rf $tmp.* +} + +# get standard environment, filters and checks +. ./common/rc +. ./common/filter +. ./common/attr + +# real QA test starts here +_supported_os Linux +_supported_fs ceph + +_require_attrs + +set_quota() +{ + local val=$1 + local dir=$2 + $SETFATTR_PROG -n ceph.quota.max_files -v $val $dir >>$seqres.full 2>&1 +} +get_quota() +{ + local dir=$1 + _getfattr -n ceph.quota.max_files --absolute-names $dir \ + 2>>$seqres.full | _filter_test_dir +} + +rm -f $seqres.full +rm -rf $workdir +mkdir $workdir + +# test setting quota +set_quota 10 $workdir +get_quota $workdir + +# set quota to largest acceptable value (0x7FFFFFFFFFFFFFFF) +set_quota 9223372036854775807 $workdir +get_quota $workdir + +# test resetting quota +set_quota 0 $workdir +get_quota $workdir + +# set quota to invalid values (0x8000000000000000 and -1) +set_quota 9223372036854775808 $workdir +get_quota $workdir + +set_quota -1 $workdir +get_quota $workdir + +set_quota 5 $workdir +mkdir $workdir/0 +touch $workdir/0/1 +touch $workdir/0/2 +touch $workdir/3 + +touch $workdir/4 2>&1 | _filter_test_dir # should fail +mkdir $workdir/5 2>&1 | _filter_test_dir # should fail + +set_quota 0 $workdir +touch $workdir/4 # shouldn't fail +mkdir $workdir/5 # shouldn't fail + +# success, all done +status=0 +exit diff --git a/tests/ceph/001.out b/tests/ceph/001.out new file mode 100644 index 000000000000..bc5ff5e61a8f --- /dev/null +++ b/tests/ceph/001.out @@ -0,0 +1,9 @@ +QA output created by 001 +# file: TEST_DIR/001 +ceph.quota.max_files="10" + +# file: TEST_DIR/001 +ceph.quota.max_files="9223372036854775807" + +touch: cannot touch 'TEST_DIR/001/4': Disk quota exceeded +mkdir: cannot create directory 'TEST_DIR/001/5': Disk quota exceeded diff --git a/tests/ceph/Makefile b/tests/ceph/Makefile new file mode 100644 index 000000000000..f93862af4f31 --- /dev/null +++ b/tests/ceph/Makefile @@ -0,0 +1,20 @@ +# +# Copyright (c) 2019 SUSE LLC. All Rights Reserved. +# + +TOPDIR = ../.. +include $(TOPDIR)/include/builddefs + +CEPHFS_DIR = cephfs +TARGET_DIR = $(PKG_LIB_DIR)/$(TESTS_DIR)/$(CEPHFS_DIR) + +include $(BUILDRULES) + +install: + $(INSTALL) -m 755 -d $(TARGET_DIR) + $(INSTALL) -m 755 $(TESTS) $(TARGET_DIR) + $(INSTALL) -m 644 group $(TARGET_DIR) + $(INSTALL) -m 644 $(OUTFILES) $(TARGET_DIR) + +# Nothing. +install-dev install-lib: diff --git a/tests/ceph/group b/tests/ceph/group new file mode 100644 index 000000000000..e389bc6ec7ee --- /dev/null +++ b/tests/ceph/group @@ -0,0 +1 @@ +001 auto quick quota From patchwork Mon Apr 8 16:08:42 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Luis Henriques X-Patchwork-Id: 10889819 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 38517186D for ; Mon, 8 Apr 2019 16:08:50 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 2114E286E2 for ; Mon, 8 Apr 2019 16:08:50 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id 1589E286E5; Mon, 8 Apr 2019 16:08:50 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-7.9 required=2.0 tests=BAYES_00,LOTS_OF_MONEY, MAILING_LIST_MULTI,RCVD_IN_DNSWL_HI autolearn=ham version=3.3.1 Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 7DA4C286EC for ; Mon, 8 Apr 2019 16:08:49 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1728877AbfDHQIt (ORCPT ); Mon, 8 Apr 2019 12:08:49 -0400 Received: from mx2.suse.de ([195.135.220.15]:53882 "EHLO mx1.suse.de" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1726228AbfDHQIs (ORCPT ); Mon, 8 Apr 2019 12:08:48 -0400 X-Virus-Scanned: by amavisd-new at test-mx.suse.de Received: from relay2.suse.de (unknown [195.135.220.254]) by mx1.suse.de (Postfix) with ESMTP id 83644AE8A; Mon, 8 Apr 2019 16:08:46 +0000 (UTC) From: Luis Henriques To: fstests@vger.kernel.org Cc: "Yan, Zheng" , Dave Chinner , Eryu Guan , ceph-devel@vger.kernel.org, Luis Henriques Subject: [PATCH v3 2/2] ceph: test basic ceph.quota.max_bytes quota Date: Mon, 8 Apr 2019 17:08:42 +0100 Message-Id: <20190408160842.23649-3-lhenriques@suse.com> In-Reply-To: <20190408160842.23649-1-lhenriques@suse.com> References: <20190408160842.23649-1-lhenriques@suse.com> MIME-Version: 1.0 Sender: fstests-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: fstests@vger.kernel.org X-Virus-Scanned: ClamAV using ClamSMTP Simple set of checks for CephFS max_bytes directory quota implementation. Signed-off-by: Luis Henriques --- tests/ceph/002 | 127 +++++++++++++++++++++++++++++++++++++++++++++ tests/ceph/002.out | 64 +++++++++++++++++++++++ tests/ceph/group | 1 + 3 files changed, 192 insertions(+) create mode 100755 tests/ceph/002 create mode 100644 tests/ceph/002.out diff --git a/tests/ceph/002 b/tests/ceph/002 new file mode 100755 index 000000000000..0edeb10b104e --- /dev/null +++ b/tests/ceph/002 @@ -0,0 +1,127 @@ +#! /bin/bash +# SPDX-License-Identifier: GPL-2.0 +# Copyright (c) 2019 SUSE LLC. All Rights Reserved. +# +# FS QA Test No. 002 +# +# This tests basic ceph.quota.max_bytes quota features. +# + +seq=`basename $0` +seqres=$RESULT_DIR/$seq +echo "QA output created by $seq" + +workdir=$TEST_DIR/$seq + +tmp=/tmp/$$ +status=1 # failure is the default! +trap "_cleanup; exit \$status" 0 1 2 3 15 + +_cleanup() +{ + cd / + rm -rf $tmp.* +} + +# get standard environment, filters and checks +. ./common/rc +. ./common/filter +. ./common/attr + +# real QA test starts here +_supported_os Linux +_supported_fs ceph + +_require_attrs + +set_quota() +{ + local val=$1 + local dir=$2 + $SETFATTR_PROG -n ceph.quota.max_bytes -v $val $dir >>$seqres.full 2>&1 +} + +get_quota() +{ + local dir=$1 + _getfattr -n ceph.quota.max_bytes --absolute-names $dir \ + 2>>$seqres.full | _filter_test_dir +} + +# function to write a file. We use a loop because quotas in CephFS is a +# "best-effort" implementation, i.e. a write may actually be allowed even if the +# quota is being exceeded. Using a loop reduces the chances of this to happen: +# the usage of fsync (-W in xfs_io) and the open/close of the file will make +# sure the file size is be updated in the MDSs. +# +# NOTE: 'size' parameter is in M +write_file() +{ + local file=$1 + local size=$2 # size in M + for (( i = 1; i < $size; i++ )); do + $XFS_IO_PROG -f -c "pwrite -W $((i * 1048576)) 1m" \ + $file | _filter_xfs_io + done +} + +rm -f $seqres.full +rm -rf $workdir +mkdir $workdir + +# test setting quota +set_quota 1000000 $workdir +get_quota $workdir + +# set quota to largest acceptable value (0x7FFFFFFFFFFFFFFF) +set_quota 9223372036854775807 $workdir +get_quota $workdir + +# test resetting quota +set_quota 0 $workdir +get_quota $workdir + +# set quota to invalid values (0x8000000000000000 and -1) +set_quota 9223372036854775808 $workdir +get_quota $workdir + +set_quota -1 $workdir +get_quota $workdir + +bigfile="$workdir/bigfile" + +# set quota to 10M +set_quota $((10 * 1048576)) $workdir + +# write 9M file +write_file $bigfile 9 +stat -c %s $bigfile +rm $bigfile + +# try to write 11M file +write_file $bigfile 11 # 11M +stat -c %s $bigfile +rm $bigfile + +# write 5 x 2M files +for (( j = 1; j < 6; j++ )); do + smallfile="$workdir/smallfile_$j" + write_file $smallfile 2 # 2M + stat -c %s $smallfile +done + +# try to write another 2M file, should fail +smallfile="$workdir/smallfile_fail" +write_file $smallfile 2 +stat -c %s $smallfile + +# reset quota +set_quota 0 $workdir + +# write 2M file +write_file $smallfile 2 +stat -c %s $smallfile + +# success, all done +status=0 +exit diff --git a/tests/ceph/002.out b/tests/ceph/002.out new file mode 100644 index 000000000000..f5881e532a3e --- /dev/null +++ b/tests/ceph/002.out @@ -0,0 +1,64 @@ +QA output created by 002 +# file: TEST_DIR/002 +ceph.quota.max_bytes="1000000" + +# file: TEST_DIR/002 +ceph.quota.max_bytes="9223372036854775807" + +wrote 1048576/1048576 bytes at offset 1048576 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +wrote 1048576/1048576 bytes at offset 2097152 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +wrote 1048576/1048576 bytes at offset 3145728 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +wrote 1048576/1048576 bytes at offset 4194304 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +wrote 1048576/1048576 bytes at offset 5242880 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +wrote 1048576/1048576 bytes at offset 6291456 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +wrote 1048576/1048576 bytes at offset 7340032 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +wrote 1048576/1048576 bytes at offset 8388608 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +9437184 +wrote 1048576/1048576 bytes at offset 1048576 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +wrote 1048576/1048576 bytes at offset 2097152 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +wrote 1048576/1048576 bytes at offset 3145728 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +wrote 1048576/1048576 bytes at offset 4194304 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +wrote 1048576/1048576 bytes at offset 5242880 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +wrote 1048576/1048576 bytes at offset 6291456 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +wrote 1048576/1048576 bytes at offset 7340032 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +wrote 1048576/1048576 bytes at offset 8388608 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +wrote 1048576/1048576 bytes at offset 9437184 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +pwrite: Disk quota exceeded +10485760 +wrote 1048576/1048576 bytes at offset 1048576 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +2097152 +wrote 1048576/1048576 bytes at offset 1048576 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +2097152 +wrote 1048576/1048576 bytes at offset 1048576 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +2097152 +wrote 1048576/1048576 bytes at offset 1048576 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +2097152 +wrote 1048576/1048576 bytes at offset 1048576 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +2097152 +pwrite: Disk quota exceeded +0 +wrote 1048576/1048576 bytes at offset 1048576 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +2097152 diff --git a/tests/ceph/group b/tests/ceph/group index e389bc6ec7ee..02da95169c67 100644 --- a/tests/ceph/group +++ b/tests/ceph/group @@ -1 +1,2 @@ 001 auto quick quota +002 auto quick quota