From patchwork Fri Apr 5 14:53:04 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Luis Henriques X-Patchwork-Id: 10887539 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 1E6FD1515 for ; Fri, 5 Apr 2019 14:53:13 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 0D30628A7C for ; Fri, 5 Apr 2019 14:53:13 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id 019EC28A7E; Fri, 5 Apr 2019 14:53:12 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-7.9 required=2.0 tests=BAYES_00,LOTS_OF_MONEY, MAILING_LIST_MULTI,RCVD_IN_DNSWL_HI autolearn=unavailable version=3.3.1 Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 9881F28A85 for ; Fri, 5 Apr 2019 14:53:12 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1730492AbfDEOxM (ORCPT ); Fri, 5 Apr 2019 10:53:12 -0400 Received: from mx2.suse.de ([195.135.220.15]:57974 "EHLO mx1.suse.de" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1726694AbfDEOxL (ORCPT ); Fri, 5 Apr 2019 10:53:11 -0400 X-Virus-Scanned: by amavisd-new at test-mx.suse.de Received: from relay2.suse.de (unknown [195.135.220.254]) by mx1.suse.de (Postfix) with ESMTP id 253DFB629; Fri, 5 Apr 2019 14:53:09 +0000 (UTC) From: Luis Henriques To: fstests@vger.kernel.org Cc: "Yan, Zheng" , Dave Chinner , ceph-devel@vger.kernel.org, Luis Henriques Subject: [PATCH v2 1/2] ceph: test basic ceph.quota.max_files quota Date: Fri, 5 Apr 2019 15:53:04 +0100 Message-Id: <20190405145305.9574-2-lhenriques@suse.com> In-Reply-To: <20190405145305.9574-1-lhenriques@suse.com> References: <20190405145305.9574-1-lhenriques@suse.com> MIME-Version: 1.0 Sender: ceph-devel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: ceph-devel@vger.kernel.org X-Virus-Scanned: ClamAV using ClamSMTP Simple set of checks for CephFS max_files directory quota implementation. Signed-off-by: Luis Henriques --- tests/ceph/001 | 86 +++++++++++++++++++++++++++++++++++++++++++++ tests/ceph/001.out | 9 +++++ tests/ceph/Makefile | 20 +++++++++++ tests/ceph/group | 1 + 4 files changed, 116 insertions(+) create mode 100755 tests/ceph/001 create mode 100644 tests/ceph/001.out create mode 100644 tests/ceph/Makefile create mode 100644 tests/ceph/group diff --git a/tests/ceph/001 b/tests/ceph/001 new file mode 100755 index 000000000000..770e952cd8dc --- /dev/null +++ b/tests/ceph/001 @@ -0,0 +1,86 @@ +#! /bin/bash +# SPDX-License-Identifier: GPL-2.0 +# Copyright (c) 2019 SUSE LLC. All Rights Reserved. +# +# FS QA Test No. 001 +# +# Test basic ceph.quota.max_files quota features. +# + +seq=`basename $0` +seqres=$RESULT_DIR/$seq +echo "QA output created by $seq" + +workdir=$TEST_DIR/$seq + +tmp=/tmp/$$ +status=1 # failure is the default! +trap "_cleanup; exit \$status" 0 1 2 3 15 + +_cleanup() +{ + cd / + rm -rf $tmp.* +} + +# get standard environment, filters and checks +. ./common/rc +. ./common/filter +. ./common/attr + +# real QA test starts here +_supported_os Linux +_supported_fs ceph + +_require_attrs + +set_quota() +{ + val=$1 + dir=$2 + $SETFATTR_PROG -n ceph.quota.max_files -v $val $dir >/dev/null 2>&1 +} +get_quota() +{ + dir=$1 + $GETFATTR_PROG -n ceph.quota.max_files $dir 2> /dev/null +} + +rm -rf $workdir +mkdir $workdir + +# test setting quota +set_quota 10 $workdir +get_quota $workdir + +# set quota to largest acceptable value (0x7FFFFFFFFFFFFFFF) +set_quota 9223372036854775807 $workdir +get_quota $workdir + +# test resetting quota +set_quota 0 $workdir +get_quota $workdir + +# set quota to invalid values (0x8000000000000000 and -1) +set_quota 9223372036854775808 $workdir +get_quota $workdir + +set_quota -1 $workdir +get_quota $workdir + +set_quota 5 $workdir +mkdir $workdir/0 +touch $workdir/0/1 +touch $workdir/0/2 +touch $workdir/3 + +touch $workdir/4 2>&1 | _filter_test_dir # should fail +mkdir $workdir/5 2>&1 | _filter_test_dir # should fail + +set_quota 0 $workdir +touch $workdir/4 # shouldn't fail +mkdir $workdir/5 # shouldn't fail + +# success, all done +status=0 +exit diff --git a/tests/ceph/001.out b/tests/ceph/001.out new file mode 100644 index 000000000000..6ddb007dce22 --- /dev/null +++ b/tests/ceph/001.out @@ -0,0 +1,9 @@ +QA output created by 001 +# file: mnt/test/001 +ceph.quota.max_files="10" + +# file: mnt/test/001 +ceph.quota.max_files="9223372036854775807" + +touch: cannot touch 'TEST_DIR/001/4': Disk quota exceeded +mkdir: cannot create directory 'TEST_DIR/001/5': Disk quota exceeded diff --git a/tests/ceph/Makefile b/tests/ceph/Makefile new file mode 100644 index 000000000000..f93862af4f31 --- /dev/null +++ b/tests/ceph/Makefile @@ -0,0 +1,20 @@ +# +# Copyright (c) 2019 SUSE LLC. All Rights Reserved. +# + +TOPDIR = ../.. +include $(TOPDIR)/include/builddefs + +CEPHFS_DIR = cephfs +TARGET_DIR = $(PKG_LIB_DIR)/$(TESTS_DIR)/$(CEPHFS_DIR) + +include $(BUILDRULES) + +install: + $(INSTALL) -m 755 -d $(TARGET_DIR) + $(INSTALL) -m 755 $(TESTS) $(TARGET_DIR) + $(INSTALL) -m 644 group $(TARGET_DIR) + $(INSTALL) -m 644 $(OUTFILES) $(TARGET_DIR) + +# Nothing. +install-dev install-lib: diff --git a/tests/ceph/group b/tests/ceph/group new file mode 100644 index 000000000000..e389bc6ec7ee --- /dev/null +++ b/tests/ceph/group @@ -0,0 +1 @@ +001 auto quick quota From patchwork Fri Apr 5 14:53:05 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Luis Henriques X-Patchwork-Id: 10887541 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 7657D139A for ; Fri, 5 Apr 2019 14:53:15 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 5FD9D28A7E for ; Fri, 5 Apr 2019 14:53:15 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id 548B728A85; Fri, 5 Apr 2019 14:53:15 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-7.9 required=2.0 tests=BAYES_00,LOTS_OF_MONEY, MAILING_LIST_MULTI,RCVD_IN_DNSWL_HI autolearn=ham version=3.3.1 Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id BB2E628AF3 for ; Fri, 5 Apr 2019 14:53:14 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1731066AbfDEOxN (ORCPT ); Fri, 5 Apr 2019 10:53:13 -0400 Received: from mx2.suse.de ([195.135.220.15]:57984 "EHLO mx1.suse.de" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1726626AbfDEOxM (ORCPT ); Fri, 5 Apr 2019 10:53:12 -0400 X-Virus-Scanned: by amavisd-new at test-mx.suse.de Received: from relay2.suse.de (unknown [195.135.220.254]) by mx1.suse.de (Postfix) with ESMTP id 14E73B62A; Fri, 5 Apr 2019 14:53:10 +0000 (UTC) From: Luis Henriques To: fstests@vger.kernel.org Cc: "Yan, Zheng" , Dave Chinner , ceph-devel@vger.kernel.org, Luis Henriques Subject: [PATCH v2 2/2] ceph: test basic ceph.quota.max_bytes quota Date: Fri, 5 Apr 2019 15:53:05 +0100 Message-Id: <20190405145305.9574-3-lhenriques@suse.com> In-Reply-To: <20190405145305.9574-1-lhenriques@suse.com> References: <20190405145305.9574-1-lhenriques@suse.com> MIME-Version: 1.0 Sender: ceph-devel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: ceph-devel@vger.kernel.org X-Virus-Scanned: ClamAV using ClamSMTP Simple set of checks for CephFS max_bytes directory quota implementation. Signed-off-by: Luis Henriques --- tests/ceph/002 | 125 +++++++++++++++++++++++++++++++++++++++++++++ tests/ceph/002.out | 64 +++++++++++++++++++++++ tests/ceph/group | 1 + 3 files changed, 190 insertions(+) create mode 100755 tests/ceph/002 create mode 100644 tests/ceph/002.out diff --git a/tests/ceph/002 b/tests/ceph/002 new file mode 100755 index 000000000000..6f71ba567bb5 --- /dev/null +++ b/tests/ceph/002 @@ -0,0 +1,125 @@ +#! /bin/bash +# SPDX-License-Identifier: GPL-2.0 +# Copyright (c) 2019 SUSE LLC. All Rights Reserved. +# +# FS QA Test No. 002 +# +# This tests basic ceph.quota.max_bytes quota features. +# + +seq=`basename $0` +seqres=$RESULT_DIR/$seq +echo "QA output created by $seq" + +workdir=$TEST_DIR/$seq + +tmp=/tmp/$$ +status=1 # failure is the default! +trap "_cleanup; exit \$status" 0 1 2 3 15 + +_cleanup() +{ + cd / + rm -rf $tmp.* +} + +# get standard environment, filters and checks +. ./common/rc +. ./common/filter +. ./common/attr + +# real QA test starts here +_supported_os Linux +_supported_fs ceph + +_require_attrs + +set_quota() +{ + val=$1 + dir=$2 + $SETFATTR_PROG -n ceph.quota.max_bytes -v $val $dir >/dev/null 2>&1 +} + +get_quota() +{ + dir=$1 + $GETFATTR_PROG -n ceph.quota.max_bytes $dir 2> /dev/null +} + +# function to write a file. We use a loop because quotas in CephFS is a +# "best-effort" implementation, i.e. a write may actually be allowed even if the +# quota is being exceeded. Using a loop reduces the chances of this to happen: +# the usage of fsync (-W in xfs_io) and the open/close of the file will make +# sure the file size is be updated in the MDSs. +# +# NOTE: 'size' parameter is in M +write_file() +{ + file=$1 + size=$2 # size in M + for (( i = 1; i < $size; i++ )); do + $XFS_IO_PROG -f -c "pwrite -W $((i * 1048576)) 1m" \ + $file | _filter_xfs_io + done +} + +rm -rf $workdir +mkdir $workdir + +# test setting quota +set_quota 1000000 $workdir +get_quota $workdir + +# set quota to largest acceptable value (0x7FFFFFFFFFFFFFFF) +set_quota 9223372036854775807 $workdir +get_quota $workdir + +# test resetting quota +set_quota 0 $workdir +get_quota $workdir + +# set quota to invalid values (0x8000000000000000 and -1) +set_quota 9223372036854775808 $workdir +get_quota $workdir + +set_quota -1 $workdir +get_quota $workdir + +bigfile="$workdir/bigfile" + +# set quota to 10M +set_quota $((10 * 1048576)) $workdir + +# write 9M file +write_file $bigfile 9 +stat -c %s $bigfile +rm $bigfile + +# try to write 11M file +write_file $bigfile 11 # 11M +stat -c %s $bigfile +rm $bigfile + +# write 5 x 2M files +for (( j = 1; j < 6; j++ )); do + smallfile="$workdir/smallfile_$j" + write_file $smallfile 2 # 2M + stat -c %s $smallfile +done + +# try to write another 2M file, should fail +smallfile="$workdir/smallfile_fail" +write_file $smallfile 2 +stat -c %s $smallfile + +# reset quota +set_quota 0 $workdir + +# write 2M file +write_file $smallfile 2 +stat -c %s $smallfile + +# success, all done +status=0 +exit diff --git a/tests/ceph/002.out b/tests/ceph/002.out new file mode 100644 index 000000000000..e9c597cf10a4 --- /dev/null +++ b/tests/ceph/002.out @@ -0,0 +1,64 @@ +QA output created by 002 +# file: mnt/test/002 +ceph.quota.max_bytes="1000000" + +# file: mnt/test/002 +ceph.quota.max_bytes="9223372036854775807" + +wrote 1048576/1048576 bytes at offset 1048576 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +wrote 1048576/1048576 bytes at offset 2097152 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +wrote 1048576/1048576 bytes at offset 3145728 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +wrote 1048576/1048576 bytes at offset 4194304 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +wrote 1048576/1048576 bytes at offset 5242880 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +wrote 1048576/1048576 bytes at offset 6291456 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +wrote 1048576/1048576 bytes at offset 7340032 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +wrote 1048576/1048576 bytes at offset 8388608 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +9437184 +wrote 1048576/1048576 bytes at offset 1048576 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +wrote 1048576/1048576 bytes at offset 2097152 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +wrote 1048576/1048576 bytes at offset 3145728 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +wrote 1048576/1048576 bytes at offset 4194304 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +wrote 1048576/1048576 bytes at offset 5242880 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +wrote 1048576/1048576 bytes at offset 6291456 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +wrote 1048576/1048576 bytes at offset 7340032 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +wrote 1048576/1048576 bytes at offset 8388608 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +wrote 1048576/1048576 bytes at offset 9437184 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +pwrite: Disk quota exceeded +10485760 +wrote 1048576/1048576 bytes at offset 1048576 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +2097152 +wrote 1048576/1048576 bytes at offset 1048576 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +2097152 +wrote 1048576/1048576 bytes at offset 1048576 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +2097152 +wrote 1048576/1048576 bytes at offset 1048576 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +2097152 +wrote 1048576/1048576 bytes at offset 1048576 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +2097152 +pwrite: Disk quota exceeded +0 +wrote 1048576/1048576 bytes at offset 1048576 +XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) +2097152 diff --git a/tests/ceph/group b/tests/ceph/group index e389bc6ec7ee..02da95169c67 100644 --- a/tests/ceph/group +++ b/tests/ceph/group @@ -1 +1,2 @@ 001 auto quick quota +002 auto quick quota