[RFC,0/5] Add support for central fsconfig and -q <n> unconditional loop

Message

Nirjhar Roy (IBM) Jan. 10, 2025, 9:10 a.m. UTC

This series introduces 2 new features, central fsconfig support and "-q <n>"
option to support unconditional looping. Along with this, it also brings
some improvements to output data both, in stdout and in result.log.
Central fsconfig feature allows us to define MKFS and MOUNT options for
different filesystems and use this central config to invoke any test.
We don't need to maintain different sections in local.config file for
different mkfs and mount options of any given FS.
e.g.
./check -c configs/xfs/4k,configs/ext4/1k -g quick

Central fsconfigs can be useful for below reasons:-
1. Testers and other FS developers can know what is being actively
tested and maintained by FS Maintainers.
2. It "reduces" the need to maintain different local.config files or
different sections within local.config file for subsystem maintainers
for testing different filesystem configurations.
-q <n> option can be useful for fast unconditional looping (compared to
-I <n>) to test a certain flakey test and get it's pass/fail metrics.

This is similar to -L <n>, although with -L the test only loops if it
fails the 1st time.
The individual patches can provide more details about other changes and
improvements.

This is something that was discussed during last LSFMM [1]
[1] https://lore.kernel.org/all/[e-mail]/

Nirjhar Roy (IBM) (5):
  tests/selftest: Add a new pseudo flaky test.
  check: Add -q <n> option to support unconditional looping.
  check: Improve pass/fail metrics and section config output
  check,common/config: Add support for central fsconfig
  configs: Add a couple of xfs and ext4 configuration templates.

 README.config-sections |  12 +++
 check                  | 193 +++++++++++++++++++++++++++++++----------
 common/config          |  51 ++++++++++-
 common/report          |   2 +-
 configs/ext4/1k        |   3 +
 configs/ext4/4k        |   3 +
 configs/ext4/64k       |   3 +
 configs/xfs/1k         |   3 +
 configs/xfs/4k         |   3 +
 configs/xfs/64k        |   3 +
 configs/xfs/adv        |   3 +
 configs/xfs/quota      |   3 +
 tests/selftest/007     |  21 +++++
 tests/selftest/007.out |   2 +
 14 files changed, 256 insertions(+), 49 deletions(-)
 create mode 100644 configs/ext4/1k
 create mode 100644 configs/ext4/4k
 create mode 100644 configs/ext4/64k
 create mode 100644 configs/xfs/1k
 create mode 100644 configs/xfs/4k
 create mode 100644 configs/xfs/64k
 create mode 100644 configs/xfs/adv
 create mode 100644 configs/xfs/quota
 create mode 100755 tests/selftest/007
 create mode 100644 tests/selftest/007.out

--
2.34.1