[PATCHSET,RFC,0/8] fstests: improve junit xml reporting

Message ID	167149446381.332657.9402608531757557463.stgit@magnolia (mailing list archive)
Headers	show Return-Path: <fstests-owner@kernel.org> Subject: [PATCHSET RFC 0/8] fstests: improve junit xml reporting From: "Darrick J. Wong" <djwong@kernel.org> To: djwong@kernel.org, zlang@redhat.com Cc: linux-xfs@vger.kernel.org, fstests@vger.kernel.org, guan@eryu.me, leah.rumancik@gmail.com, quwenruo.btrfs@gmx.com Date: Mon, 19 Dec 2022 16:01:03 -0800 Message-ID: <167149446381.332657.9402608531757557463.stgit@magnolia> User-Agent: StGit/0.19 MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Precedence: bulk
Series	fstests: improve junit xml reporting \| expand [PATCHSET,RFC,0/8] fstests: improve junit xml reporting [1/8] check: generate section reports between tests [2/8] report: derive an xml schema for the xunit report [3/8] report: capture the time zone in the test report timestamp [4/8] report: sort properties by name [5/8] report: pass property value to _xunit_add_property [6/8] report: collect basic information about a test run [7/8] report: record xfs-specific information about a test run [8/8] report: record ext*-specific information about a test run

Message ID

167149446381.332657.9402608531757557463.stgit@magnolia (mailing list archive)

Headers

Subject: [PATCHSET RFC 0/8] fstests: improve junit xml reporting
From: "Darrick J. Wong" <djwong@kernel.org>
To: djwong@kernel.org, zlang@redhat.com
Cc: linux-xfs@vger.kernel.org, fstests@vger.kernel.org, guan@eryu.me,
        leah.rumancik@gmail.com, quwenruo.btrfs@gmx.com
Date: Mon, 19 Dec 2022 16:01:03 -0800
Message-ID: <167149446381.332657.9402608531757557463.stgit@magnolia>
User-Agent: StGit/0.19
MIME-Version: 1.0
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: 7bit
Precedence: bulk

Series

fstests: improve junit xml reporting | expand

Message

Darrick J. Wong Dec. 20, 2022, 12:01 a.m. UTC

Hi all,

This series improves the fstests reporting code in several ways.  First,
change the ./check code to generate the report after every test, so that
a cluster-based fstest scheduler can reschedule tests after a VM crash.
Personally, I was using it to get live status on my tests dashboard.

The bulk of the patches in here improve the junit xml reporting so that
we (a) actually declare which xml schema we're trying to emit and (b)
capture a lot more information about what was being tested.

If you're going to start using this mess, you probably ought to just
pull from my git trees, which are linked below.

This is an extraordinary way to destroy everything.  Enjoy!
Comments and questions are, as always, welcome.

--D

fstests git tree:
https://git.kernel.org/cgit/linux/kernel/git/djwong/xfstests-dev.git/log/?h=xunit-reporting-improvements
---
 check         |   10 +++
 common/ext4   |    5 +
 common/report |   77 +++++++++++++++++--
 common/xfs    |   10 +++
 doc/xunit.xsd |  226 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++
 5 files changed, 318 insertions(+), 10 deletions(-)
 create mode 100644 doc/xunit.xsd