mbox series

[PATCHSET,v3,00/15] fstests: improve junit xml reporting

Message ID 167884155064.2482843.4310780034948240980.stgit@magnolia (mailing list archive)
Headers show
Series fstests: improve junit xml reporting | expand

Message

Darrick J. Wong March 15, 2023, 12:52 a.m. UTC
Hi all,

This series improves the fstests reporting code in several ways.  First,
change the ./check code to generate the report after every test, so that
a cluster-based fstest scheduler can reschedule tests after a VM crash.
Personally, I was using it to get live status on my tests dashboard.

The bulk of the patches in here improve the junit xml reporting so that
we (a) actually declare which xml schema we're trying to emit and (b)
capture a lot more information about what was being tested.

v2: shorten indenting in the schema file, record .dmesg files as a
separate kernel-log tag, clarify what the timestamp attribute means,
record the test suite start time and report generation time as separate
attributes, make it possible to pass in a list of report variables,
encode cdata correctly

v3: Reviewed-and-tested-by: Leah Rumancik <leah.rumancik@gmail.com>

If you're going to start using this mess, you probably ought to just
pull from my git trees, which are linked below.

This is an extraordinary way to destroy everything.  Enjoy!
Comments and questions are, as always, welcome.

--D

fstests git tree:
https://git.kernel.org/cgit/linux/kernel/git/djwong/xfstests-dev.git/log/?h=xunit-reporting-improvements
---
 README        |    3 +
 check         |   11 +++
 common/ext4   |    5 +
 common/report |  130 +++++++++++++++++++++++++-----
 common/xfs    |   11 +++
 doc/xunit.xsd |  246 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++
 6 files changed, 386 insertions(+), 20 deletions(-)
 create mode 100644 doc/xunit.xsd