[0/9] tweak results organization and reporting

Message

Scott Mayhew March 5, 2025, 12:57 a.m. UTC

I do most of my kdevops runs under buildbot.  Currently I don't have an
easy way to view test results in buildbot's web interface. 

The first four patches implement a "last-run" directory and
"last-kernel.txt" file similar to what the fstests workflow already has.
This is mainly to facilitate the remaining patches, but I think it will
also make it easier for me to feed my test results into other tooling in
the future.

The remaining patches add a "<workflow>-show-results" makefile target,
which basically print the test results to the standard output.  The
results for the most recent run are printed by default, but that can be
changed by overriding the LAST_KERNEL variable.  The results printed
varies from workflow to workflow, and can be overidden via the PATTERN
variable.

Scott Mayhew (9):
  pynfs: add last-run directory and last-kernel.txt to the results
  nfstest: add last-run directory and last-kernel.txt to the results
  gitr: add last-run directory and last-kernel.txt to the results
  ltp: add last-run directory and last-kernel.txt to the results
  fstests: add makefile target to show test results
  pynfs: add makefile target to show test results
  nfstest: add makefile target to show test results
  gitr: add makefile target to show test results
  ltp: add makefile target to show test results

 playbooks/roles/gitr/tasks/main.yml    | 59 +++++++++++++++++++++----
 playbooks/roles/ltp/tasks/main.yml     | 60 ++++++++++++++++++++++++--
 playbooks/roles/nfstest/tasks/main.yml | 60 ++++++++++++++++++++++----
 playbooks/roles/pynfs/tasks/main.yml   | 38 +++++++++++++++-
 workflows/fstests/Makefile             | 16 +++++++
 workflows/gitr/Makefile                | 21 +++++++++
 workflows/ltp/Makefile                 | 21 +++++++++
 workflows/nfstest/Makefile             | 17 ++++++++
 workflows/pynfs/Makefile               | 12 ++++++
 9 files changed, 282 insertions(+), 22 deletions(-)

Comments

Scott Mayhew March 5, 2025, 1:11 a.m. UTC | #1

Whoops, I accidentally re-sent this series while I was sending the
"Don't include the codereadyrepo role if we're using a custom yum repofile"
patch.

Sorry for the noise.

-Scott

On Tue, 04 Mar 2025, Scott Mayhew wrote:

> I do most of my kdevops runs under buildbot.  Currently I don't have an
> easy way to view test results in buildbot's web interface. 
> 
> The first four patches implement a "last-run" directory and
> "last-kernel.txt" file similar to what the fstests workflow already has.
> This is mainly to facilitate the remaining patches, but I think it will
> also make it easier for me to feed my test results into other tooling in
> the future.
> 
> The remaining patches add a "<workflow>-show-results" makefile target,
> which basically print the test results to the standard output.  The
> results for the most recent run are printed by default, but that can be
> changed by overriding the LAST_KERNEL variable.  The results printed
> varies from workflow to workflow, and can be overidden via the PATTERN
> variable.
> 
> Scott Mayhew (9):
>   pynfs: add last-run directory and last-kernel.txt to the results
>   nfstest: add last-run directory and last-kernel.txt to the results
>   gitr: add last-run directory and last-kernel.txt to the results
>   ltp: add last-run directory and last-kernel.txt to the results
>   fstests: add makefile target to show test results
>   pynfs: add makefile target to show test results
>   nfstest: add makefile target to show test results
>   gitr: add makefile target to show test results
>   ltp: add makefile target to show test results
> 
>  playbooks/roles/gitr/tasks/main.yml    | 59 +++++++++++++++++++++----
>  playbooks/roles/ltp/tasks/main.yml     | 60 ++++++++++++++++++++++++--
>  playbooks/roles/nfstest/tasks/main.yml | 60 ++++++++++++++++++++++----
>  playbooks/roles/pynfs/tasks/main.yml   | 38 +++++++++++++++-
>  workflows/fstests/Makefile             | 16 +++++++
>  workflows/gitr/Makefile                | 21 +++++++++
>  workflows/ltp/Makefile                 | 21 +++++++++
>  workflows/nfstest/Makefile             | 17 ++++++++
>  workflows/pynfs/Makefile               | 12 ++++++
>  9 files changed, 282 insertions(+), 22 deletions(-)
> 
> -- 
> 2.48.1
> 
>