From patchwork Wed Mar 12 21:42:23 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Scott Mayhew X-Patchwork-Id: 14013941 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.129.124]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id D25071EE03C for ; Wed, 12 Mar 2025 21:42:41 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=170.10.129.124 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1741815763; cv=none; b=J5j2fr0IVLUNpGSb5b28bRUUQleVWD3K9Dujp39mEPME4cZNR5XclLeGGSsOHyRfgh4IXECzaWNU4VHzd6OKGRkaBJ/FLr2RnRQcug5ubdT12rRo/I0/EZCacWtV8V9eDqJg4fSEGp161oVEhEEAvSgEL8tlbbiwzwpgziuyZeg= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1741815763; c=relaxed/simple; bh=qnnSS8gMMFj2sIxBUm3KupBlV7VQmOBC/YHp9ZR7HXw=; h=From:To:Subject:Date:Message-ID:MIME-Version:content-type; b=fY9m5OcZbvKm6SOpc+UQ2jyt/v0ANGySkDoJCol8ROT3xuUe+NEo2Hr6I6FPl7IX8CUzmdIL0b4j7uNuWYiCOAPh8KBWKr6uvWIHRal8IIYWvytP26jsmsaAwfoIJcIBilMeJXHgXqxluTe+4Od4pyukN/2vQDS6fhFU6QTyjwc= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=redhat.com; spf=pass smtp.mailfrom=redhat.com; dkim=pass (1024-bit key) header.d=redhat.com header.i=@redhat.com header.b=D5i9VSz4; arc=none smtp.client-ip=170.10.129.124 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=redhat.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=redhat.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=redhat.com header.i=@redhat.com header.b="D5i9VSz4" DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1741815759; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=0h1f8X+s6O07X65EGHsRsREngsGDx/9HMj6q0QSFoJo=; b=D5i9VSz4ywIr85XQfObozEo9TaltVB0NQGEWUElPvEEhMy9dKYGmdNyIKWEwbbQ4i/4BJC K6J3VqoS2d7o92aIN5uVxDZBiS13d5RsWkM2o8LU4iOOVCfGlDLnZkoHp8ETx9OR9qqi2B pKcP+B1pu00ICWbE1sR6fCnl32uMHB4= Received: from mx-prod-mc-01.mail-002.prod.us-west-2.aws.redhat.com (ec2-54-186-198-63.us-west-2.compute.amazonaws.com [54.186.198.63]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-183-5ODlIQPgOl276KQfTcQQog-1; Wed, 12 Mar 2025 17:42:37 -0400 X-MC-Unique: 5ODlIQPgOl276KQfTcQQog-1 X-Mimecast-MFC-AGG-ID: 5ODlIQPgOl276KQfTcQQog_1741815754 Received: from mx-prod-int-08.mail-002.prod.us-west-2.aws.redhat.com (mx-prod-int-08.mail-002.prod.us-west-2.aws.redhat.com [10.30.177.111]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by mx-prod-mc-01.mail-002.prod.us-west-2.aws.redhat.com (Postfix) with ESMTPS id 5A6CE1955E88 for ; Wed, 12 Mar 2025 21:42:34 +0000 (UTC) Received: from aion.redhat.com (unknown [10.22.80.106]) by mx-prod-int-08.mail-002.prod.us-west-2.aws.redhat.com (Postfix) with ESMTPS id 26CCE180174E for ; Wed, 12 Mar 2025 21:42:34 +0000 (UTC) Received: from aion.redhat.com (localhost [IPv6:::1]) by aion.redhat.com (Postfix) with ESMTP id 8FE7D338A0D for ; Wed, 12 Mar 2025 17:42:32 -0400 (EDT) From: Scott Mayhew To: kdevops@lists.linux.dev Subject: [PATCH v2 0/9] tweak results organization and reporting Date: Wed, 12 Mar 2025 17:42:23 -0400 Message-ID: <20250312214232.955450-1-smayhew@redhat.com> Precedence: bulk X-Mailing-List: kdevops@lists.linux.dev List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-Scanned-By: MIMEDefang 3.4.1 on 10.30.177.111 X-Mimecast-Spam-Score: 0 X-Mimecast-MFC-PROC-ID: FS6503P8_8ZhUN9Q_KVLyk7gdGX0IEbESlKK8krDnFI_1741815754 X-Mimecast-Originator: redhat.com content-type: text/plain; charset="US-ASCII"; x-default=true I do most of my kdevops runs under buildbot. Currently I don't have an easy way to view test results in buildbot's web interface. The first four patches implement a "last-run" directory and "last-kernel.txt" file similar to what the fstests workflow already has. This is mainly to facilitate the remaining patches, but I think it will also make it easier for me to feed my test results into other tooling in the future. The remaining patches add a "-show-results" makefile target, which basically print the test results to the standard output. The results for the most recent run are printed by default, but that can be changed by overriding the LAST_KERNEL variable. The results printed varies from workflow to workflow, and can be overidden via the PATTERN variable. Changes since v1: - fstests-show-results now outputs the xunit_results.txt file by default - ltp-show-results now outputs the "*.log" files by default - simplified the find command in the show-results targets by doing a little more variable parsing earlier in the makefiles Scott Mayhew (9): pynfs: add last-run directory and last-kernel.txt to the results nfstest: add last-run directory and last-kernel.txt to the results gitr: add last-run directory and last-kernel.txt to the results ltp: add last-run directory and last-kernel.txt to the results fstests: add makefile target to show test results pynfs: add makefile target to show test results nfstest: add makefile target to show test results gitr: add makefile target to show test results ltp: add makefile target to show test results playbooks/roles/gitr/tasks/main.yml | 59 +++++++++++++++++++++---- playbooks/roles/ltp/tasks/main.yml | 60 ++++++++++++++++++++++++-- playbooks/roles/nfstest/tasks/main.yml | 60 ++++++++++++++++++++++---- playbooks/roles/pynfs/tasks/main.yml | 38 +++++++++++++++- workflows/fstests/Makefile | 27 ++++++++++++ workflows/gitr/Makefile | 23 ++++++++++ workflows/ltp/Makefile | 23 ++++++++++ workflows/nfstest/Makefile | 23 ++++++++++ workflows/pynfs/Makefile | 23 ++++++++++ 9 files changed, 314 insertions(+), 22 deletions(-)