From patchwork Thu Oct 15 15:50:03 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ian Jackson X-Patchwork-Id: 11839579 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 934801744 for ; Thu, 15 Oct 2020 15:52:10 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 4DBC722254 for ; Thu, 15 Oct 2020 15:52:10 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (1024-bit key) header.d=xenproject.org header.i=@xenproject.org header.b="5uRoQMzX" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 4DBC722254 Authentication-Results: mail.kernel.org; dmarc=pass (p=none dis=none) header.from=xenproject.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.7516.19670 (Exim 4.92) (envelope-from ) id 1kT5WV-0006Jy-67; Thu, 15 Oct 2020 15:50:35 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 7516.19670; Thu, 15 Oct 2020 15:50:35 +0000 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5WV-0006Jp-1C; Thu, 15 Oct 2020 15:50:35 +0000 Received: by outflank-mailman (input) for mailman id 7516; Thu, 15 Oct 2020 15:50:34 +0000 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5WU-0006GM-0o for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:34 +0000 Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id 733865e4-7403-49ce-adca-e4676c5d0d6c; Thu, 15 Oct 2020 15:50:28 +0000 (UTC) Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5WO-00087l-DE for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:28 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5WO-0005EZ-B1 for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:28 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WM-0000oB-Fn; Thu, 15 Oct 2020 16:50:26 +0100 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5WU-0006GM-0o for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:34 +0000 X-Inumbo-ID: 733865e4-7403-49ce-adca-e4676c5d0d6c Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id 733865e4-7403-49ce-adca-e4676c5d0d6c; Thu, 15 Oct 2020 15:50:28 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=xenproject.org; s=20200302mail; h=Content-Transfer-Encoding:MIME-Version: References:In-Reply-To:Message-Id:Date:Subject:Cc:To:From; bh=Ib9u1KozgEMCg0jCGLWPWL8C4aZzOGRCjREpAAS7g4Y=; b=5uRoQMzX8oU6XFYbtTezweKWbT rbMo9yOrAT5Pxnp+T9kmCHM10GgixrtLQ/Lr53QdVadPIXx2+ryUcYpracwnk6PdJ86qH6O7RfuMF o3tRVc4O8qdjJ0q/8TPh6sMfIwwR8O2qCLF9zoS9V+ZjIjP+DAQxJ7MVmCtaEE3Pk+5c=; Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5WO-00087l-DE for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:28 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5WO-0005EZ-B1 for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:28 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WM-0000oB-Fn; Thu, 15 Oct 2020 16:50:26 +0100 From: Ian Jackson To: xen-devel@lists.xenproject.org Cc: Ian Jackson Subject: [OSSTEST PATCH v2 01/17] Honour OSSTEST_SIMULATE=2 to actually run dummy flight Date: Thu, 15 Oct 2020 16:50:03 +0100 Message-Id: <20201015155019.20705-2-iwj@xenproject.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20201015155019.20705-1-iwj@xenproject.org> References: <20201015155019.20705-1-iwj@xenproject.org> MIME-Version: 1.0 Signed-off-by: Ian Jackson --- cri-args-hostlists | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/cri-args-hostlists b/cri-args-hostlists index 994e00c0..6cdff53f 100644 --- a/cri-args-hostlists +++ b/cri-args-hostlists @@ -68,8 +68,8 @@ fi execute_flight () { case "x$OSSTEST_SIMULATE" in - x|x0) ;; - *) echo SIMULATING - NOT EXECUTING $1 $2 + x|x0|x2) ;; + *) echo SIMULATING $OSSTEST_SIMULATE - NOT EXECUTING $1 $2 return ;; esac From patchwork Thu Oct 15 15:50:04 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ian Jackson X-Patchwork-Id: 11839555 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 155541580 for ; Thu, 15 Oct 2020 15:51:01 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id C739D22254 for ; Thu, 15 Oct 2020 15:51:00 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (1024-bit key) header.d=xenproject.org header.i=@xenproject.org header.b="b2yRrKKC" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org C739D22254 Authentication-Results: mail.kernel.org; dmarc=pass (p=none dis=none) header.from=xenproject.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.7517.19682 (Exim 4.92) (envelope-from ) id 1kT5WW-0006MD-Dl; Thu, 15 Oct 2020 15:50:36 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 7517.19682; Thu, 15 Oct 2020 15:50:36 +0000 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5WW-0006M4-AO; Thu, 15 Oct 2020 15:50:36 +0000 Received: by outflank-mailman (input) for mailman id 7517; Thu, 15 Oct 2020 15:50:34 +0000 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5WU-0006GR-Qx for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:34 +0000 Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id af5f75c7-18ec-4453-a7b3-5bf1a27f9f3d; Thu, 15 Oct 2020 15:50:28 +0000 (UTC) Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5WO-00087o-Jw for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:28 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5WO-0005Em-Is for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:28 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WM-0000oB-OA; Thu, 15 Oct 2020 16:50:26 +0100 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5WU-0006GR-Qx for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:34 +0000 X-Inumbo-ID: af5f75c7-18ec-4453-a7b3-5bf1a27f9f3d Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id af5f75c7-18ec-4453-a7b3-5bf1a27f9f3d; Thu, 15 Oct 2020 15:50:28 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=xenproject.org; s=20200302mail; h=Content-Transfer-Encoding:MIME-Version: References:In-Reply-To:Message-Id:Date:Subject:Cc:To:From; bh=ChVOyZirwRN6GYYGaNTGSTLn1c+zNQzFzRYYMg92a3g=; b=b2yRrKKCQz2qK9sK7vrxLr4/Sl 1YqLKwjwOa9DxF3CYK3TkhOctsO1LWUAqzohJvLMoNB/eznfYzezv0szba90PNbwE2uRkeYA0WPdL BBzRRRQY22a3bVpRJMKI6m1C1PxsmoyVYtthPKi1qrE6UcZLvsQf9M6Wiqn94Xh6yZ1s=; Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5WO-00087o-Jw for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:28 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5WO-0005Em-Is for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:28 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WM-0000oB-OA; Thu, 15 Oct 2020 16:50:26 +0100 From: Ian Jackson To: xen-devel@lists.xenproject.org Cc: Ian Jackson Subject: [OSSTEST PATCH v2 02/17] Honour OSSTEST_SIMULATE_FAIL in sg-run-job Date: Thu, 15 Oct 2020 16:50:04 +0100 Message-Id: <20201015155019.20705-3-iwj@xenproject.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20201015155019.20705-1-iwj@xenproject.org> References: <20201015155019.20705-1-iwj@xenproject.org> MIME-Version: 1.0 This is a Tcl list of globs for ., and allows for simulating particular test failures. Signed-off-by: Ian Jackson --- sg-run-job | 9 ++++++++- 1 file changed, 8 insertions(+), 1 deletion(-) diff --git a/sg-run-job b/sg-run-job index dd76d4f2..c64ae026 100755 --- a/sg-run-job +++ b/sg-run-job @@ -406,7 +406,14 @@ proc spawn-ts {iffail testid args} { jobdb::spawn-step-commit $flight $jobinfo(job) $stepno $testid set xprefix {} - if {[var-or-default env(OSSTEST_SIMULATE) 0]} { set xprefix echo } + if {[var-or-default env(OSSTEST_SIMULATE) 0]} { + set xprefix echo + foreach ent [var-or-default env(OSSTEST_SIMULATE_FAIL) {}] { + if {[string match $ent $jobinfo(job).$testid]} { + set xprefix OSSTEST_SIMULATE_FAIL + } + } + } set log [jobdb::step-log-filename $flight $jobinfo(job) $stepno $ts] set redirects {} From patchwork Thu Oct 15 15:50:05 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ian Jackson X-Patchwork-Id: 11839567 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 539241580 for ; Thu, 15 Oct 2020 15:51:44 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 0C24722254 for ; Thu, 15 Oct 2020 15:51:43 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (1024-bit key) header.d=xenproject.org header.i=@xenproject.org header.b="Q/8ZYg2r" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 0C24722254 Authentication-Results: mail.kernel.org; dmarc=pass (p=none dis=none) header.from=xenproject.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.7515.19654 (Exim 4.92) (envelope-from ) id 1kT5WR-0006H6-0V; Thu, 15 Oct 2020 15:50:31 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 7515.19654; Thu, 15 Oct 2020 15:50:30 +0000 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5WQ-0006Gu-OB; Thu, 15 Oct 2020 15:50:30 +0000 Received: by outflank-mailman (input) for mailman id 7515; Thu, 15 Oct 2020 15:50:30 +0000 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5WP-0006GR-Ub for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:29 +0000 Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id 8c9d18f5-3706-4452-bb2e-3b894d5a3882; Thu, 15 Oct 2020 15:50:29 +0000 (UTC) Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5WO-00087r-QW for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:28 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5WO-0005Ey-Oo for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:28 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WN-0000oB-0F; Thu, 15 Oct 2020 16:50:27 +0100 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5WP-0006GR-Ub for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:29 +0000 X-Inumbo-ID: 8c9d18f5-3706-4452-bb2e-3b894d5a3882 Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id 8c9d18f5-3706-4452-bb2e-3b894d5a3882; Thu, 15 Oct 2020 15:50:29 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=xenproject.org; s=20200302mail; h=Content-Transfer-Encoding:MIME-Version: References:In-Reply-To:Message-Id:Date:Subject:Cc:To:From; bh=GKNUYQeiTTAK8ez/vVJcZ2hoW8Ug+I9meJLpgJqBeIU=; b=Q/8ZYg2rwXY9YNgyMWTqtdK71s Hnuv+uKXW4Y5/kNa24G4vbTHCC4kUxl0kAcWsbflvzZG+PKjMMND9O8uijMOaUI0WHyZEgdRDbgkK 7r9RQqayc3e1qLH40ULry3k2bNV2W+sHp68N9Rp1NsMFipf4vagcjcVua7bKdRxT4WoI=; Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5WO-00087r-QW for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:28 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5WO-0005Ey-Oo for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:28 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WN-0000oB-0F; Thu, 15 Oct 2020 16:50:27 +0100 From: Ian Jackson To: xen-devel@lists.xenproject.org Cc: Ian Jackson Subject: [OSSTEST PATCH v2 03/17] sg-report-flight: Consider all blessings for "never pass" Date: Thu, 15 Oct 2020 16:50:05 +0100 Message-Id: <20201015155019.20705-4-iwj@xenproject.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20201015155019.20705-1-iwj@xenproject.org> References: <20201015155019.20705-1-iwj@xenproject.org> MIME-Version: 1.0 $anypassq is used for the "never pass" check; the distinction between this and simply "fail" is cosmetic (although it can be informative). On non-"real" flights, it can easily happen that the flight never passed *on this branch with this blessing* but has passed on real. So the steps subquery does not find us an answer within reasonable time. Work around this by always searching for "real". This keeps the performance within acceptable bounds even during ad-hoc testing. We don't actually use the row from this query, so the only effect is that when the job passed in a "real" flight, we go on to the full regresson analysis rather than short-circuiting and reporting "never pass". Signed-off-by: Ian Jackson --- sg-report-flight | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/sg-report-flight b/sg-report-flight index a07e03cb..15631001 100755 --- a/sg-report-flight +++ b/sg-report-flight @@ -935,7 +935,7 @@ sub justifyfailures ($;$) { ) SELECT * FROM flights JOIN s USING (flight) WHERE $branches_cond_q - AND $blessingscond + AND ($blessingscond) OR blessing = 'real' LIMIT 1 END $anypassq= db_prepare($anypassq); From patchwork Thu Oct 15 15:50:06 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ian Jackson X-Patchwork-Id: 11839563 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 497571580 for ; Thu, 15 Oct 2020 15:51:30 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 0BF5E22254 for ; Thu, 15 Oct 2020 15:51:29 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (1024-bit key) header.d=xenproject.org header.i=@xenproject.org header.b="CXoc1/pu" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 0BF5E22254 Authentication-Results: mail.kernel.org; dmarc=pass (p=none dis=none) header.from=xenproject.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.7519.19702 (Exim 4.92) (envelope-from ) id 1kT5Wb-0006Rr-8z; Thu, 15 Oct 2020 15:50:41 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 7519.19702; Thu, 15 Oct 2020 15:50:41 +0000 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5Wa-0006RO-VD; Thu, 15 Oct 2020 15:50:40 +0000 Received: by outflank-mailman (input) for mailman id 7519; Thu, 15 Oct 2020 15:50:39 +0000 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5WZ-0006GR-RD for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:39 +0000 Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id 319bc935-827b-4bc2-a804-a0d3a64e1b32; Thu, 15 Oct 2020 15:50:29 +0000 (UTC) Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5WP-00087u-3W for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:29 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5WP-0005FC-1D for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:29 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WN-0000oB-7F; Thu, 15 Oct 2020 16:50:27 +0100 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5WZ-0006GR-RD for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:39 +0000 X-Inumbo-ID: 319bc935-827b-4bc2-a804-a0d3a64e1b32 Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id 319bc935-827b-4bc2-a804-a0d3a64e1b32; Thu, 15 Oct 2020 15:50:29 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=xenproject.org; s=20200302mail; h=Content-Transfer-Encoding:MIME-Version: References:In-Reply-To:Message-Id:Date:Subject:Cc:To:From; bh=jMrPuRfDpr5F+mH23YfeFKCRSJQrvgGxKa9leTchrQs=; b=CXoc1/puYuanYGZwuMzekdpowu 8Rr6FPbGx+mQf1rceLB8ZdAcoj2yjyXt2pUuCdc0pU5DcrgN85o5JNGpciFEQH6ny7CQBmAO3RdFX OyY5lxg5eNxls6XlyA4ZznHZo3n7jE2uIvDjy0x5FUGDpta0EvjRgYIDZvCKrOVl27Ig=; Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5WP-00087u-3W for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:29 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5WP-0005FC-1D for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:29 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WN-0000oB-7F; Thu, 15 Oct 2020 16:50:27 +0100 From: Ian Jackson To: xen-devel@lists.xenproject.org Cc: Ian Jackson Subject: [OSSTEST PATCH v2 04/17] mg-execute-flight: Do not include the transcript in reports Date: Thu, 15 Oct 2020 16:50:06 +0100 Message-Id: <20201015155019.20705-5-iwj@xenproject.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20201015155019.20705-1-iwj@xenproject.org> References: <20201015155019.20705-1-iwj@xenproject.org> MIME-Version: 1.0 These are large and not very useful. A copy is in the tree if needed. Signed-off-by: Ian Jackson --- mg-execute-flight | 3 --- 1 file changed, 3 deletions(-) diff --git a/mg-execute-flight b/mg-execute-flight index 391f4810..bef8dab6 100755 --- a/mg-execute-flight +++ b/mg-execute-flight @@ -101,9 +101,6 @@ echo ./cr-fold-long-lines &2 if $publish; then From patchwork Thu Oct 15 15:50:07 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ian Jackson X-Patchwork-Id: 11839559 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id A69761744 for ; Thu, 15 Oct 2020 15:51:18 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 655DD22255 for ; Thu, 15 Oct 2020 15:51:16 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (1024-bit key) header.d=xenproject.org header.i=@xenproject.org header.b="sOco/NYN" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 655DD22255 Authentication-Results: mail.kernel.org; dmarc=pass (p=none dis=none) header.from=xenproject.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.7518.19694 (Exim 4.92) (envelope-from ) id 1kT5Wa-0006Qk-NY; Thu, 15 Oct 2020 15:50:40 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 7518.19694; Thu, 15 Oct 2020 15:50:40 +0000 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5Wa-0006Qb-JJ; Thu, 15 Oct 2020 15:50:40 +0000 Received: by outflank-mailman (input) for mailman id 7518; Thu, 15 Oct 2020 15:50:39 +0000 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5WZ-0006GM-11 for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:39 +0000 Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id 39964fa8-4653-494f-9ed6-c44f232c5b55; Thu, 15 Oct 2020 15:50:29 +0000 (UTC) Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5WP-00087x-7D for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:29 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5WP-0005FQ-6O for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:29 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WN-0000oB-GH; Thu, 15 Oct 2020 16:50:27 +0100 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5WZ-0006GM-11 for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:39 +0000 X-Inumbo-ID: 39964fa8-4653-494f-9ed6-c44f232c5b55 Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id 39964fa8-4653-494f-9ed6-c44f232c5b55; Thu, 15 Oct 2020 15:50:29 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=xenproject.org; s=20200302mail; h=Content-Transfer-Encoding:MIME-Version: References:In-Reply-To:Message-Id:Date:Subject:Cc:To:From; bh=02bnAe8Pk+WQt+MbpE+lK1JlJkiQs50S4+SkvCn1WvQ=; b=sOco/NYNjydGO2EzHcka/1MPPg V80yd2kaHgCE8uDjurbLWMIQ5GUy60sKXV6nxpbq6lHuN2OmXx2r/gP5AwQvmz3Tf9+rxHHPfpHqc 8eaI7mYQ7ol9nV2c12KuyQ+Ej9z3Zft1UdVFW0F8p49Zn4FiX9t/CzZeTDd7/o5YAfgI=; Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5WP-00087x-7D for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:29 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5WP-0005FQ-6O for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:29 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WN-0000oB-GH; Thu, 15 Oct 2020 16:50:27 +0100 From: Ian Jackson To: xen-devel@lists.xenproject.org Cc: Ian Jackson , Ian Jackson Subject: [OSSTEST PATCH v2 05/17] sg-report-job-history: eval $DAILY_BRANCH_PREEXEC_HOOK Date: Thu, 15 Oct 2020 16:50:07 +0100 Message-Id: <20201015155019.20705-6-iwj@xenproject.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20201015155019.20705-1-iwj@xenproject.org> References: <20201015155019.20705-1-iwj@xenproject.org> MIME-Version: 1.0 From: Ian Jackson Put the call to this debugging/testing variable inside an eval. This allows a wider variety of stunts. The one in-tree reference is already compatible with this new semantics. Signed-off-by: Ian Jackson --- cr-daily-branch | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/cr-daily-branch b/cr-daily-branch index b8f221ee..23060588 100755 --- a/cr-daily-branch +++ b/cr-daily-branch @@ -472,7 +472,7 @@ sgr_args+=" $EXTRA_SGR_ARGS" date >&2 : $flight $branch $OSSTEST_BLESSING $sgr_args -$DAILY_BRANCH_PREEXEC_HOOK +eval "$DAILY_BRANCH_PREEXEC_HOOK" execute_flight $flight $OSSTEST_BLESSING date >&2 From patchwork Thu Oct 15 15:50:08 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ian Jackson X-Patchwork-Id: 11839565 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 57A571580 for ; Thu, 15 Oct 2020 15:51:35 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 18C2E22254 for ; Thu, 15 Oct 2020 15:51:35 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (1024-bit key) header.d=xenproject.org header.i=@xenproject.org header.b="unmqpZyD" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 18C2E22254 Authentication-Results: mail.kernel.org; dmarc=pass (p=none dis=none) header.from=xenproject.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.7521.19730 (Exim 4.92) (envelope-from ) id 1kT5Wh-0006ch-1V; Thu, 15 Oct 2020 15:50:47 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 7521.19730; Thu, 15 Oct 2020 15:50:47 +0000 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5Wg-0006cR-Sg; Thu, 15 Oct 2020 15:50:46 +0000 Received: by outflank-mailman (input) for mailman id 7521; Thu, 15 Oct 2020 15:50:44 +0000 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5We-0006GR-RR for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:44 +0000 Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id a670aa57-38dc-4535-97dc-1bc30af5c51d; Thu, 15 Oct 2020 15:50:29 +0000 (UTC) Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5WP-000882-JI for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:29 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5WP-0005Fq-IS for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:29 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WN-0000oB-PA; Thu, 15 Oct 2020 16:50:27 +0100 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5We-0006GR-RR for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:44 +0000 X-Inumbo-ID: a670aa57-38dc-4535-97dc-1bc30af5c51d Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id a670aa57-38dc-4535-97dc-1bc30af5c51d; Thu, 15 Oct 2020 15:50:29 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=xenproject.org; s=20200302mail; h=Content-Transfer-Encoding:MIME-Version: References:In-Reply-To:Message-Id:Date:Subject:Cc:To:From; bh=9Pahmn/najHz4bedXTajTfnABim3bLuns9qaaY31+FA=; b=unmqpZyDago95DXw00wFDinbP4 Ewy2V1ZSOw3/0aBYfww8ftOk4YPyIH9V7WfPz0ngDwfM+At55jWSdctFxhM5F6UeuGJyRgbTAvm7+ Y7X3EL8D+T2GjpByD82SOCIN41pJ/l5RtBHTbdjGHbhrZ4uuRMCng7LQaTaU9enXoCZs=; Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5WP-000882-JI for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:29 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5WP-0005Fq-IS for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:29 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WN-0000oB-PA; Thu, 15 Oct 2020 16:50:27 +0100 From: Ian Jackson To: xen-devel@lists.xenproject.org Cc: Ian Jackson , Ian Jackson Subject: [OSSTEST PATCH v2 06/17] cri-args-hostlists: New debug var $OSSTEST_REPORT_JOB_HISTORY_RUN Date: Thu, 15 Oct 2020 16:50:08 +0100 Message-Id: <20201015155019.20705-7-iwj@xenproject.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20201015155019.20705-1-iwj@xenproject.org> References: <20201015155019.20705-1-iwj@xenproject.org> MIME-Version: 1.0 From: Ian Jackson No effect if this is empty. Signed-off-by: Ian Jackson --- cri-args-hostlists | 1 + 1 file changed, 1 insertion(+) diff --git a/cri-args-hostlists b/cri-args-hostlists index 6cdff53f..7019c0c7 100644 --- a/cri-args-hostlists +++ b/cri-args-hostlists @@ -121,6 +121,7 @@ start_email () { date >&2 + $OSSTEST_REPORT_JOB_HISTORY_RUN \ with-lock-ex -w $globallockdir/report-lock \ ./sg-report-job-history --report-processing-start-time \ --html-dir=$job_html_dir --flight=$flight From patchwork Thu Oct 15 15:50:09 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ian Jackson X-Patchwork-Id: 11839581 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 4E3FE1744 for ; Thu, 15 Oct 2020 15:52:14 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 0AFD422254 for ; Thu, 15 Oct 2020 15:52:13 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (1024-bit key) header.d=xenproject.org header.i=@xenproject.org header.b="g11WSl3P" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 0AFD422254 Authentication-Results: mail.kernel.org; dmarc=pass (p=none dis=none) header.from=xenproject.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.7522.19742 (Exim 4.92) (envelope-from ) id 1kT5Wl-0006lF-NU; Thu, 15 Oct 2020 15:50:51 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 7522.19742; Thu, 15 Oct 2020 15:50:51 +0000 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5Wl-0006l1-Hp; Thu, 15 Oct 2020 15:50:51 +0000 Received: by outflank-mailman (input) for mailman id 7522; Thu, 15 Oct 2020 15:50:49 +0000 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5Wj-0006GR-RP for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:49 +0000 Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id d6d92408-c0d2-446a-afef-747eb7d61167; Thu, 15 Oct 2020 15:50:30 +0000 (UTC) Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5WP-000888-Vc for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:29 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5WP-0005GM-Um for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:29 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WO-0000oB-91; Thu, 15 Oct 2020 16:50:28 +0100 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5Wj-0006GR-RP for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:49 +0000 X-Inumbo-ID: d6d92408-c0d2-446a-afef-747eb7d61167 Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id d6d92408-c0d2-446a-afef-747eb7d61167; Thu, 15 Oct 2020 15:50:30 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=xenproject.org; s=20200302mail; h=Content-Transfer-Encoding:MIME-Version: References:In-Reply-To:Message-Id:Date:Subject:Cc:To:From; bh=e3H0s2+WzQtNrHrJPYnYMyg0OSRyEJNxDWc8yLBsrEc=; b=g11WSl3PbOg704AUjUeAfnRHnt 55RaGFyjVc6ODZWVVFOrP0uH3pNZO5YUsLfMDZhZBfeZPVK+4IhEfJUxO6kPNL//a0o1kpCi+EN6H 436yHTfkTvRU+Kvapj38GQ2sNfniIWIMlYahKdMNIjnKL34qnQdMe6By+gh+IneR7cpA=; Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5WP-000888-Vc for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:29 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5WP-0005GM-Um for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:29 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WO-0000oB-91; Thu, 15 Oct 2020 16:50:28 +0100 From: Ian Jackson To: xen-devel@lists.xenproject.org Cc: Ian Jackson Subject: [OSSTEST PATCH v2 07/17] cri-args-hostlists: Break out report_flight and publish_logs Date: Thu, 15 Oct 2020 16:50:09 +0100 Message-Id: <20201015155019.20705-8-iwj@xenproject.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20201015155019.20705-1-iwj@xenproject.org> References: <20201015155019.20705-1-iwj@xenproject.org> MIME-Version: 1.0 From: Ian Jackson NFC. Signed-off-by: Ian Jackson --- cri-args-hostlists | 21 +++++++++++++++------ 1 file changed, 15 insertions(+), 6 deletions(-) diff --git a/cri-args-hostlists b/cri-args-hostlists index 7019c0c7..52e39f33 100644 --- a/cri-args-hostlists +++ b/cri-args-hostlists @@ -128,10 +128,7 @@ start_email () { date >&2 - ./sg-report-flight --report-processing-start-time \ - --html-dir=$flight_html_dir/$flight/ \ - --allow=allow.all --allow=allow.$branch \ - $sgr_args $flight >tmp/$flight.report + report_flight $flight ./cr-fold-long-lines tmp/$flight.report date >&2 @@ -144,11 +141,23 @@ start_email () { date >&2 } +report_flight () { + local flight=$1 + ./sg-report-flight --html-dir=$flight_html_dir/$flight/ \ + --allow=allow.all --allow=allow.$branch \ + $sgr_args $flight >tmp/$flight.report +} + +publish_logs () { + local flight=$1 + ./cr-publish-flight-logs ${OSSTEST_PUSH_HARNESS- --push-harness} \ + $flight >&2 +} + publish_send_email () { local flight=$1 + publish_logs $flight exec >&2 - ./cr-publish-flight-logs ${OSSTEST_PUSH_HARNESS- --push-harness} \ - $flight send_email tmp/$flight.email } From patchwork Thu Oct 15 15:50:10 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ian Jackson X-Patchwork-Id: 11839561 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 986541580 for ; Thu, 15 Oct 2020 15:51:25 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 5DF1822254 for ; Thu, 15 Oct 2020 15:51:25 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (1024-bit key) header.d=xenproject.org header.i=@xenproject.org header.b="xwf0V06E" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 5DF1822254 Authentication-Results: mail.kernel.org; dmarc=pass (p=none dis=none) header.from=xenproject.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.7520.19718 (Exim 4.92) (envelope-from ) id 1kT5Wf-0006ZF-Ib; Thu, 15 Oct 2020 15:50:45 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 7520.19718; Thu, 15 Oct 2020 15:50:45 +0000 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5Wf-0006Yy-DG; Thu, 15 Oct 2020 15:50:45 +0000 Received: by outflank-mailman (input) for mailman id 7520; Thu, 15 Oct 2020 15:50:44 +0000 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5We-0006GM-1H for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:44 +0000 Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id 4208f03d-7c5c-4660-a429-de645d2d7303; Thu, 15 Oct 2020 15:50:30 +0000 (UTC) Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5WQ-00088E-7q for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:30 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5WQ-0005Gg-6t for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:30 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WO-0000oB-Gu; Thu, 15 Oct 2020 16:50:28 +0100 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5We-0006GM-1H for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:44 +0000 X-Inumbo-ID: 4208f03d-7c5c-4660-a429-de645d2d7303 Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id 4208f03d-7c5c-4660-a429-de645d2d7303; Thu, 15 Oct 2020 15:50:30 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=xenproject.org; s=20200302mail; h=Content-Transfer-Encoding:MIME-Version: References:In-Reply-To:Message-Id:Date:Subject:Cc:To:From; bh=gfMUQl6jqji00/zUqCTGBQAbnUbgIuHTcubMdohdrgs=; b=xwf0V06ExMj7gdaT7ohYraVscw Y6PoRK4crIguLGtGiO4j13aC03h3Pg/hckM43upCinIYFy/GXS6kK34FHpvdOL/85cNzzpt/ODbEl 9Op/eRjF8ShNMQ1np7pq4VkhMf7vXxDMyPPEwL2XgFEOfo2r5ZFUUL9KpBNqzQ939HMY=; Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5WQ-00088E-7q for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:30 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5WQ-0005Gg-6t for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:30 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WO-0000oB-Gu; Thu, 15 Oct 2020 16:50:28 +0100 From: Ian Jackson To: xen-devel@lists.xenproject.org Cc: Ian Jackson Subject: [OSSTEST PATCH v2 08/17] sg-report-flight: Break out printout_flightheader Date: Thu, 15 Oct 2020 16:50:10 +0100 Message-Id: <20201015155019.20705-9-iwj@xenproject.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20201015155019.20705-1-iwj@xenproject.org> References: <20201015155019.20705-1-iwj@xenproject.org> MIME-Version: 1.0 From: Ian Jackson No functional change. Signed-off-by: Ian Jackson --- sg-report-flight | 15 +++++++++++---- 1 file changed, 11 insertions(+), 4 deletions(-) diff --git a/sg-report-flight b/sg-report-flight index 15631001..2ab1637f 100755 --- a/sg-report-flight +++ b/sg-report-flight @@ -783,6 +783,14 @@ sub includes ($) { } } +sub printout_flightheader ($) { + my ($r) = @_; + bodyprint <{Flight} $branch $r->{FlightInfo}{blessing} [$r->{FlightInfo}{intended}] +$c{ReportHtmlPubBaseUrl}/$r->{Flight}/ +END +} + sub printout { my ($r, @failures) = @_; $header_text = ''; @@ -793,10 +801,9 @@ sub printout { $r->{Flight}: $r->{OutcomeSummary} END includes(\@includebeginfiles); - bodyprint <{Flight} $branch $r->{FlightInfo}{blessing} [$r->{FlightInfo}{intended}] -$c{ReportHtmlPubBaseUrl}/$r->{Flight}/ -END + + printout_flightheader($r); + if (defined $r->{Overall}) { bodyprint "\n"; bodyprint $r->{Overall}; From patchwork Thu Oct 15 15:50:11 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ian Jackson X-Patchwork-Id: 11839557 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 735E51744 for ; Thu, 15 Oct 2020 15:51:16 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 32BBF22254 for ; Thu, 15 Oct 2020 15:51:16 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (1024-bit key) header.d=xenproject.org header.i=@xenproject.org header.b="1AN05+e+" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 32BBF22254 Authentication-Results: mail.kernel.org; dmarc=pass (p=none dis=none) header.from=xenproject.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.7523.19754 (Exim 4.92) (envelope-from ) id 1kT5Wq-0006sI-6Q; Thu, 15 Oct 2020 15:50:56 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 7523.19754; Thu, 15 Oct 2020 15:50:56 +0000 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5Wq-0006s9-1V; Thu, 15 Oct 2020 15:50:56 +0000 Received: by outflank-mailman (input) for mailman id 7523; Thu, 15 Oct 2020 15:50:54 +0000 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5Wo-0006GR-Re for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:54 +0000 Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id a5e58849-0ead-484c-8253-532dfd143437; Thu, 15 Oct 2020 15:50:30 +0000 (UTC) Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5WQ-00088L-GG for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:30 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5WQ-0005H7-FM for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:30 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WO-0000oB-ON; Thu, 15 Oct 2020 16:50:28 +0100 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5Wo-0006GR-Re for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:54 +0000 X-Inumbo-ID: a5e58849-0ead-484c-8253-532dfd143437 Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id a5e58849-0ead-484c-8253-532dfd143437; Thu, 15 Oct 2020 15:50:30 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=xenproject.org; s=20200302mail; h=Content-Transfer-Encoding:MIME-Version: References:In-Reply-To:Message-Id:Date:Subject:Cc:To:From; bh=/UKradk/z4OgKrjjcpnOfZ9csQk7I4shSwqTZgX4ibw=; b=1AN05+e+5E0n5jtCCVluZ9s+Mg cACAFIPLJyoHMpAVkpkURdXSZFEhoDC323dAUZNgOanvjicq7WHNVsheb9kCFQKyTH1pv4Pv1VsBK GBWDZEnUyLX7LmsHDOZ4Q8ExvSW7cbzWIYQQY+/RTnbNEq8o7lxwj1TFvSmFFbodPoDc=; Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5WQ-00088L-GG for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:30 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5WQ-0005H7-FM for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 15:50:30 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WO-0000oB-ON; Thu, 15 Oct 2020 16:50:28 +0100 From: Ian Jackson To: xen-devel@lists.xenproject.org Cc: Ian Jackson Subject: [OSSTEST PATCH v2 09/17] sg-report-flight: Provide --refer-to-flight option Date: Thu, 15 Oct 2020 16:50:11 +0100 Message-Id: <20201015155019.20705-10-iwj@xenproject.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20201015155019.20705-1-iwj@xenproject.org> References: <20201015155019.20705-1-iwj@xenproject.org> MIME-Version: 1.0 From: Ian Jackson This just generates an extra heading and URL at the top of the output. In particular, it doesn't affect the algorithms which calculate regressions. Signed-off-by: Ian Jackson --- sg-report-flight | 18 ++++++++++++++++++ 1 file changed, 18 insertions(+) diff --git a/sg-report-flight b/sg-report-flight index 2ab1637f..bcd896a8 100755 --- a/sg-report-flight +++ b/sg-report-flight @@ -42,6 +42,7 @@ our $htmldir; our $want_info_headers; our ($branch, $branches_cond_q); our @allows; +our (@refer_to_flights); our (@includebeginfiles,@includefiles); open DEBUG, ">/dev/null"; @@ -66,6 +67,8 @@ while (@ARGV && $ARGV[0] =~ m/^-/) { push @includebeginfiles, $1; } elsif (m/^--include=(.*)$/) { push @includefiles, $1; + } elsif (m/^--refer-to-flight=(.*)$/) { + push @refer_to_flights, $1; } elsif (restrictflight_arg($_)) { # Handled by Executive } elsif (m/^--allow=(.*)$/) { @@ -504,6 +507,16 @@ END die unless defined $specflight; } } +sub find_refer_to_flights () { + my $ffq = $dbh_tests->prepare("SELECT * FROM flights WHERE flight=?"); + @refer_to_flights = map { + my $flight = $_; + $ffq->execute($flight); + my $row = $ffq->fetchrow_hashref(); + die "refer to flight $flight not found\n" unless $row; + { Flight => $flight, FlightInfo => $row }; + } @refer_to_flights; +} sub examineflight ($) { my ($flight) = @_; @@ -804,6 +817,10 @@ END printout_flightheader($r); + foreach my $ref_r (@refer_to_flights) { + printout_flightheader($ref_r); + } + if (defined $r->{Overall}) { bodyprint "\n"; bodyprint $r->{Overall}; @@ -1878,6 +1895,7 @@ db_retry($dbh_tests, [], sub { if (defined $mro) { open MRO, "> $mro.new" or die "$mro.new $!"; } + find_refer_to_flights(); findspecflight(); my $fi= examineflight($specflight); my @fails= justifyfailures($fi); From patchwork Thu Oct 15 15:50:12 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ian Jackson X-Patchwork-Id: 11839593 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id C3E8E1752 for ; Thu, 15 Oct 2020 16:10:19 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 8158921D7F for ; Thu, 15 Oct 2020 16:10:19 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (1024-bit key) header.d=xenproject.org header.i=@xenproject.org header.b="Ryfx2r6N" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 8158921D7F Authentication-Results: mail.kernel.org; dmarc=pass (p=none dis=none) header.from=xenproject.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.7542.19772 (Exim 4.92) (envelope-from ) id 1kT5oP-0000Wh-V3; Thu, 15 Oct 2020 16:09:05 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 7542.19772; Thu, 15 Oct 2020 16:09:05 +0000 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5oP-0000Wa-Rz; Thu, 15 Oct 2020 16:09:05 +0000 Received: by outflank-mailman (input) for mailman id 7542; Thu, 15 Oct 2020 16:09:05 +0000 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5oO-0000WV-TC for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:04 +0000 Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id ef44b822-9280-4aa4-b6a7-5da67909f9d1; Thu, 15 Oct 2020 16:08:59 +0000 (UTC) Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5oI-0000fe-RS for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:08:58 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5oI-0006Zr-Ps for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:08:58 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WO-0000oB-W5; Thu, 15 Oct 2020 16:50:29 +0100 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5oO-0000WV-TC for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:04 +0000 X-Inumbo-ID: ef44b822-9280-4aa4-b6a7-5da67909f9d1 Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id ef44b822-9280-4aa4-b6a7-5da67909f9d1; Thu, 15 Oct 2020 16:08:59 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=xenproject.org; s=20200302mail; h=Content-Transfer-Encoding:MIME-Version: References:In-Reply-To:Message-Id:Date:Subject:Cc:To:From; bh=t3Vg9e/VRpm4vV8Mm3UCVRG1em/CaV0bxhpLQJqI3XA=; b=Ryfx2r6NB3s0ZO7bDJi7fVXYpv Dv5FiWdwIwi3MbiRkYVpbJp/GTCabTK8pWmHnxKPPWJN2LYJt68ow2zmDFQxszBRyZ8HqjI5xNg6X 880i8MmDNPaTF54b4r2VuZS0RBl4EbnqaH95twQfHXcGOmlgNxOwCpWkkxfT/u78mS1o=; Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5oI-0000fe-RS for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:08:58 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5oI-0006Zr-Ps for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:08:58 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WO-0000oB-W5; Thu, 15 Oct 2020 16:50:29 +0100 From: Ian Jackson To: xen-devel@lists.xenproject.org Cc: Ian Jackson Subject: [OSSTEST PATCH v2 10/17] sg-report-flight: Nicer output for --refer-to-flight option Date: Thu, 15 Oct 2020 16:50:12 +0100 Message-Id: <20201015155019.20705-11-iwj@xenproject.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20201015155019.20705-1-iwj@xenproject.org> References: <20201015155019.20705-1-iwj@xenproject.org> MIME-Version: 1.0 Sort the flight summary lines together, before the URLs. This makes it considerably easier to read. Signed-off-by: Ian Jackson --- sg-report-flight | 18 +++++++++--------- 1 file changed, 9 insertions(+), 9 deletions(-) diff --git a/sg-report-flight b/sg-report-flight index bcd896a8..cbd39599 100755 --- a/sg-report-flight +++ b/sg-report-flight @@ -796,12 +796,17 @@ sub includes ($) { } } -sub printout_flightheader ($) { - my ($r) = @_; - bodyprint <{Flight} $branch $r->{FlightInfo}{blessing} [$r->{FlightInfo}{intended}] +END + } + foreach my $r (@_) { + bodyprint <{Flight}/ END + } } sub printout { @@ -814,12 +819,7 @@ sub printout { $r->{Flight}: $r->{OutcomeSummary} END includes(\@includebeginfiles); - - printout_flightheader($r); - - foreach my $ref_r (@refer_to_flights) { - printout_flightheader($ref_r); - } + printout_flightheaders $r, @refer_to_flights; if (defined $r->{Overall}) { bodyprint "\n"; From patchwork Thu Oct 15 15:50:13 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ian Jackson X-Patchwork-Id: 11839595 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id D1A8117CA for ; Thu, 15 Oct 2020 16:10:19 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 93E3522210 for ; Thu, 15 Oct 2020 16:10:19 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (1024-bit key) header.d=xenproject.org header.i=@xenproject.org header.b="ymWNHGrA" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 93E3522210 Authentication-Results: mail.kernel.org; dmarc=pass (p=none dis=none) header.from=xenproject.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.7543.19784 (Exim 4.92) (envelope-from ) id 1kT5oV-0000Y6-7Y; Thu, 15 Oct 2020 16:09:11 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 7543.19784; Thu, 15 Oct 2020 16:09:11 +0000 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5oV-0000Xz-45; Thu, 15 Oct 2020 16:09:11 +0000 Received: by outflank-mailman (input) for mailman id 7543; Thu, 15 Oct 2020 16:09:09 +0000 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5oT-0000WV-Rf for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:09 +0000 Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id 6149a3bf-9f7e-44f6-b055-eb9cb7ea1ec5; Thu, 15 Oct 2020 16:09:03 +0000 (UTC) Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5oN-0000g0-Hg for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:03 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5oN-0006ay-ER for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:03 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WP-0000oB-FP; Thu, 15 Oct 2020 16:50:29 +0100 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5oT-0000WV-Rf for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:09 +0000 X-Inumbo-ID: 6149a3bf-9f7e-44f6-b055-eb9cb7ea1ec5 Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id 6149a3bf-9f7e-44f6-b055-eb9cb7ea1ec5; Thu, 15 Oct 2020 16:09:03 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=xenproject.org; s=20200302mail; h=Content-Transfer-Encoding:MIME-Version: References:In-Reply-To:Message-Id:Date:Subject:Cc:To:From; bh=pacL1ullUVs7eBNosppLBDynVv2r14S6C90c7shdrs4=; b=ymWNHGrAQqb+8EtIaJSaYB3mJx rTiYue9Ejhobk1qFqt/o2f0h/em6GcGqfMG8YTa8pFNdpf2TX5LT3Ti/RPfIJe4wrrxRBWsalNA1r 7izg5bd8uAl+CKhOrV/k/sMNd/Fcnq97HODaqFGXitgdOqKNVf0E8msu6JvxP/g/RZ8U=; Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5oN-0000g0-Hg for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:03 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5oN-0006ay-ER for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:03 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WP-0000oB-FP; Thu, 15 Oct 2020 16:50:29 +0100 From: Ian Jackson To: xen-devel@lists.xenproject.org Cc: Ian Jackson , Ian Jackson Subject: [OSSTEST PATCH v2 11/17] Introduce real-retry blessing Date: Thu, 15 Oct 2020 16:50:13 +0100 Message-Id: <20201015155019.20705-12-iwj@xenproject.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20201015155019.20705-1-iwj@xenproject.org> References: <20201015155019.20705-1-iwj@xenproject.org> MIME-Version: 1.0 From: Ian Jackson Nothing produces this yet. (There's play-retry as well of course but we don't need to document that really.) Signed-off-by: Ian Jackson --- README.dev | 9 +++++---- cr-daily-branch | 3 ++- cr-disk-report | 2 +- cr-try-bisect | 4 ++-- cr-try-bisect-adhoc | 2 +- cs-bisection-step | 4 ++-- sg-report-flight | 2 +- 7 files changed, 14 insertions(+), 12 deletions(-) diff --git a/README.dev b/README.dev index 2cbca109..3d09b3c6 100644 --- a/README.dev +++ b/README.dev @@ -381,10 +381,11 @@ These are the principal (intended) blessings: commissioning, and that blessing removed and replaced with `real' when the hosts are ready. - * `real-bisect' and `adhoc-bisect': These are found only as the - blessing of finished flights. (This is achieved by passing - *-bisect to sg-execute-flight.) This allows the archaeologist - tools to distinguish full flights from bisection steps. + * `real-bisect', `real-retry', `adhoc-bisect': These are found only + as the blessing of finished flights. (This is achieved by passing + *-bisect or *-retry to sg-execute-flight.) This allows the + archaeologist tools to distinguish full flights from bisection + steps and retries. The corresponding intended blessing (as found in the `intended' column of the flights table) is `real'. So the hosts used by the diff --git a/cr-daily-branch b/cr-daily-branch index 23060588..285ea361 100755 --- a/cr-daily-branch +++ b/cr-daily-branch @@ -76,7 +76,8 @@ case $branch in treeurl=`./ap-print-url $branch`;; esac -blessings_arg=--blessings=${DAILY_BRANCH_TESTED_BLESSING:-real} +blessings_arg=${DAILY_BRANCH_TESTED_BLESSING:-real} +blessings_arg=--blessings=${blessings_arg},${blessings_arg}-retest sgr_args+=" $blessings_arg" force_baseline='' # Non-empty = indication why we are forcing baseline. diff --git a/cr-disk-report b/cr-disk-report index 543d35bf..d76fd72f 100755 --- a/cr-disk-report +++ b/cr-disk-report @@ -38,7 +38,7 @@ our $graphs_px=0; our $graphs_py=0; open DEBUG, ">/dev/null" or die $!; -our @blessings = qw(real real-bisect); +our @blessings = qw(real real-retry real-bisect); # for these blessings column is " " # for other blessings column is " []" diff --git a/cr-try-bisect b/cr-try-bisect index a2b77b9a..6adc2bcc 100755 --- a/cr-try-bisect +++ b/cr-try-bisect @@ -59,7 +59,7 @@ compute_state_done_callback () { compute_state_callback () { compute_state_core \ --basis-template=$basisflight \ - --blessings=$OSSTEST_BLESSING,$OSSTEST_BLESSING-bisect \ + --blessings=$OSSTEST_BLESSING,$OSSTEST_BLESSING-bisect,$OSSTEST_BLESSING-retry \ "$@" $branch $job $testid } @@ -78,7 +78,7 @@ perhaps_bisect_step () { echo "already completed $branch $job $testid" return fi - perhaps_bisect_step_core $OSSTEST_BLESSING $OSSTEST_BLESSING-bisect + perhaps_bisect_step_core $OSSTEST_BLESSING $OSSTEST_BLESSING-bisect $OSSTEST_BLESSING-real } subject_prefix="[$branch bisection]" diff --git a/cr-try-bisect-adhoc b/cr-try-bisect-adhoc index caadfd80..c2cfa475 100755 --- a/cr-try-bisect-adhoc +++ b/cr-try-bisect-adhoc @@ -49,7 +49,7 @@ export OSSTEST_BLESSING=adhoc compute_state_callback () { compute_state_core \ - --blessings=real,real-bisect,adhoc-bisect \ + --blessings=real,real-retry,real-bisect,adhoc-bisect \ $bisect "$@" $branch $job $testid } diff --git a/cs-bisection-step b/cs-bisection-step index 762966da..8b391448 100755 --- a/cs-bisection-step +++ b/cs-bisection-step @@ -7,7 +7,7 @@ # usage: # ./cs-bisection-setup [] # options, usually: -# --blessings=real,real-bisect +# --blessings=real,real-retry,real-bisect # # First entry in --blessings list is the blessing of the basis # (non-bisection) flights. This should not be the same as the @@ -45,7 +45,7 @@ use HTML::Entities; use Osstest::Executive; use URI::Escape; -our @blessings= qw(real real-bisect); +our @blessings= qw(real real-retry real-bisect); our @revtuplegenargs= (); our $broken; diff --git a/sg-report-flight b/sg-report-flight index cbd39599..51a409ed 100755 --- a/sg-report-flight +++ b/sg-report-flight @@ -120,7 +120,7 @@ die if defined $specver{this}{flight}; die if defined $specver{that}{flight} && grep { $_ ne 'flight' } keys %{ $specver{that} }; -push @blessings, 'real', 'real-bisect' unless @blessings; +push @blessings, 'real', 'real-retry', 'real-bisect' unless @blessings; csreadconfig(); From patchwork Thu Oct 15 15:50:14 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ian Jackson X-Patchwork-Id: 11839605 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 59D761580 for ; Thu, 15 Oct 2020 16:10:57 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 1E4D721D7F for ; Thu, 15 Oct 2020 16:10:57 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (1024-bit key) header.d=xenproject.org header.i=@xenproject.org header.b="x4/oegTz" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 1E4D721D7F Authentication-Results: mail.kernel.org; dmarc=pass (p=none dis=none) header.from=xenproject.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.7546.19820 (Exim 4.92) (envelope-from ) id 1kT5ok-0000k0-3S; Thu, 15 Oct 2020 16:09:26 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 7546.19820; Thu, 15 Oct 2020 16:09:26 +0000 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5oj-0000jr-W2; Thu, 15 Oct 2020 16:09:25 +0000 Received: by outflank-mailman (input) for mailman id 7546; Thu, 15 Oct 2020 16:09:24 +0000 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5oi-0000WV-SA for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:24 +0000 Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id 33e90831-08e4-4696-aef3-6363429603ce; Thu, 15 Oct 2020 16:09:22 +0000 (UTC) Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5og-0000gb-Fb for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:22 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5og-0006eP-Er for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:22 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WP-0000oB-NK; Thu, 15 Oct 2020 16:50:29 +0100 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5oi-0000WV-SA for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:24 +0000 X-Inumbo-ID: 33e90831-08e4-4696-aef3-6363429603ce Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id 33e90831-08e4-4696-aef3-6363429603ce; Thu, 15 Oct 2020 16:09:22 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=xenproject.org; s=20200302mail; h=Content-Transfer-Encoding:MIME-Version: References:In-Reply-To:Message-Id:Date:Subject:Cc:To:From; bh=T/OCcqRxeQc9x8tpxs5RGS4FPCqsIq9O+7k8X7cgE7E=; b=x4/oegTzScwg1bFjxBllaeFo5f DdYOED9tMHlPQ86HkMWdFYsr+UWXnFQhKl79+h/Cux0yMxM5InJfvqUZfOd+v2W/Fd91004LnnJx9 gWFDwg0CAqPALj2uN5Pna/HvBNfvNP25FbGJ/5NkP/6j3lwW9Hk8Lnl1LPdKTqjoRqYc=; Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5og-0000gb-Fb for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:22 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5og-0006eP-Er for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:22 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WP-0000oB-NK; Thu, 15 Oct 2020 16:50:29 +0100 From: Ian Jackson To: xen-devel@lists.xenproject.org Cc: Ian Jackson Subject: [OSSTEST PATCH v2 12/17] cri-args-hostlists: Move flight_html_dir variable Date: Thu, 15 Oct 2020 16:50:14 +0100 Message-Id: <20201015155019.20705-13-iwj@xenproject.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20201015155019.20705-1-iwj@xenproject.org> References: <20201015155019.20705-1-iwj@xenproject.org> MIME-Version: 1.0 This is only used in report_flight. We are going to want to call report_flight from outside start_email, without having to set that variable ourselves. The variable isn't actually used in start_email. Signed-off-by: Ian Jackson --- cri-args-hostlists | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/cri-args-hostlists b/cri-args-hostlists index 52e39f33..52cac195 100644 --- a/cri-args-hostlists +++ b/cri-args-hostlists @@ -113,7 +113,6 @@ start_email () { printf '%s\n' "`getconfig EmailStdHeaders`" printf 'Subject: %s' "${subject_prefix:-[$branch test] }" - local flight_html_dir=$OSSTEST_HTMLPUB_DIR/ local job_html_dir=$OSSTEST_HTML_DIR/ local host_html_dir=$OSSTEST_HTML_DIR/host/ @@ -143,6 +142,7 @@ start_email () { report_flight () { local flight=$1 + local flight_html_dir=$OSSTEST_HTMLPUB_DIR/ ./sg-report-flight --html-dir=$flight_html_dir/$flight/ \ --allow=allow.all --allow=allow.$branch \ $sgr_args $flight >tmp/$flight.report From patchwork Thu Oct 15 15:50:15 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ian Jackson X-Patchwork-Id: 11839597 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 2D20F1580 for ; Thu, 15 Oct 2020 16:10:29 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id E3BF521D7F for ; Thu, 15 Oct 2020 16:10:28 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (1024-bit key) header.d=xenproject.org header.i=@xenproject.org header.b="6nBC+4Wr" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org E3BF521D7F Authentication-Results: mail.kernel.org; dmarc=pass (p=none dis=none) header.from=xenproject.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.7549.19856 (Exim 4.92) (envelope-from ) id 1kT5ow-0000yr-8R; Thu, 15 Oct 2020 16:09:38 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 7549.19856; Thu, 15 Oct 2020 16:09:38 +0000 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5ow-0000yd-4E; Thu, 15 Oct 2020 16:09:38 +0000 Received: by outflank-mailman (input) for mailman id 7549; Thu, 15 Oct 2020 16:09:37 +0000 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5ov-0000xQ-2W for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:37 +0000 Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id e17d3cb8-6410-454c-a99e-ac964f8ccf48; Thu, 15 Oct 2020 16:09:36 +0000 (UTC) Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5ou-0000h7-7W for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:36 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5ou-0006gy-6g for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:36 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WP-0000oB-Uw; Thu, 15 Oct 2020 16:50:30 +0100 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5ov-0000xQ-2W for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:37 +0000 X-Inumbo-ID: e17d3cb8-6410-454c-a99e-ac964f8ccf48 Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id e17d3cb8-6410-454c-a99e-ac964f8ccf48; Thu, 15 Oct 2020 16:09:36 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=xenproject.org; s=20200302mail; h=Content-Transfer-Encoding:MIME-Version: References:In-Reply-To:Message-Id:Date:Subject:Cc:To:From; bh=rKhUBECvH4UVMiFTJmADZZZYMWQOR+f/Us5E4XBbMw4=; b=6nBC+4WrrE9VyBaqiUBy++5BXv PMlM1TTv/orJDF/qEz40NHcR1E9G9v+iv8KKje/8Q/h/hhgArylaZlbZB5cmke+cpuFmzhf7CPJTm EWcp1onyN6frRapjHtWJcV7ZP1MK3pA4e1q/fhVyZgMDLpyexhB6PoKTC0hiLmuoWfRE=; Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5ou-0000h7-7W for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:36 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5ou-0006gy-6g for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:36 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WP-0000oB-Uw; Thu, 15 Oct 2020 16:50:30 +0100 From: Ian Jackson To: xen-devel@lists.xenproject.org Cc: Ian Jackson , Ian Jackson Subject: [OSSTEST PATCH v2 13/17] cr-daily-branch: Immediately retry failing tests Date: Thu, 15 Oct 2020 16:50:15 +0100 Message-Id: <20201015155019.20705-14-iwj@xenproject.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20201015155019.20705-1-iwj@xenproject.org> References: <20201015155019.20705-1-iwj@xenproject.org> MIME-Version: 1.0 From: Ian Jackson We exclude the self-tests because we don't want to miss breakage, and the Xen smoke tests because they will be run again RSN anyway. Signed-off-by: Ian Jackson --- cr-daily-branch | 48 +++++++++++++++++++++++++++++++++++++++++++++++- 1 file changed, 47 insertions(+), 1 deletion(-) diff --git a/cr-daily-branch b/cr-daily-branch index 285ea361..bea8734e 100755 --- a/cr-daily-branch +++ b/cr-daily-branch @@ -472,12 +472,58 @@ esac sgr_args+=" $EXTRA_SGR_ARGS" date >&2 +original_start=`date +%s` + : $flight $branch $OSSTEST_BLESSING $sgr_args eval "$DAILY_BRANCH_PREEXEC_HOOK" execute_flight $flight $OSSTEST_BLESSING date >&2 -start_email $flight $branch "$sgr_args" "$subject_prefix" +default_immediate_retry=$wantpush + +case "$branch" in +*smoke*) default_immediate_retry=false ;; +osstest) default_immediate_retry=false ;; +*) ;; +esac + +: ${OSSTEST_IMMEDIATE_RETRY:-$default_immediate_retry} + +while true; do + start_email $flight $branch "$sgr_args" "$subject_prefix" + if grep '^tolerable$' $mrof >/dev/null 2>&1; then break; fi + if ! $OSSTEST_IMMEDIATE_RETRY; then break; fi + OSSTEST_IMMEDIATE_RETRY=false + retry_jobs=$( + perl <$mrof -wne ' + next unless m/^regression (\S+) /; + my $j = $1; + next if $j =~ m/^build/; + $r{$j}++; + END { + print "copy-jobs '$flight' $_ " + foreach sort keys %r; + }' + ) + if [ "x$retry_jobs" = x ]; then break; fi + + rflight=$( + ./cs-adjust-flight new:$OSSTEST_BLESSING \ + branch-set $branch \ + $retry_jobs + ) + + ./mg-adjust-flight-makexrefs -v $rflight \ + --branch=$branch --revision-osstest=$narness_rev \ + '^build-*' --debug --blessings=real + + export OSSTEST_RESOURCE_WAITSTART=$original_start + execute_flight $rflight $OSSTEST_BLESSING-retest + report_flight $rflight + publish_logs $rflight + + sgr_args+=" --refer-to-flight=$rflight" +done push=false if grep '^tolerable$' $mrof >/dev/null 2>&1; then push=$wantpush; fi From patchwork Thu Oct 15 15:50:16 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ian Jackson X-Patchwork-Id: 11839603 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 1E91314B3 for ; Thu, 15 Oct 2020 16:10:41 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id CF35622267 for ; Thu, 15 Oct 2020 16:10:40 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (1024-bit key) header.d=xenproject.org header.i=@xenproject.org header.b="rkJjFYWX" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org CF35622267 Authentication-Results: mail.kernel.org; dmarc=pass (p=none dis=none) header.from=xenproject.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.7544.19796 (Exim 4.92) (envelope-from ) id 1kT5oa-0000bf-GS; Thu, 15 Oct 2020 16:09:16 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 7544.19796; Thu, 15 Oct 2020 16:09:16 +0000 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5oa-0000bX-D4; Thu, 15 Oct 2020 16:09:16 +0000 Received: by outflank-mailman (input) for mailman id 7544; Thu, 15 Oct 2020 16:09:14 +0000 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5oY-0000WV-Rm for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:14 +0000 Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id fd9e91f7-be31-4013-a56f-e8777305bc8c; Thu, 15 Oct 2020 16:09:11 +0000 (UTC) Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5oV-0000gF-CJ for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:11 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5oV-0006c9-BS for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:11 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WQ-0000oB-6Q; Thu, 15 Oct 2020 16:50:30 +0100 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5oY-0000WV-Rm for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:14 +0000 X-Inumbo-ID: fd9e91f7-be31-4013-a56f-e8777305bc8c Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id fd9e91f7-be31-4013-a56f-e8777305bc8c; Thu, 15 Oct 2020 16:09:11 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=xenproject.org; s=20200302mail; h=Content-Transfer-Encoding:MIME-Version: References:In-Reply-To:Message-Id:Date:Subject:Cc:To:From; bh=sjdvYyM1PnXhPbXqN8m96KPPeA795n+928eEa0JNcoo=; b=rkJjFYWXXI5rcMm20svd5AyiKo wD//qzGLFyxtvnmo/nqrCsX9lTuJB1NwS+KXH2h2mdHDCEuPrThi1A0jwl1xWL+HFm7b8HkmIS5EM vck74Xe4WaZ+T5VoJ40m4SK9/P9INOd59mc/6f8u17cqvvNrgejc7a57P5B7VD/VGi1I=; Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5oV-0000gF-CJ for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:11 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5oV-0006c9-BS for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:11 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WQ-0000oB-6Q; Thu, 15 Oct 2020 16:50:30 +0100 From: Ian Jackson To: xen-devel@lists.xenproject.org Cc: Ian Jackson Subject: [OSSTEST PATCH v2 14/17] Honour OSSTEST_SIMULATE_FAIL_RETRY for immediate retries Date: Thu, 15 Oct 2020 16:50:16 +0100 Message-Id: <20201015155019.20705-15-iwj@xenproject.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20201015155019.20705-1-iwj@xenproject.org> References: <20201015155019.20705-1-iwj@xenproject.org> MIME-Version: 1.0 This is primarily useful for debugging the immediate-retry logic, but it seems churlish to delete it again. Signed-off-by: Ian Jackson --- cr-daily-branch | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/cr-daily-branch b/cr-daily-branch index bea8734e..3e58d465 100755 --- a/cr-daily-branch +++ b/cr-daily-branch @@ -517,6 +517,10 @@ while true; do --branch=$branch --revision-osstest=$narness_rev \ '^build-*' --debug --blessings=real + if [ "${OSSTEST_SIMULATE_FAIL_RETRY+y}" = y ]; then + export OSSTEST_SIMULATE_FAIL="${OSSTEST_SIMULATE_FAIL_RETRY}" + fi + export OSSTEST_RESOURCE_WAITSTART=$original_start execute_flight $rflight $OSSTEST_BLESSING-retest report_flight $rflight From patchwork Thu Oct 15 15:50:17 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ian Jackson X-Patchwork-Id: 11839601 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 4D5C91580 for ; Thu, 15 Oct 2020 16:10:39 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 0FFD021D7F for ; Thu, 15 Oct 2020 16:10:39 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (1024-bit key) header.d=xenproject.org header.i=@xenproject.org header.b="ucPB9WYI" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 0FFD021D7F Authentication-Results: mail.kernel.org; dmarc=pass (p=none dis=none) header.from=xenproject.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.7545.19808 (Exim 4.92) (envelope-from ) id 1kT5oe-0000ep-P1; Thu, 15 Oct 2020 16:09:20 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 7545.19808; Thu, 15 Oct 2020 16:09:20 +0000 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5oe-0000ei-LM; Thu, 15 Oct 2020 16:09:20 +0000 Received: by outflank-mailman (input) for mailman id 7545; Thu, 15 Oct 2020 16:09:19 +0000 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5od-0000WV-S0 for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:19 +0000 Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id ad5d6dd0-5b63-453f-b297-7a399c91773d; Thu, 15 Oct 2020 16:09:16 +0000 (UTC) Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5oa-0000gP-23 for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:16 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5oa-0006d2-18 for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:16 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WQ-0000oB-Fn; Thu, 15 Oct 2020 16:50:30 +0100 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5od-0000WV-S0 for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:19 +0000 X-Inumbo-ID: ad5d6dd0-5b63-453f-b297-7a399c91773d Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id ad5d6dd0-5b63-453f-b297-7a399c91773d; Thu, 15 Oct 2020 16:09:16 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=xenproject.org; s=20200302mail; h=Content-Transfer-Encoding:MIME-Version: References:In-Reply-To:Message-Id:Date:Subject:Cc:To:From; bh=uF93lLE6Hujj9HHD1uOcz9Kb2G0DNm7aSbOO3mDjPxk=; b=ucPB9WYIV0ZAF7oH+CGrjitn7Y jOM9r+VrJwVBV1a9GkeV4ypM3hBlEDHCtcji9kMc+BcJ/m1a8iuBWL7WgCbFmfVkX4sPSs3DMMZfU 7SVRFn3zPiEKWwyCWOFTkHzmIwiiEa0UhArz6L3LRjp/ZqfpJn+j2RySJ9vrI9Awsg0E=; Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5oa-0000gP-23 for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:16 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5oa-0006d2-18 for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:16 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WQ-0000oB-Fn; Thu, 15 Oct 2020 16:50:30 +0100 From: Ian Jackson To: xen-devel@lists.xenproject.org Cc: Ian Jackson , Andrew Cooper Subject: [OSSTEST PATCH v2 15/17] cr-daily-branch: Do not do immediate retry of failing xtf flights Date: Thu, 15 Oct 2020 16:50:17 +0100 Message-Id: <20201015155019.20705-16-iwj@xenproject.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20201015155019.20705-1-iwj@xenproject.org> References: <20201015155019.20705-1-iwj@xenproject.org> MIME-Version: 1.0 CC: Andrew Cooper Signed-off-by: Ian Jackson --- cr-daily-branch | 1 + 1 file changed, 1 insertion(+) diff --git a/cr-daily-branch b/cr-daily-branch index 3e58d465..9b1961bd 100755 --- a/cr-daily-branch +++ b/cr-daily-branch @@ -484,6 +484,7 @@ default_immediate_retry=$wantpush case "$branch" in *smoke*) default_immediate_retry=false ;; osstest) default_immediate_retry=false ;; +xtf*) default_immediate_retry=false ;; *) ;; esac From patchwork Thu Oct 15 15:50:18 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ian Jackson X-Patchwork-Id: 11839599 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 515601580 for ; Thu, 15 Oct 2020 16:10:31 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 1129F21D7F for ; Thu, 15 Oct 2020 16:10:30 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (1024-bit key) header.d=xenproject.org header.i=@xenproject.org header.b="CDw6OgNv" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 1129F21D7F Authentication-Results: mail.kernel.org; dmarc=pass (p=none dis=none) header.from=xenproject.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.7548.19844 (Exim 4.92) (envelope-from ) id 1kT5or-0000so-Tx; Thu, 15 Oct 2020 16:09:33 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 7548.19844; Thu, 15 Oct 2020 16:09:33 +0000 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5or-0000sf-Pb; Thu, 15 Oct 2020 16:09:33 +0000 Received: by outflank-mailman (input) for mailman id 7548; Thu, 15 Oct 2020 16:09:33 +0000 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5oq-0000mi-UO for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:32 +0000 Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id 7b574eae-3e04-4a0f-bdce-bb8145bcf898; Thu, 15 Oct 2020 16:09:31 +0000 (UTC) Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5op-0000gy-LC for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:31 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5op-0006g4-KA for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:31 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WQ-0000oB-PH; Thu, 15 Oct 2020 16:50:30 +0100 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5oq-0000mi-UO for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:32 +0000 X-Inumbo-ID: 7b574eae-3e04-4a0f-bdce-bb8145bcf898 Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id 7b574eae-3e04-4a0f-bdce-bb8145bcf898; Thu, 15 Oct 2020 16:09:31 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=xenproject.org; s=20200302mail; h=Content-Transfer-Encoding:MIME-Version: References:In-Reply-To:Message-Id:Date:Subject:Cc:To:From; bh=/E/dZdst6zLSlIoKGnfjgU1l91GnjdF0tvF6OifHDMo=; b=CDw6OgNva7Jc9kANBV8ub63OU5 Z4obG4I7LgAvfcTDkI3XGp0QSS5xJSdstWVWEvrlRY3bn87mXJqSRfsoijN74T5zrRaULsaE7b4Xm 7CQ2Npcvs/F5cgVCfLwliuj06uC9QmJ22n0txD39LKwKESfO3Y4LWtTkdWvYpYFPIzYc=; Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5op-0000gy-LC for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:31 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5op-0006g4-KA for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:31 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WQ-0000oB-PH; Thu, 15 Oct 2020 16:50:30 +0100 From: Ian Jackson To: xen-devel@lists.xenproject.org Cc: Ian Jackson Subject: [OSSTEST PATCH v2 16/17] sg-report-flight: Include count of blockers, and of jobs, in mro Date: Thu, 15 Oct 2020 16:50:18 +0100 Message-Id: <20201015155019.20705-17-iwj@xenproject.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20201015155019.20705-1-iwj@xenproject.org> References: <20201015155019.20705-1-iwj@xenproject.org> MIME-Version: 1.0 The mro will now contain exactly one of "blockers" or "tolerable". Nothing uses this yet. Signed-off-by: Ian Jackson --- sg-report-flight | 5 ++++- 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/sg-report-flight b/sg-report-flight index 51a409ed..fd266586 100755 --- a/sg-report-flight +++ b/sg-report-flight @@ -1128,13 +1128,16 @@ END } if (!$heisen_why) { + my $n_blockers = scalar grep { $_->{Blocker} } @failures; + print MRO "njobs ", scalar(@{ $fi->{JobTexts} }), "\n"; + print MRO "nblockers $n_blockers\n" if $n_blockers; if (!@failures) { print MRO "tolerable\nperfect\n" or die $!; $fi->{Overall}.= "Perfect :-)\n"; } elsif (grep { $_->{Blocker} eq 'regression' } @failures) { $fi->{OutcomeSummary}= "regressions - $fi->{OutcomeSummary}"; $fi->{Overall}.= "Regressions :-(\n"; - } elsif (!grep { $_->{Blocker} } @failures) { + } elsif (!$n_blockers) { $fi->{OutcomeSummary}= "tolerable $fi->{OutcomeSummary}"; print MRO "tolerable\n" or die $! unless defined $heisen_why; From patchwork Thu Oct 15 15:50:19 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ian Jackson X-Patchwork-Id: 11839591 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id E044F17C9 for ; Thu, 15 Oct 2020 16:10:17 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id A5B9722210 for ; Thu, 15 Oct 2020 16:10:17 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (1024-bit key) header.d=xenproject.org header.i=@xenproject.org header.b="pcoWROS+" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org A5B9722210 Authentication-Results: mail.kernel.org; dmarc=pass (p=none dis=none) header.from=xenproject.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.7547.19832 (Exim 4.92) (envelope-from ) id 1kT5on-0000o8-Jw; Thu, 15 Oct 2020 16:09:29 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 7547.19832; Thu, 15 Oct 2020 16:09:29 +0000 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5on-0000nv-Fc; Thu, 15 Oct 2020 16:09:29 +0000 Received: by outflank-mailman (input) for mailman id 7547; Thu, 15 Oct 2020 16:09:28 +0000 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5om-0000mi-3O for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:28 +0000 Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id dd437341-70cf-41f8-ab23-e7417d87276f; Thu, 15 Oct 2020 16:09:27 +0000 (UTC) Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5ol-0000gl-0Z for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:27 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5ok-0006fE-W1 for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:26 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WR-0000oB-0p; Thu, 15 Oct 2020 16:50:31 +0100 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5om-0000mi-3O for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:28 +0000 X-Inumbo-ID: dd437341-70cf-41f8-ab23-e7417d87276f Received: from mail.xenproject.org (unknown [104.130.215.37]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id dd437341-70cf-41f8-ab23-e7417d87276f; Thu, 15 Oct 2020 16:09:27 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=xenproject.org; s=20200302mail; h=Content-Transfer-Encoding:MIME-Version: References:In-Reply-To:Message-Id:Date:Subject:Cc:To:From; bh=Eb2yZLxvdxwd6Ruht+D5KNOOBqV7wkTSytbhDN+ksww=; b=pcoWROS+3Qx7axDTdPcbd1X2zg YDzlPXdGcMkg/HXAmGrVVr1QZWy5Wg8HIj+akL2PuMqCmwHJXN7xugVx+ur3oVxQWafXfeDn3qqjN TH8HThuWkxsRhpotYAAJwqkEuUNhqwu9ZJoGJdfmTGlNd3Jw8AMb1SPJthZQHHtL8hK4=; Received: from xenbits.xenproject.org ([104.239.192.120]) by mail.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kT5ol-0000gl-0Z for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:27 +0000 Received: from iwj (helo=mynotebook.example.org) by xenbits.xenproject.org with local-bsmtp (Exim 4.92) (envelope-from ) id 1kT5ok-0006fE-W1 for xen-devel@lists.xenproject.org; Thu, 15 Oct 2020 16:09:26 +0000 Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by mariner.uk.xensource.com with esmtp (Exim 4.89) (envelope-from ) id 1kT5WR-0000oB-0p; Thu, 15 Oct 2020 16:50:31 +0100 From: Ian Jackson To: xen-devel@lists.xenproject.org Cc: Ian Jackson Subject: [OSSTEST PATCH v2 17/17] cr-daily-branch: Heuristics for when to do immediate retest flight Date: Thu, 15 Oct 2020 16:50:19 +0100 Message-Id: <20201015155019.20705-18-iwj@xenproject.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20201015155019.20705-1-iwj@xenproject.org> References: <20201015155019.20705-1-iwj@xenproject.org> MIME-Version: 1.0 Do not do a retest if it would involve retesting more than 10% of the original flight, or if it wouldn't get a push even if the retests pass. Signed-off-by: Ian Jackson --- cr-daily-branch | 15 +++++++++++++++ 1 file changed, 15 insertions(+) diff --git a/cr-daily-branch b/cr-daily-branch index 9b1961bd..e54ca227 100755 --- a/cr-daily-branch +++ b/cr-daily-branch @@ -497,11 +497,26 @@ while true; do OSSTEST_IMMEDIATE_RETRY=false retry_jobs=$( perl <$mrof -wne ' + $n_blockers = $1 if m/^nblockers (\d+)\s*$/; + $n_jobs = $1 if m/^njobs (\d+)\s*$/; next unless m/^regression (\S+) /; my $j = $1; next if $j =~ m/^build/; $r{$j}++; + sub nope { + print STDERR "no retry: @_\n"; + exit 0; + } END { + my $n_retry_jobs = scalar(keys %r); + print STDERR <<"END"; +n_retry_jobs=$n_retry_jobs n_blockers=$n_blockers n_jobs=$n_jobs +END + nope("other blockers") if + $n_retry_jobs < $n_blockers; + nope("too many regressions") if + $n_retry_jobs > 1 && + $n_retry_jobs > $n_jobs/10; print "copy-jobs '$flight' $_ " foreach sort keys %r; }'