From patchwork Thu Oct 1 16:24:32 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ian Jackson X-Patchwork-Id: 11811867 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 8A3936CB for ; Thu, 1 Oct 2020 16:25:46 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 6691B20759 for ; Thu, 1 Oct 2020 16:25:46 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 6691B20759 Authentication-Results: mail.kernel.org; dmarc=pass (p=none dis=none) header.from=xenproject.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.1458.4617 (Exim 4.92) (envelope-from ) id 1kO1OK-0001a4-C1; Thu, 01 Oct 2020 16:25:12 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 1458.4617; Thu, 01 Oct 2020 16:25:12 +0000 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kO1OK-0001Zt-7X; Thu, 01 Oct 2020 16:25:12 +0000 Received: by outflank-mailman (input) for mailman id 1458; Thu, 01 Oct 2020 16:25:10 +0000 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kO1OI-0001JL-K1 for xen-devel@lists.xenproject.org; Thu, 01 Oct 2020 16:25:10 +0000 Received: from chiark.greenend.org.uk (unknown [2001:ba8:1e3::]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id 3e49779b-04c5-4b07-8019-bb35150fe206; Thu, 01 Oct 2020 16:24:49 +0000 (UTC) Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by chiark.greenend.org.uk (Debian Exim 4.84_2 #1) with esmtp (return-path ijackson@chiark.greenend.org.uk) id 1kO1Nw-00029L-TM; Thu, 01 Oct 2020 17:24:49 +0100 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kO1OI-0001JL-K1 for xen-devel@lists.xenproject.org; Thu, 01 Oct 2020 16:25:10 +0000 X-Inumbo-ID: 3e49779b-04c5-4b07-8019-bb35150fe206 Received: from chiark.greenend.org.uk (unknown [2001:ba8:1e3::]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id 3e49779b-04c5-4b07-8019-bb35150fe206; Thu, 01 Oct 2020 16:24:49 +0000 (UTC) Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by chiark.greenend.org.uk (Debian Exim 4.84_2 #1) with esmtp (return-path ijackson@chiark.greenend.org.uk) id 1kO1Nw-00029L-TM; Thu, 01 Oct 2020 17:24:49 +0100 From: Ian Jackson To: xen-devel@lists.xenproject.org Cc: Ian Jackson Subject: [OSSTEST PATCH 1/8] Executive: Fix an undef warning message Date: Thu, 1 Oct 2020 17:24:32 +0100 Message-Id: <20201001162439.18160-1-iwj@xenproject.org> X-Mailer: git-send-email 2.20.1 MIME-Version: 1.0 $onhost can be undef too Signed-off-by: Ian Jackson --- Osstest/Executive.pm | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/Osstest/Executive.pm b/Osstest/Executive.pm index 80e70070..a0d9f81e 100644 --- a/Osstest/Executive.pm +++ b/Osstest/Executive.pm @@ -1283,7 +1283,8 @@ END return sub { my ($job, $hostidname, $onhost, $uptoincl_testid) = @_; - my $memokey = "$job $hostidname $onhost ".($uptoincl_testid//""); + my $memokey = "$job $hostidname " + .($onhost//"")." ".($uptoincl_testid//""); my $memo = $our_memo->{$memokey}; return @$memo if $memo; From patchwork Thu Oct 1 16:24:33 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ian Jackson X-Patchwork-Id: 11811869 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 3510A139A for ; Thu, 1 Oct 2020 16:25:52 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 0EA4120759 for ; Thu, 1 Oct 2020 16:25:52 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 0EA4120759 Authentication-Results: mail.kernel.org; dmarc=pass (p=none dis=none) header.from=xenproject.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.1454.4568 (Exim 4.92) (envelope-from ) id 1kO1Nz-0001JX-4c; Thu, 01 Oct 2020 16:24:51 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 1454.4568; Thu, 01 Oct 2020 16:24:51 +0000 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kO1Nz-0001JQ-1Z; Thu, 01 Oct 2020 16:24:51 +0000 Received: by outflank-mailman (input) for mailman id 1454; Thu, 01 Oct 2020 16:24:50 +0000 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kO1Ny-0001JL-Ku for xen-devel@lists.xenproject.org; Thu, 01 Oct 2020 16:24:50 +0000 Received: from chiark.greenend.org.uk (unknown [2001:ba8:1e3::]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id 418437ea-7a37-43b9-8e44-19305a131d4a; Thu, 01 Oct 2020 16:24:49 +0000 (UTC) Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by chiark.greenend.org.uk (Debian Exim 4.84_2 #1) with esmtp (return-path ijackson@chiark.greenend.org.uk) id 1kO1Nx-00029L-5P; Thu, 01 Oct 2020 17:24:49 +0100 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kO1Ny-0001JL-Ku for xen-devel@lists.xenproject.org; Thu, 01 Oct 2020 16:24:50 +0000 X-Inumbo-ID: 418437ea-7a37-43b9-8e44-19305a131d4a Received: from chiark.greenend.org.uk (unknown [2001:ba8:1e3::]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id 418437ea-7a37-43b9-8e44-19305a131d4a; Thu, 01 Oct 2020 16:24:49 +0000 (UTC) Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by chiark.greenend.org.uk (Debian Exim 4.84_2 #1) with esmtp (return-path ijackson@chiark.greenend.org.uk) id 1kO1Nx-00029L-5P; Thu, 01 Oct 2020 17:24:49 +0100 From: Ian Jackson To: xen-devel@lists.xenproject.org Cc: Ian Jackson Subject: [OSSTEST PATCH 2/8] standalone: Use mkdir -p Date: Thu, 1 Oct 2020 17:24:33 +0100 Message-Id: <20201001162439.18160-2-iwj@xenproject.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20201001162439.18160-1-iwj@xenproject.org> References: <20201001162439.18160-1-iwj@xenproject.org> MIME-Version: 1.0 These two mkdir calls could fail if standalone-generate-dump-flight-runvars is run without a log directory, because they were not concurrency-correct. mkdir -p should fix that. Signed-off-by: Ian Jackson --- standalone | 8 ++------ 1 file changed, 2 insertions(+), 6 deletions(-) diff --git a/standalone b/standalone index 9553d6c9..4d1f3513 100755 --- a/standalone +++ b/standalone @@ -181,12 +181,8 @@ check_repos() { } ensure_logs() { - if [ ! -d "logs" ] ; then - mkdir "logs" - fi - if [ ! -d "logs/$flight" ] ; then - mkdir "logs/$flight" - fi + mkdir -p "logs" + mkdir -p "logs/$flight" } with_logging() { From patchwork Thu Oct 1 16:24:34 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ian Jackson X-Patchwork-Id: 11811865 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 3A6AA139A for ; Thu, 1 Oct 2020 16:25:44 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 15E9520759 for ; Thu, 1 Oct 2020 16:25:44 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 15E9520759 Authentication-Results: mail.kernel.org; dmarc=pass (p=none dis=none) header.from=xenproject.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.1455.4581 (Exim 4.92) (envelope-from ) id 1kO1O4-0001Lt-EP; Thu, 01 Oct 2020 16:24:56 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 1455.4581; Thu, 01 Oct 2020 16:24:56 +0000 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kO1O4-0001Lm-AW; Thu, 01 Oct 2020 16:24:56 +0000 Received: by outflank-mailman (input) for mailman id 1455; Thu, 01 Oct 2020 16:24:55 +0000 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kO1O3-0001JL-JR for xen-devel@lists.xenproject.org; Thu, 01 Oct 2020 16:24:55 +0000 Received: from chiark.greenend.org.uk (unknown [2001:ba8:1e3::]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id 57916f4e-c27c-453e-bc92-0bb81ac20b09; Thu, 01 Oct 2020 16:24:50 +0000 (UTC) Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by chiark.greenend.org.uk (Debian Exim 4.84_2 #1) with esmtp (return-path ijackson@chiark.greenend.org.uk) id 1kO1Nx-00029L-Cc; Thu, 01 Oct 2020 17:24:49 +0100 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kO1O3-0001JL-JR for xen-devel@lists.xenproject.org; Thu, 01 Oct 2020 16:24:55 +0000 X-Inumbo-ID: 57916f4e-c27c-453e-bc92-0bb81ac20b09 Received: from chiark.greenend.org.uk (unknown [2001:ba8:1e3::]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id 57916f4e-c27c-453e-bc92-0bb81ac20b09; Thu, 01 Oct 2020 16:24:50 +0000 (UTC) Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by chiark.greenend.org.uk (Debian Exim 4.84_2 #1) with esmtp (return-path ijackson@chiark.greenend.org.uk) id 1kO1Nx-00029L-Cc; Thu, 01 Oct 2020 17:24:49 +0100 From: Ian Jackson To: xen-devel@lists.xenproject.org Cc: Ian Jackson Subject: [OSSTEST PATCH 3/8] sg-run-job: Preserve step state "fail" if set by test script Date: Thu, 1 Oct 2020 17:24:34 +0100 Message-Id: <20201001162439.18160-3-iwj@xenproject.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20201001162439.18160-1-iwj@xenproject.org> References: <20201001162439.18160-1-iwj@xenproject.org> MIME-Version: 1.0 If the test script exits nonzero but after setting the step status to 'fail', we can leave it that way. This is particularly relevant if the iffail in the job spec says 'broken' or something. After this change, a step can decide to override that. An alternative would be to have the step script exit zero, but of course that would (generally) leave the job to continue running more steps! Signed-off-by: Ian Jackson --- tcl/JobDB-Executive.tcl | 1 + 1 file changed, 1 insertion(+) diff --git a/tcl/JobDB-Executive.tcl b/tcl/JobDB-Executive.tcl index 4fe85696..38248823 100644 --- a/tcl/JobDB-Executive.tcl +++ b/tcl/JobDB-Executive.tcl @@ -325,6 +325,7 @@ proc step-set-status {flight job stepno st} { AND status<>'aborted' AND status<>'broken' AND status<>'starved' + AND status<>'fail' " set pause 0 db-execute-array stopinfo " From patchwork Thu Oct 1 16:24:35 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ian Jackson X-Patchwork-Id: 11811877 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id D0E1413B2 for ; Thu, 1 Oct 2020 16:26:12 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id AE58A20759 for ; Thu, 1 Oct 2020 16:26:12 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org AE58A20759 Authentication-Results: mail.kernel.org; dmarc=pass (p=none dis=none) header.from=xenproject.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.1456.4593 (Exim 4.92) (envelope-from ) id 1kO1O9-0001Px-N0; Thu, 01 Oct 2020 16:25:01 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 1456.4593; Thu, 01 Oct 2020 16:25:01 +0000 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kO1O9-0001Pp-Ja; Thu, 01 Oct 2020 16:25:01 +0000 Received: by outflank-mailman (input) for mailman id 1456; Thu, 01 Oct 2020 16:25:00 +0000 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kO1O8-0001JL-Jf for xen-devel@lists.xenproject.org; Thu, 01 Oct 2020 16:25:00 +0000 Received: from chiark.greenend.org.uk (unknown [2001:ba8:1e3::]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id 67a43fb5-0bab-4e4d-b4b0-b5c32ab605ac; Thu, 01 Oct 2020 16:24:50 +0000 (UTC) Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by chiark.greenend.org.uk (Debian Exim 4.84_2 #1) with esmtp (return-path ijackson@chiark.greenend.org.uk) id 1kO1Nx-00029L-KT; Thu, 01 Oct 2020 17:24:49 +0100 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kO1O8-0001JL-Jf for xen-devel@lists.xenproject.org; Thu, 01 Oct 2020 16:25:00 +0000 X-Inumbo-ID: 67a43fb5-0bab-4e4d-b4b0-b5c32ab605ac Received: from chiark.greenend.org.uk (unknown [2001:ba8:1e3::]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id 67a43fb5-0bab-4e4d-b4b0-b5c32ab605ac; Thu, 01 Oct 2020 16:24:50 +0000 (UTC) Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by chiark.greenend.org.uk (Debian Exim 4.84_2 #1) with esmtp (return-path ijackson@chiark.greenend.org.uk) id 1kO1Nx-00029L-KT; Thu, 01 Oct 2020 17:24:49 +0100 From: Ian Jackson To: xen-devel@lists.xenproject.org Cc: Ian Jackson Subject: [OSSTEST PATCH 4/8] ts-hosts-allocate-Executive: Allow to tolerate missing resources Date: Thu, 1 Oct 2020 17:24:35 +0100 Message-Id: <20201001162439.18160-4-iwj@xenproject.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20201001162439.18160-1-iwj@xenproject.org> References: <20201001162439.18160-1-iwj@xenproject.org> MIME-Version: 1.0 Now, a job can specify that lack of a suitable host should be treated as a plain test failure (ie, subject to the usual regression analysis) rather than as an infrastructure or configuration problem. This will be useful for some tests which don't work in some branches because of lack of suitable hardware. We want to avoid encoding our hardware availability situation in make-flight. Signed-off-by: Ian Jackson --- ts-hosts-allocate-Executive | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/ts-hosts-allocate-Executive b/ts-hosts-allocate-Executive index 698437c0..58d2a389 100755 --- a/ts-hosts-allocate-Executive +++ b/ts-hosts-allocate-Executive @@ -704,6 +704,10 @@ sub alloc_hosts () { my ($ok, $bookinglist) = attempt_allocation({ ts_hosts_allocate_precheck => 1, }, 0); + if ($ok == $alloc_starved_r && $r{hostalloc_missing_expected}) { + broken 'no suitable hosts available (as possibly expected)', + 'fail'; + } die $ok if $ok>1; } From patchwork Thu Oct 1 16:24:36 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ian Jackson X-Patchwork-Id: 11811863 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 20DF4139A for ; Thu, 1 Oct 2020 16:25:27 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id EE81D20848 for ; Thu, 1 Oct 2020 16:25:26 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org EE81D20848 Authentication-Results: mail.kernel.org; dmarc=pass (p=none dis=none) header.from=xenproject.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.1457.4605 (Exim 4.92) (envelope-from ) id 1kO1OF-0001Uo-28; Thu, 01 Oct 2020 16:25:07 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 1457.4605; Thu, 01 Oct 2020 16:25:07 +0000 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kO1OE-0001Uf-V9; Thu, 01 Oct 2020 16:25:06 +0000 Received: by outflank-mailman (input) for mailman id 1457; Thu, 01 Oct 2020 16:25:05 +0000 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kO1OD-0001JL-Jp for xen-devel@lists.xenproject.org; Thu, 01 Oct 2020 16:25:05 +0000 Received: from chiark.greenend.org.uk (unknown [2001:ba8:1e3::]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id ffc40c9e-ce12-41c2-9097-de9fe89da053; Thu, 01 Oct 2020 16:24:50 +0000 (UTC) Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by chiark.greenend.org.uk (Debian Exim 4.84_2 #1) with esmtp (return-path ijackson@chiark.greenend.org.uk) id 1kO1Nx-00029L-SQ; Thu, 01 Oct 2020 17:24:49 +0100 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kO1OD-0001JL-Jp for xen-devel@lists.xenproject.org; Thu, 01 Oct 2020 16:25:05 +0000 X-Inumbo-ID: ffc40c9e-ce12-41c2-9097-de9fe89da053 Received: from chiark.greenend.org.uk (unknown [2001:ba8:1e3::]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id ffc40c9e-ce12-41c2-9097-de9fe89da053; Thu, 01 Oct 2020 16:24:50 +0000 (UTC) Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by chiark.greenend.org.uk (Debian Exim 4.84_2 #1) with esmtp (return-path ijackson@chiark.greenend.org.uk) id 1kO1Nx-00029L-SQ; Thu, 01 Oct 2020 17:24:49 +0100 From: Ian Jackson To: xen-devel@lists.xenproject.org Cc: Ian Jackson Subject: [OSSTEST PATCH 5/8] cri-getplatforms: Give names to xenarch and suite Date: Thu, 1 Oct 2020 17:24:36 +0100 Message-Id: <20201001162439.18160-5-iwj@xenproject.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20201001162439.18160-1-iwj@xenproject.org> References: <20201001162439.18160-1-iwj@xenproject.org> MIME-Version: 1.0 No functional change. This will be useful in a moment. Signed-off-by: Ian Jackson --- cri-getplatforms | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/cri-getplatforms b/cri-getplatforms index 2b8cee0b..1f206908 100755 --- a/cri-getplatforms +++ b/cri-getplatforms @@ -17,9 +17,11 @@ # along with this program. If not, see . getplatforms () { + local xenarch=$1 + local suite=$2 perl -e ' use Osstest; csreadconfig(); - print join " ", $mhostdb->get_arch_platforms("'$blessing'", "'$1'", "'$2'") or die $!; + print join " ", $mhostdb->get_arch_platforms("'$blessing'", "'$xenarch'", "'$suite'") or die $!; ' } From patchwork Thu Oct 1 16:24:37 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ian Jackson X-Patchwork-Id: 11811871 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 59F0F6CB for ; Thu, 1 Oct 2020 16:25:57 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 344AE20872 for ; Thu, 1 Oct 2020 16:25:57 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 344AE20872 Authentication-Results: mail.kernel.org; dmarc=pass (p=none dis=none) header.from=xenproject.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.1459.4629 (Exim 4.92) (envelope-from ) id 1kO1OO-0001eU-M6; Thu, 01 Oct 2020 16:25:16 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 1459.4629; Thu, 01 Oct 2020 16:25:16 +0000 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kO1OO-0001eN-Ie; Thu, 01 Oct 2020 16:25:16 +0000 Received: by outflank-mailman (input) for mailman id 1459; Thu, 01 Oct 2020 16:25:15 +0000 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kO1ON-0001JL-K9 for xen-devel@lists.xenproject.org; Thu, 01 Oct 2020 16:25:15 +0000 Received: from chiark.greenend.org.uk (unknown [2001:ba8:1e3::]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id 827dfb01-4f3e-43a8-bbd4-e111ff0eb190; Thu, 01 Oct 2020 16:24:50 +0000 (UTC) Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by chiark.greenend.org.uk (Debian Exim 4.84_2 #1) with esmtp (return-path ijackson@chiark.greenend.org.uk) id 1kO1Ny-00029L-37; Thu, 01 Oct 2020 17:24:50 +0100 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kO1ON-0001JL-K9 for xen-devel@lists.xenproject.org; Thu, 01 Oct 2020 16:25:15 +0000 X-Inumbo-ID: 827dfb01-4f3e-43a8-bbd4-e111ff0eb190 Received: from chiark.greenend.org.uk (unknown [2001:ba8:1e3::]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id 827dfb01-4f3e-43a8-bbd4-e111ff0eb190; Thu, 01 Oct 2020 16:24:50 +0000 (UTC) Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by chiark.greenend.org.uk (Debian Exim 4.84_2 #1) with esmtp (return-path ijackson@chiark.greenend.org.uk) id 1kO1Ny-00029L-37; Thu, 01 Oct 2020 17:24:50 +0100 From: Ian Jackson To: xen-devel@lists.xenproject.org Cc: Ian Jackson Subject: [OSSTEST PATCH 6/8] cri-getplatforms: Honour new MF_SIMULATE_PLATFORMS env var Date: Thu, 1 Oct 2020 17:24:37 +0100 Message-Id: <20201001162439.18160-6-iwj@xenproject.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20201001162439.18160-1-iwj@xenproject.org> References: <20201001162439.18160-1-iwj@xenproject.org> MIME-Version: 1.0 This is to be expanded by the shell, using eval, so that it can refer to $xenarch, $suite and $blessing. No functional change if this variable is unset, or empty. If it is set to a single space, cri-getplatforms produces no output (as it does anyway in standalone mode). Signed-off-by: Ian Jackson --- cri-getplatforms | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/cri-getplatforms b/cri-getplatforms index 1f206908..9f4cae56 100755 --- a/cri-getplatforms +++ b/cri-getplatforms @@ -19,6 +19,10 @@ getplatforms () { local xenarch=$1 local suite=$2 + if [ "x$MF_SIMULATE_PLATFORMS" != x ]; then + eval "echo $MF_SIMULATE_PLATFORMS" + return + fi perl -e ' use Osstest; csreadconfig(); From patchwork Thu Oct 1 16:24:38 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ian Jackson X-Patchwork-Id: 11811873 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id E08036CB for ; Thu, 1 Oct 2020 16:26:02 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id BD89520759 for ; Thu, 1 Oct 2020 16:26:02 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org BD89520759 Authentication-Results: mail.kernel.org; dmarc=pass (p=none dis=none) header.from=xenproject.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.1460.4641 (Exim 4.92) (envelope-from ) id 1kO1OU-0001k1-0i; Thu, 01 Oct 2020 16:25:22 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 1460.4641; Thu, 01 Oct 2020 16:25:21 +0000 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kO1OT-0001jq-SK; Thu, 01 Oct 2020 16:25:21 +0000 Received: by outflank-mailman (input) for mailman id 1460; Thu, 01 Oct 2020 16:25:20 +0000 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kO1OS-0001JL-KK for xen-devel@lists.xenproject.org; Thu, 01 Oct 2020 16:25:20 +0000 Received: from chiark.greenend.org.uk (unknown [2001:ba8:1e3::]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id 809d7148-c8f6-4f44-bfcf-d302cb04b56d; Thu, 01 Oct 2020 16:24:51 +0000 (UTC) Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by chiark.greenend.org.uk (Debian Exim 4.84_2 #1) with esmtp (return-path ijackson@chiark.greenend.org.uk) id 1kO1Ny-00029L-Ao; Thu, 01 Oct 2020 17:24:50 +0100 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kO1OS-0001JL-KK for xen-devel@lists.xenproject.org; Thu, 01 Oct 2020 16:25:20 +0000 X-Inumbo-ID: 809d7148-c8f6-4f44-bfcf-d302cb04b56d Received: from chiark.greenend.org.uk (unknown [2001:ba8:1e3::]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id 809d7148-c8f6-4f44-bfcf-d302cb04b56d; Thu, 01 Oct 2020 16:24:51 +0000 (UTC) Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by chiark.greenend.org.uk (Debian Exim 4.84_2 #1) with esmtp (return-path ijackson@chiark.greenend.org.uk) id 1kO1Ny-00029L-Ao; Thu, 01 Oct 2020 17:24:50 +0100 From: Ian Jackson To: xen-devel@lists.xenproject.org Cc: Ian Jackson Subject: [OSSTEST PATCH 7/8] standalone-generate-dump-flight-runvars: Simulate cri-getplatforms Date: Thu, 1 Oct 2020 17:24:38 +0100 Message-Id: <20201001162439.18160-7-iwj@xenproject.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20201001162439.18160-1-iwj@xenproject.org> References: <20201001162439.18160-1-iwj@xenproject.org> MIME-Version: 1.0 Set MF_SIMULATE_PLATFORMS to a suitable value if it is not *set*. (Distinguishing unset from set to empty.) I have verified that this, plus the preceding commits to cri-getplatforms, produces no change in the output of MF_SIMULATE_PLATFORMS='' OSSTEST_CONFIG=standalone-config-example eatmydata ./standalone-generate-dump-flight-runvars Without the MF_SIMULATE_PLATFORMS setting it adds several new jobs to each flight, name things like this: test-amd64-$arch1-xl-simplat-$arch2-$suite The purpose of this right now is to provide a way to dry-run test the next change. Signed-off-by: Ian Jackson --- standalone-generate-dump-flight-runvars | 3 +++ 1 file changed, 3 insertions(+) diff --git a/standalone-generate-dump-flight-runvars b/standalone-generate-dump-flight-runvars index 5c93b0af..07b9c126 100755 --- a/standalone-generate-dump-flight-runvars +++ b/standalone-generate-dump-flight-runvars @@ -45,6 +45,9 @@ fi : ${AP_FETCH_PLACEHOLDERS:=y} export AP_FETCH_PLACEHOLDERS +: ${MF_SIMULATE_PLATFORMS='simplat-$xenarch-$suite'} +export MF_SIMULATE_PLATFORMS + export OSSTEST_HOSTSLIST_DUMMY=1 if [ "x$AP_FETCH_PLACEHOLDERS" != xy ]; then From patchwork Thu Oct 1 16:24:39 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ian Jackson X-Patchwork-Id: 11811875 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 8B1AC6CB for ; Thu, 1 Oct 2020 16:26:08 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 66F8620872 for ; Thu, 1 Oct 2020 16:26:08 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 66F8620872 Authentication-Results: mail.kernel.org; dmarc=pass (p=none dis=none) header.from=xenproject.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.1461.4653 (Exim 4.92) (envelope-from ) id 1kO1OZ-0001qQ-Di; Thu, 01 Oct 2020 16:25:27 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 1461.4653; Thu, 01 Oct 2020 16:25:27 +0000 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kO1OZ-0001qG-85; Thu, 01 Oct 2020 16:25:27 +0000 Received: by outflank-mailman (input) for mailman id 1461; Thu, 01 Oct 2020 16:25:25 +0000 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kO1OX-0001JL-KY for xen-devel@lists.xenproject.org; Thu, 01 Oct 2020 16:25:25 +0000 Received: from chiark.greenend.org.uk (unknown [2001:ba8:1e3::]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id a44ed8a7-3c40-49e2-905e-6951fcd05921; Thu, 01 Oct 2020 16:24:52 +0000 (UTC) Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by chiark.greenend.org.uk (Debian Exim 4.84_2 #1) with esmtp (return-path ijackson@chiark.greenend.org.uk) id 1kO1Ny-00029L-Gk; Thu, 01 Oct 2020 17:24:50 +0100 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1kO1OX-0001JL-KY for xen-devel@lists.xenproject.org; Thu, 01 Oct 2020 16:25:25 +0000 X-Inumbo-ID: a44ed8a7-3c40-49e2-905e-6951fcd05921 Received: from chiark.greenend.org.uk (unknown [2001:ba8:1e3::]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id a44ed8a7-3c40-49e2-905e-6951fcd05921; Thu, 01 Oct 2020 16:24:52 +0000 (UTC) Received: from [172.18.45.5] (helo=zealot.relativity.greenend.org.uk) by chiark.greenend.org.uk (Debian Exim 4.84_2 #1) with esmtp (return-path ijackson@chiark.greenend.org.uk) id 1kO1Ny-00029L-Gk; Thu, 01 Oct 2020 17:24:50 +0100 From: Ian Jackson To: xen-devel@lists.xenproject.org Cc: Ian Jackson Subject: [OSSTEST PATCH 8/8] Tolerate lack of platform-specific hosts in old Xen branches Date: Thu, 1 Oct 2020 17:24:39 +0100 Message-Id: <20201001162439.18160-8-iwj@xenproject.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20201001162439.18160-1-iwj@xenproject.org> References: <20201001162439.18160-1-iwj@xenproject.org> MIME-Version: 1.0 Right now we have a situation where these can't all be made to work because because some older Xen branches are hard to make work on current Debian stable, and we have some hardware (which we have tagged as specific "platforms") which doesn't work with oldstable. This seems like a general problem, so fix it this way. Note that we still treat these failed allocations as failures, so they are subject to regression analysis and ought not to appear willy-nilly on existing branches. Runvar dump shows the addition of this runvar hostalloc_missing_expected=1 to qemu-upstream-4.6-testing xen-4.6-testing ... qemu-upstream-4.14-testing xen-4.14-testing inclusive. Signed-off-by: Ian Jackson --- make-flight | 16 +++++++++++++++- 1 file changed, 15 insertions(+), 1 deletion(-) diff --git a/make-flight b/make-flight index d5a3d99a..fb38bc50 100755 --- a/make-flight +++ b/make-flight @@ -643,13 +643,27 @@ do_pv_debian_tests () { for xsm in $xsms ; do # Basic PV Linux test with xl for platform in '' `getplatforms $xenarch $defsuite` ; do + platform_runvars='' # xsm test is not platform specific if [ x$xsm = xtrue -a x$platform != x ]; then continue fi - do_pv_debian_test_one xl '' xl "$platform" enable_xsm=$xsm + missing_expected=false + if [ x$platform != x ]; then + case "$xenbranch" in + xen-3.*-testing) missing_expected=true ;; + xen-4.*-testing) missing_expected=true ;; + *) ;; + esac + fi + if $missing_expected; then + platform_runvars+=hostalloc_missing_expected=1 + fi + + do_pv_debian_test_one xl '' xl "$platform" enable_xsm=$xsm \ + $platform_runvars done done