From patchwork Thu Jul 21 15:44:51 2016 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Wei Liu X-Patchwork-Id: 9241871 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork.web.codeaurora.org (Postfix) with ESMTP id 2775C607D3 for ; Thu, 21 Jul 2016 15:47:53 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 198CA1FE7B for ; Thu, 21 Jul 2016 15:47:53 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id 0E5C127EED; Thu, 21 Jul 2016 15:47:53 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-4.2 required=2.0 tests=BAYES_00, RCVD_IN_DNSWL_MED autolearn=ham version=3.3.1 Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.wl.linuxfoundation.org (Postfix) with ESMTPS id B67121FE7B for ; Thu, 21 Jul 2016 15:47:52 +0000 (UTC) Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.84_2) (envelope-from ) id 1bQG9k-0004OC-1w; Thu, 21 Jul 2016 15:45:00 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xenproject.org with esmtp (Exim 4.84_2) (envelope-from ) id 1bQG9i-0004NV-IS for xen-devel@lists.xenproject.org; Thu, 21 Jul 2016 15:44:58 +0000 Received: from [85.158.139.211] by server-14.bemta-5.messagelabs.com id B7/36-10347-9FDE0975; Thu, 21 Jul 2016 15:44:57 +0000 X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFupnkeJIrShJLcpLzFFi42JxWrohUvfn2wn hBi8nSFt83zKZyYHR4/CHKywBjFGsmXlJ+RUJrBkvZ01nLjjKUbFz0WzmBsYeti5GTg4JAX+J PVuvMIPYbALKEj87e8HiIgJ6Ek0HnjOC2MwCGRITpz8FqxEWcJD4P38NexcjBweLgKrEr0OKI GFeASeJpQ9vsUKMlJM4f/wnWDmngLPEmvOPmUDKhYBqruzOBgkLCShIdEw/xgTRKihxcuYTFo hNEhIHX7xghhjDLXH79FTmCYx8s5CUzUJStoCRaRWjRnFqUVlqka6hkV5SUWZ6RkluYmaOrqG BqV5uanFxYnpqTmJSsV5yfu4mRmBAMQDBDsa+Wc6HGCU5mJREed9OnhAuxJeUn1KZkVicEV9U mpNafIhRhoNDSYJXChigQoJFqempFWmZOcDQhklLcPAoifC+egOU5i0uSMwtzkyHSJ1iVJQS5 30KkhAASWSU5sG1weLpEqOslDAvI9AhQjwFqUW5mSWo8q8YxTkYlYR52UC282TmlcBNfwW0mA lo8RyBfpDFJYkIKakGxmkHZxQaMb+sny8ZGF092axCrErzs5Hbm38sVt/MWCQPu3yxuGrj++O 2ul/kTMv9ms7bpIOtVjWzuM/svbYnnDssQ3mPzKNL2usuN0YtXrJOlami9WU805EtIZuOqIWf mRXn+jkl814Z+xI/Dp0t1xfFLZ2W4nS3/PPkOavFS364uck2NdpIKrEUZyQaajEXFScCAEeYr ayiAgAA X-Env-Sender: prvs=0034167b4=wei.liu2@citrix.com X-Msg-Ref: server-16.tower-206.messagelabs.com!1469115895!34853170!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n, received_headers: No Received headers X-StarScan-Received: X-StarScan-Version: 8.77; banners=-,-,- X-VirusChecked: Checked Received: (qmail 34071 invoked from network); 21 Jul 2016 15:44:57 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-16.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 21 Jul 2016 15:44:57 -0000 X-IronPort-AV: E=Sophos;i="5.28,399,1464652800"; d="scan'208";a="367591109" From: Wei Liu To: Xen-devel Date: Thu, 21 Jul 2016 16:44:51 +0100 Message-ID: <1469115891-2269-4-git-send-email-wei.liu2@citrix.com> X-Mailer: git-send-email 2.1.4 In-Reply-To: <1469115891-2269-1-git-send-email-wei.liu2@citrix.com> References: <1469115891-2269-1-git-send-email-wei.liu2@citrix.com> MIME-Version: 1.0 X-DLP: MIA2 Cc: Wei Liu , Ian Jackson , andrew.cooper3@citrix.com Subject: [Xen-devel] [PATCH XTF 3/3] xtf-runner: regularise runner exit code X-BeenThere: xen-devel@lists.xen.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xen.org Sender: "Xen-devel" X-Virus-Scanned: ClamAV using ClamSMTP Report the first "ERROR" and "FAILURE" if found, otherwise report "SKIP" if found. Eventually if everything is ok the exit code will be 0. See runner code for numeric exit code space. Signed-off-by: Wei Liu --- xtf-runner | 12 +++++++++--- 1 file changed, 9 insertions(+), 3 deletions(-) diff --git a/xtf-runner b/xtf-runner index 17ce933..ebe5c27 100755 --- a/xtf-runner +++ b/xtf-runner @@ -249,17 +249,23 @@ def run_tests(args): if not len(tests): raise RunnerError("No tests to run") - rc = 0 + rc = exit_code('SUCCESS') results = [] for test in tests: res = run_test(test) - if res != "SUCCESS": - rc = 1 + if res in ("ERROR", "FAILURE") and rc == exit_code('SUCCESS'): + rc = exit_code(res) results.append(res) + if rc == exit_code('SUCCESS'): + for res in results: + if res == 'SKIP': + rc = exit_code('SKIP') + break + print "\nCombined test results:" for test, res in zip(tests, results):