[OSSTEST,00/82] Reuse test hosts

Message ID	20201007180024.7932-1-iwj@xenproject.org (mailing list archive)
Headers	show Return-Path: <SRS0=B7KG=DO=lists.xenproject.org=xen-devel-bounces@kernel.org> DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org C715B2173E Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" <xen-devel-bounces@lists.xenproject.org> From: Ian Jackson <iwj@xenproject.org> To: xen-devel@lists.xenproject.org Cc: Ian Jackson <iwj@xenproject.org> Subject: [OSSTEST PATCH 00/82] Reuse test hosts Date: Wed, 7 Oct 2020 18:59:02 +0100 Message-Id: <20201007180024.7932-1-iwj@xenproject.org> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit
Series	Reuse test hosts \| expand [OSSTEST,00/82] Reuse test hosts [OSSTEST,01/82] ms-queuedaemon: Update for newer Tcl's socket channel ids [OSSTEST,02/82] Executive.pm planner: fix typo [OSSTEST,03/82] README.planner: Document magic job hostflags [OSSTEST,04/82] sg-run-job: Minor whitespace (formatting) changes [OSSTEST,05/82] sg-run-job: Improve some internal API docs [OSSTEST,06/82] show_abs_time: Represent undef $timet as <undef> [OSSTEST,07/82] ts-hosts-allocate-Executive: Add a comment about a warning [OSSTEST,08/82] host reuse: ms-planner: Bring some variables forward [OSSTEST,09/82] host reuse: ms-planner: Do not show reuse as shared in the plan [OSSTEST,10/82] hsot reuse: ms-planner: Abbreviate reporting of test shares [OSSTEST,11/82] cr-publish-flight-logs: Fix abs_time calls [OSSTEST,12/82] target setup refactoring: Move target_kernkind_check [OSSTEST,13/82] target setup refactoring: Move target_kernkind_console_inittab [OSSTEST,14/82] target setup refactoring: Merge target_kernkind_* [OSSTEST,15/82] target setup refactoring: Add a doc comment [OSSTEST,16/82] abolish "kernkind"; desupport non-pvops kernels [OSSTEST,17/82] Debian: osstest-erase-other-disks: Slightly guard against races [OSSTEST,18/82] host allocation: Remove some unnecessary definedness tests [OSSTEST,19/82] host allocation: Executive: Honour $xparams{InfraPriority} [OSSTEST,20/82] ts-hosts-allocate-Executive: Fix handling of failed preps for same sharing [OSSTEST,21/82] sg-run-job: support +! for only adding things to TESTID [OSSTEST,22/82] sg-run-job: Use +! in per-host-ts implementation [OSSTEST,23/82] db_retry: Make the sleeps random and increasing [OSSTEST,24/82] host allocation: _shared_mark_ready: Allow other states [OSSTEST,25/82] host allocation: _shared_mark_ready: Make $sharetype check optional [OSSTEST,26/82] host allocation: selecthost: allow sort-of-selection of prospective hosts [OSSTEST,27/82] host allocation: _shared_mark_ready: allow alternative $oldtypes [OSSTEST,28/82] host allocation: Support new reuse- magic hostflag [OSSTEST,29/82] host allocation: *_shared_mark_ready: Only prod when $newstate is ready [OSSTEST,30/82] plan_search: Break out $share_compat_ok [OSSTEST,31/82] plan_search: Improve debugging of $share_compat_ok->() [OSSTEST,32/82] plan_search: Use plan's Wear information rather than tracking it ourselves [OSSTEST,33/82] plan search: Move $share_compat_ok further up the file [OSSTEST,34/82] plan_search: Track last sharing state to determine $share_reuse [OSSTEST,35/82] resource reporting: Print username when listing "rogue tasks" [OSSTEST,36/82] resource reporting, nfc: Break out report_rogue_task_description [OSSTEST,37/82] ts-hosts-allocate-Executive: Better message for hosts abandoned mid-test [OSSTEST,38/82] ts-host-reuse: New script, to do reuse state changes [OSSTEST,39/82] ts-host-reuse: tolerate unremoveable lv [OSSTEST,40/82] ts-host-reuse: Do not depend on bios [OSSTEST,41/82] ts-host-reuse: Add some missing runvars to the host sharing control [OSSTEST,42/82] host allocation: selecthost(): Support @IDENT for reuse [OSSTEST,43/82] ts-hosts-allocate-Executive print sharing info in debug output [OSSTEST,44/82] sg-run-job: New @ iffail tag for prep tasks [OSSTEST,45/82] sg-run-job: Detect improper use of @ iffail with run-ts [OSSTEST,46/82] shared/reuse: Use @ for ts-xen-build-prep [OSSTEST,47/82] shared/reuse: Use @ for ts-host-install [OSSTEST,48/82] shared/reuse: Use @ for freebsd host prep [OSSTEST,49/82] host reuse: sg-run-job: per-host prep: Use @ for per-host-ts [OSSTEST,50/82] shared/reuse: Rely on @ for ts-host-ping-check [OSSTEST,51/82] host reuse: Reuse test hosts within a flight [OSSTEST,52/82] host allocation: Group jobs by their reuse parameters [OSSTEST,53/82] host reuse: Jiggle the infra-priority a bit, within a flight [OSSTEST,54/82] host reuse: Use literal for the hosts_infraprioritygroup runvar [OSSTEST,55/82] host reuse: Bump host share reuse bonus [OSSTEST,56/82] subst_netboot_template: Do not use all of %r [OSSTEST,57/82] TestSupport: Provide runvar_is_synth [OSSTEST,58/82] runvar access: Introduce access control machinery [OSSTEST,59/82] runvar access: Provide runvar_glob [OSSTEST,60/82] runvar access: Use runvar_glob for dmrestrict runvar search [OSSTEST,61/82] runvar access: Introduce sharing_for_build [OSSTEST,62/82] runvar access: Introduce effects_gone_before_share_reuse [OSSTEST,63/82] test host reuse: Switch to principled sharing scope runvar scheme [OSSTEST,64/82] hsot reuse: Hash the share type [OSSTEST,65/82] hsot reuse: Make share type hash more easily greppable [OSSTEST,66/82] host lifecycle: Machinery, db, for tracking relevant events [OSSTEST,67/82] host lifecycle: Fix detection of concurrent jobs [OSSTEST,68/82] host lifecycle: Prevent referential integrity violation [OSSTEST,69/82] host lifecycle: Record lifecycle in db and runvar [OSSTEST,70/82] sg-report-flight: Refactor runvar access [OSSTEST,71/82] resource reporting, nfc: split a here document [OSSTEST,72/82] resource reporting: Report host reuse/sharing in job report [OSSTEST,73/82] host reuse: sg-run-job: Reanme post-test-ok parameter [OSSTEST,74/82] host reuse: ts-host-reuse: Prepare for argument handling [OSSTEST,75/82] host reuse: New protocol between sg-run-job and ts-host-reuse [OSSTEST,76/82] sg-report-flight: Reformat slightly [OSSTEST,77/82] sg-report-flight: Improvements to other job (share/reuse) reporting [OSSTEST,78/82] flight other job reporting: Put nulls last in the report [OSSTEST,79/82] flight other job reporting: Further improvements to ordering [OSSTEST,80/82] tsreadconfig: Change misleading "setting" message [OSSTEST,81/82] sg-report-flight: Sharing reports: more task finished info [OSSTEST,82/82] sg-report-flight: Word-wrapping improvements to job and step names

Message ID

20201007180024.7932-1-iwj@xenproject.org (mailing list archive)

Headers

DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org C715B2173E
Errors-To: xen-devel-bounces@lists.xenproject.org
Precedence: list
Sender: "Xen-devel" <xen-devel-bounces@lists.xenproject.org>
From: Ian Jackson <iwj@xenproject.org>
To: xen-devel@lists.xenproject.org
Cc: Ian Jackson <iwj@xenproject.org>
Subject: [OSSTEST PATCH 00/82] Reuse test hosts
Date: Wed,  7 Oct 2020 18:59:02 +0100
Message-Id: <20201007180024.7932-1-iwj@xenproject.org>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit

Series

Reuse test hosts | expand

Message

Ian Jackson Oct. 7, 2020, 5:59 p.m. UTC

This series arranges to save on host setup by reusing a test host, if
the previous test passed.  Care is taken to make sure that a host is
only reused in this way if the new test would have set it up
identically.

I have had this branch in preparation since November 2017...

Comments

Ian Jackson Oct. 7, 2020, 6:22 p.m. UTC | #1

Ian Jackson writes ("[OSSTEST PATCH 00/82] Reuse test hosts"):
> This series arranges to save on host setup by reusing a test host, if
> the previous test passed.  Care is taken to make sure that a host is
> only reused in this way if the new test would have set it up
> identically.
> 
> I have had this branch in preparation since November 2017...

Many of the earlier commits in this series had my Citrix address as
the author.  My setup was not configured to deliver these mails
correctly (ie, via the Citrix mail servers), so those messages will
generally have been blocked as spam.  Additionally, even the mails
which were From: iwj@xenproject were delivered via my colo mail server
which is not really right.  So some of those might also get blocked.

I don't propose to resend the mailbomb.  You can find the complete
series here:
  https://xenbits.xen.org/gitweb/?p=people/iwj/osstest.git;a=shortlog;h=refs/heads/test-host-reuse-v1
  https://xenbits.xen.org/git-http/people/iwj/osstest.git#test-host-reuse-v1

It's in osstest pretest now.

Ian.