From patchwork Wed Oct 23 02:53:31 2024 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Lira, Victor M" X-Patchwork-Id: 13846364 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 87B8BD2E008 for ; Wed, 23 Oct 2024 02:54:54 +0000 (UTC) Received: from list by lists.xenproject.org with outflank-mailman.824394.1238529 (Exim 4.92) (envelope-from ) id 1t3RWJ-00059x-0U; Wed, 23 Oct 2024 02:54:47 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 824394.1238529; Wed, 23 Oct 2024 02:54:46 +0000 Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1t3RWI-00059q-Tj; Wed, 23 Oct 2024 02:54:46 +0000 Received: by outflank-mailman (input) for mailman id 824394; Wed, 23 Oct 2024 02:54:46 +0000 Received: from se1-gles-flk1-in.inumbo.com ([94.247.172.50] helo=se1-gles-flk1.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1t3RWI-00051s-Dh for xen-devel@lists.xenproject.org; Wed, 23 Oct 2024 02:54:46 +0000 Received: from NAM02-SN1-obe.outbound.protection.outlook.com (mail-sn1nam02on20609.outbound.protection.outlook.com [2a01:111:f403:2406::609]) by se1-gles-flk1.inumbo.com (Halon) with ESMTPS id 2821ed89-90ea-11ef-99a3-01e77a169b0f; Wed, 23 Oct 2024 04:54:44 +0200 (CEST) Received: from SJ0PR05CA0149.namprd05.prod.outlook.com (2603:10b6:a03:33d::34) by SJ1PR12MB6291.namprd12.prod.outlook.com (2603:10b6:a03:456::22) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8069.28; Wed, 23 Oct 2024 02:54:39 +0000 Received: from MWH0EPF000971E2.namprd02.prod.outlook.com (2603:10b6:a03:33d:cafe::a8) by SJ0PR05CA0149.outlook.office365.com (2603:10b6:a03:33d::34) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8093.14 via Frontend Transport; Wed, 23 Oct 2024 02:54:39 +0000 Received: from SATLEXMB04.amd.com (165.204.84.17) by MWH0EPF000971E2.mail.protection.outlook.com (10.167.243.69) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.20.8093.14 via Frontend Transport; Wed, 23 Oct 2024 02:54:38 +0000 Received: from SATLEXMB06.amd.com (10.181.40.147) by SATLEXMB04.amd.com (10.181.40.145) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.39; Tue, 22 Oct 2024 21:54:21 -0500 Received: from SATLEXMB04.amd.com (10.181.40.145) by SATLEXMB06.amd.com (10.181.40.147) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.39; Tue, 22 Oct 2024 21:53:50 -0500 Received: from xsjwoods50.xilinx.com (10.180.168.240) by SATLEXMB04.amd.com (10.181.40.145) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.39 via Frontend Transport; Tue, 22 Oct 2024 21:53:49 -0500 X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" X-Inumbo-ID: 2821ed89-90ea-11ef-99a3-01e77a169b0f ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=dJ/NCCHXeKE2+3sCKgW7BMYHnug7X7zRUYJ28xCio7FU5VKr+kMFQD6GUZcrgXANjd/it/oA+FZy35B5AG2LIDKBN+7PbzCk9J6Oa3qQPzOfQ4ldJxM8Wr1eHi8dgYgGKK/aP7Guz8Eb13+3jTIEEr3KNg/8ma24MzskWx67OhI9TkhV6NNFOkSXu+WqdboYfM2vOxmPPHzYmeZ5LCKP5sJO03b7Hd7ADpMk6GnUc5v9EtxXSdaE3oYBOpaQH8q7BNAvaQDua6wxPe1qj0XUQfKzLNKSSnMT9BeCF0fm+eU5ypd/V/xeCssg4ZUfTvrB75gqnQe2XOlwjyUIGXq7Yw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=XeVq+a/a2D6KtSOF8g9EkO6PZ2zI7kCe7cjqoeQZhAw=; b=uxdP3BIoXer4jd+B18n7BFcIvyFw9+0E8W+A/m0w1MZyh+m9qKDxfQDTFi0mtQqSs9nyJW8ct7NhKCWp38KoBQmn3T3ezpotjshyvWRw4lt2f/c4RlrFdqniFPLgIkIdmiWM4MUA0bhGq3mXZWpm8DiorsA6euj/OUkZ/s9ReYUhLOJHOjA/5uJhrMkxCAkqjs/pwMUt20RUIEcLrXy33mjQy1AK+vxDbGYT1UJZSovdKfXCvakKpzsjl4ramnLSJwsmuZ2KepGGn75m1UaX/bfW4Odu8w3v4aRWnkBj27hB10WnWqBgdEgfOirQGgIQYr42DnJtIOSloyySJHaCtw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 165.204.84.17) smtp.rcpttodomain=lists.xenproject.org smtp.mailfrom=amd.com; dmarc=pass (p=quarantine sp=quarantine pct=100) action=none header.from=amd.com; dkim=none (message not signed); arc=none (0) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amd.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=XeVq+a/a2D6KtSOF8g9EkO6PZ2zI7kCe7cjqoeQZhAw=; b=PRjjlQqQFgkH98oVpiC2ta0yUxBpCB87b/6mwyu4Nyjdaxo5NCmt2sRASOHIwUFWdK8M5HOCEgc3XGT4nR+jC+Nf6HsSwocZUy+JUtbJ6jATWIGywO9SHNW9uqdPMsUkok8DcR/1CBrdYvQgAI0h6b4GSgarEjA5miWjs8ZjDHA= X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 165.204.84.17) smtp.mailfrom=amd.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=amd.com; Received-SPF: Pass (protection.outlook.com: domain of amd.com designates 165.204.84.17 as permitted sender) receiver=protection.outlook.com; client-ip=165.204.84.17; helo=SATLEXMB04.amd.com; pr=C From: To: CC: Victor Lira , Andrew Cooper , =?utf-8?q?Marek_Marczykowski-G?= =?utf-8?q?=C3=B3recki?= , Doug Goldstein , Stefano Stabellini Subject: [RFC TEST_ARTIFACTS PATCH 0/2] artifacts: Initial commit Date: Tue, 22 Oct 2024 19:53:31 -0700 Message-ID: X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: MWH0EPF000971E2:EE_|SJ1PR12MB6291:EE_ X-MS-Office365-Filtering-Correlation-Id: 07af8cec-8283-4fa9-a96b-08dcf30e0957 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|36860700013|376014|82310400026|1800799024; X-Microsoft-Antispam-Message-Info: 8nfgaR+j8ZXyieTjLaOi2jX9GnxetLJKydlhI/riOJwx5ah8PlZ369gqyFOLzTscyemSgaRvlbUceowUzWVBnLo6zSTqH36eecYBjjASGY6iLQtO1vKlS3gQL1Y2qXFhIrQEjw3PY69z6cNmKj18NomM4AK8knBlfNrxQ45zLEhtNMjHRd9r8AEgSLZsk3EviccEJVABTwo7YGxBdTGA7kl+/gE/DZlVvwEfacd+MF6An6VIcUFNmqR5nAqTPzFRjEMBXVNfICVrFUG3mh48YGhzJ0Y8P5woszpr1vAJ7QuKom1G/mAQD6SA8T21E0QOhrA8xMd0axuTofUu7Y6syFPH939JKLpNqPZ5jaakL7ebtAqqjVst34zV0MTwtJANcjJEvJUCsTaLq2qG/BbJJeOInkV+M4UcZ1Aj00OOoDC0YuENcQau1lzlwXZD/fVYr3JxMCTr6qetuxfkOBQ1SaYcHb5+3S4ZJckYOlaRy6SMqu42+JWck8zuOSW/YUvI97+ERYwWP2DPlJHHmUeKrysa/yXBhlLaBLvUmEQk5cp+gH1e4XokutgrFh+qxHidiQTShJrSmVDWvSeIqAq6CzhsKG/cmOPCQT5ksxGrnsyrbt6NdnmerKqpq06tBUae2Sbtq5i6NAKkZ/YMIORnBrXC47LeCNcGmdyO209Bk/PDdr7EFunxyIXGSGwc1yqEn7Ry/+IlI/UOVf8enDhYKuU4H0XAvqZKxwmhy+56li6zQnsE/wL0b9mD+IJ9VZWHd/t4nW9Eqwwv3L7CtU7uJdX16UQnmh/h6PAWloav4uR+ouBeVX+juX9nBN/zvG3RY4fyNKMrOzSzqrfAQN3oX6kXCBNbSlbRRXrykWFv6ziJMnaIJTlJ/4kimBs5yaxzHtTMgqQFs5VvFpf5evhv+ThXotxnCLrXP3kLLU2D5h2NTxTn0mG+cV4Zujs2mLKhu2s8ku6zhyVw2oqxvUW038UXSzdxgBvbRcsJcnW00QsBHDjHrtTADv0dXJRRXLiJZYWUPWSM4nCZOXDpZZu12oKJ7baf+PHTUZ4Fje3oN4sEv9MWdnFq6vJ50cAJK2ydFNBvRGZZsVqPSl0Ct861MYNFR/MecaG7I2mYjzLkC5PY5xeuN+SxVFRtQhjo6Mj2pGcptaHw3G4FXIeUFzqsw8frmiu8DOYd8P09M1j/T2TpakeHbr+keY7LDzyi0IhB2/3XMOgsu1gW9xdT2Gg36KTbwlR0qxRgXxxsmcSe/na/WToCXz7iHZeC2ZXurwIQibTcx/vTGstFbdQmaeexuJsehnjpnLaNCBUGlPy43JJn018PV8Vois4pQhl3DenahEL6TKUuH18rutIWM1YJ3aZvLqU2TgfmY4HZdahrLDvZYOcUIYVHv4Q5z6whguGCVjRe643Ag/3HqiVmuBv+hRKmWQt54sOVb0CzwgOWZ64= X-Forefront-Antispam-Report: CIP:165.204.84.17;CTRY:US;LANG:en;SCL:1;SRV:;IPV:CAL;SFV:NSPM;H:SATLEXMB04.amd.com;PTR:InfoDomainNonexistent;CAT:NONE;SFS:(13230040)(36860700013)(376014)(82310400026)(1800799024);DIR:OUT;SFP:1101; X-OriginatorOrg: amd.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 23 Oct 2024 02:54:38.9880 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 07af8cec-8283-4fa9-a96b-08dcf30e0957 X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=3dd8961f-e488-4e60-8e11-a82d994e183d;Ip=[165.204.84.17];Helo=[SATLEXMB04.amd.com] X-MS-Exchange-CrossTenant-AuthSource: MWH0EPF000971E2.namprd02.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: SJ1PR12MB6291 From: Victor Lira This patch series is a proof of concept that a separate repository can be used to generate kernel, rootfs, and other commonly used binary artifacts, and have Xen test jobs load these instead of generating them every run. The current configuration of Xen CI generates these using "dummy" jobs in every pipeline. This unecessarily uses a large amount of storage and network traffic because artifacts are duplicated overprojects/branches. Instead, use GitLab CI built-in functionality to retrieve them from a separate repository using the "needs" keyword. The "needs:project" feature is currently limited to 5 artifacts archives from external pipelines per job, but web requests can be used if more are needed. It's preferable to use this as opposed to just web requests since this doesn't requre modying the any test scripts as long as the archive has the same directory structure. The example of a test artifacts repository: https://gitlab.com/xen-project/people/victormlira/test-artifacts/-/pipelines/1508031895 The example of the use: https://gitlab.com/xen-project/people/sstabellini/xen/-/pipelines/1508069266 Stefano Stabellini (1): Initial commit --- 2.25.1