From patchwork Wed Nov 22 07:01:20 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Sai.Sathujoda@toshiba-tsip.com X-Patchwork-Id: 13464121 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 07394C072A2 for ; Wed, 22 Nov 2023 07:01:36 +0000 (UTC) Received: from mo-csw.securemx.jp (mo-csw.securemx.jp [210.130.202.158]) by mx.groups.io with SMTP id smtpd.web11.14083.1700636490669955266 for ; Tue, 21 Nov 2023 23:01:31 -0800 Authentication-Results: mx.groups.io; dkim=none (message not signed); spf=pass (domain: toshiba-tsip.com, ip: 210.130.202.158, mailfrom: sai.sathujoda@toshiba-tsip.com) Received: by mo-csw.securemx.jp (mx-mo-csw1122) id 3AM71RC83873515; Wed, 22 Nov 2023 16:01:27 +0900 X-Iguazu-Qid: 2rWgM08Ffz8SXgp1s8 X-Iguazu-QSIG: v=2; s=0; t=1700636487; q=2rWgM08Ffz8SXgp1s8; m=CtRhubI77m1DKRIkT3uwDguFdrMNXNI7AlkPilrDtYU= Received: from imx2-a.toshiba.co.jp (imx2-a.toshiba.co.jp [106.186.93.35]) by relay.securemx.jp (mx-mr1121) id 3AM71PVk3403006 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NOT); Wed, 22 Nov 2023 16:01:26 +0900 From: Sai.Sathujoda@toshiba-tsip.com To: cip-dev@lists.cip-project.org, jan.kiszka@siemens.com Cc: Sai Sathujoda , dinesh.kumar@toshiba-tsip.com, kazuhiro3.hayashi@toshiba.co.jp Subject: [isar-cip-core v1 2/3] scripts/deploy-cip-core.sh: Upload dpkg-status file to aws s3 bucket Date: Wed, 22 Nov 2023 12:31:20 +0530 X-TSB-HOP2: ON Message-Id: <20231122070121.326276-3-Sai.Sathujoda@toshiba-tsip.com> X-Mailer: git-send-email 2.30.2 In-Reply-To: <20231122070121.326276-1-Sai.Sathujoda@toshiba-tsip.com> References: <20231122070121.326276-1-Sai.Sathujoda@toshiba-tsip.com> MIME-Version: 1.0 X-OriginalArrivalTime: 22 Nov 2023 07:01:21.0326 (UTC) FILETIME=[B2DBF4E0:01DA1D11] List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Wed, 22 Nov 2023 07:01:36 -0000 X-Groupsio-URL: https://lists.cip-project.org/g/cip-dev/message/13611 From: Sai Sathujoda For every build job executed in CI, the dpkg-status file shall be uploaded to a respective directory in aws s3 bucket. Signed-off-by: Sai Sathujoda --- scripts/deploy-cip-core.sh | 15 +++++++++++++++ 1 file changed, 15 insertions(+) diff --git a/scripts/deploy-cip-core.sh b/scripts/deploy-cip-core.sh index 5855acb..834ba8e 100755 --- a/scripts/deploy-cip-core.sh +++ b/scripts/deploy-cip-core.sh @@ -15,6 +15,7 @@ TARGET=$2 EXTENSION=$3 DTB=$4 REF=$5 +DPKG_STATUS=$6 BASE_FILENAME=cip-core-image-cip-core-$RELEASE-$TARGET if [ "${EXTENSION}" != "none" ]; then @@ -53,3 +54,17 @@ else aws s3 cp --no-progress --acl public-read build/tmp/deploy/images/*/"$DTB" "${S3_TARGET}" fi fi + +# Deploy the dpkg status file (/var/lib/dpkg/status) to AWS for the CIP CVE checker (cip-core-sec) +# to periodically extract and report pending CVEs. +# * CI builds will override the previous dpkg status file +# * Released images will contain the commit_id in the file name, and will not be automatically overriden +# * they have to be signed and released separately from the CI +# * CVE checks will only scan the latest builds, and the released images +# * AWS S3 bucket structure +# * download.cip-project.org/cip-core/cve-checks/ +# * dpkg-status: folder to store the dpkg status files generated by the CI and released images +# * cve-reports: folder to store the cve-reports generated from the dpkg status files +# * they can be linked from the release website +DPKG_STATUS_FILENAME=${CI_JOB_NAME#build:}.dpkg_status +aws s3 cp --no-progress build/tmp/deploy/images/$TARGET/$DPKG_STATUS s3://download.cip-project.org/cip-core/cve-checks/dpkg-status/$DPKG_STATUS_FILENAME