From patchwork Mon Mar 10 18:32:05 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Chuck Lever X-Patchwork-Id: 14010500 Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 719852AD16 for ; Mon, 10 Mar 2025 18:32:11 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1741631531; cv=none; b=W2PVKx/ZJOVNy65O0qmfZ0cKljGG+tiWPqdUd+144I8F8UAoFYeCXK2cBvO9E31drtfzIP285/sw2hRfKocV+vTBxpjd28K//GqenMTUUjtxHMejrP63eUfPc+NKmhJl8o9G59UJfh25jXbNGgHVXdgWTE9Gw/YIZ6OIcKQJ0Bg= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1741631531; c=relaxed/simple; bh=gqfS+grO/rGCBh5M2Pic+sWGeqxXnifQEX08yZbhbnc=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version; b=gL6xxnipk7muoFHMBohRnPQsQ5FUPVzkMGnLov1UKyt0gIE3ak1guPWweis57Zx5yjanD/Z28J5bHtzUD+zXHZSYjAjxvuTEqfyFRgssVPbiYEAhFrxQw0s/CAa9FrMluQ5WFbuKltqfhMKZV3DJiuZ05HdV59/5L/Loqfvt7Q8= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=CKrSHbAM; arc=none smtp.client-ip=10.30.226.201 Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="CKrSHbAM" Received: by smtp.kernel.org (Postfix) with ESMTPSA id 9D32EC4CEEC; Mon, 10 Mar 2025 18:32:10 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1741631530; bh=gqfS+grO/rGCBh5M2Pic+sWGeqxXnifQEX08yZbhbnc=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=CKrSHbAMLJ1Az+JNOpBrLjirNJ47pGYsITi8MMs8Cak4MWMWQu4wnb9wEqNS6hfXt /IC8ucPmlDrL8T6Uil5AjvTw9TXuu6M7gIhVcGFKbQE9KAiFSdD0Kr4znWFbk5q2s0 TduEmLmAUBnz/UtTvJ0i4TskviBNxbd61E9AKaY3Wr0H6gi+Soyp62AaEdVvfkFY0L hOpcnnCbOfOSJMEcWfuRXOu6rpcZ35sMELA6XSgzG+g5KjWB4CDEqnrMvgy/aGLnm4 gMtyTwIk5u8zbmmYA65fnTbP/SL8IUtSWtwuTQUGVmXxzOmYtX7gvToUbqy6ypQ6qC h/hLe0N3bgibQ== From: cel@kernel.org To: Cc: Chuck Lever Subject: [PATCH v1 1/4] linux-mirror: Fix installation on Fedora systems Date: Mon, 10 Mar 2025 14:32:05 -0400 Message-ID: <20250310183208.999430-2-cel@kernel.org> X-Mailer: git-send-email 2.48.1 In-Reply-To: <20250310183208.999430-1-cel@kernel.org> References: <20250310183208.999430-1-cel@kernel.org> Precedence: bulk X-Mailing-List: kdevops@lists.linux.dev List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 From: Chuck Lever I noticed that git-daemon was not installed when I set up the git mirror on my Fedora 40 control host. If "include_tasks:" has a tag, the included tasks also need to have a "tags:" attribute or they will not be run. Also, because my lab is already behind a firewall gateway, there happens to be no firewall running on my controller, so the "enable the git port" step fails with: firewall is not currently running, unable to perform immediate actions without a running firewall daemon Signed-off-by: Chuck Lever --- .../roles/linux-mirror/tasks/install-deps/fedora/main.yml | 8 ++++++++ 1 file changed, 8 insertions(+) diff --git a/playbooks/roles/linux-mirror/tasks/install-deps/fedora/main.yml b/playbooks/roles/linux-mirror/tasks/install-deps/fedora/main.yml index 2a93256a3d6e..01e98895cabe 100644 --- a/playbooks/roles/linux-mirror/tasks/install-deps/fedora/main.yml +++ b/playbooks/roles/linux-mirror/tasks/install-deps/fedora/main.yml @@ -9,6 +9,11 @@ state: present when: - install_linux_mirror|bool + tags: [ 'mirror' ] + +- name: Gather service facts + ansible.builtin.service_facts: + tags: [ 'mirror' ] - name: Open the firewall on control node for git traffic become: true @@ -22,3 +27,6 @@ state: enabled when: - install_linux_mirror|bool + - '"firewalld.service" in ansible_facts.services' + - ansible_facts.services['firewalld.service'].state == "enabled" + tags: [ 'mirror' ] From patchwork Mon Mar 10 18:32:06 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Chuck Lever X-Patchwork-Id: 14010501 Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 8C4251C3F34 for ; Mon, 10 Mar 2025 18:32:11 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1741631531; cv=none; b=L4pqPPuGq8gkKJTDJJYn2kzUrK7GtO+uKEIVu8F7x0BlVWSTMVdj40FHjjNZMG4GUP+qwALKz27x2XCxW8o4ideFJKKIxQBJ3KLknqz1xxt6W+tauQewBtV58BQPJagI9ZXU/PXxKazi7SbtJ45HvnK3gR+Dxmx2QnD6J9Di9Mg= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1741631531; c=relaxed/simple; bh=E73uhiflIFBBqRhLfUNsciNNCRNKjWBMCMCr68XUpH8=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version; b=bXZ9O8rkTKzFwlkhhDEWjL/6FZxQwQ3FS4x6Lg8O3DPFJcoPtn1Qz1iulb9zcqeYvT05Auch/k+OKDr4562altkuuJy71YjAc2PdRsYhOc3CpLUz7hWZ/1JieWgeu6Y/3mBrnirb+PoDj75Lh5kablgbU/Ytt91CGAlN98RwCfs= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=iU7bGn9t; arc=none smtp.client-ip=10.30.226.201 Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="iU7bGn9t" Received: by smtp.kernel.org (Postfix) with ESMTPSA id 26348C4CEE5; Mon, 10 Mar 2025 18:32:11 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1741631531; bh=E73uhiflIFBBqRhLfUNsciNNCRNKjWBMCMCr68XUpH8=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=iU7bGn9tyaordXMKfP/1BYDKma19GOMYxvvKhgRb1q60zrJMMBMiShQpGWFgMnAjM wDstn1HNG7si1jR9Y2SDYIzIrOrtosVancU7texcIrp0yjSu7MQlSdgkE+IaWElYaN alP1Asvu2xX7WA4PoRWd+vr03NMxRtInzpP9o4Y0nVuSQ6EmjxpM0gCitm4CECEdM3 pr90HGVUGwUkfbFCtyA0bz9rugKHlrqRx+0wdtvQs/sS+f+ZVI+Ov+VnAObrZR/zPc H6W+mvcNl5ZhQjbgjMKbEfjIaLDMok1cQrT4y3Z7WVVHKp3LYBB8mkF/q5vsipyyUY TDCXl50XWrjFw== From: cel@kernel.org To: Cc: Chuck Lever Subject: [PATCH v1 2/4] linux-mirror: Ensure git-daemon runs as the Ansible user Date: Mon, 10 Mar 2025 14:32:06 -0400 Message-ID: <20250310183208.999430-3-cel@kernel.org> X-Mailer: git-send-email 2.48.1 In-Reply-To: <20250310183208.999430-1-cel@kernel.org> References: <20250310183208.999430-1-cel@kernel.org> Precedence: bulk X-Mailing-List: kdevops@lists.linux.dev List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 From: Chuck Lever In my initial installation, git-daemon emits the "safe.directory" warning and exits; remote attempts to access the repos there fail. git-daemon needs to run as the same user that owns the repos to avoid this warning. linux-mirror doesn't currently have a consistent "user" for this: the instructions say "create a /mirror directory" but then later tasks in linux-mirror try to create /mirror owned by root. This patch doesn't address that larger problem, but it simply adds a setting under the daemon's [Service] stanza to make it run as the user that is setting up the mirror. Signed-off-by: Chuck Lever --- playbooks/roles/linux-mirror/templates/git-daemon@.service.j2 | 1 + 1 file changed, 1 insertion(+) diff --git a/playbooks/roles/linux-mirror/templates/git-daemon@.service.j2 b/playbooks/roles/linux-mirror/templates/git-daemon@.service.j2 index a8bf669608bc..06c08d989545 100644 --- a/playbooks/roles/linux-mirror/templates/git-daemon@.service.j2 +++ b/playbooks/roles/linux-mirror/templates/git-daemon@.service.j2 @@ -7,3 +7,4 @@ ExecStart=-/usr/bin/git daemon --verbose --init-timeout=10 --timeout=5 --inetd - StandardInput=socket StandardOutput=inherit StandardError=journal +User={{ ansible_user_id }} From patchwork Mon Mar 10 18:32:07 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Chuck Lever X-Patchwork-Id: 14010502 Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 71E371C3F34 for ; Mon, 10 Mar 2025 18:32:12 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1741631532; cv=none; b=THIp/eFNfFGnAK+yfhcW8osdZGf5AEPBEuEQ3d6My4awAl9SiUMGFCL8mnOJSEk+6T/n2euLTb8NS9csaHy/+AdN9JhuN4VgZrMfD50xDBlIqodbi6u8z0c/hxUlkTkP9EnM7F2wCe98zMunKgXH1q5RQEQkc6ThXsOapqMwyJM= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1741631532; c=relaxed/simple; bh=odeQgZaTos4PMrNTVAwMFOFrCNMvkahe06ficnAOY5k=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version; b=ZdN7CPR9zz6KR+OXK0tReiiCFABEz9DBoU9/BJAutae/W8zSaEdV4TzjbwyjDEWyMGpCMV9aYYZY3o9Kw8MLU/FH0QU/aCLxXOa9G7LO64pAifFKJsx1Kf0T3bV5/EWFbD+p+8GBp/xyhbK+eDzHtSUHpDGuIZWE77MAhF9XZg0= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=JLDUDT4e; arc=none smtp.client-ip=10.30.226.201 Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="JLDUDT4e" Received: by smtp.kernel.org (Postfix) with ESMTPSA id A41B0C4CEF0; Mon, 10 Mar 2025 18:32:11 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1741631531; bh=odeQgZaTos4PMrNTVAwMFOFrCNMvkahe06ficnAOY5k=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=JLDUDT4e2TjYuZtsCKnTyydxAAKM9bRwpRustWz3yjs3Ea8JyNcobunjaH7s3KmbH EWTpFpqU2cbAg5voLcXuqcuXexsEWZWYRUS3oE/UB6B2mWZimzg0HIOFTSZSj5KEsD vUmJjTX58fqk6E520/dq66zVZ6edF9to8yrZPQIXpyPD0GPRLkW17xfEvEKYDhZ5qS GVFrSWmN/HgQucYElW2OMqdIbjMWKn85ZHQy1oOLE8VEuGhBZ1XlwD0iYqO6mR5msx 5knHLgS02J4WtNahEZp/HU4nYDrqX5r/VV8y4apiV6mzDccioxaJ5w432gJefZ4dvL ptu24DOMFao5w== From: cel@kernel.org To: Cc: Chuck Lever Subject: [PATCH v1 3/4] mirror: Reduce frequency of retrieving results archive Date: Mon, 10 Mar 2025 14:32:07 -0400 Message-ID: <20250310183208.999430-4-cel@kernel.org> X-Mailer: git-send-email 2.48.1 In-Reply-To: <20250310183208.999430-1-cel@kernel.org> References: <20250310183208.999430-1-cel@kernel.org> Precedence: bulk X-Mailing-List: kdevops@lists.linux.dev List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 From: Chuck Lever Each run takes longer than 10 seconds, which generates a "git process is still running" warning in the system journal every minute. Signed-off-by: Chuck Lever --- playbooks/roles/linux-mirror/templates/mirrors.yaml.j2 | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/playbooks/roles/linux-mirror/templates/mirrors.yaml.j2 b/playbooks/roles/linux-mirror/templates/mirrors.yaml.j2 index dabbadcc6528..45e79349a3d4 100644 --- a/playbooks/roles/linux-mirror/templates/mirrors.yaml.j2 +++ b/playbooks/roles/linux-mirror/templates/mirrors.yaml.j2 @@ -36,7 +36,7 @@ mirrors: - short_name: "kdevops-results-archive" url: "{{ defaults_kdevops_results_archive_git }}" target: "kdevops-results-archive.git" - refresh: "10s" + refresh: "10m" - short_name: "kdevops/fstests" url: "{{ mirror_kdevops_fstests_url }}" target: "kdevops/fstests.git" From patchwork Mon Mar 10 18:32:08 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Chuck Lever X-Patchwork-Id: 14010503 Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id F25241C3F34 for ; Mon, 10 Mar 2025 18:32:12 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1741631533; cv=none; b=b7OwLbjjY5X/jERHeUjMoMLARpu2OV4Q+P2aC+5aiqD0gpi/RJR4ocPsTykU0W86mCXw/QTZ7W9iLm6QxUJ0J9Tk66j+q2JwNQtKTUoE1k+F+ZVQwRnTLq5XV+GOmz22Zbfhj0/I8Ju73SzRBTTy0YH/ePRyFA+jp88WfeQSLII= ARC-Message-Signature: i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1741631533; c=relaxed/simple; bh=FtFm0YpvLpQkD0sEIomM2dvH/R0RDBQ2v+FE9nUfBEc=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version; b=uitAg3wtb//WL9+7UrQV0VPVUMbi6iHIKlA2LwKc36UfQGUZ46C3AvUythNtjCTkBMte/M+QnqEYx3RKo0r5AWK9021hkCzEtm47Jht76suUaXNBgZoKMx0ilvHxgK0jaqyX44p7eEk0eJ+PW4bfHIBH8LAW/c+rU9n5O20QXI8= ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=qkLtjaju; arc=none smtp.client-ip=10.30.226.201 Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="qkLtjaju" Received: by smtp.kernel.org (Postfix) with ESMTPSA id 30FDDC4CEE5; Mon, 10 Mar 2025 18:32:12 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1741631532; bh=FtFm0YpvLpQkD0sEIomM2dvH/R0RDBQ2v+FE9nUfBEc=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=qkLtjajuCq/iW5PadM0Y5q+SUG07L+JOsGk+XotKPTcTGvGs6kkzkcpYTMgjt8p0X zc8eYN5AX+Ps5+Z30Kgfov/HSUXoRrccqQQic3qFtLYxCIvCxunFEFAdrk/W7rf9k3 anQowqMZqQ8AE1xPizZ6hw+yTqYgBkku7RjQNOC+G7t4su53qTboOC6dCjzZsTgULS yyRZTqjFQgqZgL01Yb1s+DKX5ut/8gbLZ1KWjHb1LfW8nJsRkk0TpDYAgW7g+WgoQZ 54Hy7coVP8k4qChvLJqNQZt03dmT88cgzpxFkcWB2AEfc/QpoOAMSXK5rpvr8iYpVC q2hej3N4W76LQ== From: cel@kernel.org To: Cc: Chuck Lever Subject: [PATCH v1 4/4] linux-mirror: Add a mirror for linux-stable-rc Date: Mon, 10 Mar 2025 14:32:08 -0400 Message-ID: <20250310183208.999430-5-cel@kernel.org> X-Mailer: git-send-email 2.48.1 In-Reply-To: <20250310183208.999430-1-cel@kernel.org> References: <20250310183208.999430-1-cel@kernel.org> Precedence: bulk X-Mailing-List: kdevops@lists.linux.dev List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 From: Chuck Lever I test the LTS queue/ branches nightly. Signed-off-by: Chuck Lever --- playbooks/roles/linux-mirror/defaults/main.yml | 5 +++-- playbooks/roles/linux-mirror/templates/mirrors.yaml.j2 | 6 ++++++ 2 files changed, 9 insertions(+), 2 deletions(-) diff --git a/playbooks/roles/linux-mirror/defaults/main.yml b/playbooks/roles/linux-mirror/defaults/main.yml index c95342591090..c193932931b6 100644 --- a/playbooks/roles/linux-mirror/defaults/main.yml +++ b/playbooks/roles/linux-mirror/defaults/main.yml @@ -14,12 +14,13 @@ defaults_nfstest_git: "git://git.linux-nfs.org/projects/mora/nfstest.git" defaults_xfsprogs_git: "https://git.kernel.org/pub/scm/fs/xfs/xfsprogs-dev.git" defaults_xfsdump_git: "https://github.com/linux-kdevops/xfsdump-dev.git" -# These are mirrors which have variability support, the above should be coverted +# These are mirrors which have variability support. The above should be converted # to these types so to support alternatives for sources and also the ability to -# not use git and instead https incase of firewall restrictions in some +# not use git and instead https in case of firewall restrictions in some # environments. mirror_kdevops_url: "https://github.com/linux-kdevops/kdevops.git" mirror_stable_url: "https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git" +mirror_stable_rc_url: "https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable-rc.git" mirror_torvalds_url: "git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git" install_only_git_daemon: false diff --git a/playbooks/roles/linux-mirror/templates/mirrors.yaml.j2 b/playbooks/roles/linux-mirror/templates/mirrors.yaml.j2 index 45e79349a3d4..79bbbc6595ba 100644 --- a/playbooks/roles/linux-mirror/templates/mirrors.yaml.j2 +++ b/playbooks/roles/linux-mirror/templates/mirrors.yaml.j2 @@ -88,6 +88,12 @@ mirrors: refresh: "120m" refresh_on_boot: "20m" reference: "linux.git" + - short_name: "stable-rc" + url: "{{ mirror_stable_rc_url }}" + target: "linux-stable-rc.git" + refresh: "120m" + refresh_on_boot: "20m" + reference: "linux-stable-rc.git" - short_name: "vfs" url: "{{ mirror_vfs_url }}" target: "vfs.git"