From patchwork Tue May 9 19:18:49 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: John Cai X-Patchwork-Id: 13236104 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id 765F9C7EE24 for ; Tue, 9 May 2023 19:19:02 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S234606AbjEITTB (ORCPT ); Tue, 9 May 2023 15:19:01 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:48162 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229534AbjEITS5 (ORCPT ); Tue, 9 May 2023 15:18:57 -0400 Received: from mail-wr1-x42b.google.com (mail-wr1-x42b.google.com [IPv6:2a00:1450:4864:20::42b]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id CAA21422B for ; Tue, 9 May 2023 12:18:55 -0700 (PDT) Received: by mail-wr1-x42b.google.com with SMTP id ffacd0b85a97d-3063b5f32aaso4103163f8f.2 for ; Tue, 09 May 2023 12:18:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1683659934; x=1686251934; h=cc:to:mime-version:content-transfer-encoding:fcc:subject:date:from :references:in-reply-to:message-id:from:to:cc:subject:date :message-id:reply-to; bh=uZhFDGmqjC6o6CL26mgnGBnxyvAceRWz2SgtOUWsswA=; b=WdAXpugOfPf5oPuTIlw+8mlMChg7sLnouJ9aboMMg4q3bEhBpNZ4hqDLgl6hLorYj5 1gIL0j5qjLcheZ5d5gskt5m/XJM07PjzKFTKIGBLr3RBpMfX5CP2v+MYKYc0ByB0pifi U6amvaS6tFYlbkKqxzqrzt/cQgdI2D6UdojnhLoM8Gojf8o3L4EVOSYVYfJiBo1552VZ 3iU4NLXlzQLcEuVJwTOXAwz+Cb0lnly5/mpCZ85uV5fTY5k9+tGY1VGAiqJWzb7icteD PWAs1hkfQHQM3k5Q8gELFuEzEyRAUwGbJjXK2pmTHl6lPfwyNEjWT5aiQzIBiyYtJVE8 vBlA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1683659934; x=1686251934; h=cc:to:mime-version:content-transfer-encoding:fcc:subject:date:from :references:in-reply-to:message-id:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=uZhFDGmqjC6o6CL26mgnGBnxyvAceRWz2SgtOUWsswA=; b=LZpfiPcAqR0i56mNxmYkn1c6CuoSnt61uHSQ40rZLe9xDZAJIxC3cDzeMWlWLWg1EM nZtFnR4dfIA/dtrokOwXwMajx1tIN1ejLDrAo9y3FQE+M6zkT5fvO6saVOvNUyj65S23 ichRQAEiH2czSug/67HuIXM5HlUjfzjAIviCFrGLFYIoEvUznR6ThdFTiFUxWER5phEE 8MfOMfwkirMJzvfePRx9Yo7yhpCcxZl+ozeIaC9y3Id+lPUZVkZn5QnnzmyiPyolu0+7 yRQw8xWn+gcEN89Bu62TS1zFzbsAUG9sCfuOvjAkvTEvF5PMdT44oyROA566N6bTtWLL PsOA== X-Gm-Message-State: AC+VfDwlC/oWE0sITfru8NZjRY2Z/11nvbnLiErlvZR5QPABuAaZm41B +EqKlxsUAeQV1gO1UjPcXQLHL/7WHjE= X-Google-Smtp-Source: ACHHUZ7FX69/0XElxpr4Ug5Kk4oWn9NH2ZVKVQ+LtNZgljgRT4AoKEGCa1RVzWL3n/ViFgHNTs/AOw== X-Received: by 2002:adf:ee84:0:b0:306:3261:809 with SMTP id b4-20020adfee84000000b0030632610809mr10495146wro.50.1683659933905; Tue, 09 May 2023 12:18:53 -0700 (PDT) Received: from [127.0.0.1] ([13.74.141.28]) by smtp.gmail.com with ESMTPSA id n3-20020a5d4843000000b003047d5b8817sm15192939wrs.80.2023.05.09.12.18.53 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 09 May 2023 12:18:53 -0700 (PDT) Message-Id: <0b40b24b95d81cbc956eb4c7761e043c16a00be0.1683659931.git.gitgitgadget@gmail.com> In-Reply-To: References: Date: Tue, 09 May 2023 19:18:49 +0000 Subject: [PATCH v2 1/3] docs: clarify git-pack-refs --all will pack all refs Fcc: Sent MIME-Version: 1.0 To: git@vger.kernel.org Cc: Junio C Hamano , Christian Couder , John Cai , John Cai Precedence: bulk List-ID: X-Mailing-List: git@vger.kernel.org From: John Cai From: John Cai --all packs not just branch tips but anything under refs/ with the exception of hidden refs and broken refs. Clarify this in the documentation. Signed-off-by: John Cai --- Documentation/git-pack-refs.txt | 7 ++++--- 1 file changed, 4 insertions(+), 3 deletions(-) diff --git a/Documentation/git-pack-refs.txt b/Documentation/git-pack-refs.txt index 154081f2de2..e011e5fead3 100644 --- a/Documentation/git-pack-refs.txt +++ b/Documentation/git-pack-refs.txt @@ -49,10 +49,11 @@ OPTIONS The command by default packs all tags and refs that are already packed, and leaves other refs -alone. This is because branches are expected to be actively +alone. This is because branches are expected to be actively developed and packing their tips does not help performance. -This option causes branch tips to be packed as well. Useful for -a repository with many branches of historical interests. +This option causes all refs to be packed as well, with the exception of hidden +and broken refs. Useful for a repository with many branches of historical +interests. --no-prune:: From patchwork Tue May 9 19:18:50 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: John Cai X-Patchwork-Id: 13236105 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id 08E8DC77B75 for ; Tue, 9 May 2023 19:19:05 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S234628AbjEITTD (ORCPT ); Tue, 9 May 2023 15:19:03 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:48170 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S233064AbjEITS7 (ORCPT ); Tue, 9 May 2023 15:18:59 -0400 Received: from mail-wm1-x332.google.com (mail-wm1-x332.google.com [IPv6:2a00:1450:4864:20::332]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id D79844239 for ; Tue, 9 May 2023 12:18:56 -0700 (PDT) Received: by mail-wm1-x332.google.com with SMTP id 5b1f17b1804b1-3f315712406so221464375e9.0 for ; Tue, 09 May 2023 12:18:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1683659935; x=1686251935; h=cc:to:mime-version:content-transfer-encoding:fcc:subject:date:from :references:in-reply-to:message-id:from:to:cc:subject:date :message-id:reply-to; bh=i7zoBJ8a0jUjuIttqlS1XAZt3tZh8AJDm2Emn6MdpkA=; b=L6W1ASMw5jC+aGWhpEm6DDxgAm08KlgWzvKB6NXBXzK3Ty8Ye0wIPPOB4NOUXqoOm7 4wwHBJz5S5fRLnPRKKdd8bhKf8tQ1SBjaqNrY5M0C8GLy+45u1JTpyiUuM2UqjeTrDsi dXls5jmql0sEZO370oreBv690Adp01QFJNIrWoEtNWGecpIW3JBBmHLLDin7wvTKKWSv hsCQ/6fTMnGChkMzIFTUFK6i3Tj7wRmZgt80g/2Dl/RamkOVWXOVU/htpsgF5SzMgrcL oetO6KWOT3JYgXjJYKovGF8BvVczlcRKCSVlGqk0e61T+1YuozwJERW93fv2UEGz3iw/ i4zQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1683659935; x=1686251935; h=cc:to:mime-version:content-transfer-encoding:fcc:subject:date:from :references:in-reply-to:message-id:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=i7zoBJ8a0jUjuIttqlS1XAZt3tZh8AJDm2Emn6MdpkA=; b=lDLDtCGU5u5h5X6SD6JQzPhdrTaGibXkkBVXDZ1dPOcNPWLgnPYhILqXr2Gz1TmSrM IQXj8K6g7i7PDbtZqUOc5aucSQe4yY+rVQwVs9G8+Ow+z8I2U8or4wLs2n1+V8Z8Vt/s W45VHl+cJ2AqzuwdmDYo9A/1Vyw5iR8iIkfHFN2+vZbh2Td5WZuIuk9GJaqwKAeWwL2t HrPc+WaewhfOCfRQ7qnZe2QB1AG+VQXxj51ZwT4Q9u6OfaC/2N0/4+fC4LQ2IVvmm18X GQsc3J8NfA1J2LawSJdDKToQX29oKX5H7+WCqUmvlR2qOwB9VcCqLK6HE7yeZIkgkKTC WOjg== X-Gm-Message-State: AC+VfDz5O11It/9ROaaiaUA5UB3r9H2TiCsUzYxNUaQuITSnk17v1JVs PR2DJWylli2jsfaW6c+HhFEmTPY+05s= X-Google-Smtp-Source: ACHHUZ4tNNobm9MdbBjBKMxqntCHYPt9YnWi6qkvIZ5WLitTrulzUM5x/eyX1d1GrS28rG4FDPbPdQ== X-Received: by 2002:a7b:c00d:0:b0:3f3:4264:2c5c with SMTP id c13-20020a7bc00d000000b003f342642c5cmr10432187wmb.13.1683659934775; Tue, 09 May 2023 12:18:54 -0700 (PDT) Received: from [127.0.0.1] ([13.74.141.28]) by smtp.gmail.com with ESMTPSA id e3-20020a05600c218300b003f421979398sm9362788wme.26.2023.05.09.12.18.54 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 09 May 2023 12:18:54 -0700 (PDT) Message-Id: <027b3f85a0b9c33c5334d6dad84e99c325ebec10.1683659931.git.gitgitgadget@gmail.com> In-Reply-To: References: Date: Tue, 09 May 2023 19:18:50 +0000 Subject: [PATCH v2 2/3] pack-refs: teach --exclude option to exclude refs from being packed Fcc: Sent MIME-Version: 1.0 To: git@vger.kernel.org Cc: Junio C Hamano , Christian Couder , John Cai , John Cai Precedence: bulk List-ID: X-Mailing-List: git@vger.kernel.org From: John Cai From: John Cai At GitLab, we have a system that creates ephemeral internal refs that don't live long before getting deleted. Having an option to not include certain refs from a packed-refs file allows these internal references to be deleted much more efficiently. Add an --exclude option to the pack-refs builtin, and use the ref exclusions API to exclude certain refs from being packed into the final packed-refs file Signed-off-by: John Cai --- Documentation/git-pack-refs.txt | 12 +++++++++++- builtin/pack-refs.c | 21 +++++++++++++++++---- refs.c | 4 ++-- refs.h | 7 ++++++- refs/debug.c | 4 ++-- refs/files-backend.c | 16 ++++++++++------ refs/packed-backend.c | 2 +- refs/refs-internal.h | 3 ++- t/helper/test-ref-store.c | 3 ++- t/t3210-pack-refs.sh | 18 ++++++++++++++++++ 10 files changed, 71 insertions(+), 19 deletions(-) diff --git a/Documentation/git-pack-refs.txt b/Documentation/git-pack-refs.txt index e011e5fead3..c0f7426e519 100644 --- a/Documentation/git-pack-refs.txt +++ b/Documentation/git-pack-refs.txt @@ -8,7 +8,7 @@ git-pack-refs - Pack heads and tags for efficient repository access SYNOPSIS -------- [verse] -'git pack-refs' [--all] [--no-prune] +'git pack-refs' [--all] [--no-prune] [--exclude ] DESCRIPTION ----------- @@ -60,6 +60,16 @@ interests. The command usually removes loose refs under `$GIT_DIR/refs` hierarchy after packing them. This option tells it not to. +--exclude :: + +Do not pack refs matching the given `glob(7)` pattern. Repetitions of this option +accumulate exclusion patterns. Use `--no-exclude` to clear and reset the list of +patterns. If a ref is already packed, including it with `--exclude` will not +unpack it. + +When used with `--all`, it will use the difference between the set of all refs, +and what is provided to `--exclude`. + BUGS ---- diff --git a/builtin/pack-refs.c b/builtin/pack-refs.c index 9833815fb30..3dcbd6e2421 100644 --- a/builtin/pack-refs.c +++ b/builtin/pack-refs.c @@ -4,22 +4,35 @@ #include "parse-options.h" #include "refs.h" #include "repository.h" +#include "revision.h" static char const * const pack_refs_usage[] = { - N_("git pack-refs [--all] [--no-prune]"), + N_("git pack-refs [--all] [--no-prune] [--exclude ]"), NULL }; int cmd_pack_refs(int argc, const char **argv, const char *prefix) { unsigned int flags = PACK_REFS_PRUNE; + static struct ref_exclusions excludes = REF_EXCLUSIONS_INIT; + struct pack_refs_opts pack_refs_opts = {.exclusions = &excludes, .flags = flags}; + static struct string_list option_excluded_refs = STRING_LIST_INIT_NODUP; + struct string_list_item *item; + struct option opts[] = { - OPT_BIT(0, "all", &flags, N_("pack everything"), PACK_REFS_ALL), - OPT_BIT(0, "prune", &flags, N_("prune loose refs (default)"), PACK_REFS_PRUNE), + OPT_BIT(0, "all", &pack_refs_opts.flags, N_("pack everything"), PACK_REFS_ALL), + OPT_BIT(0, "prune", &pack_refs_opts.flags, N_("prune loose refs (default)"), PACK_REFS_PRUNE), + OPT_STRING_LIST(0, "exclude", &option_excluded_refs, N_("pattern"), + N_("references to exclude")), OPT_END(), }; + git_config(git_default_config, NULL); if (parse_options(argc, argv, prefix, opts, pack_refs_usage, 0)) usage_with_options(pack_refs_usage, opts); - return refs_pack_refs(get_main_ref_store(the_repository), flags); + + for_each_string_list_item(item, &option_excluded_refs) + add_ref_exclusion(pack_refs_opts.exclusions, item->string); + + return refs_pack_refs(get_main_ref_store(the_repository), &pack_refs_opts); } diff --git a/refs.c b/refs.c index d2a98e1c21f..881a0da65cf 100644 --- a/refs.c +++ b/refs.c @@ -2132,9 +2132,9 @@ void base_ref_store_init(struct ref_store *refs, struct repository *repo, } /* backend functions */ -int refs_pack_refs(struct ref_store *refs, unsigned int flags) +int refs_pack_refs(struct ref_store *refs, struct pack_refs_opts *opts) { - return refs->be->pack_refs(refs, flags); + return refs->be->pack_refs(refs, opts); } int peel_iterated_oid(const struct object_id *base, struct object_id *peeled) diff --git a/refs.h b/refs.h index 123cfa44244..46020bd335c 100644 --- a/refs.h +++ b/refs.h @@ -63,6 +63,11 @@ struct worktree; #define RESOLVE_REF_NO_RECURSE 0x02 #define RESOLVE_REF_ALLOW_BAD_NAME 0x04 +struct pack_refs_opts { + unsigned int flags; + struct ref_exclusions *exclusions; +}; + const char *refs_resolve_ref_unsafe(struct ref_store *refs, const char *refname, int resolve_flags, @@ -405,7 +410,7 @@ void warn_dangling_symrefs(FILE *fp, const char *msg_fmt, * Write a packed-refs file for the current repository. * flags: Combination of the above PACK_REFS_* flags. */ -int refs_pack_refs(struct ref_store *refs, unsigned int flags); +int refs_pack_refs(struct ref_store *refs, struct pack_refs_opts *opts); /* * Setup reflog before using. Fill in err and return -1 on failure. diff --git a/refs/debug.c b/refs/debug.c index adc34c836fc..63f434ea26b 100644 --- a/refs/debug.c +++ b/refs/debug.c @@ -122,10 +122,10 @@ static int debug_initial_transaction_commit(struct ref_store *refs, return res; } -static int debug_pack_refs(struct ref_store *ref_store, unsigned int flags) +static int debug_pack_refs(struct ref_store *ref_store, struct pack_refs_opts *opts) { struct debug_ref_store *drefs = (struct debug_ref_store *)ref_store; - int res = drefs->refs->be->pack_refs(drefs->refs, flags); + int res = drefs->refs->be->pack_refs(drefs->refs, opts); trace_printf_key(&trace_refs, "pack_refs: %d\n", res); return res; } diff --git a/refs/files-backend.c b/refs/files-backend.c index d0581ee41ac..6a51267f379 100644 --- a/refs/files-backend.c +++ b/refs/files-backend.c @@ -19,6 +19,7 @@ #include "../worktree.h" #include "../wrapper.h" #include "../write-or-die.h" +#include "../revision.h" /* * This backend uses the following flags in `ref_update::flags` for @@ -1173,7 +1174,7 @@ static void prune_refs(struct files_ref_store *refs, struct ref_to_prune **refs_ */ static int should_pack_ref(const char *refname, const struct object_id *oid, unsigned int ref_flags, - unsigned int pack_flags) + struct pack_refs_opts *opts) { /* Do not pack per-worktree refs: */ if (parse_worktree_ref(refname, NULL, NULL, NULL) != @@ -1181,7 +1182,7 @@ static int should_pack_ref(const char *refname, return 0; /* Do not pack non-tags unless PACK_REFS_ALL is set: */ - if (!(pack_flags & PACK_REFS_ALL) && !starts_with(refname, "refs/tags/")) + if (!(opts->flags & PACK_REFS_ALL) && !starts_with(refname, "refs/tags/")) return 0; /* Do not pack symbolic refs: */ @@ -1192,10 +1193,14 @@ static int should_pack_ref(const char *refname, if (!ref_resolves_to_object(refname, the_repository, oid, ref_flags)) return 0; + if (opts->exclusions && ref_excluded(opts->exclusions, refname)) + return 0; + return 1; } -static int files_pack_refs(struct ref_store *ref_store, unsigned int flags) +static int files_pack_refs(struct ref_store *ref_store, + struct pack_refs_opts *opts) { struct files_ref_store *refs = files_downcast(ref_store, REF_STORE_WRITE | REF_STORE_ODB, @@ -1220,8 +1225,7 @@ static int files_pack_refs(struct ref_store *ref_store, unsigned int flags) * in the packed ref cache. If the reference should be * pruned, also add it to refs_to_prune. */ - if (!should_pack_ref(iter->refname, iter->oid, iter->flags, - flags)) + if (!should_pack_ref(iter->refname, iter->oid, iter->flags, opts)) continue; /* @@ -1235,7 +1239,7 @@ static int files_pack_refs(struct ref_store *ref_store, unsigned int flags) iter->refname, err.buf); /* Schedule the loose reference for pruning if requested. */ - if ((flags & PACK_REFS_PRUNE)) { + if ((opts->flags & PACK_REFS_PRUNE)) { struct ref_to_prune *n; FLEX_ALLOC_STR(n, name, iter->refname); oidcpy(&n->oid, iter->oid); diff --git a/refs/packed-backend.c b/refs/packed-backend.c index 2333ed5a1f7..9a2dd10dba7 100644 --- a/refs/packed-backend.c +++ b/refs/packed-backend.c @@ -1576,7 +1576,7 @@ static int packed_delete_refs(struct ref_store *ref_store, const char *msg, } static int packed_pack_refs(struct ref_store *ref_store UNUSED, - unsigned int flags UNUSED) + struct pack_refs_opts *pack_opts UNUSED) { /* * Packed refs are already packed. It might be that loose refs diff --git a/refs/refs-internal.h b/refs/refs-internal.h index a85d113123c..f72b7be8941 100644 --- a/refs/refs-internal.h +++ b/refs/refs-internal.h @@ -547,7 +547,8 @@ typedef int ref_transaction_commit_fn(struct ref_store *refs, struct ref_transaction *transaction, struct strbuf *err); -typedef int pack_refs_fn(struct ref_store *ref_store, unsigned int flags); +typedef int pack_refs_fn(struct ref_store *ref_store, + struct pack_refs_opts *opts); typedef int create_symref_fn(struct ref_store *ref_store, const char *ref_target, const char *refs_heads_master, diff --git a/t/helper/test-ref-store.c b/t/helper/test-ref-store.c index 6d8f844e9c7..de4197708d9 100644 --- a/t/helper/test-ref-store.c +++ b/t/helper/test-ref-store.c @@ -116,8 +116,9 @@ static struct flag_definition pack_flags[] = { FLAG_DEF(PACK_REFS_PRUNE), static int cmd_pack_refs(struct ref_store *refs, const char **argv) { unsigned int flags = arg_flags(*argv++, "flags", pack_flags); + struct pack_refs_opts pack_opts = { .flags = flags }; - return refs_pack_refs(refs, flags); + return refs_pack_refs(refs, &pack_opts); } static int cmd_create_symref(struct ref_store *refs, const char **argv) diff --git a/t/t3210-pack-refs.sh b/t/t3210-pack-refs.sh index 07a0ff93def..31b9f72e84a 100755 --- a/t/t3210-pack-refs.sh +++ b/t/t3210-pack-refs.sh @@ -108,6 +108,24 @@ test_expect_success \ git branch -d n/o/p && git branch n' +test_expect_success \ + 'test excluded refs are not packed' ' + git branch dont_pack1 && + git branch dont_pack2 && + git branch pack_this && + git pack-refs --all --exclude refs/heads/dont_pack* && + test -f .git/refs/heads/dont_pack1 && + test -f .git/refs/heads/dont_pack2 && + ! test -f ./git/refs/heads/pack_this' + +test_expect_success \ + 'test --no-exclude refs clears excluded refs' ' + git branch dont_pack3 && + git branch dont_pack4 && + git pack-refs --all --exclude refs/heads/dont_pack* --no-exclude && + ! test -f .git/refs/heads/dont_pack3 && + ! test -f .git/refs/heads/dont_pack4' + test_expect_success \ 'see if up-to-date packed refs are preserved' \ 'git branch q && From patchwork Tue May 9 19:18:51 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: John Cai X-Patchwork-Id: 13236106 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id 2F376C7EE22 for ; Tue, 9 May 2023 19:19:07 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S234768AbjEITTF (ORCPT ); Tue, 9 May 2023 15:19:05 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:48172 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S234420AbjEITS7 (ORCPT ); Tue, 9 May 2023 15:18:59 -0400 Received: from mail-wm1-x32b.google.com (mail-wm1-x32b.google.com [IPv6:2a00:1450:4864:20::32b]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 48C22423A for ; Tue, 9 May 2023 12:18:57 -0700 (PDT) Received: by mail-wm1-x32b.google.com with SMTP id 5b1f17b1804b1-3f417ea5252so26815265e9.0 for ; Tue, 09 May 2023 12:18:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1683659935; x=1686251935; h=cc:to:mime-version:content-transfer-encoding:fcc:subject:date:from :references:in-reply-to:message-id:from:to:cc:subject:date :message-id:reply-to; bh=aSvfGA6ZeDgICLM7bAi9aYm+Y1F51ka/7GJxA/PERUY=; b=KNBjuIaDm48B/PJKQlR23eHBvuNoas/Lle6rWyqt76YCsioQq378JT2qg9BeqAbaDt 2x747DVxKtcfNJsUK+qcgfY+dxsREUcd9pDqS7RUVVycDGgiRCLE6+PwnwFFK+pRqDrZ QRQYH1cda+0v/AhVPF+NxyaCwGk3whODY0MYGm+DraVRbDgSHGxeZg7a/9sDF253fm39 mykD6WS3H2E/FpF4uL0MfusY5v/Y0HOhYtv9oko2lcYo6HhF1hnLKvYTMVgC7dXGRs7J tFCr8Z3dYddF1zDEqw65VP7gNFvZZ6j5kQItJuurP4BsImhOTSBI8cTIWcu/qrlSbpqJ 6/zA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1683659935; x=1686251935; h=cc:to:mime-version:content-transfer-encoding:fcc:subject:date:from :references:in-reply-to:message-id:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=aSvfGA6ZeDgICLM7bAi9aYm+Y1F51ka/7GJxA/PERUY=; b=loVhEUGAh3ZRgdSlyrvQ+v+J0dXFCDmIYhYSGm6uJJ9HEjPwG24SxeXxpS7Dikg1Lk zc+nCysCxL6yBEIRa7I+PKIiokXj8eZji8ynY/neZe69+e4oVMqJdZgoSvrOFemS5Ots OixBmvbHCy8bld6hlwuByUJeUGy0e5mIiZDnlMHUpe4fmL6/ETRPeZriWb5qOp7O6GRl aKMD3wKyQUXnmKjAbtDc8b40Aovwu5jHRebfcD2swosk1+cNXH3zMQO9WrK6JidTQTKS C2P3cRxu3HlzMmDAX+jrcZ94bsYUHUykoHzn8hp09p+E7Q/InSthE4t/M3oMnBZXOQFC r5pA== X-Gm-Message-State: AC+VfDwlTNQ5zw1LV/fsmCJ9ejGBl8bA3+CXDlbeHjymIGr6idihCMRY GRo+hCT6ylgnMiSKJfnI++KFyDo8A4E= X-Google-Smtp-Source: ACHHUZ5fLCzmx0Ny2uR4bzTkX50GSfrrAfzI9lfelKr20EpJlzAn2ClUp/gyLzOrK0AAGyuLguKvUw== X-Received: by 2002:a05:600c:2055:b0:3f1:74c3:3c51 with SMTP id p21-20020a05600c205500b003f174c33c51mr10731856wmg.35.1683659935463; Tue, 09 May 2023 12:18:55 -0700 (PDT) Received: from [127.0.0.1] ([13.74.141.28]) by smtp.gmail.com with ESMTPSA id n22-20020a7bcbd6000000b003f41bb52834sm11225022wmi.38.2023.05.09.12.18.54 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 09 May 2023 12:18:55 -0700 (PDT) Message-Id: <03950e8f120e48b7df68f3273bbb2f7bb1e9073d.1683659931.git.gitgitgadget@gmail.com> In-Reply-To: References: Date: Tue, 09 May 2023 19:18:51 +0000 Subject: [PATCH v2 3/3] pack-refs: teach pack-refs --include option Fcc: Sent MIME-Version: 1.0 To: git@vger.kernel.org Cc: Junio C Hamano , Christian Couder , John Cai , John Cai Precedence: bulk List-ID: X-Mailing-List: git@vger.kernel.org From: John Cai From: John Cai Allow users to be more selective over which refs to pack by adding an --include option to git-pack-refs. The existing options allow some measure of selectivity. By default git-pack-refs packs all tags. --all can be used to include all refs, and the previous commit added the ability to exclude certain refs with --exclude. While these knobs give the user some selection over which refs to pack, it could be useful to give more control. For instance, a repository may have a set of branches that are rarely updated and would benefit from being packed. --include would allow the user to easily include a set of branches to be packed while leaving everything else unpacked. Signed-off-by: John Cai --- Documentation/git-pack-refs.txt | 15 ++++++++++++++- builtin/pack-refs.c | 10 ++++++++-- refs.h | 1 + refs/files-backend.c | 14 +++++++++++--- t/t3210-pack-refs.sh | 10 ++++++++++ 5 files changed, 44 insertions(+), 6 deletions(-) diff --git a/Documentation/git-pack-refs.txt b/Documentation/git-pack-refs.txt index c0f7426e519..f187925bdc0 100644 --- a/Documentation/git-pack-refs.txt +++ b/Documentation/git-pack-refs.txt @@ -8,7 +8,7 @@ git-pack-refs - Pack heads and tags for efficient repository access SYNOPSIS -------- [verse] -'git pack-refs' [--all] [--no-prune] [--exclude ] +'git pack-refs' [--all] [--no-prune] [--include ] [--exclude ] DESCRIPTION ----------- @@ -60,6 +60,15 @@ interests. The command usually removes loose refs under `$GIT_DIR/refs` hierarchy after packing them. This option tells it not to. +--include :: + +Pack refs based on a `glob(7)` pattern. Repetitions of this option +accumulate inclusion patterns. If a ref is both included in `--include` and +`--exclude`, `--exclude` takes precedence. Using `--include` does not preclude +all tags from being included by default. Symbolic refs and broken refs will never +be packed. When used with `--all`, it will be a noop. Use `--no-include` to clear +and reset the list of patterns. + --exclude :: Do not pack refs matching the given `glob(7)` pattern. Repetitions of this option @@ -70,6 +79,10 @@ unpack it. When used with `--all`, it will use the difference between the set of all refs, and what is provided to `--exclude`. +When used with `--include`, it will use what is provided to `--include` as well +as the the default of all tags and already packed refs, minus refs that are +provided to `--exclude`. + BUGS ---- diff --git a/builtin/pack-refs.c b/builtin/pack-refs.c index 3dcbd6e2421..293cdd17181 100644 --- a/builtin/pack-refs.c +++ b/builtin/pack-refs.c @@ -7,7 +7,7 @@ #include "revision.h" static char const * const pack_refs_usage[] = { - N_("git pack-refs [--all] [--no-prune] [--exclude ]"), + N_("git pack-refs [--all] [--no-prune] [--include ] [--exclude ]"), NULL }; @@ -15,13 +15,19 @@ int cmd_pack_refs(int argc, const char **argv, const char *prefix) { unsigned int flags = PACK_REFS_PRUNE; static struct ref_exclusions excludes = REF_EXCLUSIONS_INIT; - struct pack_refs_opts pack_refs_opts = {.exclusions = &excludes, .flags = flags}; + static struct string_list included_refs = STRING_LIST_INIT_NODUP; + struct pack_refs_opts pack_refs_opts = { .exclusions = &excludes, + .flags = flags, + .included_refs = &included_refs }; + static struct string_list option_excluded_refs = STRING_LIST_INIT_NODUP; struct string_list_item *item; struct option opts[] = { OPT_BIT(0, "all", &pack_refs_opts.flags, N_("pack everything"), PACK_REFS_ALL), OPT_BIT(0, "prune", &pack_refs_opts.flags, N_("prune loose refs (default)"), PACK_REFS_PRUNE), + OPT_STRING_LIST(0, "include", pack_refs_opts.included_refs, N_("pattern"), + N_("references to include")), OPT_STRING_LIST(0, "exclude", &option_excluded_refs, N_("pattern"), N_("references to exclude")), OPT_END(), diff --git a/refs.h b/refs.h index 46020bd335c..2f91f4c4a90 100644 --- a/refs.h +++ b/refs.h @@ -66,6 +66,7 @@ struct worktree; struct pack_refs_opts { unsigned int flags; struct ref_exclusions *exclusions; + struct string_list *included_refs; }; const char *refs_resolve_ref_unsafe(struct ref_store *refs, diff --git a/refs/files-backend.c b/refs/files-backend.c index 6a51267f379..3f8974a4a32 100644 --- a/refs/files-backend.c +++ b/refs/files-backend.c @@ -1181,6 +1181,17 @@ static int should_pack_ref(const char *refname, REF_WORKTREE_SHARED) return 0; + if (opts->exclusions && ref_excluded(opts->exclusions, refname)) + return 0; + + if (opts->included_refs && opts->included_refs->nr) { + struct string_list_item *item; + + for_each_string_list_item(item, opts->included_refs) + if (!wildmatch(item->string, refname, 0)) + return 1; + } + /* Do not pack non-tags unless PACK_REFS_ALL is set: */ if (!(opts->flags & PACK_REFS_ALL) && !starts_with(refname, "refs/tags/")) return 0; @@ -1193,9 +1204,6 @@ static int should_pack_ref(const char *refname, if (!ref_resolves_to_object(refname, the_repository, oid, ref_flags)) return 0; - if (opts->exclusions && ref_excluded(opts->exclusions, refname)) - return 0; - return 1; } diff --git a/t/t3210-pack-refs.sh b/t/t3210-pack-refs.sh index 31b9f72e84a..86b3ff6a3e0 100755 --- a/t/t3210-pack-refs.sh +++ b/t/t3210-pack-refs.sh @@ -126,6 +126,16 @@ test_expect_success \ ! test -f .git/refs/heads/dont_pack3 && ! test -f .git/refs/heads/dont_pack4' +test_expect_success \ + 'test only included refs are packed' ' + git branch pack_this1 && + git branch pack_this2 && + git tag dont_pack5 && + git pack-refs --include refs/tags/pack_this* --exclude refs/tags/dont_pack* && + test -f .git/refs/tags/dont_pack5 && + ! test -f ./git/refs/heads/pack_this1 && + ! test -f ./git/refs/heads/pack_this2' + test_expect_success \ 'see if up-to-date packed refs are preserved' \ 'git branch q &&