From patchwork Mon Oct 16 10:38:28 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: karthik nayak X-Patchwork-Id: 13422968 Received: from lindbergh.monkeyblade.net (lindbergh.monkeyblade.net [23.128.96.19]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 35A4820B21 for ; Mon, 16 Oct 2023 10:38:45 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="hwS2IrOk" Received: from mail-ed1-x52d.google.com (mail-ed1-x52d.google.com [IPv6:2a00:1450:4864:20::52d]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id B14E0C5 for ; Mon, 16 Oct 2023 03:38:43 -0700 (PDT) Received: by mail-ed1-x52d.google.com with SMTP id 4fb4d7f45d1cf-53e751aeb3cso3011599a12.2 for ; Mon, 16 Oct 2023 03:38:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1697452722; x=1698057522; darn=vger.kernel.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=1FiY2+5KerkCg3TRlt8yED0XiGRko5TMen1uOL/Q64Y=; b=hwS2IrOkuS/5fge0ZVmMrILvewHJBpfaIYjQiRqNLUJi6QiImCkTH5ewVbM6XwFG6Z DgDt2pvvhkhqs1ItKkOkOZrO8F5p7DsV8FDBPAEMlyyYqQOoI7L4KI/x2F7Rjk7wkq1y Q+wirYt/ILKgDvp0I9cSccfn5HsV91YZq32kX/zDFny6R7OYS1S48v5BaehsTQDvSuba 42jjmMNFWlOLs+YYrtHfhD6/VY5IwURci1DSztTJDfwHXFjfvRtee+DLIRvH2f1/b98g WugRxE0j/s+mL/qHCB66Eb5wO1vc6jyM9vgh6qK+JAcG6kQzZtpaKfiiW49Hge/4X/K/ givA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1697452722; x=1698057522; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=1FiY2+5KerkCg3TRlt8yED0XiGRko5TMen1uOL/Q64Y=; b=afuHB6rK3/baD/2ZB0m+l+0wUp1McBvzShqXM4K8kYtmQkZ8XrLQntPF0lX+msOBtT NSaUtJ2NF2ZBLHfj0HpPhNI4XA1xIsTa/M7zGLDdWmOCnBJf8lmzLyh63JTyMNd1u3Bv GT4sGgbLt8YNrurPDyEaUN/UlwUZbtEKc924xC65x/I8h9XswpCIrj9fKWCbJNUgq3n7 VjKFYPQBmXDlqu5O6VjoqINdRmRF7cvqauVFHGIcbczD6whbGRZhne+y6PpM5K1S9Zok 7N8vRNgrifBI4xNqjBLHuK0yAbNBJkGa4sC7q4lbMPefDX+DgyjiKkbvSDMrjzgyT9n2 LJ5w== X-Gm-Message-State: AOJu0YzG+9mdnWLJITHjpsZjVldMQ9kcqMMtClQth4hG+onZC5hT3Ghz EJN4LDnq5ONVOvYZRK7rbp8= X-Google-Smtp-Source: AGHT+IG0sMgUT5bz3LT5BPeb09e7yZ/g/dEyr9M1UcxQfElRbXPV++/9aIXeEJqwPB1u0v1qIk8OmA== X-Received: by 2002:a17:906:dc89:b0:9bf:d70:fc6b with SMTP id cs9-20020a170906dc8900b009bf0d70fc6bmr5271500ejc.71.1697452721669; Mon, 16 Oct 2023 03:38:41 -0700 (PDT) Received: from worklaptop.fritz.box ([2a02:2454:56d:f00:b15b:356c:2a07:7b52]) by smtp.gmail.com with ESMTPSA id jx17-20020a170907761100b009ad875d12d7sm3784390ejc.210.2023.10.16.03.38.40 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 16 Oct 2023 03:38:41 -0700 (PDT) From: Karthik Nayak To: karthik.188@gmail.com Cc: git@vger.kernel.org, gitster@pobox.com, ps@pks.im Subject: [PATCH v2 1/3] revision: rename bit to `do_not_die_on_missing_objects` Date: Mon, 16 Oct 2023 12:38:28 +0200 Message-ID: <20231016103830.56486-2-karthik.188@gmail.com> X-Mailer: git-send-email 2.41.0 In-Reply-To: <20231016103830.56486-1-karthik.188@gmail.com> References: <20231009105528.17777-1-karthik.188@gmail.com> <20231016103830.56486-1-karthik.188@gmail.com> Precedence: bulk X-Mailing-List: git@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-Spam-Status: No, score=-1.8 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_ENVFROM_END_DIGIT, FREEMAIL_FROM,RCVD_IN_DNSWL_NONE,SPF_HELO_NONE,SPF_PASS autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net The bit `do_not_die_on_missing_tree` is used in revision.h to ensure the revision walker does not die when encountering a missing tree. This is currently exclusively set within `builtin/rev-list.c` to ensure the `--missing` option works with missing trees. In the upcoming commits, we will extend `--missing` to also support missing commits. So let's rename the bit to `do_not_die_on_missing_objects`, which is object type agnostic and can be used for both trees/commits. Signed-off-by: Karthik Nayak --- builtin/reflog.c | 2 +- builtin/rev-list.c | 2 +- list-objects.c | 2 +- revision.h | 17 +++++++++-------- 4 files changed, 12 insertions(+), 11 deletions(-) diff --git a/builtin/reflog.c b/builtin/reflog.c index df63a5892e..9e369a5977 100644 --- a/builtin/reflog.c +++ b/builtin/reflog.c @@ -298,7 +298,7 @@ static int cmd_reflog_expire(int argc, const char **argv, const char *prefix) struct rev_info revs; repo_init_revisions(the_repository, &revs, prefix); - revs.do_not_die_on_missing_tree = 1; + revs.do_not_die_on_missing_objects = 1; revs.ignore_missing = 1; revs.ignore_missing_links = 1; if (verbose) diff --git a/builtin/rev-list.c b/builtin/rev-list.c index ff715d6918..ea77489c38 100644 --- a/builtin/rev-list.c +++ b/builtin/rev-list.c @@ -561,7 +561,7 @@ int cmd_rev_list(int argc, const char **argv, const char *prefix) } if (arg_missing_action) - revs.do_not_die_on_missing_tree = 1; + revs.do_not_die_on_missing_objects = 1; argc = setup_revisions(argc, argv, &revs, &s_r_opt); diff --git a/list-objects.c b/list-objects.c index c25c72b32c..47296dff2f 100644 --- a/list-objects.c +++ b/list-objects.c @@ -177,7 +177,7 @@ static void process_tree(struct traversal_context *ctx, is_promisor_object(&obj->oid)) return; - if (!revs->do_not_die_on_missing_tree) + if (!revs->do_not_die_on_missing_objects) die("bad tree object %s", oid_to_hex(&obj->oid)); } diff --git a/revision.h b/revision.h index 50091bbd13..c73c92ef40 100644 --- a/revision.h +++ b/revision.h @@ -212,18 +212,19 @@ struct rev_info { /* * Blobs are shown without regard for their existence. - * But not so for trees: unless exclude_promisor_objects + * But not so for trees/commits: unless exclude_promisor_objects * is set and the tree in question is a promisor object; * OR ignore_missing_links is set, the revision walker - * dies with a "bad tree object HASH" message when - * encountering a missing tree. For callers that can - * handle missing trees and want them to be filterable + * dies with a "bad object HASH" message when + * encountering a missing object. For callers that can + * handle missing trees/commits and want them to be filterable * and showable, set this to true. The revision walker - * will filter and show such a missing tree as usual, - * but will not attempt to recurse into this tree - * object. + * will filter and show such a missing object as usual, + * but will not attempt to recurse into this tree/commit + * object. The revision walker will also set the MISSING + * flag for such objects. */ - do_not_die_on_missing_tree:1, + do_not_die_on_missing_objects:1, /* for internal use only */ exclude_promisor_objects:1; From patchwork Mon Oct 16 10:38:29 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: karthik nayak X-Patchwork-Id: 13422969 Received: from lindbergh.monkeyblade.net (lindbergh.monkeyblade.net [23.128.96.19]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 8B1FE210EB for ; Mon, 16 Oct 2023 10:38:46 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="Ai+sha7g" Received: from mail-ej1-x62f.google.com (mail-ej1-x62f.google.com [IPv6:2a00:1450:4864:20::62f]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 77085E6 for ; Mon, 16 Oct 2023 03:38:44 -0700 (PDT) Received: by mail-ej1-x62f.google.com with SMTP id a640c23a62f3a-99c1c66876aso694621966b.2 for ; Mon, 16 Oct 2023 03:38:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1697452723; x=1698057523; darn=vger.kernel.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=f6TnQ1vaFjHTDr0P4PWPFgZC7Ma0ongoXkP+orTCGcI=; b=Ai+sha7g3ZpmkI62LA1PEbSvOajjE/qESTwexefWg6Rl/wQYOn+kl7z60OeaYPiNuo w8aYVBXVK0LhtFtHGKA6x6cGMGAqZ96r5nlh7ei57l1Zq+RyCwYQCiGOmp6GSHb3JLP3 dxPdbA4WDEuHMD33rhlabfvF4dLQuhB3j0NzRwhjxYVEYxvPWsFBOEEZ4AMxJM2I2xvK ZMLv5OTsG5NSiSvFi43z/kDSfscGyqrdjizOZNSvbdRT06BBUXzqvuvtzCKbVtVUAp20 ggFmzsdFwnm3zyyhV32Ae5hg+sJl1ovnBTiYWoBJZlE9rMZQcv0Xkva6OZiwncgiZOMZ 1gtg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1697452723; x=1698057523; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=f6TnQ1vaFjHTDr0P4PWPFgZC7Ma0ongoXkP+orTCGcI=; b=k6gmcKNNqPvpy7TwgRJupW6ry8UC44ZM+ijFFdb8Nrk4a6cR232JukUcHr+DQiwNzi MIOlxG+YyjB35YNj/l2yy/6XbvkA4klpv7IOhrl2C97/sleRJW+Ab3ab4F8Yt2PmtO8W wDO/yGMMaz3TDCJoshL5W+V3fdGhs/dczBn+hWur60HJfOYXyCdy3rS4dfCTpwAEePMU sLIYveq29mU6eVgOMa4V/9+bl6f6WyHma2x/verdprQRUkeovszOEtInM/VQPyybuPAp iEkGc2dghGWdQWqLHK5SifQmLbsPo8crhsU89PAYO1tBEoLwU09FRwH0yTcy1UCGLd6v IRHw== X-Gm-Message-State: AOJu0Yzg952PFqL2WYToGneAkWDst/bCOy3/zsFZyTJaiid00LyjsSAq S/Hq7vOnbFjCA+cxOZLaOQE= X-Google-Smtp-Source: AGHT+IGSG5/QQKNpC9gG6Ejm/sRtJYEHWAZa3vvL/b1+ZquXytzvkoZ5LBWmz1Y3wc7bVmH4e09SDg== X-Received: by 2002:a17:906:314f:b0:9b0:169b:eece with SMTP id e15-20020a170906314f00b009b0169beecemr28200545eje.40.1697452722633; Mon, 16 Oct 2023 03:38:42 -0700 (PDT) Received: from worklaptop.fritz.box ([2a02:2454:56d:f00:b15b:356c:2a07:7b52]) by smtp.gmail.com with ESMTPSA id jx17-20020a170907761100b009ad875d12d7sm3784390ejc.210.2023.10.16.03.38.41 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 16 Oct 2023 03:38:42 -0700 (PDT) From: Karthik Nayak To: karthik.188@gmail.com Cc: git@vger.kernel.org, gitster@pobox.com, ps@pks.im Subject: [PATCH v2 2/3] rev-list: move `show_commit()` to the bottom Date: Mon, 16 Oct 2023 12:38:29 +0200 Message-ID: <20231016103830.56486-3-karthik.188@gmail.com> X-Mailer: git-send-email 2.41.0 In-Reply-To: <20231016103830.56486-1-karthik.188@gmail.com> References: <20231009105528.17777-1-karthik.188@gmail.com> <20231016103830.56486-1-karthik.188@gmail.com> Precedence: bulk X-Mailing-List: git@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-Spam-Status: No, score=-1.8 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_ENVFROM_END_DIGIT, FREEMAIL_FROM,RCVD_IN_DNSWL_NONE,SPF_HELO_NONE,SPF_PASS autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net The `show_commit()` function already depends on `finish_commit()`, and in the upcoming commit, we'll also add a dependency on `finish_object__ma()`. Since in C symbols must be declared before they're used, let's move `show_commit()` below both `finish_commit()` and `finish_object__ma()`, so the code is cleaner as a whole without the need for declarations. Signed-off-by: Karthik Nayak --- builtin/rev-list.c | 85 +++++++++++++++++++++++----------------------- 1 file changed, 42 insertions(+), 43 deletions(-) diff --git a/builtin/rev-list.c b/builtin/rev-list.c index ea77489c38..98542e8b3c 100644 --- a/builtin/rev-list.c +++ b/builtin/rev-list.c @@ -100,7 +100,48 @@ static off_t get_object_disk_usage(struct object *obj) return size; } -static void finish_commit(struct commit *commit); +static inline void finish_object__ma(struct object *obj) +{ + /* + * Whether or not we try to dynamically fetch missing objects + * from the server, we currently DO NOT have the object. We + * can either print, allow (ignore), or conditionally allow + * (ignore) them. + */ + switch (arg_missing_action) { + case MA_ERROR: + die("missing %s object '%s'", + type_name(obj->type), oid_to_hex(&obj->oid)); + return; + + case MA_ALLOW_ANY: + return; + + case MA_PRINT: + oidset_insert(&missing_objects, &obj->oid); + return; + + case MA_ALLOW_PROMISOR: + if (is_promisor_object(&obj->oid)) + return; + die("unexpected missing %s object '%s'", + type_name(obj->type), oid_to_hex(&obj->oid)); + return; + + default: + BUG("unhandled missing_action"); + return; + } +} + +static void finish_commit(struct commit *commit) +{ + free_commit_list(commit->parents); + commit->parents = NULL; + free_commit_buffer(the_repository->parsed_objects, + commit); +} + static void show_commit(struct commit *commit, void *data) { struct rev_list_info *info = data; @@ -219,48 +260,6 @@ static void show_commit(struct commit *commit, void *data) finish_commit(commit); } -static void finish_commit(struct commit *commit) -{ - free_commit_list(commit->parents); - commit->parents = NULL; - free_commit_buffer(the_repository->parsed_objects, - commit); -} - -static inline void finish_object__ma(struct object *obj) -{ - /* - * Whether or not we try to dynamically fetch missing objects - * from the server, we currently DO NOT have the object. We - * can either print, allow (ignore), or conditionally allow - * (ignore) them. - */ - switch (arg_missing_action) { - case MA_ERROR: - die("missing %s object '%s'", - type_name(obj->type), oid_to_hex(&obj->oid)); - return; - - case MA_ALLOW_ANY: - return; - - case MA_PRINT: - oidset_insert(&missing_objects, &obj->oid); - return; - - case MA_ALLOW_PROMISOR: - if (is_promisor_object(&obj->oid)) - return; - die("unexpected missing %s object '%s'", - type_name(obj->type), oid_to_hex(&obj->oid)); - return; - - default: - BUG("unhandled missing_action"); - return; - } -} - static int finish_object(struct object *obj, const char *name UNUSED, void *cb_data) { From patchwork Mon Oct 16 10:38:30 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: karthik nayak X-Patchwork-Id: 13422970 Received: from lindbergh.monkeyblade.net (lindbergh.monkeyblade.net [23.128.96.19]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 98350224FB for ; Mon, 16 Oct 2023 10:38:47 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="fMYLZs5e" Received: from mail-ej1-x629.google.com (mail-ej1-x629.google.com [IPv6:2a00:1450:4864:20::629]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 99AF0E8 for ; Mon, 16 Oct 2023 03:38:45 -0700 (PDT) Received: by mail-ej1-x629.google.com with SMTP id a640c23a62f3a-9be7e3fa1daso305122466b.3 for ; Mon, 16 Oct 2023 03:38:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1697452724; x=1698057524; darn=vger.kernel.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=86imHDVmdTpFlF6Ru4qRiI5dVgFaPxgnx/oYtQjs1Vw=; b=fMYLZs5eY/gsqE1d80r70ySEER6b9MVPvuoXxeALRpQyNgedhGeojsArBzDaiweQGd J3DuVTLWSPWjeWd+86SphqHmAM9aW57+DmCFFGDUmXasz6+6zoLex3z3W1MK+cjrsZxV eygPkpCWgu05u91IwOBInpeWze9Feuxd1Aq/Gu/BnQOAEOdZyWlXt9MRGCkkhSJ6jhG6 xVOmWodmpehwNfGtzNrpuEbXs51JNskMYTeICW5rp3dcKjESmApI9O/J5FOO9wQngisn URh6D769fuel6LRK2rha9OPBmdxU31fxp+BHnfgjJzXPQOc8LBFuUPuxguDmvzSnuy/M Mj1w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1697452724; x=1698057524; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=86imHDVmdTpFlF6Ru4qRiI5dVgFaPxgnx/oYtQjs1Vw=; b=J3hx0xvsmufeLDnlEV1eH7E5tMvD9jHO+SH2VdfRcgMQ7oCEc7Abn6YqeQrvZ1I88c YmF58YIqnbXVoPNqaTMk8e3LzTV+o8w/RnxVReAwc4y7hZQkKnJPfeBxlbEi7tRPYVnJ 6Tfi1LrBpfYNMeBf5mSGqpo1rE0mRfXIBaeALWBjlJbkEus2boXll8vUIHrZ4MMtfgxv EpONFFFKJlm4lN60ahQ7OUtgErQKJiyOtJTbPkxr4STptvGN5xjQ36E3RI9+R/ZZtaYR iA3N0b2xsCKp3nqJp4EyAZqyl9bEDzz+2ddenrGLUSOdQAPuNEgxjbtgvLneB/wKf3uX T37A== X-Gm-Message-State: AOJu0YyK5BdLPrfIsbGLwWEkrEx++IpMSF0xHR3jQrwienCoDsVV10Rc jMJLXz1/EB+ay+BKGLjo3dk= X-Google-Smtp-Source: AGHT+IGDU6nrBMmTQR6Lh4GPpaQb0BLWW8NUZVnL58ay6mBDQFmXJMULQvPf4WtWYs4wlldixy0vUg== X-Received: by 2002:a17:907:31c2:b0:9be:30c2:b8ff with SMTP id xf2-20020a17090731c200b009be30c2b8ffmr6594077ejb.61.1697452723926; Mon, 16 Oct 2023 03:38:43 -0700 (PDT) Received: from worklaptop.fritz.box ([2a02:2454:56d:f00:b15b:356c:2a07:7b52]) by smtp.gmail.com with ESMTPSA id jx17-20020a170907761100b009ad875d12d7sm3784390ejc.210.2023.10.16.03.38.42 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 16 Oct 2023 03:38:43 -0700 (PDT) From: Karthik Nayak To: karthik.188@gmail.com Cc: git@vger.kernel.org, gitster@pobox.com, ps@pks.im Subject: [PATCH v2 3/3] rev-list: add commit object support in `--missing` option Date: Mon, 16 Oct 2023 12:38:30 +0200 Message-ID: <20231016103830.56486-4-karthik.188@gmail.com> X-Mailer: git-send-email 2.41.0 In-Reply-To: <20231016103830.56486-1-karthik.188@gmail.com> References: <20231009105528.17777-1-karthik.188@gmail.com> <20231016103830.56486-1-karthik.188@gmail.com> Precedence: bulk X-Mailing-List: git@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-Spam-Status: No, score=-1.8 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_ENVFROM_END_DIGIT, FREEMAIL_FROM,RCVD_IN_DNSWL_NONE,SPF_HELO_NONE,SPF_PASS autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net The `--missing` object option in rev-list currently works only with missing blobs/trees. For missing commits the revision walker fails with a fatal error. Let's extend the functionality of `--missing` option to also support commit objects. This is done by adding a new `MISSING` flag that the revision walker sets whenever it encounters a missing tree/commit. The revision walker will now continue the traversal and call `show_commit()` even for missing commits. In rev-list we can then check for this flag and call the existing code for parsing `--missing` objects. A scenario where this option would be used is to find the boundary objects between different object directories. Consider a repository with a main object directory (GIT_OBJECT_DIRECTORY) and one or more alternate object directories (GIT_ALTERNATE_OBJECT_DIRECTORIES). In such a repository, using the `--missing=print` option while disabling the alternate object directory allows us to find the boundary objects between the main and alternate object directory. Signed-off-by: Karthik Nayak --- builtin/rev-list.c | 6 +++ list-objects.c | 2 +- object.h | 2 +- revision.c | 11 ++++-- revision.h | 3 ++ t/t6022-rev-list-missing.sh | 74 +++++++++++++++++++++++++++++++++++++ 6 files changed, 93 insertions(+), 5 deletions(-) create mode 100755 t/t6022-rev-list-missing.sh diff --git a/builtin/rev-list.c b/builtin/rev-list.c index 98542e8b3c..604ae01d0c 100644 --- a/builtin/rev-list.c +++ b/builtin/rev-list.c @@ -149,6 +149,12 @@ static void show_commit(struct commit *commit, void *data) display_progress(progress, ++progress_counter); + if (revs->do_not_die_on_missing_objects && + commit->object.flags & MISSING) { + finish_object__ma(&commit->object); + return; + } + if (show_disk_usage) total_disk_usage += get_object_disk_usage(&commit->object); diff --git a/list-objects.c b/list-objects.c index 47296dff2f..60c5533721 100644 --- a/list-objects.c +++ b/list-objects.c @@ -387,7 +387,7 @@ static void do_traverse(struct traversal_context *ctx) * an uninteresting boundary commit may not have its tree * parsed yet, but we are not going to show them anyway */ - if (!ctx->revs->tree_objects) + if (!ctx->revs->tree_objects || commit->object.flags & MISSING) ; /* do not bother loading tree */ else if (repo_get_commit_tree(the_repository, commit)) { struct tree *tree = repo_get_commit_tree(the_repository, diff --git a/object.h b/object.h index 114d45954d..12913e6116 100644 --- a/object.h +++ b/object.h @@ -62,7 +62,7 @@ void object_array_init(struct object_array *array); /* * object flag allocation: - * revision.h: 0---------10 15 23------27 + * revision.h: 0---------10 15 22------27 * fetch-pack.c: 01 67 * negotiator/default.c: 2--5 * walker.c: 0-2 diff --git a/revision.c b/revision.c index e789834dd1..d147e0f611 100644 --- a/revision.c +++ b/revision.c @@ -1110,7 +1110,7 @@ static int process_parents(struct rev_info *revs, struct commit *commit, struct commit_list *parent = commit->parents; unsigned pass_flags; - if (commit->object.flags & ADDED) + if (commit->object.flags & ADDED || commit->object.flags & MISSING) return 0; commit->object.flags |= ADDED; @@ -1168,7 +1168,8 @@ static int process_parents(struct rev_info *revs, struct commit *commit, for (parent = commit->parents; parent; parent = parent->next) { struct commit *p = parent->item; int gently = revs->ignore_missing_links || - revs->exclude_promisor_objects; + revs->exclude_promisor_objects || + revs->do_not_die_on_missing_objects; if (repo_parse_commit_gently(revs->repo, p, gently) < 0) { if (revs->exclude_promisor_objects && is_promisor_object(&p->object.oid)) { @@ -1176,7 +1177,11 @@ static int process_parents(struct rev_info *revs, struct commit *commit, break; continue; } - return -1; + + if (!revs->do_not_die_on_missing_objects) + return -1; + else + p->object.flags |= MISSING; } if (revs->sources) { char **slot = revision_sources_at(revs->sources, p); diff --git a/revision.h b/revision.h index c73c92ef40..07906bc3bc 100644 --- a/revision.h +++ b/revision.h @@ -41,6 +41,9 @@ /* WARNING: This is also used as REACHABLE in commit-graph.c. */ #define PULL_MERGE (1u<<15) +/* WARNING: This is also used as NEEDS_BITMAP in pack-bitmap.c. */ +#define MISSING (1u<<22) + #define TOPO_WALK_EXPLORED (1u<<23) #define TOPO_WALK_INDEGREE (1u<<24) diff --git a/t/t6022-rev-list-missing.sh b/t/t6022-rev-list-missing.sh new file mode 100755 index 0000000000..40265a4f66 --- /dev/null +++ b/t/t6022-rev-list-missing.sh @@ -0,0 +1,74 @@ +#!/bin/sh + +test_description='handling of missing objects in rev-list' + +TEST_PASSES_SANITIZE_LEAK=true +. ./test-lib.sh + +# We setup the repository with two commits, this way HEAD is always +# available and we can hide commit 1. +test_expect_success 'create repository and alternate directory' ' + test_commit 1 && + test_commit 2 && + test_commit 3 +' + +for obj in "HEAD~1" "HEAD~1^{tree}" "HEAD:1.t" +do + test_expect_success "rev-list --missing=error fails with missing object $obj" ' + oid="$(git rev-parse $obj)" && + path=".git/objects/$(test_oid_to_path $oid)" && + + mv "$path" "$path.hidden" && + test_when_finished "mv $path.hidden $path" && + + test_must_fail git rev-list --missing=error --objects \ + --no-object-names HEAD + ' +done + +for obj in "HEAD~1" "HEAD~1^{tree}" "HEAD:1.t" +do + for action in "allow-any" "print" + do + test_expect_success "rev-list --missing=$action with missing $obj" ' + oid="$(git rev-parse $obj)" && + path=".git/objects/$(test_oid_to_path $oid)" && + + # Before the object is made missing, we use rev-list to + # get the expected oids. + git rev-list --objects --no-object-names \ + HEAD ^$obj >expect.raw && + + # Blobs are shared by all commits, so evethough a commit/tree + # might be skipped, its blob must be accounted for. + if [ $obj != "HEAD:1.t" ]; then + echo $(git rev-parse HEAD:1.t) >>expect.raw && + echo $(git rev-parse HEAD:2.t) >>expect.raw + fi && + + mv "$path" "$path.hidden" && + test_when_finished "mv $path.hidden $path" && + + git rev-list --missing=$action --objects --no-object-names \ + HEAD >actual.raw && + + # When the action is to print, we should also add the missing + # oid to the expect list. + case $action in + allow-any) + ;; + print) + grep ?$oid actual.raw && + echo ?$oid >>expect.raw + ;; + esac && + + sort actual.raw >actual && + sort expect.raw >expect && + test_cmp expect actual + ' + done +done + +test_done