From patchwork Thu Dec 16 13:46:15 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Joel Holdsworth X-Patchwork-Id: 12681241 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id E241CC433EF for ; Thu, 16 Dec 2021 13:47:23 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S234043AbhLPNrX (ORCPT ); Thu, 16 Dec 2021 08:47:23 -0500 Received: from mail-bn7nam10on2081.outbound.protection.outlook.com ([40.107.92.81]:63200 "EHLO NAM10-BN7-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S233978AbhLPNrW (ORCPT ); Thu, 16 Dec 2021 08:47:22 -0500 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=ZWICTmDbA2bCY0nql0o+ohltRWn0PylxPDLbnrB/ntAK70xbUpDgvK2/cOXQ8yUlRgJhVZOpFNouXozAhopuHIhY33aPc0bIkxlYb4VNgxXhWe3K3dbYjVHBc5ziJijO1SFbfeaxpaGCsZQgvP1HuoudLD+HnY5Dy41nBFh2lESqJnP20ccTCY7zxFU5tzG1u4SWDeusWC2pDFgQmOFf7c9fiF8bu4MRPYoBV1gYTiFw2D65hd0FG0NXTboJ3n3uuQJhGf6EJJYVmHRV6xNOn68Oj3NgBbo8SBOZWaBqt0his5tQyRzcBPMSvSTSQrPZi1StIJgkxBLNSzone2luuQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=dCZSFVL/iEwwhUAbfeX0lfiW2N1XjCZXlIE3OhLttZA=; b=mXsiYSYEsj4r89t26tOUEJniuQJoQvZYoYvrC0pLj7AnplciMS2db1jlk3AuKMNQnEXK/DeqChGsMH2Gd1aXVW8QzgmOiewwWZ+HMIpQXVrcH2yuaCCZBQ+MfYB/xzLaKZmpqNCV7WWFCgfHmBWcoSLm5dQQ8bUoXAXslNvJdy7WPB2N6z6Q7bk+L+5wfko6ZwVWhvj8XjKkhlVPO+l/eGIR6uAb4lMykV9ZhlZNYPB9eZt46/bH2JA2fqtKw/rdRjW3ilcg1+BBCkdRxYiaQquwmNj+xdSn5qTmBYz+TYj5QML//Qz3eqfaoabTzjACCUTqHNEr7nTCHEDT48FddA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nvidia.com; dmarc=pass action=none header.from=nvidia.com; dkim=pass header.d=nvidia.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=dCZSFVL/iEwwhUAbfeX0lfiW2N1XjCZXlIE3OhLttZA=; b=BCb2Dj4rnvm5ZHxgaAEbuwNYPGZn0gNT9nLW1HFey7I5ddu+90kEnuOL0TSmF6UgUpWVKJsMlS14cQvAAvr6vtOgiqHl+BjXqoeVTWL3yzTgPrRKAQxt44e/rfITj2jfgUVQR8Fy8GlNOA7n2n6GzXGB99np01MYcFuTRMVAm2gAsMKGPxY9xD8Dn4Y4VvI0i7clQIuBKndPw+wrOI9MPbL3xGshwv50F0BdhLKj6d6ibVhWka8v+083BRklCOYLBh32JiS4zfepzltfkJF+U1ith7RJN1ZEQUjHAg4ScwXrdCdeVuMcS4qx/tWkYnZ4Mcnqo2QXYcZSg5mwEkRZiw== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=nvidia.com; Received: from BN8PR12MB3361.namprd12.prod.outlook.com (2603:10b6:408:67::19) by BN8PR12MB3443.namprd12.prod.outlook.com (2603:10b6:408:63::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4778.16; Thu, 16 Dec 2021 13:47:20 +0000 Received: from BN8PR12MB3361.namprd12.prod.outlook.com ([fe80::4063:6e26:a906:e592]) by BN8PR12MB3361.namprd12.prod.outlook.com ([fe80::4063:6e26:a906:e592%3]) with mapi id 15.20.4778.018; Thu, 16 Dec 2021 13:47:20 +0000 From: Joel Holdsworth To: git@vger.kernel.org Cc: Tzadik Vanderhoof , Dorgon Chang , Joachim Kuebart , Daniel Levin , Johannes Schindelin , Luke Diamand , Ben Keene , Andrew Oakley , Joel Holdsworth Subject: [PATCH v2 1/5] git-p4: use with statements to close files after use in patchRCSKeywords Date: Thu, 16 Dec 2021 13:46:15 +0000 Message-Id: <20211216134619.2048348-2-jholdsworth@nvidia.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20211216134619.2048348-1-jholdsworth@nvidia.com> References: <20211216134619.2048348-1-jholdsworth@nvidia.com> X-ClientProxiedBy: AM9P193CA0028.EURP193.PROD.OUTLOOK.COM (2603:10a6:20b:21e::33) To BN8PR12MB3361.namprd12.prod.outlook.com (2603:10b6:408:67::19) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: f0b00782-f9ef-4860-b28d-08d9c09a94b7 X-MS-TrafficTypeDiagnostic: BN8PR12MB3443:EE_ X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:6108; X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: IAEvQmZoODXERLyEwCicxljZ2t5m6cv2EvkGtlD9aIINMw6FHChZ94ca+txcEtqPer63TwbfLeJSEe1hFKjm7LFDmN2FuoaVpqdCJBmEVVY+nTdLiIxeAA6OpfeU9A4wu0Db0gQlv49UHroUDHEbVfUu9h3EPAaMAXKwm+a15orS9AkxQmaClmQ8um9jxUYa4T8MImD5biIxCcv8I5RCQQ33vdMEcKIYTKeujCMFFcC0auGZsH52rK3AS13SsrpZKWeXt+0dI905dZyFLPT+bj3C6trdhYzyCA2ft4zRFuACkYTLnJz7ZedOmUTa9FUkVgQZcrRQ/uufZA0BAgq2aTYgaS51F8W1i0iQSqCoUP7suTXZTDnP5Vq9xWqJQB79CB+J5Zjn7/cmq5K40/fpFi17TlZ5v8xPtjJc88m++rq/0dPlM4KlC2u0zoZIPfvDa/Dfvmk+eoHRhgg4zBDVuNttx3Jkl91JxHJAgIzNZvtmZHh1Ap0EVzAsISoTJV5ipH9Lmy+WVzWPrtTJcuGyt3UzPbZPRCPakaJeFJp45h4v2E/V5B9jF+VfgvnziZ6bDujE0JHpv/iSDQXD6KdLpmxUuzyIO3A6rkgLIiwpUm6hssWv4UNIuaqMKI35mFEhZ+Bx3nMGSJDlnOpcpxGWMoHgRDE9UEhQN7eWOWuVRWcFLw9wUaFc7AiRAS0LVe2WacaCm4lTk3c8vX8wQIuiHifmQkh78xUMN4mUDrZGnC4= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:BN8PR12MB3361.namprd12.prod.outlook.com;PTR:;CAT:NONE;SFS:(4636009)(366004)(38100700002)(66476007)(66556008)(8936002)(6512007)(66946007)(36756003)(508600001)(38350700002)(26005)(1076003)(86362001)(6916009)(4326008)(55236004)(6666004)(83380400001)(316002)(107886003)(52116002)(8676002)(186003)(5660300002)(54906003)(6486002)(2906002)(2616005)(6506007)(156123004);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: AO3Se7lPlWAI/R+07O4GMcXwiPnb6kkavSeZktEcHAFI5BHODq73bNNeMyYhU/VuizH16NDv86wcgaY0D3dXkfvFYFbIXZBM33Wjo8xUoFHXt25iZPYErf+4LlUnQttMVP1X9PWIzaM6u+i5Jm8byiduOsnZuFr8XKHpLUWku9L8Ebf9Vn9Nxu4yQQlnVUvVPCKvG2DnMjkerYVrHrnkAU1haqH8BEhyTGU8rkkztjVQiNssuYZgz28l2RxmTsD+iJGFrCVNjvJ2nL7KjvGOF5Kh6spHseSuybWXc6jp6zxxe8jLSoH6Kl5+z7NCzSHtJUoiSlL+9qb3sXQsLKqkl3y5JCrlbn3e1LsRRuROWmeu3W53fCLnwooLDzHa30Me41QTLxKmuk3WUBaOwKKxwJPB8szmRQ0tC5Tz2xDBBTkaF+jvJS2UNttQ3cwmAbHlAZHUPEYpOxC3SwlFSuqgoCShL4E7OvKZa6aX4z4A3QFmpoeJ1PYX2+hvg5TgZXKbzd0pBBUYnCtm8EHl6jgZ3+4VRBLm7/QlBC/KnjVJcPBW0i3KiPsodISF4AE44GkCNljTamlvGxsNePWlqHtIbCGpEhhcwvu0lcl5jj0BuuwImU1NhATfkkUaBNNSUX547NlXI4PXOzhebKXhmUd3GsiL0ThtdIWeC5CVwgiTNUkkbQPAdAhUkk5OUmoMNJPzJNa8F5K62UwJwpyFPb1DRLV+d/PPAKUdELNyMHRJ3G5Fx1OxSCH+kVzB9DrPD6Yznas0sz1MtAXYEvDZyz553GCuME9GtwhkBXkmbtzwj6f06gvjwZ0WAL5Rn3oo8oomAE0KRlKhPB+PGOw8QGmuksgwD6d3htJ/CW2ZaRRX2cVH8/hTNug12wGNo788+yEGZyk9TmPyngpPOv3hEaf7xoC4o7pyve69F3pe92wi6jjU2szzl20OrAeX+9t+w4Hp/4frvDbJoE5mXHD8OCMJpeETSeRgZJUi7UD6JLp22GOmeABIJBE6+hJisyyD6oORzyEsoxAxb/oK+r1ipugWw1T50RRCNqr4IJtmsNm1mC5eoyzxznYvOo7CEJJd1aHdseWXjIzeluc/+KlTqnGd0/VvrYtWzIgaTkMITJRmTuSr8IQbv9Msn/WMKOmqf7Ih53WEqey4BldVI15qk6rHt8bgf6UfkQqAjFyE+qmXKcFM0AvqD80jLdXN7eycmbFHj7mvl6z3D/FGPd7FEEuapwk4iYClZnMDc5b8qdPYE443SVqaJDKvqqSfsOILf4P+nr6UofYUQy4thnyha21f4Ohb4PZEN3NZonvKojq5Zfy+uNTIedi1E7Z6PkB4A+1aWqSZxBP03VCu5PZpxBzcOFEN5udF1YEnH9N3PGs93zcUxKAFn0qiPDkrmEgNdK8Uv67SNyaV1Dat2SIXAtPnwlNuVMlkwW1yJ/SfkWvtZppI3JA4DlKoRAjfu/KUJcM3XPS/bAYIRUXvkYJRPJaKRC56ww2wfOUqR+1pbMsCIl6zbAzzkDJ7Bj8W8x93iIlYuYSoxA48eynYFOSQo6aT9grm6hkUGFkhD5pJEG08/51uy3fN7dZF5pbRBIEx8U0As1EFdUpqT0kZO10drmamF4ioU/8wfUYjRpVjm98d0VQ= X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-Network-Message-Id: f0b00782-f9ef-4860-b28d-08d9c09a94b7 X-MS-Exchange-CrossTenant-AuthSource: BN8PR12MB3361.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 16 Dec 2021 13:47:20.3358 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: ZqTaTF7kynYx01m1rYRH2F4QrNRyHfNgXsOxrOmMueY66qknm94fTDQFbefB4gc/R0VnSlpjC1Xp18pZzlNreA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN8PR12MB3443 Precedence: bulk List-ID: X-Mailing-List: git@vger.kernel.org Python with statements are used to wrap the execution of a block of code so that an object can be safely released when execution leaves the scope. They are desirable for improving code tidyness, and to ensure that objects are properly destroyed even when exceptions are thrown. Signed-off-by: Joel Holdsworth --- git-p4.py | 13 +++++-------- 1 file changed, 5 insertions(+), 8 deletions(-) diff --git a/git-p4.py b/git-p4.py index 2b4500226a..226cdef424 100755 --- a/git-p4.py +++ b/git-p4.py @@ -1757,14 +1757,11 @@ def patchRCSKeywords(self, file, pattern): # Attempt to zap the RCS keywords in a p4 controlled file matching the given pattern (handle, outFileName) = tempfile.mkstemp(dir='.') try: - outFile = os.fdopen(handle, "w+") - inFile = open(file, "r") - regexp = re.compile(pattern, re.VERBOSE) - for line in inFile.readlines(): - line = regexp.sub(r'$\1$', line) - outFile.write(line) - inFile.close() - outFile.close() + with os.fdopen(handle, "w+") as outFile, open(file, "r") as inFile: + regexp = re.compile(pattern, re.VERBOSE) + for line in inFile.readlines(): + line = regexp.sub(r'$\1$', line) + outFile.write(line) # Forcibly overwrite the original file os.unlink(file) shutil.move(outFileName, file) From patchwork Thu Dec 16 13:46:16 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Joel Holdsworth X-Patchwork-Id: 12681243 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id 621F5C433F5 for ; Thu, 16 Dec 2021 13:47:26 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S234143AbhLPNrZ (ORCPT ); Thu, 16 Dec 2021 08:47:25 -0500 Received: from mail-bn8nam11on2057.outbound.protection.outlook.com ([40.107.236.57]:47297 "EHLO NAM11-BN8-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S234025AbhLPNrX (ORCPT ); Thu, 16 Dec 2021 08:47:23 -0500 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=hhiXRysZkKDofYfKB0DpFPdEjPmttLPNpYsptU3ug4oac7VCb5fgiummu0VpICYn68n0R9x6RD24eDJYMXsqHQ8Z9a9cEOSk5rD5qE4ZAUY4y6dCTHSFpOuxvxt+Q7FZ7OFeAJ/Olrh++HacrcGrFsuSyTysuYOJxw58rwdazMZzDuu2a1+tgxjlPNtxj6sIj5CZmEPJOBMnar/AfOpU9lQ83L9EUCL9jFOPnvUIalCvpchAeZWAd8Axo64iwPuiDmlZ68bXAjZiUFzwOMff5gs7NClmBQz7OSHgC4XXE6yQM4sYvJ5DKIRGVBja8wKvnkgwMF++Q30HtNFx6SIJ8w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=0UtJwWaLxcuO0LcZQE6toP0jWfy05EyFdf93XDYv62s=; b=Vbz8cD6i2MuvyECqeLJ3PiKXsPgsNknpS1H4TakBXQ2PIrI+IYIEE+pZES/hEsC+v4R7Ca3bECxtDJ7t7k8aztXorTxkKs70dMMEdNqZrh4Atn+n/rzYqknmQFAoh49oRtq7t8HHXiL76JJnoN/XY7VE1/S1CFb2kszNCMZDWlkgB51APjz2HRxtI4y1IfUqAbNV57Y+sYhgQx1s1zUgRlCjuW1LBj8tK831mmemGwb2QmAdOIJrPgyd0ro9isiS7Z1ByawKyKrmfI+WQJjHkywWmRCNqVH8Cb3v5l44eFBYbWhO7A1fTaLV+Id0sNW/L7wvPeCY6MvKZcEPHdJWag== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nvidia.com; dmarc=pass action=none header.from=nvidia.com; dkim=pass header.d=nvidia.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=0UtJwWaLxcuO0LcZQE6toP0jWfy05EyFdf93XDYv62s=; b=dOucWAs89tBZVE678o1pgAOajsUg3X8SohK5gVqsQXtAKPvVC5SZpY1O/ARDIOjeisxC5++5xU87+EmkGoijdD44ycfT/s1xrnshHezLx+kYcfKbaSmi45fDXgwLdHWUmoS/YCBQNcl9UG4qpThwkD2xAjjersXEuXOpy2kWKZGJbMS2xGuPZdQV8NuEgwoB8win2UVZdJXypaKnAF2kyIeSIQoOkInvV2dzkxTrZSmONha1a0JxfPhbNNoFjGLiplhGT0vPmFw9T301NhMT/zzpOSXV2jYur+PfwxcXw9M4AR43X/KjaRJ98QMpUtuEFZBeb/DxHjvj/X3x2O0Ptg== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=nvidia.com; Received: from BN8PR12MB3361.namprd12.prod.outlook.com (2603:10b6:408:67::19) by BN8PR12MB2946.namprd12.prod.outlook.com (2603:10b6:408:9d::13) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4778.14; Thu, 16 Dec 2021 13:47:22 +0000 Received: from BN8PR12MB3361.namprd12.prod.outlook.com ([fe80::4063:6e26:a906:e592]) by BN8PR12MB3361.namprd12.prod.outlook.com ([fe80::4063:6e26:a906:e592%3]) with mapi id 15.20.4778.018; Thu, 16 Dec 2021 13:47:22 +0000 From: Joel Holdsworth To: git@vger.kernel.org Cc: Tzadik Vanderhoof , Dorgon Chang , Joachim Kuebart , Daniel Levin , Johannes Schindelin , Luke Diamand , Ben Keene , Andrew Oakley , Joel Holdsworth Subject: [PATCH v2 2/5] git-p4: pre-compile RCS keyword regexes Date: Thu, 16 Dec 2021 13:46:16 +0000 Message-Id: <20211216134619.2048348-3-jholdsworth@nvidia.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20211216134619.2048348-1-jholdsworth@nvidia.com> References: <20211216134619.2048348-1-jholdsworth@nvidia.com> X-ClientProxiedBy: AM9P193CA0028.EURP193.PROD.OUTLOOK.COM (2603:10a6:20b:21e::33) To BN8PR12MB3361.namprd12.prod.outlook.com (2603:10b6:408:67::19) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 9fb2f639-af07-49cc-bf91-08d9c09a95b7 X-MS-TrafficTypeDiagnostic: BN8PR12MB2946:EE_ X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:2512; X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 9LCNJXRX11fIrWyEUFhcnmhIrMckJn07XNufZ0zGhyochPC+xGIh+KFP9+9/sk3DfCuUd2cm9d7NZnRr9xOUB2Eyyw0rTfnwlbgwN6oSePrk7OS474QKZ+q7CK37Z260WhD/uXlMYNePT5hnrQ4Jy7U50oAfn4S7AdR/z2zLozgv3u2V7JVlRxmlqOwHAQQETTvkR1XoMQyCacTOg4/4sEIQcI7e/441ASPJez2aW2Lh0nfG3daThUh9AjsNXxMCegucRYHKMkbGjGKHCXSQYB5deXQtemlaYZegRgSj1r36hntL3yT9aHevoeCa/vTnNvZNZr03u20UEOZZw28u94lq8oib7Em8s/IgdxXk47MhhZl10dfInUaMnV6fDvJyCsw72TxK4eGM2C7q+XQInxk3GYHpTOzdv/6xa/X+YZU+KekC3WeajAxKxQvcrE5POUe000g4/yDbWFm4RXvyuwdmScBkNA36wPfqbGeE6aqEm9ysFN3B8Bx9MluYRKs1FYsgG5S/uUXLiddJej/0p5TvxaTLiCgTTr6Pv3kjTBbDqRZcGBYwy7nKCPW2kI5dfq2o2m6HDv7GzyClf7Z/0m0eAmeEXKx4nKQHdv5BpVrx9ZbB2NT+AahI/JqKZtU0MCtxOWpgADyLmnBHyeOehF4I+++nRYwv5reUjkNsHY22EYibarP/y1m22b5A8kRpJp/ZMTilxoqid9jzYe1yqg== X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:BN8PR12MB3361.namprd12.prod.outlook.com;PTR:;CAT:NONE;SFS:(4636009)(366004)(8676002)(5660300002)(66946007)(508600001)(86362001)(55236004)(54906003)(66556008)(6506007)(6512007)(316002)(1076003)(6666004)(6486002)(66476007)(8936002)(26005)(6916009)(107886003)(4326008)(2906002)(2616005)(36756003)(186003)(83380400001)(52116002)(38350700002)(38100700002);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: 5u4sQcPqVHOM7CZP339uWuhPphsPVCDabjd7TJAYykRzdKS6MnejDEk8vt9WKC+Ei9x8e2VBW4UUNbIYKCrQWvRWz3SjzRiZaKbKhOUS99sym/U8JIBb9xWkN6Dfccy2tCuaE1Lllta/mUcq/ZGpYHDjriGmUnvR6BHcOZbvAgkbwnKCdR2fFvvuABub0p/Vvp5feah3ooJVAN5RbwVrNRI2T2/mdupHVZv7pt09gCFwaAxXfhxd1Rc/B84T7IAHatH8tqBmxmEVrpjX4kG60CSSq5TZ3rLCr9ySaD6Sp9iLaM4bGB9vtxDgRBqJ2DP0rwH41X+HmFkeFBsqmcY75/lSGeKEaHZeNGZXe/BfPFg7F++oOGIxG7HANeDar4oc7qOlsifbAnQpJrWk7FD6PjvbogUoKWaYj+IrgrwKREEkAFH4+a3fg4x/QHv6D/ipHxIe+qUSKjNBo3YhozztE/XUp+OLaCQIsk8QLWG0UNf+LO4nVgkt4BmtJeEm5uXWhhQJ2bso/maylNXyfzzhFaezmnDkhUozI+peyfo6AXFR2e6mq2Zs1mxnwYSusJQa1itICwKYymUqnIgxOv6KGE/GUnNFiXN5S48xdIzmq9EE/JmOdS0Rp2XZ1P7hrUQS7oz2RB/hj+T9cNhKN+hUW6Ugr72gUjJmNZBWVxaepYwTmjlp07ZjDHo+dZh5NqChCu3aGzQvZhced9PfwSxfZecUFeBMnGh3zZThlOCRyAVokuQb0TxMox3AtgIgOK8wBxn7/qzR7yNZEu6lbZZMVLwbmSfBN0mQIkl+OBXtfBY9nDDsjAC7MvV3W6XbE93xjSZi2EZN1hYnbO3Xlp7URWDPxf2wkPramoqQ5DKBC9e1xK1HxVXOV53xeacnnh492h0baALgpCbS37t8Efd6uXogvJOdlNFmi2kxSze5W3IjgrV42z7uBV713rCQ4lPYFuZhbhMegzQd4d14OOey2HE0DgNk830/TrLTCJfNRBxKSV2mt29V0D7jN3LZH3CDQawIm0ZBVoD2EOs8fQ5uSOkitCmnOrMeSuc8FtgaHeKs0w+IoBsw9KsFQu3os9brnfP81Ie2qgjprnQ9vqZvupu2n1LJO+GbVFBfhs5Nyo8+uBCHy0IssxwRNRHAEgE0yKlPqWbUbF5wevPXo+48lUEIb7bXgVXc01nDxn08mfYHzKZpG1ZwHr2DVNwTb+ybcMj7/OuxsP3F074AsQxVXMd8h5HSh3KpXeCd9S/20D9ofDNCyGFT0WmVYfA2Ey3Lpipv7YDLjMxxDy5pBd3oelHU0DYToHSGUqipjW8J4sImbGfh2GGtr7+eAMR9KjWH8tpIkl/zTOo9U280WR2t7QTTTRYCDUGtaYWV6/DumWifXwNu0LLKuE01w99hALO7F7IE0r1itBNRiAFEQa3q1m+A/sF5QsraIGL+euiRfLXXYzuHJIzF+35eUJbfAmZBZ6gDmYoaq4UNcFknAb0z5Go8czzzzgiY2z+7U8JYyZkQ+Qo8FqW8SnqD5erh2THKEErx5In8Ir6q85KouTetYjhXvf3rUm7iBXgu7ugGlavWS5oi0NuMtG8cnP1scbH0GwmdlkfnSGrjDKts/sdTw29S7RVh8SRgve+8BOiZqy8= X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-Network-Message-Id: 9fb2f639-af07-49cc-bf91-08d9c09a95b7 X-MS-Exchange-CrossTenant-AuthSource: BN8PR12MB3361.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 16 Dec 2021 13:47:21.9979 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: j7ZybHKO/k8EXd9lbHUlP7U74raWA+pVdVW8pW3q8lzvRQTDpd/9xgNZ86CckK3iTMSw7SvkTvNxtC1ZYf1rsQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN8PR12MB2946 Precedence: bulk List-ID: X-Mailing-List: git@vger.kernel.org Previously git-p4.py would compile one of two regular expressions for ever RCS keyword-enabled file. This patch improves simplifies the code by pre-compiling the two regular expressions when the script first loads. Signed-off-by: Joel Holdsworth --- git-p4.py | 48 ++++++++++++++++++------------------------------ 1 file changed, 18 insertions(+), 30 deletions(-) diff --git a/git-p4.py b/git-p4.py index 226cdef424..0af83b9c72 100755 --- a/git-p4.py +++ b/git-p4.py @@ -56,6 +56,9 @@ p4_access_checked = False +re_ko_keywords = re.compile(r'\$(Id|Header)(:[^$\n]+)?\$') +re_k_keywords = re.compile(r'\$(Id|Header|Author|Date|DateTime|Change|File|Revision)(:[^$\n]+)?\$') + def p4_build_cmd(cmd): """Build a suitable p4 command line. @@ -577,20 +580,12 @@ def p4_type(f): # def p4_keywords_regexp_for_type(base, type_mods): if base in ("text", "unicode", "binary"): - kwords = None if "ko" in type_mods: - kwords = 'Id|Header' + return re_ko_keywords elif "k" in type_mods: - kwords = 'Id|Header|Author|Date|DateTime|Change|File|Revision' + return re_k_keywords else: return None - pattern = r""" - \$ # Starts with a dollar, followed by... - (%s) # one of the keywords, followed by... - (:[^$\n]+)? # possibly an old expansion, followed by... - \$ # another dollar - """ % kwords - return pattern else: return None @@ -1753,15 +1748,13 @@ def prepareLogMessage(self, template, message, jobs): return result - def patchRCSKeywords(self, file, pattern): - # Attempt to zap the RCS keywords in a p4 controlled file matching the given pattern + def patchRCSKeywords(self, file, regexp): + # Attempt to zap the RCS keywords in a p4 controlled file matching the given regex (handle, outFileName) = tempfile.mkstemp(dir='.') try: with os.fdopen(handle, "w+") as outFile, open(file, "r") as inFile: - regexp = re.compile(pattern, re.VERBOSE) for line in inFile.readlines(): - line = regexp.sub(r'$\1$', line) - outFile.write(line) + outFile.write(regexp.sub(r'$\1$', line)) # Forcibly overwrite the original file os.unlink(file) shutil.move(outFileName, file) @@ -2088,25 +2081,22 @@ def applyCommit(self, id): # the patch to see if that's possible. if gitConfigBool("git-p4.attemptRCSCleanup"): file = None - pattern = None kwfiles = {} for file in editedFiles | filesToDelete: # did this file's delta contain RCS keywords? - pattern = p4_keywords_regexp_for_file(file) - - if pattern: + regexp = p4_keywords_regexp_for_file(file) + if regexp: # this file is a possibility...look for RCS keywords. - regexp = re.compile(pattern, re.VERBOSE) for line in read_pipe_lines(["git", "diff", "%s^..%s" % (id, id), file]): if regexp.search(line): if verbose: - print("got keyword match on %s in %s in %s" % (pattern, line, file)) - kwfiles[file] = pattern + print("got keyword match on %s in %s in %s" % (regex.pattern, line, file)) + kwfiles[file] = regexp break - for file in kwfiles: + for file, regexp in kwfiles.items(): if verbose: - print("zapping %s with %s" % (line,pattern)) + print("zapping %s with %s" % (line, regexp.pattern)) # File is being deleted, so not open in p4. Must # disable the read-only bit on windows. if self.isWindows and file not in editedFiles: @@ -3026,12 +3016,10 @@ def streamOneP4File(self, file, contents): # Note that we do not try to de-mangle keywords on utf16 files, # even though in theory somebody may want that. - pattern = p4_keywords_regexp_for_type(type_base, type_mods) - if pattern: - regexp = re.compile(pattern, re.VERBOSE) - text = ''.join(decode_text_stream(c) for c in contents) - text = regexp.sub(r'$\1$', text) - contents = [ encode_text_stream(text) ] + regexp = p4_keywords_regexp_for_type(type_base, type_mods) + if regexp: + contents = [encode_text_stream(regexp.sub( + r'$\1$', ''.join(decode_text_stream(c) for c in contents)))] if self.largeFileSystem: (git_mode, contents) = self.largeFileSystem.processContent(git_mode, relPath, contents) From patchwork Thu Dec 16 13:46:17 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Joel Holdsworth X-Patchwork-Id: 12681245 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id 62D87C433EF for ; Thu, 16 Dec 2021 13:47:27 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S234221AbhLPNr0 (ORCPT ); Thu, 16 Dec 2021 08:47:26 -0500 Received: from mail-bn8nam11on2067.outbound.protection.outlook.com ([40.107.236.67]:5128 "EHLO NAM11-BN8-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S233979AbhLPNrZ (ORCPT ); Thu, 16 Dec 2021 08:47:25 -0500 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=nXDoKmzOnmCuv02kkpJnoWSO9ZjqKyL/NHEFU83wzWQad1642m6y4jMM/e5erWiGOz2VBzwwm5qr2h0gSSVYOp/6T5s1TO409ite8fbzLndL9wqIt79RKdHMpkeBpnxBuS4E6G0157qkKevF+ByB+L3QC0k7WPkjm3b5S7TsMfHEuvm56WlYp3FMA0+Y6Yz5BWbDt5G2qdMDFPdRSCfhBT91SYnM2KVI5KhTzkD/qP+07Q73UEey0aBKpnyypPDHDNXFj2dKh0BswwuXl7eKTXqxkraE4mVKUmY3Tx/WGPs1FRBmEy+al/tLfVRfns3HGFeGFICPBLMs3NaNlgjluw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=OCu4H2g+2K0GGL5jT7uNdLR9FAT3fkq0Mid1ja+lPBc=; b=e+qC0EBrgEzhq2a24D+eJPpWgk1BqfQvkiyutxJfQh6BjXfCoRHXxXUz98G6L4kkeOcexHpCDKIrUc6twgHC66OxmRdbBPchVJugLNLpqS6PcNgMcbut28sWUb7aDu9nLslltwQQhBi5w/9zmdAT3iI3PnFD5uHR0J62t+um1hQqnki/1aKjXb1zh+j+GfVZbwpu00it/4UEtH/hRCxiXNp1Ahhg10g9TEXpJbKyR5qnvYIaowEtutD55uBM+Um7LRDlQ2J1CnhE13mWTBSawberDSwYUwQ+N9OhZ3AKJcL3WAaKpEG9fCGCkpvtdabDSwVCzB4JnNwVrU8DbRZ6Tw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nvidia.com; dmarc=pass action=none header.from=nvidia.com; dkim=pass header.d=nvidia.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=OCu4H2g+2K0GGL5jT7uNdLR9FAT3fkq0Mid1ja+lPBc=; b=kuBWRVMAacZRK4TnqPneY303a0Ivy8vcLX1SrLUWeXUgP76QppxydWB6FLFAA7ViMLdNv7n8/vWJXi1SV4fRVg7YePOT2Yc55Csj7nXaNYWEH2eLGmyHX0bZaGcvaIdFgV4jjWk24wwuK3Wxp+ySEpxYb3SUjMmDjj75QAg7hCmjo+enwpbpn9ZRCZdO+f6lR6G+wr1a2TH9U08rKteGSFMladKRevuWI1ivBUgobEG6AnyuCPS3+J9wdeh8jFPcgMH7823UrjFO87LXH/byGIb9weYT69NXQa3MPmfN9tnydlSFCIGWm5JCKkkRdN1XH33YxM7DrmZ8UeJpu77j1A== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=nvidia.com; Received: from BN8PR12MB3361.namprd12.prod.outlook.com (2603:10b6:408:67::19) by BN8PR12MB2946.namprd12.prod.outlook.com (2603:10b6:408:9d::13) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4778.14; Thu, 16 Dec 2021 13:47:23 +0000 Received: from BN8PR12MB3361.namprd12.prod.outlook.com ([fe80::4063:6e26:a906:e592]) by BN8PR12MB3361.namprd12.prod.outlook.com ([fe80::4063:6e26:a906:e592%3]) with mapi id 15.20.4778.018; Thu, 16 Dec 2021 13:47:23 +0000 From: Joel Holdsworth To: git@vger.kernel.org Cc: Tzadik Vanderhoof , Dorgon Chang , Joachim Kuebart , Daniel Levin , Johannes Schindelin , Luke Diamand , Ben Keene , Andrew Oakley , Joel Holdsworth Subject: [PATCH v2 3/5] git-p4: add raw option to read_pipelines Date: Thu, 16 Dec 2021 13:46:17 +0000 Message-Id: <20211216134619.2048348-4-jholdsworth@nvidia.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20211216134619.2048348-1-jholdsworth@nvidia.com> References: <20211216134619.2048348-1-jholdsworth@nvidia.com> X-ClientProxiedBy: AM9P193CA0028.EURP193.PROD.OUTLOOK.COM (2603:10a6:20b:21e::33) To BN8PR12MB3361.namprd12.prod.outlook.com (2603:10b6:408:67::19) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 8cdc11b3-ae21-4b92-d590-08d9c09a96b3 X-MS-TrafficTypeDiagnostic: BN8PR12MB2946:EE_ X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:1468; X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: +cYBTMLo0eFx2xz8Y3ZiBg/yi/x5VRuXhTL+XTZXxUya5YENTx2bBCGwgyrbUyhOSDRClctes/g7wuyZwESun/wjxNf7L+SM5+/JnMv38fXixb82tJQpC/p6qpbyO8tvQJGpewJT+RqwYI7sltrIzbjdY5VWbf8Gjkt11Y8exm5GHOwAOz+a7dD4Amay8jzTYsmKyRl3+sQUcRu5Hr7NeCSzVKGIgr0bXuekk0dPEUJF0Ne8EoHDVPLdeOnUe5rY01cL1MfUk5WJY0sRJ2zu5JahZHDrnzoX1aCYezhBQHIT0PjvEUs0mwlOZ5tXOH6Tk54t1QIkKaWwo0nkR72FAE1cf+S/5UufujRTrkTBTxpalzAPcygQUAaj7KtZ0B1kXaDGeudAEaw0vrlfOaXC6JVZL132uNcEVW1EBcSUH/yOWp+xCKZ2krkYCaPDKYKNM3PNHRXT011+Taf7ysxxuep1zGGtnh8nSb1rz2pKQXQeOYI+UEcfUwTH8bneUz40mEvXDhcX5PZGIpXjBGAuf4nAfaYxLn2TGR44rBhgj4frTA5NmwCKVRkU1uLbSHhUQ8rYXFYHis9BvLEKP6KMdExg1+6QwKfcgu2rLDkBffe2dTXORYnd9wp+6vg4cBVtwv5JhiZmXyHVsjB9iu/G0SF6hO2Gyg/mYafARV52aPT6UAMfUhKKSrkJ7zJmU6l0FmEDia7VrL3rhx0Wenwklw== X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:BN8PR12MB3361.namprd12.prod.outlook.com;PTR:;CAT:NONE;SFS:(4636009)(366004)(8676002)(5660300002)(66946007)(508600001)(86362001)(55236004)(54906003)(66556008)(6506007)(6512007)(316002)(1076003)(6666004)(6486002)(66476007)(8936002)(26005)(6916009)(107886003)(4326008)(2906002)(2616005)(36756003)(186003)(83380400001)(52116002)(38350700002)(38100700002);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: fGZEULKzg5aOZ/F8zwRi+d1MScqZWiWQvlJ6lsxFiS0fN4qeRbPOQTlrup3sGmCioLoLPHYkS+trwZom5Ys+WddT5QcnsX1SBRUSsulzso74E9sQ48fs3VRPnSBFNg+BFTARxqyT3iZF2r/N2Hbsobhkp80EQfdFvzAxqP0AJuFXudfjzh8geo83QIg1gxifEkKWBVMqR2/ujPKjIjdjlSjYppWDCT3uuY/sRau5ZmFKFY+Vl8ZKAhsWx8f30hM6ie6THADVt0vQgxOVRKh1NQ0gYW9NYqRRITPg328osnE6eAa8/KHOcY3jmofcTxPKRYxLM5X3nAA15/HYHPuzSvF446BpIXyDFzAjAnossj7BI6d9pCky0ynCzmWR5dvYCxVxZ8no783XbeLr5+uDinNn41oLGA7P0tg8vX8+t6MEPSXUG4ezckTGOLzib70IUrMdhCCeUM09skQYZ6bDDuoVg6oqhJfYixAnHjB0dUe/VtX1nZWCqfxk02p47h14n7LgCdQ0T69I49f5JdEnNMvl0nTbwg2iqCukk30DoVPOQ8WIx8dqxYDA44F3JU+1CpT48PKW2Owvmr5j63httB7P+c5v865MX+43h1zksUGQt7/PdfJs2Ql/nN0DAJs3JYDkjKwd8pgOUiLc2VdxEBI79qxLS8JNg2SOmPW4ni8atspW2eDUK9RC12byzuYRFtMs3FGk67z5RdF/herxI32pFuq6M4fNKon7/DbCPZKazXU9fRZUwzJGIwgqcg5miZ3wCZKItgVEyGXwvjR9aPzB9i9inRE8ptbeQqjTzAzese9KoUQNr/Zm0mSUjPuMKarpugFd4vwSiiC+DOwIBko53TcL7A4tR5TsgQ3Oa5WAqaODffeTNOCgJMl1V1eRK7MSLosi7ixdK54cycj10bOGmKu2hlJ98dlPbyci2Nfs077gDa/FDmgBY5/EAEAglaD0iSg2f3WO0BS+myP2Gofu2oFAQMz8Yh7xXOWPqVOqcm9No9Gc0tU2AvIxIdy27DNclMKlAY2ynXKmFQwdpkS8kpy0HeDloyS6LyzjyORULjsJIL4645MYyr2Ip1CJkOTiFTcwB0xdpNOnuQJ3geqSukUYFW+xBImCT3wFXCKF5RvS9NG8kijg38KqgLl5z7qmFT2MLD6ymk4BMhNrM6NMQfzB7wnzuutqb2D3ITWncCORwHhS0wT4YAmngC8c5hXn8gcIcGngcyTomOy7iqyKxwYytAKgzz8tXc7Um9yiz/jcWDpoO2PbPYHGkHD/45PFrsWMJl96rc6mch6fdsw78V+ruZte6Tv6zQ3IUz+Qv2FuxaZMAhK6Dak8/DuLo/z80IIopkqvbM1ufkXuo+G8avDIuv7MnY93wuXHaB7NSxa5Vc1D8kZ8WJpQHs1QOSWI6k5VMN1juFswkJyVLFllLEkbWG5NU0Ut3Whm8dL1KqI8mIlE8Vsmrt7SIq8K4ebv3+U4tr6MraWxMgOcOSS2RU2Cielp0eDya9LSBMbM0jJ820A0J+g60hFdz48eZMgdojjKdRyf/2JRdyZM1M0ONIskQeq2NEd+AiYH2K0RWiIGJq4q0jD5KVJCNPYf6sxZ9nuSjM6Ieb/ch9G4CqbbmGwiZ/wQUrVcyMiewS8= X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-Network-Message-Id: 8cdc11b3-ae21-4b92-d590-08d9c09a96b3 X-MS-Exchange-CrossTenant-AuthSource: BN8PR12MB3361.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 16 Dec 2021 13:47:23.7669 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: czcjOrnjvABvXFyp3qm/YZ3Rkn/m9lSe6Zd1EN6EMy2zK5WAuCgQ43jlPHc7yeDtt0Ut0Cg9nlP5ypB2/kGQuw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN8PR12MB2946 Precedence: bulk List-ID: X-Mailing-List: git@vger.kernel.org Previously the read_lines function always decoded the result lines. In order to improve support for non-decoded binary processing of data in git-p4.py, this patch adds a raw option to the function that allows decoding to be disabled. Signed-off-by: Joel Holdsworth --- git-p4.py | 8 +++++--- 1 file changed, 5 insertions(+), 3 deletions(-) diff --git a/git-p4.py b/git-p4.py index 0af83b9c72..509feac2d8 100755 --- a/git-p4.py +++ b/git-p4.py @@ -340,17 +340,19 @@ def p4_read_pipe(c, ignore_error=False, raw=False): real_cmd = p4_build_cmd(c) return read_pipe(real_cmd, ignore_error, raw=raw) -def read_pipe_lines(c): +def read_pipe_lines(c, raw=False): if verbose: sys.stderr.write('Reading pipe: %s\n' % str(c)) expand = not isinstance(c, list) p = subprocess.Popen(c, stdout=subprocess.PIPE, shell=expand) pipe = p.stdout - val = [decode_text_stream(line) for line in pipe.readlines()] + lines = pipe.readlines() + if not raw: + lines = [decode_text_stream(line) for line in lines] if pipe.close() or p.wait(): die('Command failed: %s' % str(c)) - return val + return lines def p4_read_pipe_lines(c): """Specifically invoke p4 on the command supplied. """ From patchwork Thu Dec 16 13:46:18 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Joel Holdsworth X-Patchwork-Id: 12681247 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id 9269DC433F5 for ; Thu, 16 Dec 2021 13:47:30 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S234501AbhLPNra (ORCPT ); Thu, 16 Dec 2021 08:47:30 -0500 Received: from mail-bn8nam11on2075.outbound.protection.outlook.com ([40.107.236.75]:16001 "EHLO NAM11-BN8-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S234161AbhLPNr0 (ORCPT ); Thu, 16 Dec 2021 08:47:26 -0500 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=HdE6WRQ9IsPPXtXByMtEiihyHr7NOO2iY4nZIjoGaXUIVv6Gemyc1QkKkmHhuDd/3tCtz/lAA47b5BIpPvezQRrF+kjFXufB342EZxVhOMSZCF8wCNsJ/kygwo9ywAWvtaLei3kBX4trO3RDlMnwjR9GUawUsGWM9NCBzJWxvMXUp6FQkdfiw0/IwWnAQljA+jYUBPv8rnLNxSKDbo7mQDy8bAZrD2ni402r8FCCJw8aEu9/hTv83hovvCSByGvsRw0ErGzT8VlIA4NkxzWQTSNPIh4ewHA3wlGgCgFxbfCLa277pjyV6lV1HrnaOb+1Z0k/BQBsaKio//K7NH9kkw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=qnWs/DoFjkwU7fMlfgYt0Z/TrrkGdvPSkOgyur/7H5g=; b=eDwESMmtmZN82Gc+oDOfzI0ZqnQERTdqdj9HZX2Yg4ExUlQZh0AUMvQYjEnq7QQyvR9hw62fVRjo7s2QgE/upvpfc/ZmS9M8pSxqoulX1L3TmiiDqt9u/vFapE0QAtemH1QCfvS7UWZROeu3ltv7AcFHBVSFtup5LuIOAYinXMmeS6XlhWK2yDpNm24mMALC6aCnQRucFuQOVgFyprhDb/hE6Jf79bBzNlI+vUCIP5hf3MIgxPEQZo50c+o4JUbkmJR340op8Cr9xq2/qG9OecbNG9UMpZx6gWfK7+p3wLdO7wj1N/LwJmdT21F7qsIfHOfvJuR9nYUGBRekvBbfDA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nvidia.com; dmarc=pass action=none header.from=nvidia.com; dkim=pass header.d=nvidia.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=qnWs/DoFjkwU7fMlfgYt0Z/TrrkGdvPSkOgyur/7H5g=; b=AWo/2RiCYeDDF2K2Ab0UAnpBlndvO2wQaF754LHqDHdIzwPXnbZZvuYU/qOVnbs5cH7IumlIqJEBey/R9tcUySZrdHL1LWhxTQoZtDVglK+4XeZOF38fXV0dqxtxStpewB85sJoJRpCMgzKXzkz4F92YpyX0ihPC9+XHr9AwdNS2bfhmFxZRHI4x7knxm6sEv1XyTkbCK9AuqKtqeHRp+0bi0QX7XydZY+ACftJqbYiygo/hY4lP4Kkt9S+uxRuqemv0XcDzAoOoFsl3wcpjl9wzMegU/YN9Tgo5QGAwKa0NcrJhOJKvhWVYm9a2ERp7s9RfQUzqLLgxWjTgh1MTVg== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=nvidia.com; Received: from BN8PR12MB3361.namprd12.prod.outlook.com (2603:10b6:408:67::19) by BN8PR12MB2946.namprd12.prod.outlook.com (2603:10b6:408:9d::13) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4778.14; Thu, 16 Dec 2021 13:47:25 +0000 Received: from BN8PR12MB3361.namprd12.prod.outlook.com ([fe80::4063:6e26:a906:e592]) by BN8PR12MB3361.namprd12.prod.outlook.com ([fe80::4063:6e26:a906:e592%3]) with mapi id 15.20.4778.018; Thu, 16 Dec 2021 13:47:25 +0000 From: Joel Holdsworth To: git@vger.kernel.org Cc: Tzadik Vanderhoof , Dorgon Chang , Joachim Kuebart , Daniel Levin , Johannes Schindelin , Luke Diamand , Ben Keene , Andrew Oakley , Joel Holdsworth Subject: [PATCH v2 4/5] git-p4: open temporary patch file for write only Date: Thu, 16 Dec 2021 13:46:18 +0000 Message-Id: <20211216134619.2048348-5-jholdsworth@nvidia.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20211216134619.2048348-1-jholdsworth@nvidia.com> References: <20211216134619.2048348-1-jholdsworth@nvidia.com> X-ClientProxiedBy: AM9P193CA0028.EURP193.PROD.OUTLOOK.COM (2603:10a6:20b:21e::33) To BN8PR12MB3361.namprd12.prod.outlook.com (2603:10b6:408:67::19) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: e0ac8f88-290d-4dfa-9c26-08d9c09a97c1 X-MS-TrafficTypeDiagnostic: BN8PR12MB2946:EE_ X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:8882; X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 0VEpYYG2tv9r783io6OS+U+KQt1cqZdFqxIiHaCvBTjlvWgBqLkie5OIWI5wpj4NKJXBiWg7wCwgSl742dvWhRu5XzJH59adWKGdnJuFdl7iyPYTjsAfNXujtNYZV5PI+85DwESoUfAvJ8EWzi/dge6qdwGE/aKP5Qz2jbevzF6fx9HhEsRaZylsPnu+BYxOuTPglIsZ5CZE5/2dQoJzkMEi1BlEcXqjwtKoeDgjD/IDb3p8xTX4EmbQzSgkVEhiRivuTh3rzO27sWvoO9A221RW0TU12t9jaYWvJMhclmE0jufK6Kzc/X1MfMddOhfQV55MEV0LHzaw0HhhIfTbGta6rlvrE8qq9v3YnZ0BQIy6NtME2AHPdUAn4bZ2X6P06N9udnt1hvh1cewZQZjRzSYjwjBYrwxTDkq0Uyo74MDTuM47XklmUbAC4gC1PvlS0DSdBOUF8bpNCRWbzrNestbjijDJg/t4gbU8QAkM0E4jGwpnurIQcrN+Y++UshZg2BFz9K6dkYbSsSgK15en05xvPUbBTiVwd7MaK8l7maRi+PoYp/f5QycgRsETozPE2zZJanZ3zLTjRM8NEbVafz5c8sOuyiZaYLbmLZDeLBr2XUS+0NYFDaBDIh4+1w3EtVAUtRwfmnnvQBvYllRsL9J7mIt3bcMxNULB6KRDpxJcHuPUTWUlmk8TkVv+6XQQDN64zQnCktJdX7aKZyvmJA== X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:BN8PR12MB3361.namprd12.prod.outlook.com;PTR:;CAT:NONE;SFS:(4636009)(366004)(8676002)(5660300002)(66946007)(508600001)(86362001)(55236004)(54906003)(66556008)(6506007)(6512007)(316002)(1076003)(6666004)(6486002)(66476007)(8936002)(26005)(4744005)(6916009)(107886003)(4326008)(2906002)(2616005)(36756003)(186003)(83380400001)(52116002)(38350700002)(38100700002);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: QJyQkZ6Fdr+MvT9Zx+Xcy2oOUY5QNNL0HIRO9cDzg4j66zpTYxOOvoXgEypEI+bwoeHg5rOk5+ddKWMqwYRdEkQ3LLFbToK5MfBGIrVYg+DWYiaZyedce0rTyl+voxQ6/ZHH6s6SVbZr9rOXPfT9oSR7lB/d5HDIWOlbcUr1zfbuXPhAqLSptn16L+gaPuXQHmEysZrYGWAQ/O5ZHrzbCJMKjCYVnqGkErLju/W2hv/SPT3UQU/plTPS/5C365geVlM8OCLIpk0mrl1fI23OANw8cg/xPPg+KXojr8USyIp+WYMfLh/jisDS0IMc1K+1oSQMer1Oyl5RG5bEEsSDdKKQzkQXMl20g0P2u6aKyoUlolIedMmdiwgrirTCCIN3MuG+oFoV0zUftxwM+wU9J+xGnEK+r7mj+Ueu1pOeFsHmI2dWil+3QI87r06UfEquCEMNTYa+Hz8kCWYywuQRsxfBa9rQ/z3sd1vQ3mvIy5AhJq1+Y6aJO/fN7e7fn5gGQuczbMF9eLLruMXAmGhJzeaaQP77x59otps3SFau57gDkAKKlccYIVvmbVmbPNHpe9dkHOaQDQEXWzBuO//eDsvv6hrNcLI58N2cI23nBxXxkeOaPXSs7C5hKnH1OOQgmqsXW69S2Piendp/wRPWsdON8JBqbMMtV3gmE6ulp/DW+PFPvXFWeM7s8l2ZCTQcal0DpAcaxnss0tgycj1qzxD26lNiMM/rzmFdXEH7rQ+JORyLBYfpCS4Xzszbctfj1//+3mM0Ky6oUa3o5zqCeHHiF6U17YtzsIkegbg5/iPYVeL7XYOuWYur+NNyNjy5WTH4qIY+wfGzeQ2rGJSH8dV/6oKUA2cM22xRu2a1JlIKufwJgtMYn28hVjN6fTBYpO6971EZM4CKY473Iz9Nv2U8mUJYhAG+VYjE0pCzdWttseat38p2Pu62uvUKvxOz5aUJw7BJzlRRZwE8Z2HsQhsrw+OjfRSBI0RwgDHnme0tUmAKQMJGZJdS593P0hdxNtfPCglNvOwMxQPoy5j40uTlI+8UAnFX7rhIyMMZn9zguwimcpSfFrqEZXEfxhvdzd5OX45SaG6ZHNTgghxHBNVrfidlAIfpEiKM2MW7kcm4rGgVPNUForV/linH64qbV58jlgLlCYRfpmsIc3TZH2uZs4kwOexcUdOO5EFSPpgIucqsdbqD/1zqcbiobQPClUUTKFCWRui18+uQv44ztOufWqTo2mHsJGyQUc3Gto9cTh/dPrrkiTcHCYmoPZEB08nULYzgWOYIIUn8wPMsi7J4++I9SXxxAZbrYnmJCgh2FgQfvOs0pCtjMp6m8q8hsQXznXtR2/i26gcNmZs3nTvK43NfagPAtcFvq4qNAbkl0OYSYt6fHMNGg0n7tTA/AKi/Hri9JEq0e5we4Qa3rSI+ou1XsE1k5B3UXl/qZbuV6fS6itSyYaJrgN1hnW3yNy5sPH9mFv9tBUiFv31Te44wxZuCyOxRB1QzRl7ec2zHYHYO41QleAtdfaV7/to8PlRm9Bu83PNllRyH39yTUi6k0C03p73Fil34mDR3Q70CmgF3fyQL/d98RoMf3cN/IW9TV2FrkNb7XdnkEpagIg+YLmmg28bf3Why7CAitSE= X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-Network-Message-Id: e0ac8f88-290d-4dfa-9c26-08d9c09a97c1 X-MS-Exchange-CrossTenant-AuthSource: BN8PR12MB3361.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 16 Dec 2021 13:47:25.5599 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: Oc9/eIeMK7IbEtZtTvfimDkB2zP6Cp+AUBwjCwOOJo8XuIBpWZ8oe5MqZILl/IS4+SRhlp/gbDj5fY5iOLiMxg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN8PR12MB2946 Precedence: bulk List-ID: X-Mailing-List: git@vger.kernel.org The patchRCSKeywords method creates a temporary file in which to store the patched output data. Previously this file was opened in "w+" mode (write and read), but the code never reads the contents of the file while open, so it only needs to be opened in "w" mode (write-only). Signed-off-by: Joel Holdsworth --- git-p4.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/git-p4.py b/git-p4.py index 509feac2d8..7845210e69 100755 --- a/git-p4.py +++ b/git-p4.py @@ -1754,7 +1754,7 @@ def patchRCSKeywords(self, file, regexp): # Attempt to zap the RCS keywords in a p4 controlled file matching the given regex (handle, outFileName) = tempfile.mkstemp(dir='.') try: - with os.fdopen(handle, "w+") as outFile, open(file, "r") as inFile: + with os.fdopen(handle, "w") as outFile, open(file, "r") as inFile: for line in inFile.readlines(): outFile.write(regexp.sub(r'$\1$', line)) # Forcibly overwrite the original file From patchwork Thu Dec 16 13:46:19 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Joel Holdsworth X-Patchwork-Id: 12681249 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id BBEF9C433FE for ; Thu, 16 Dec 2021 13:47:33 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S234626AbhLPNrc (ORCPT ); Thu, 16 Dec 2021 08:47:32 -0500 Received: from mail-bn8nam11on2089.outbound.protection.outlook.com ([40.107.236.89]:46689 "EHLO NAM11-BN8-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S234473AbhLPNr2 (ORCPT ); Thu, 16 Dec 2021 08:47:28 -0500 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=lEIwlGM1gXk8IEsU2fgSH7mncGwlQC4tCD6ezyunwcFT3Dtq+jLJ2libYcmfcmsB6TN18hVIJMnrn+pz2DeLUdOyY6rbsbJethynCK474VzdmSjgWbu0/B29xAP7fPpGJqQRUe5IMlxt4DrXsW7iGTiMXSWK6MqUWq43K3qdD3nYZi+6Td2B5E4Kux97tZfyrZ04Tsyu3ZFQ4+fa/YoNyczetrOP+Owb2Xzm0qXx6/biBTR7XbD2ac3T7EwFwIUn1VQdOHlnxKBC2XXb/q1nyVMxLb7UQQVa36SGt+L2PMrdMzwXxOU3GaSI5xM0D2Vm42+UnA0GfU34ILcsmmXDkQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=cFaeKCgJ+164wJpamcTyx+jAqUbfgWut7lg94cgI/1M=; b=Kk7ZLSddgcoZjQ9A3pJmIc+rJ/0SmfM01jiSs21Ts27JPw1RCU7qOUP5mnvzOY+1FDbXCuR+gufLzjdBfHFQ3ZOn976+xng+jhthi7s19op73anF+VVZDRb5MJrn2AWQ6brQTdB1NY70XwDiOSTxKGVaoM1oLhtxqbs+P+hz+XKVLBHzOC0Kb2kiOGsH1DgO+OlBAlrOXwWxmFzFYSVFyn7davL97a28UufQUSMfz+nExyXo6/ZGv3vV/4fDUhnK6z60S0DfJO6rLDydp8/oNXqCqQjv8mWPfzEuJeXTGjQuqR8lgUVG/EJ0e12YetPneexK3y9fCQAtXH4y/DUcYA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nvidia.com; dmarc=pass action=none header.from=nvidia.com; dkim=pass header.d=nvidia.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=cFaeKCgJ+164wJpamcTyx+jAqUbfgWut7lg94cgI/1M=; b=RkGlKcYh4jZngv7hwaBl8E1XNq248sDD2uEgUr9kPPzOt3Se/87t4idophWmm+R9xgVy1xulCWne1jPvCfikE0DIMJp0ALuOHkf2GQsKD6e6LeCEaN2EUjtC2Fq3NuacLCgzAhut6wXJ2GpNKYWia6B7CRfmVWFUVTE+BzIBOCuhsUvQ8x9ej0Lhpl3bb/qy6sOPPcwcrP9094fnoXLIgutoLG4OCVtGlHf2pKqIjRJfnZn2+y+rXTLsMsyTc9pWrEcOBYAT5rcLLIE54d8kH24wPTk1zxRBrAZxf0f58kx3eJsVucRO8dhJYqvgvVy1SGiOpBfEyr+v2h7Le3u0cA== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=nvidia.com; Received: from BN8PR12MB3361.namprd12.prod.outlook.com (2603:10b6:408:67::19) by BN8PR12MB2946.namprd12.prod.outlook.com (2603:10b6:408:9d::13) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4778.14; Thu, 16 Dec 2021 13:47:27 +0000 Received: from BN8PR12MB3361.namprd12.prod.outlook.com ([fe80::4063:6e26:a906:e592]) by BN8PR12MB3361.namprd12.prod.outlook.com ([fe80::4063:6e26:a906:e592%3]) with mapi id 15.20.4778.018; Thu, 16 Dec 2021 13:47:27 +0000 From: Joel Holdsworth To: git@vger.kernel.org Cc: Tzadik Vanderhoof , Dorgon Chang , Joachim Kuebart , Daniel Levin , Johannes Schindelin , Luke Diamand , Ben Keene , Andrew Oakley , Joel Holdsworth Subject: [PATCH v2 5/5] git-p4: resolve RCS keywords in bytes not utf-8 Date: Thu, 16 Dec 2021 13:46:19 +0000 Message-Id: <20211216134619.2048348-6-jholdsworth@nvidia.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20211216134619.2048348-1-jholdsworth@nvidia.com> References: <20211216134619.2048348-1-jholdsworth@nvidia.com> X-ClientProxiedBy: AM9P193CA0028.EURP193.PROD.OUTLOOK.COM (2603:10a6:20b:21e::33) To BN8PR12MB3361.namprd12.prod.outlook.com (2603:10b6:408:67::19) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 8989b1d6-3657-4e3d-6229-08d9c09a98d8 X-MS-TrafficTypeDiagnostic: BN8PR12MB2946:EE_ X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:5516; X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 6R279IMyXcPU/8S3Y9/voUn7D47QjCtE2EPOKZdRULWZZGlGP9iaDBzo/v3P8JemSdEC+LQeegElJB/SwjhBYKC/BITuoAr4zxRonRDodHuZhTkXXbJqUNGC2ygdvmNw9fxHdE7gnhh+CFJoIM9wE3no7gHnD4HXPW9Yw1asIll+zy+wfy9HTBHKc94P129nu4DYzrPPzkHT/ajzId7e+arth/4TnlYveLCZA2VjHVLfwHNqTutyI64oFTT1hKqgrZMUSp0yAAHf+iP3kZu+EHsNPWoc87Xt30dllGL6YD2mUETCVLS7pK+bpPj/yrsw2WD+dOrk/XccBHoz3olZTtoE8bTk8Ccty4AflfyHKAi6EGUYYNm6ovMNO8n/RcYjnHe4nNZigrxriHFI929ggZiHjDv1kUFPt66FLRvR+Dl4HlDHT4f8DhZmOa3GW6o0NX2TlJfx30kYj7501sSkvrcWlDn8dl7y6/9hdNtPXaj14nag5HPaOvHlkO6UKWoPaFXaw2NCUYmVM3/nKA04ujxbgq/m1YebrHac5L51NWZU7DEiOLrJokT6eXexEtRw/kvTZJ/t9XpYXREc5IQ/Heyv6gkpDuv/tLFUDFwUzb0zN7hWN1Yk7HYXDO7KaZOCBIRwpItO/VG9g+oopBoCqaWyM8fJ8fR8Oh1oVKFH7nfMADhMpcsqT/V5DawuNT6DJoVIGKZ44VhcMSzizT8mZg== X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:BN8PR12MB3361.namprd12.prod.outlook.com;PTR:;CAT:NONE;SFS:(4636009)(366004)(8676002)(5660300002)(66946007)(508600001)(86362001)(55236004)(54906003)(66556008)(6506007)(6512007)(316002)(1076003)(6666004)(6486002)(66476007)(8936002)(26005)(6916009)(107886003)(4326008)(2906002)(2616005)(36756003)(186003)(83380400001)(52116002)(38350700002)(38100700002);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: KzPqi3kjfQkYHHdse6Z2N0g35sK47c7kHq3M21qTVluV1yU3CcyxoVZ1IdmlGfLhTqwXuPnDiZUSHLRIS663wGOzLN7Me42yspxLksqdAuX2HD4LcIne+C2iYSLRmI/4SQeq/YZTqX8S6YpsAkeJBOxt7RGbvmeHhV+4399Ng1PeNSbiyJypQNHMh4M5MxJVsEO+ZNqcD49EElqD58k7ffCqKDasayFRGDAZiDDOzZlpudRnTQHhFzHAGM7jemOUSJY4ahEKZUbJZsht6DDaO2g6tR4DC6RymJ8f2hGRrVhYpKFK2P6RpEPh76cvrbtmWWfNUnlyl7U1yiZD4rutd5O1HyLm85Y6zfVmrQ1ehlUV8lhz5ablONCN91nqoB2JIEldGyRjZXNDKWHQIP0ri2pRfo4qK2wjO8OOr7h0B3bAURF47BcTkQikd0WpmAhu+7e00u5I1RXXjwOusvEiUlywgM9WyDnMvxcMuVb1yoiMPzMEOe8CM6h7xlen7OB2Zr0wksrOTHarIbgrQhlWqN4ktNwP06ugZ+SqnzHmreJBU13GNPPsbDVfq8qEXvPEep3osF/s6AvFrByxPxy6VLl+7ZV6CskD6/t11ahRX2Jmp1O3vQaNWUw4OKqAzwmIM9FrHqsbtutgLDfuqAbOQRHBrwXasOUUAL0CKD+wTU4gVYoj4VsxlIn3iY2jvwS7CMW55zyIBRpxI1z1uKiBBB2UJQppgwJH7Hbs9hZBM8Vsw3mYH0vl+l8mGUhIaNr3xs5hMnMw+V9byVQ6F6ICFjWaMspBTljg7uNciwfH4BIUByUz4gEVXVL0Kng3ZMstmVkqgurG+wEHRtKqQrCViEuxUOvsk8aZdV9hvZF+/kUsFL0fcSshk2DYmYNSAnyx5rWXrMeCums6JgxsrU04I6i9HLB2s2PsKq62VQewQPNJECUyNLmXFYoBwQIHMWhA8FIqW5y80BY8B/lrjIIqQZmGAqsP9djLVJW1sk8Ix05qudOpyNL0OkETqV4O7pjOuGA3edWBfN3pzLvygSLZyLaVvOKLQyRsX0TehF9UoZ0wuIDMxcDVknW2Wrt2vNeVNO1jwWBt3lGmmE2+r7iHeCHgfJaDqN5jegat4HR8bMPt9nqlozsBvIfDjR8EoEJ/d1NIZxqs6K08Ba3t6q07WhKH6Ys0Mvc6GfwNTNnXva3xbrJEWJQ5RCqgySuPCeNXEXDSmWujVIu06+FJEuBPcYRJMZVf+80I7ATJiqQYVmc7rslAU6XlBSkvbXrVvH+Jk1IAY8TSMnBLbLzCkq0teWOPUoCce7zfNh7KZ/mqFGHKASYpUq6EdH/VCurk1AZhk6XHD66Dri7xp6ovi7urtlJ1NozmxOSBb0/RFrPYoM9OcGetOL2yohXw65uQe2UIgzhqIZEUu5R4GAXKLjbQSvrIcw+b/hXZkv9QQ2KkE9wI0Jme/aH6wA3/wzGAkcSJmSUH6GnV9Wo8TcrtpMTAJNArQ1dLKpjXuSrvh++R0ts9VdxbbEYHyoV0252D3ROw1R4ciTNDDZlGNaMKfHX7S/tmHHosCw4Z82+pomCoT33fVtnm+Lpl2WiAujLfWxTWHqhOJ/idD2dDbr3ktjD4CAmg0J8q+A5U8y4lMN5kG04= X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-Network-Message-Id: 8989b1d6-3657-4e3d-6229-08d9c09a98d8 X-MS-Exchange-CrossTenant-AuthSource: BN8PR12MB3361.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 16 Dec 2021 13:47:27.3698 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: 1jjFN4JshMcvdFkwx01v/dNQh+o0+MRLPm6KyqTpi15GoPzg/DLKuPumHRsPDr7tKF8MkAcUezw2pLsxeaT0yw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN8PR12MB2946 Precedence: bulk List-ID: X-Mailing-List: git@vger.kernel.org RCS keywords are strings that are replaced with information from Perforce. Examples include $Date$, $Author$, $File$, $Change$ etc. Perforce resolves these by expanding them with their expanded values when files are synced, but Git's data model requires these expanded values to be converted back into their unexpanded form. Previously, git-p4.py would implement this behaviour through the use of regular expressions. However, the regular expression substitution was applied using decoded strings i.e. the content of incoming commit diffs was first decoded from bytes into UTF-8, processed with regular expressions, then converted back to bytes. Not only is this behaviour inefficient, but it is also a cause of a common issue caused by text files containing invalid UTF-8 data. For files created in Windows, CP1252 Smart Quote Characters (0x93 and 0x94) are seen fairly frequently. These codes are invalid in UTF-8, so if the script encountered any file containing them, on Python 2 the symbols will be corrupted, and on Python 3 the script will fail with an exception. This patch replaces this decoding/encoding with bytes object regular expressions, so that the substitution is performed directly upon the source data with no conversions. A test for smart quote handling has been added to the t9810-git-p4-rcs.sh test suite. Signed-off-by: Joel Holdsworth --- git-p4.py | 15 ++++++++------- t/t9810-git-p4-rcs.sh | 15 +++++++++++++++ 2 files changed, 23 insertions(+), 7 deletions(-) diff --git a/git-p4.py b/git-p4.py index 7845210e69..986595bef0 100755 --- a/git-p4.py +++ b/git-p4.py @@ -56,8 +56,8 @@ p4_access_checked = False -re_ko_keywords = re.compile(r'\$(Id|Header)(:[^$\n]+)?\$') -re_k_keywords = re.compile(r'\$(Id|Header|Author|Date|DateTime|Change|File|Revision)(:[^$\n]+)?\$') +re_ko_keywords = re.compile(br'\$(Id|Header)(:[^$\n]+)?\$') +re_k_keywords = re.compile(br'\$(Id|Header|Author|Date|DateTime|Change|File|Revision)(:[^$\n]+)?\$') def p4_build_cmd(cmd): """Build a suitable p4 command line. @@ -1754,9 +1754,9 @@ def patchRCSKeywords(self, file, regexp): # Attempt to zap the RCS keywords in a p4 controlled file matching the given regex (handle, outFileName) = tempfile.mkstemp(dir='.') try: - with os.fdopen(handle, "w") as outFile, open(file, "r") as inFile: + with os.fdopen(handle, "wb") as outFile, open(file, "rb") as inFile: for line in inFile.readlines(): - outFile.write(regexp.sub(r'$\1$', line)) + outFile.write(regexp.sub(br'$\1$', line)) # Forcibly overwrite the original file os.unlink(file) shutil.move(outFileName, file) @@ -2089,7 +2089,9 @@ def applyCommit(self, id): regexp = p4_keywords_regexp_for_file(file) if regexp: # this file is a possibility...look for RCS keywords. - for line in read_pipe_lines(["git", "diff", "%s^..%s" % (id, id), file]): + for line in read_pipe_lines( + ["git", "diff", "%s^..%s" % (id, id), file], + raw=True): if regexp.search(line): if verbose: print("got keyword match on %s in %s in %s" % (regex.pattern, line, file)) @@ -3020,8 +3022,7 @@ def streamOneP4File(self, file, contents): # even though in theory somebody may want that. regexp = p4_keywords_regexp_for_type(type_base, type_mods) if regexp: - contents = [encode_text_stream(regexp.sub( - r'$\1$', ''.join(decode_text_stream(c) for c in contents)))] + contents = [regexp.sub(br'$\1$', c) for c in contents] if self.largeFileSystem: (git_mode, contents) = self.largeFileSystem.processContent(git_mode, relPath, contents) diff --git a/t/t9810-git-p4-rcs.sh b/t/t9810-git-p4-rcs.sh index e3836888ec..5fe83315ec 100755 --- a/t/t9810-git-p4-rcs.sh +++ b/t/t9810-git-p4-rcs.sh @@ -4,6 +4,8 @@ test_description='git p4 rcs keywords' . ./lib-git-p4.sh +CP1252="\223\224" + test_expect_success 'start p4d' ' start_p4d ' @@ -32,6 +34,9 @@ test_expect_success 'init depot' ' p4 submit -d "filek" && p4 add -t text+ko fileko && p4 submit -d "fileko" && + printf "$CP1252" >fileko_cp1252 && + p4 add -t text+ko fileko_cp1252 && + p4 submit -d "fileko_cp1252" && p4 add -t text file_text && p4 submit -d "file_text" ) @@ -359,4 +364,14 @@ test_expect_failure 'Add keywords in git which do not match the default p4 value ) ' +test_expect_success 'check cp1252 smart quote are preserved through RCS keyword processing' ' + test_when_finished cleanup_git && + git p4 clone --dest="$git" //depot && + ( + cd "$git" && + printf "$CP1252" >expect && + test_cmp_bin expect fileko_cp1252 + ) +' + test_done