From patchwork Thu Jun 15 08:42:57 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Peng Zhang X-Patchwork-Id: 13280887 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 57816EB64D9 for ; Thu, 15 Jun 2023 08:43:14 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id DACE56B0072; Thu, 15 Jun 2023 04:43:13 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id D36896B0074; Thu, 15 Jun 2023 04:43:13 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id BD6AD8E0001; Thu, 15 Jun 2023 04:43:13 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0010.hostedemail.com [216.40.44.10]) by kanga.kvack.org (Postfix) with ESMTP id A72E46B0072 for ; Thu, 15 Jun 2023 04:43:13 -0400 (EDT) Received: from smtpin17.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay07.hostedemail.com (Postfix) with ESMTP id 65C27160B0B for ; Thu, 15 Jun 2023 08:43:13 +0000 (UTC) X-FDA: 80904342666.17.E468791 Received: from mail-pf1-f173.google.com (mail-pf1-f173.google.com [209.85.210.173]) by imf20.hostedemail.com (Postfix) with ESMTP id E94EC1C001F for ; Thu, 15 Jun 2023 08:43:10 +0000 (UTC) Authentication-Results: imf20.hostedemail.com; dkim=pass header.d=bytedance.com header.s=google header.b=K3VbDUKx; spf=pass (imf20.hostedemail.com: domain of zhangpeng.00@bytedance.com designates 209.85.210.173 as permitted sender) smtp.mailfrom=zhangpeng.00@bytedance.com; dmarc=pass (policy=quarantine) header.from=bytedance.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1686818591; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:references:dkim-signature; bh=M+bDN9iklFF/86ce+oPNSVCYPYiJrmlJzMuqyt9nX5o=; b=sbuAdRXakkKdR4zJR4E50m1l1MRmczb7/Qd1ns3xU+D/RAi0vXSMouso6k5XQkH16Jlb+x nfkKSig7wNt64Wf2YZHrGZ+tx12vx4WWGjrHUgPxfQt7jjfecHLQ7VWDqr7+67xcW1nABH F71JyfF4YgI6ShxSH8J++aEHsmE/qiA= ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1686818591; a=rsa-sha256; cv=none; b=yQCU+gFci1iIHVjp97NC7MJcUvmveHOXaQOEB8QPlfclc7czK+OtZhuZVQ3VhmBk+5xIjN V8yRE+nlNEjBCiMvXUCwYcqX4p+xmrazt+e4tqoi1aoQt31IVrdFTIPMYqeRHYc0gQa4v9 iIN2iI8/LSU4RxjZB7cZFICWLNRHugE= ARC-Authentication-Results: i=1; imf20.hostedemail.com; dkim=pass header.d=bytedance.com header.s=google header.b=K3VbDUKx; spf=pass (imf20.hostedemail.com: domain of zhangpeng.00@bytedance.com designates 209.85.210.173 as permitted sender) smtp.mailfrom=zhangpeng.00@bytedance.com; dmarc=pass (policy=quarantine) header.from=bytedance.com Received: by mail-pf1-f173.google.com with SMTP id d2e1a72fcca58-6667e221f75so848935b3a.1 for ; Thu, 15 Jun 2023 01:43:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bytedance.com; s=google; t=1686818589; x=1689410589; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:from:to:cc:subject:date:message-id:reply-to; bh=M+bDN9iklFF/86ce+oPNSVCYPYiJrmlJzMuqyt9nX5o=; b=K3VbDUKxfW83+DEvn4rsfcapW299oJpQAsgELcRCXsTVFxhXlekAGxdg83EmeXXzNw qqsfXFUj1GmlYY2dc7xyZb5uXz847X+gbNTMhOsyiUXr6yZDTNEKQJ64f7UBA/TYZn+b xMzpD1oZiSVZxVYdMiD0IoiKzLM8z3ESEo/Tg4at3HQjP8JqWIQuQ8guU+RnPhTpWnQC x2zNuBMvhuNj3Ifvhi5qwGO8FcrH6u4HFP9/KNeqhnRfR6b4MUnMS4vkqNVjGwBJYXld T6Igf9QqXnDao+MCpFWs1wbfxJZI96d3w8mVgLcPj1yhjnQLU0ejgUfClYHIxZuYFcFL YrsQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1686818589; x=1689410589; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=M+bDN9iklFF/86ce+oPNSVCYPYiJrmlJzMuqyt9nX5o=; b=DlI8vBQtnxEJePuP/1gKTtjkhekVA0ZYxRpY/eZzIA4dmXXpDN3cxRkq4DaqlBBHqY IfSxpdyAU/RmchgsqtlSK6rU9OYMtPBrop/1PiStXOU7Bj+TZ3/LbGuDmEheSM7lJMWq lTUrcrsIaRCkfEIG0ziPXnPl3Dw+m2nGqqmEEENzfLGqFToSOTntx3YN5f6B2qV2mLs/ 5p9xX8kwvaCntriEgH5NOluFnVtbPVv2XB4TLWVnSjH41P4wkjeK0lwGCiAFkZ7d0wSV 5Sl9vK+0TjTMr2wEq+23fc4NjmBv4xbRgXN90FCzSjX+u/2Xrs+jvJQdUfRry1dLh8RJ U72A== X-Gm-Message-State: AC+VfDwFWdTsKUWfydtpGWb1C2YIWSCLq11mjJ6R6YO/jZdPClQCbv8u 7U4il6FmP3bEEXnPpNxOA8fAKA== X-Google-Smtp-Source: ACHHUZ5swGm0ZAv9wRJ//osArlRAwIoHqPkH/Wvsjjf16/jySAnIU5Oywv6OhF9QARwwQeWCm6Z69g== X-Received: by 2002:a05:6a00:881:b0:64d:1451:8224 with SMTP id q1-20020a056a00088100b0064d14518224mr4643699pfj.22.1686818589299; Thu, 15 Jun 2023 01:43:09 -0700 (PDT) Received: from GL4FX4PXWL.bytedance.net ([139.177.225.249]) by smtp.gmail.com with ESMTPSA id i21-20020aa78b55000000b0064fe06fe712sm11139783pfd.129.2023.06.15.01.43.06 (version=TLS1_3 cipher=TLS_CHACHA20_POLY1305_SHA256 bits=256/256); Thu, 15 Jun 2023 01:43:08 -0700 (PDT) From: Peng Zhang To: Liam.Howlett@oracle.com Cc: akpm@linux-foundation.org, linux-mm@kvack.org, linux-kernel@vger.kernel.org, maple-tree@lists.infradead.org, Peng Zhang Subject: [PATCH v3 0/4] Optimize the fast path of mas_store() Date: Thu, 15 Jun 2023 16:42:57 +0800 Message-Id: <20230615084301.97701-1-zhangpeng.00@bytedance.com> X-Mailer: git-send-email 2.37.0 (Apple Git-136) MIME-Version: 1.0 X-Rspamd-Queue-Id: E94EC1C001F X-Rspam-User: X-Stat-Signature: j38oca9tu61m6ethiruxumtg8xadjce9 X-Rspamd-Server: rspam03 X-HE-Tag: 1686818590-131030 X-HE-Meta: U2FsdGVkX18f3ZOMbydsq0AwwwEoL8QtGNBlGXobwQMqfy9/dbYH8UGnlO3hUWPNcKonQgRmzY7/EMvpBCMcae2XL1cq4J6E6pS4Az6KmIgGLWue+BSRuaMERtoNg+Y0RC9bK9O9wvtK+YLq422woASQTbrDmxqa2ZPx24EQFhFK7pwFzz4fVDQqdx1aefl9PMsJS6I73+Lo12g3icjZNN5o6/93EEfuwzlbuY/huB9YexiKDiOAgvOcCnYSsR2B/RDn+IrsHAa30zFsE6wcAz9KSYpnhOrKckR3nOSC69b9xb4IPIQOKt+G2s7d59B3JlysZcTFPsjqEsAYDVpipyN4qj8GmsGmzM9GyY2KGf/jxNcpjXA5xLYBCESBXM6hhlw02zC5MlSLNK56+PQKlIwGxCSqxSMRQ8P7hwVFx3EoDvG8oQO+Y0EzxPzinwiATiaC1+452eeulYllonEjKtR3g1I1TWC1GPQlYwSLuUGM//nStQUmZDhugWUO0nINz4ESziO+D4Klis3QKo7/qoVfV9wc+TKb0oFGWA20lmZ6W6RmdpGj8szZMPrD5Cjw4AcaEZ+FI4MCb/i1oeUKMwLli6MG6BwHE1O9gbxk0zuzl063xY9wjU2pX8aSxLrT2fZzOgXMbG8ndSXCokvZRO2roeFubJj2apPfGiw8DE0O/p/irxxPHwksZjZGJxK7eSl0Ww6pq1wuzY/1Q4hUuYD2kSWJ0qO6uOhsiNlv40avG528pJ9sBKJz5bVmE4JTEtzUfTG4Uk0yUP2xQVHgbUwllKLDKs3iYS3fqbMOx6XWPdeDifR1Ng9ia0lebd/IqXORFDVpg8ifv46SeNhDLRjP+dCVH7HfEfTgSXCSAEP8wDvpl8P4i9yISwnrft5+O47Tlu8//ZAHQgir8hEi5gfDhNwAczP+6eDfZWIVuoUbX1bvw8pD/hZMOfklZpR3gNMeCDGNOCA1wCHn2gB K3bX4ynF H9zXhPYdDX5vvEQjYkM2PQg8S6LlJVlCx06yA4hGHwih+djZ0HB3MgCaoFuHx1PU45lJlvQ/63zzaCQFUdZUOS7cC8ZMXMclKVdbCbFaDmjya5eNfsaEQ4WknnWZwYsf7Ht1RWM+sjoslfHiFx4ucIRoZGzlKovfZ1t7jVnTgltFrJHFTKPv3lk961Txz4GnZreb0l0IFY6X5kLMfBigTyPXscHGeG9KPgp2eYySuXE+4tUpD251YJGhFx991P5LEpLeFcBVIf3GOSkfz1+wYSvPXMsOUQpXcydztjBry1Rj++3nvjk6/J+dsXP+PwW1aycXqQcu7XmJzE9eQ7lVUiPoOdsl7lRuKrFY4b1md7UUH3oeW9ydHaP3eIjK+uiyCi7nQxQa6SaSRtIuRpzREXr9ULSaUbrnrPAdsmXfYEyCPrDpxjPjSDofpa599RgKK7EuRILnfa+wwW/OUXvWUXUotDHrVZMKMdWmDzSIkG2mebNgdGp59HwbNuBccpyzLWo78jWgVXKe3/aA= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Add fast paths for mas_wr_append() and mas_wr_slot_store() respectively. The newly added fast path of mas_wr_append() is used in fork() and how much it benefits fork() depends on how many VMAs are duplicated. Changes since v2: - Add test for expanding range in RCU mode. [2/4] v1: https://lore.kernel.org/lkml/20230602075353.5917-1-zhangpeng.00@bytedance.com/ v2: https://lore.kernel.org/lkml/20230609120347.63936-1-zhangpeng.00@bytedance.com/ Peng Zhang (4): maple_tree: add test for mas_wr_modify() fast path maple_tree: add test for expanding range in RCU mode maple_tree: optimize mas_wr_append(), also improve duplicating VMAs maple_tree: add a fast path case in mas_wr_slot_store() lib/maple_tree.c | 69 +++++++++++++++++++---------- lib/test_maple_tree.c | 65 +++++++++++++++++++++++++++ tools/testing/radix-tree/maple.c | 75 ++++++++++++++++++++++++++++++++ 3 files changed, 186 insertions(+), 23 deletions(-) Reviewed-by: Liam R. Howlett