From patchwork Wed Apr 28 15:36:15 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Liam R. Howlett" X-Patchwork-Id: 12229587 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-17.8 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER, INCLUDES_PATCH,MAILING_LIST_MULTI,PDS_BAD_THREAD_QP_64,SPF_HELO_NONE, USER_AGENT_GIT autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 51C5FC433B4 for ; Wed, 28 Apr 2021 15:49:55 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id BA4FE610FA for ; Wed, 28 Apr 2021 15:49:54 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org BA4FE610FA Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=oracle.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id 24CDF940023; Wed, 28 Apr 2021 11:49:54 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 1FCAF940015; Wed, 28 Apr 2021 11:49:54 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 002AB940023; Wed, 28 Apr 2021 11:49:53 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0168.hostedemail.com [216.40.44.168]) by kanga.kvack.org (Postfix) with ESMTP id D47A0940015 for ; Wed, 28 Apr 2021 11:49:53 -0400 (EDT) Received: from smtpin04.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay05.hostedemail.com (Postfix) with ESMTP id 92F67181AF5C3 for ; Wed, 28 Apr 2021 15:49:53 +0000 (UTC) X-FDA: 78082211466.04.F76A650 Received: from mx0b-00069f02.pphosted.com (mx0b-00069f02.pphosted.com [205.220.177.32]) by imf25.hostedemail.com (Postfix) with ESMTP id 02863600010D for ; Wed, 28 Apr 2021 15:49:46 +0000 (UTC) Received: from pps.filterd (m0246630.ppops.net [127.0.0.1]) by mx0b-00069f02.pphosted.com (8.16.0.43/8.16.0.43) with SMTP id 13SFNedI010520; Wed, 28 Apr 2021 15:36:51 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h=from : to : cc : subject : date : message-id : references : in-reply-to : content-type : content-transfer-encoding : mime-version; s=corp-2020-01-29; bh=1236/yjXDuEcCb4/5odJn8u6xtn9cui6m3hQ6MFzjZU=; b=vm7YZQN5fMk+Knb72H2S5OLb98TXO17wA/xhdO3vVKkn2DCNVfFu4+nNWZ6dp5sn+VQ+ HEI1ZLq2sfCSzjmgtnmRTm/5WEKM/dHo8A2vnjOxw7jCqEFMXu60V9AzGryVe/OFqgiq tvfQEdhkDfVrPkTP+ubi0tovA0DAGCF5bOHywEBS0337/ovYkXkvhqnkEMmwOu5rCMmZ caynJvnN06FmqaP5bBlBJ9IYMSIXZjp/r47IRqJsjDm1mOLcOMakQvMksDSo1y6YqrYn tN8pPxRi7wYI3krKmeHv9NofDpOyvMzavJLbsE5jLjyWG3C43ZBu+Lcg507ydZfvl4eF hw== Received: from oracle.com (aserp3030.oracle.com [141.146.126.71]) by mx0b-00069f02.pphosted.com with ESMTP id 38789105yx-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Wed, 28 Apr 2021 15:36:51 +0000 Received: from aserp3030.oracle.com (aserp3030.oracle.com [127.0.0.1]) by pps.podrdrct (8.16.0.36/8.16.0.36) with SMTP id 13SFaAx8018431; Wed, 28 Apr 2021 15:36:50 GMT Received: from nam11-bn8-obe.outbound.protection.outlook.com (mail-bn8nam11lp2177.outbound.protection.outlook.com [104.47.58.177]) by aserp3030.oracle.com with ESMTP id 3874d2759n-5 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Wed, 28 Apr 2021 15:36:50 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=dqE3WCSZiMclrk6Fxs1YbzdqVRbIRBWM9SRhvoAj5gvb5ecegNDxHGEwX79WTq5ZiF2Vr+6ZO7WkKaCiITCXx4CvLWwZUbQ3YMCo82yRrUCibSa1dQ589Bzy2WjXQJekLRJSlil5gqoLlU9yNG1F+jGb63K5U8el6nFsphAl7O3CBl4gfB6Zi7jfqAtWHev85HibPIMAEXXjuJr53NqR4XYixvtt0IdWn2GdOcife+iPGi/RKNjL7ZDoGQkI4cgxLXdxbh8MBHFRPDLa2Xewgmq4co+by4j79JsVsFt/GounvTuzLIyTOgcjg/QvGAMtOe7IeaJGW/DJNNV6G/pwhA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=1236/yjXDuEcCb4/5odJn8u6xtn9cui6m3hQ6MFzjZU=; b=Vphkd4dWyJuOMe4MXAo4SINGlHTyHucEDFTuqb7MevzSovwvYAy/zs+C6VBcGl7omYtVxRmOWXYuY8/DFZBtlUDs+TTMIgcFdJx8LgDUrODfWKhJDEELMAMkem0P06wYeGa3wq0i5tvg52bHWNdzv/jtvjRaidTTtodfU/ctaGjo3/WkmlM7MwKXtkX49aFpiuvf9zyMcVT0m3WPQHb6l9h/ijGE65UO3UJLiKZUl5YVEDZXEZnNt/CS5lC7Jc2K/yT9/NhkigHSurJwZSfLdZ21iRGvr8EHCWlGD6VfuhaSvzoS4JVk6GnqhgrH7WDNkzjJJR0k0DDQDd9WY7g0LQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=oracle.com; dmarc=pass action=none header.from=oracle.com; dkim=pass header.d=oracle.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.onmicrosoft.com; s=selector2-oracle-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=1236/yjXDuEcCb4/5odJn8u6xtn9cui6m3hQ6MFzjZU=; b=V6AswDE2+cpHiiw4f44NH9M85H6qCeRMGhSzR0F4RmW+mjREmyZq3u43AW9p7C+gNu8HfrHynIceGRiL2ZLrqaAmm2DVyQNgvSNyF/d/zOQvO1QjNCbL1lkFGtP+8nCCcfsTZSRtlucUnuNdzCowXoW+sVvdETzf7ic1QxE+DNQ= Received: from MWHPR10MB1582.namprd10.prod.outlook.com (2603:10b6:300:22::8) by MWHPR10MB1743.namprd10.prod.outlook.com (2603:10b6:301:7::7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4087.25; Wed, 28 Apr 2021 15:36:46 +0000 Received: from MWHPR10MB1582.namprd10.prod.outlook.com ([fe80::353a:1802:6e91:1811]) by MWHPR10MB1582.namprd10.prod.outlook.com ([fe80::353a:1802:6e91:1811%8]) with mapi id 15.20.4065.027; Wed, 28 Apr 2021 15:36:46 +0000 From: Liam Howlett To: "maple-tree@lists.infradead.org" , "linux-mm@kvack.org" , "linux-kernel@vger.kernel.org" , Andrew Morton CC: Song Liu , Davidlohr Bueso , "Paul E . McKenney" , Matthew Wilcox , Laurent Dufour , David Rientjes , Axel Rasmussen , Suren Baghdasaryan , Vlastimil Babka , Rik van Riel , Peter Zijlstra , Michel Lespinasse , Liam Howlett Subject: [PATCH 54/94] arch/parisc: Remove mmap linked list from kernel/cache Thread-Topic: [PATCH 54/94] arch/parisc: Remove mmap linked list from kernel/cache Thread-Index: AQHXPEQ5kJgl2G0NBUKuLENhUljoww== Date: Wed, 28 Apr 2021 15:36:15 +0000 Message-ID: <20210428153542.2814175-55-Liam.Howlett@Oracle.com> References: <20210428153542.2814175-1-Liam.Howlett@Oracle.com> In-Reply-To: <20210428153542.2814175-1-Liam.Howlett@Oracle.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-mailer: git-send-email 2.30.2 authentication-results: lists.infradead.org; dkim=none (message not signed) header.d=none;lists.infradead.org; dmarc=none action=none header.from=oracle.com; x-originating-ip: [23.233.25.87] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 6b98dc0b-fda8-4df5-16b0-08d90a5b6ea6 x-ms-traffictypediagnostic: MWHPR10MB1743: x-ms-exchange-transport-forked: True x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:4125; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: NbmFpwF2x+WzftBzLwpj1kfTlLpLB9e7k8b4QS64fQmbklGzkUjhcAWwZyDiC3XUKIr+KCtTVsPDQ1V2AfZwkB+mcs162Fxkw1GpRT4UBNeD4w0zghNP0f5eq1dbfCBAYGvJunbYJr0zXO21z3WpLXBC6yK/Y41OlsvjcON/6WZMmHPstJbkaUQWZI/60DJYJIHG9OGR98jw4zX6vA9V5s3mzVWrECYXOju0Pr6MlplZ6OgG1zCSA6zhSnx5lA3Ia2hIhoJTbqjiurljjfLOYrzQ6ERH5JpEc8gYVcSxnTuYqL80iJWqjAizToc0TrNVnAKLX1GuaL4FxAL6yg7FTTQC9+QD8PoWyyMu0m2nWEzA256HQAaTNTuZ2oK9BCGZAb0RYQEr2gwhDL1cYNhlhmGTGgS+LKwUbNkNPDYwbkMnkGsYacwOGOW4aJWsmxfW8dLKc7Wq3lkc7V2VjmYXPBoCeXWK6dGOrq3TawOloiqomk4/bfOi3RfwQeWouGeAA8tQBShz7SC+SH3ff0cemgS+kKbK4u4xpwOccbBxO4UsUVAuvpkkqFV15PXGkC2JT6cN1bgPSaDXpj1j2GyOcTpVckT/JrZpl3+r4hWdzig= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:MWHPR10MB1582.namprd10.prod.outlook.com;PTR:;CAT:NONE;SFS:(39860400002)(376002)(396003)(366004)(136003)(346002)(110136005)(91956017)(316002)(1076003)(64756008)(66946007)(76116006)(44832011)(5660300002)(66476007)(66446008)(8936002)(6486002)(8676002)(83380400001)(54906003)(2616005)(66556008)(2906002)(122000001)(38100700002)(6666004)(478600001)(36756003)(7416002)(86362001)(6506007)(26005)(4326008)(186003)(6512007)(71200400001)(107886003);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata: =?iso-8859-1?q?NkSzcOYW/lvSzUlDRreBwAA8w?= =?iso-8859-1?q?r+4Qmwfn3ezHxW1QOGmNCGlyKfoKT+1yGy3/qQTs1ckGvB84snAqq7bs4uc8?= =?iso-8859-1?q?aUllFDUefQzrBafHrlTCJTXwxbiMF1kYajzOUfoesbD2jypry12z9t4nhyfZ?= =?iso-8859-1?q?wnc2lWEPSYP1s9IEJrdWF4toH4CKpMqk0XkdG5Zc4aAXjPwcvQfl/WSgVbSs?= =?iso-8859-1?q?jRoMv2PSg/uPM3tyR6lHkMD7dPfgJdChDxdbwmrr2s9HPe4FuZ9l4sQ2pWSK?= =?iso-8859-1?q?tHlXrVtOb+g+qS84DM/IJM5nlURLZKY/LlymewaNQKjVj8sCKwzuNXblgJhz?= =?iso-8859-1?q?p7BfgS24fzW8kE2XFItP1S3vkp1pLf2nLcFj+7Vw8HunF+kn1wnr1nbgmkcz?= =?iso-8859-1?q?F9e06P/AguyhpWOLjXKQ7bxD2HvKZ8h44iYe7tCBve5ez2IFC8cdZ//CxmV0?= =?iso-8859-1?q?UPkAfmajh3diP42ZBDyNlVcOTkZdiRvYMlwStmS1n98YkuPQbOEt7L2Jw3No?= =?iso-8859-1?q?jmUKAehVnI0Y8Z0P+rfYKTnh841gptWjum016jJ6HbAX3Yk7vhMI7X1JU8eK?= =?iso-8859-1?q?OfvGRMUCVEEesv0uYv/5mMoaXlKnqzjfQTRY8c3XsH4PO7pCRcu4tpLNvcjg?= =?iso-8859-1?q?0E60hLCkEhXKNAlyWM9dBGTmpm3kyBeq+JyfHqHZvBjHRr7U/pFuVdvG/zQu?= =?iso-8859-1?q?qA+Cj8nQzi4BTJKnU+WxB0poXfDLt0ecoEHKPXPGuMO1QX1p19eY8uUiLABr?= =?iso-8859-1?q?JQ3C9fbzg4r6jRKZvUZJsiD9z42bY/dlHmjYsybNo8L/X/6AftwCSfU/x3q+?= =?iso-8859-1?q?SPgYMaPBEsODMUYW0rCy4ddOmosAGApy6kzJ/+06ZTa0BlJohK4nu8gR79Dk?= =?iso-8859-1?q?vzm/DX3TO52c4qykbe2bAs5BLMSstTMqffIUBKjz2vKOCiNnguV64S3eGJSJ?= =?iso-8859-1?q?voaue7UBaCJoEQfA4SAsNU1GC1s4tZJY2uWN+ak/bqe0FQQ8s1+GIR90N9Er?= =?iso-8859-1?q?sMuhOrU/mcetdwB6aGib4iG9+DVoDnDqMILu3yxmBkS2nwXjZ7lXE2p4gpS+?= =?iso-8859-1?q?06jbJ5+O3qOE3EZwGkHJFGyu5xQTRx8sy0hnh8klbGZefTrJp7hApwauXJxf?= =?iso-8859-1?q?U3bAc8wbJ6jGcuY91PqQWyv0J3RVQO+zYZ/h64gouXHhQBbkq40sfqAB12io?= =?iso-8859-1?q?0yiJnDMXrwX8BYklRwiZYVZTw1uM7diVSfwaujnaQwR9vWeoe7nnsaTcH4Yb?= =?iso-8859-1?q?GJxNQThx3Oxw4pDDFVi1nS/gaB/WfQoVjcj8xHnENDzY79uNKvu4l+P6wQT9?= =?iso-8859-1?q?N3vLZd3zwLILGAtNLOfMinuqkHdYQWiF8Ib+oXGBxcqv2mPbQYLf2nq58mh?= MIME-Version: 1.0 X-OriginatorOrg: oracle.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: MWHPR10MB1582.namprd10.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 6b98dc0b-fda8-4df5-16b0-08d90a5b6ea6 X-MS-Exchange-CrossTenant-originalarrivaltime: 28 Apr 2021 15:36:15.3903 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: xrNuwsmZIKBjcN7puc4D9C7kdOOCkDSEbQlAVV4zp32LGIeKWr8fT5OURo+PLQC6HTWwh//MVniIyvLQEI9LNQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: MWHPR10MB1743 X-Proofpoint-Virus-Version: vendor=nai engine=6200 definitions=9968 signatures=668683 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 phishscore=0 spamscore=0 adultscore=0 suspectscore=0 mlxscore=0 mlxlogscore=999 malwarescore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2104060000 definitions=main-2104280101 X-Proofpoint-GUID: 4SxOnZ5x7XZWA54ohSVIdStUU9GBDawv X-Proofpoint-ORIG-GUID: 4SxOnZ5x7XZWA54ohSVIdStUU9GBDawv X-Rspamd-Queue-Id: 02863600010D X-Stat-Signature: upfwitj37sso34p15y6mtjjywm6sb4ym X-Rspamd-Server: rspam02 Received-SPF: none (oracle.com>: No applicable sender policy available) receiver=imf25; identity=mailfrom; envelope-from=""; helo=mx0b-00069f02.pphosted.com; client-ip=205.220.177.32 X-HE-DKIM-Result: pass/pass X-HE-Tag: 1619624986-446946 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Start using the maple tree Signed-off-by: Liam R. Howlett --- arch/parisc/kernel/cache.c | 15 ++++++++++++--- 1 file changed, 12 insertions(+), 3 deletions(-) diff --git a/arch/parisc/kernel/cache.c b/arch/parisc/kernel/cache.c index 86a1a63563fd..bc7bffed24ba 100644 --- a/arch/parisc/kernel/cache.c +++ b/arch/parisc/kernel/cache.c @@ -520,9 +520,13 @@ static inline unsigned long mm_total_size(struct mm_struct *mm) { struct vm_area_struct *vma; unsigned long usize = 0; + MA_STATE(mas, &mm->mm_mt, 0, 0); - for (vma = mm->mmap; vma; vma = vma->vm_next) + rcu_read_lock(); + mas_for_each(&mas, vma, ULONG_MAX) usize += vma->vm_end - vma->vm_start; + rcu_read_unlock(); + return usize; } @@ -548,6 +552,7 @@ void flush_cache_mm(struct mm_struct *mm) { struct vm_area_struct *vma; pgd_t *pgd; + MA_STATE(mas, &mm->mm_mt, 0, 0); /* Flushing the whole cache on each cpu takes forever on rp3440, etc. So, avoid it if the mm isn't too big. */ @@ -560,17 +565,20 @@ void flush_cache_mm(struct mm_struct *mm) } if (mm->context == mfsp(3)) { - for (vma = mm->mmap; vma; vma = vma->vm_next) { + rcu_read_lock(); + mas_for_each(&mas, vma, ULONG_MAX) { flush_user_dcache_range_asm(vma->vm_start, vma->vm_end); if (vma->vm_flags & VM_EXEC) flush_user_icache_range_asm(vma->vm_start, vma->vm_end); flush_tlb_range(vma, vma->vm_start, vma->vm_end); } + rcu_read_unlock(); return; } pgd = mm->pgd; - for (vma = mm->mmap; vma; vma = vma->vm_next) { + rcu_read_lock(); + mas_for_each(&mas, vma, ULONG_MAX) { unsigned long addr; for (addr = vma->vm_start; addr < vma->vm_end; @@ -590,6 +598,7 @@ void flush_cache_mm(struct mm_struct *mm) } } } + rcu_read_unlock(); } void flush_cache_range(struct vm_area_struct *vma,