From patchwork Wed Dec 1 14:29:51 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Liam R. Howlett" X-Patchwork-Id: 12650043 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 7C19CC433F5 for ; Wed, 1 Dec 2021 14:40:36 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 09D226B0093; Wed, 1 Dec 2021 09:31:38 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 04C5F6B0095; Wed, 1 Dec 2021 09:31:37 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id DBA1A6B0098; Wed, 1 Dec 2021 09:31:37 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0063.hostedemail.com [216.40.44.63]) by kanga.kvack.org (Postfix) with ESMTP id CA7EE6B0093 for ; Wed, 1 Dec 2021 09:31:37 -0500 (EST) Received: from smtpin02.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay02.hostedemail.com (Postfix) with ESMTP id 16C2E869A9 for ; Wed, 1 Dec 2021 14:31:26 +0000 (UTC) X-FDA: 78869463372.02.DF568E4 Received: from mx0a-00069f02.pphosted.com (mx0a-00069f02.pphosted.com [205.220.165.32]) by imf05.hostedemail.com (Postfix) with ESMTP id 16944508BBAA for ; Wed, 1 Dec 2021 14:30:20 +0000 (UTC) Received: from pps.filterd (m0246627.ppops.net [127.0.0.1]) by mx0b-00069f02.pphosted.com (8.16.1.2/8.16.1.2) with SMTP id 1B1EGXgI017179; Wed, 1 Dec 2021 14:29:59 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h=from : to : cc : subject : date : message-id : references : in-reply-to : content-type : content-transfer-encoding : mime-version; s=corp-2021-07-09; bh=qPUXANS/+3MnCzF8TwO6wHkbynztV9tHawAwN4AOS/c=; b=taUhp5G9uHihWZsBW3lcxWLc3Cdbs3dqQLrcwndf46pww8IWssGYjJZekYcIlbycvQCz vqJPSU+k+cROwyudgPu8iiWbGI0QkScdiuiKz9Ng4tPv5bmGaJI8jofQi/SmBlskrIjY pms5EmvBP2zu5+WKGQdRk/nA/xuKZyow/CAtFz0XnAHBTKyBu+4IdxW7XQ9549Obg93j cqomdHdjCa/qI6cFq0zSTa91PqY82Ti5yygOoo+aJhbe0WAJm2Gm1NIFGqiKCyA2f47p 1fcaWjUkbN91Qudl/XW+1EmeUNb+PqKUz6y+sQGDttW/d9cAx50rv+nYiDGxOABisJeO 9A== Received: from aserp3030.oracle.com (aserp3030.oracle.com [141.146.126.71]) by mx0b-00069f02.pphosted.com with ESMTP id 3cp7weh2p9-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Wed, 01 Dec 2021 14:29:57 +0000 Received: from pps.filterd (aserp3030.oracle.com [127.0.0.1]) by aserp3030.oracle.com (8.16.1.2/8.16.1.2) with SMTP id 1B1EBMFF049269; Wed, 1 Dec 2021 14:29:54 GMT Received: from nam12-bn8-obe.outbound.protection.outlook.com (mail-bn8nam12lp2175.outbound.protection.outlook.com [104.47.55.175]) by aserp3030.oracle.com with ESMTP id 3ckaqgkcte-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Wed, 01 Dec 2021 14:29:54 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=ghTwCoUtdkzWTSk79ty/Sn3PRaBkvDYgD4HtHO8Mo5gGjZE8vYEz0aQXX6dfNE9T1vACwBST8i6vie7mI0JHuqtukT+ckCl5V+5rzNcjBTkfSZQvCMnxiJMQUeCN2d4NqsjEbR4CLoyk3OmMxfE/jHfhU0UXjhzc7wp52pdY0fFK/OtzGTjj9WePEAyFC2BnCnDFpm3QH79EDqg969R0x1HP5ZXHludX+abuAM+I3LI6NPbGlTB4KkHyou67GI8xOZTFNNXsFGYVJaghCQ/UcPreVjSmSdoDB7LzouVGSvJ0/HlJi7uMkDhw2zgqQtzjA0x0x4GCJm6XbQQ7uxEwcg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=qPUXANS/+3MnCzF8TwO6wHkbynztV9tHawAwN4AOS/c=; b=juVtut9Oo3q4IGjffwj85S7zsq8QVful1uT02kCZJIiZDKkQ0kXznqkaywPKhO+oZq8YyVZoy2ATbrqVt5vMm3fNDTBVy8LJhEkjmsxyo5UtLedzeINzFrbdpYgo+zVuT0G82Ba16FeOLE7jS8nkAVs+Vh0ZIO/X55P5ZvX+OESRoWpgHIUUOHhIDKQp/vAScbsO+VU4mMxw8oi/2PBjf3cYtEGpv7JjOQMyKbQUUAV8UVyDvk6L69C/m2xbCCsypdrI2jCwLOG5yoeDFa0h2kbZehNo+ZBZn0NGGA/ZRT0EziCz8RaROYankuU6NmyeZi9tq3IjNJkUFUJexHBV9w== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=oracle.com; dmarc=pass action=none header.from=oracle.com; dkim=pass header.d=oracle.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.onmicrosoft.com; s=selector2-oracle-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=qPUXANS/+3MnCzF8TwO6wHkbynztV9tHawAwN4AOS/c=; b=ZXzKQGi6AaXRKYhsDdzj7/XBNcqbU2rxsaPnhJLF6CjESHxTn4Ad2u7DWYW6HlNxF+amz8sw2jrKFg9BT1e8iYPIAGLfj3rFHV3aieXD4D5XPx4vnNnbjtUsKw5HiZVDJ4mNLPfU82/sTwk+YObaW7x/K+VFxspMgLe2GLv9zkQ= Received: from SN6PR10MB3022.namprd10.prod.outlook.com (2603:10b6:805:d8::25) by SN6PR10MB2768.namprd10.prod.outlook.com (2603:10b6:805:4a::25) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4734.23; Wed, 1 Dec 2021 14:29:52 +0000 Received: from SN6PR10MB3022.namprd10.prod.outlook.com ([fe80::c4d0:8291:84d:ac66]) by SN6PR10MB3022.namprd10.prod.outlook.com ([fe80::c4d0:8291:84d:ac66%7]) with mapi id 15.20.4734.027; Wed, 1 Dec 2021 14:29:52 +0000 From: Liam Howlett To: "maple-tree@lists.infradead.org" , "linux-mm@kvack.org" , "linux-kernel@vger.kernel.org" , Andrew Morton CC: Song Liu , Davidlohr Bueso , "Paul E . McKenney" , Matthew Wilcox , Laurent Dufour , David Rientjes , Axel Rasmussen , Suren Baghdasaryan , Vlastimil Babka , Rik van Riel , Peter Zijlstra , Michel Lespinasse , Jerome Glisse , Minchan Kim , Joel Fernandes , Rom Lemarchand , Liam Howlett Subject: [PATCH v4 07/66] mm: Add VMA iterator Thread-Topic: [PATCH v4 07/66] mm: Add VMA iterator Thread-Index: AQHX5r/m765iFHbPa0ejviOTbVUOwA== Date: Wed, 1 Dec 2021 14:29:51 +0000 Message-ID: <20211201142918.921493-8-Liam.Howlett@oracle.com> References: <20211201142918.921493-1-Liam.Howlett@oracle.com> In-Reply-To: <20211201142918.921493-1-Liam.Howlett@oracle.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-mailer: git-send-email 2.30.2 x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: b1f7e999-e1b0-4857-92b8-08d9b4d709bf x-ms-traffictypediagnostic: SN6PR10MB2768: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:1332; x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: nTheGkJ1Z2N7wtzBBF2JXntgUn+hGadc2MTuR0WnvTRho3kX5V5vYgP23BcZurkGtTXOABqFgj7uf2eDx84Zc8Kb57MPL5vCQ1FtRkGps9bj+AuI6uCwfzZwMZdqFZDg84T1SB66xsTzTQw6oCT37M4Gm3P/nC34aaqsOtC59SWd3rvtToiOie2Maq67QTf7yqgBTaFdRU36xrWCoKdu2HZyIfCcwTZhANpCuBiIYEYi+xWWRKxSl8ncmLA7jMPq7PS9f/kVdVMWGd9TsGOzdsAvJ+F4pMggrJFasKE/CqxrsrVbn/VxIHSf957lfFlrkkIb2wWU1k21MFf5tI6RaSpZ7HNHskrz2Xma9iSm7M8O0akHbO4jT5voagWU6OT1iZZo6t9Dev8NMvU91NrkXzb9UuEPd/R1YyPMsAIlSuvCISZ23jYqAOfZQ3wvtrCPROO5RicagLA6JIlNalO3+LxSY2qBLJRPShtWHUhkfRILOJiMLuV9QUXCELIzJMmJXuDfbBh3ygxEAkUiwjBxxHPOWaA+iEBOGBLDrX8FQjmZzf6Xo81/xyqVhI113/ftnzhf9mjbPZVAvdmFaEY6B7ZVk4cwPahNmBfXst48G+2VY5Ry91SdLYQTPAfKeBgFhFHAIWKOiwdknil0caxDvnhfNO1Muk5AcVjYNpFJK4snS6oQQvSRW9gkbKp9EN25RUownfCOjNyt8BwTd4V6Pg== x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:SN6PR10MB3022.namprd10.prod.outlook.com;PTR:;CAT:NONE;SFS:(366004)(6512007)(508600001)(66446008)(64756008)(66556008)(66476007)(44832011)(7416002)(66946007)(110136005)(316002)(36756003)(122000001)(6486002)(54906003)(2616005)(4326008)(186003)(91956017)(5660300002)(71200400001)(38070700005)(26005)(8676002)(86362001)(83380400001)(76116006)(2906002)(1076003)(38100700002)(8936002)(6506007)(107886003);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?q?pwUHtkVPYnL8Wu2ulFSvhm2?= =?iso-8859-1?q?SuU0QXsVfDGR+S4ExyKzwkGmKQ5TBho21PPIoroJzXTObsusK2kgubun4kr8?= =?iso-8859-1?q?rVVDVYMqtYx7al8tv9lFpElhkkgAE3bqP1GcuKQ94XF5PDUisa4ZJv9dXKzA?= =?iso-8859-1?q?T2K/JsGVhmfrubg25EsslIHJgGNWoNrEH9BkGlj0UqGnU6Z9SwTrwCYiG40D?= =?iso-8859-1?q?Sk4cUvBIuYX9VjuxP+XJ3HYO1Z6MZUywp6XtTAMF+Vdq96TcqT40k2xCTQ2w?= =?iso-8859-1?q?Gy3EIwGaSxK3fCS0xQOUDUz3lzewF2Qf6DcQkEKUyjrzmQhkPGk3esFxs5uB?= =?iso-8859-1?q?JDFvv62Ze4gqf6H1P5nHPrypu+nv8ASssEnZjKiEV5T0YmRLmv4h15w+vPer?= =?iso-8859-1?q?+eOBmLnUbMf5fS/t+NCe6/Jul+4MAwS/6aolF4OcAGdzyWlce24JKn918zg4?= =?iso-8859-1?q?GGSPDS12HayiUS2JLbALgC9tSpdZxsVB7pb8fixZH/JoOAxjtjX8jW5FmFY/?= =?iso-8859-1?q?SNWDG51YcGCSMVi6irzjs1/gfK4l6I4RPJuGiTxVTb+T1BJdI9IQJWEZ2Irl?= =?iso-8859-1?q?iWGZO8o1k9J1WiHUqY6INuRHEdNm30qVOKUVz8kMJojSkKuNHKbcHIVafHGW?= =?iso-8859-1?q?Xto/bX/6h6IjyZGdTzvznWDwmPZzuBm7Ycc/Fu/btRJ2dOWsKWQ91UeAII2+?= =?iso-8859-1?q?FjTtboRoNCwHJi41x3NkM+DMjdJhwReyfhByUiP2ynOS2Uk8gvovpD6A/gis?= =?iso-8859-1?q?XowNKBqrJ3KAeOb0qdkLSIwLellmNQe1C9ab+9VGZTWpxG69HWcVAFccZKqW?= =?iso-8859-1?q?2tw6DgXY3EvtNVNZeEB+NAF51whKRcZDDwoz52HDo1QTYVZPP8OX5MYWpaPm?= =?iso-8859-1?q?FkqOqionRN6mINJo8zu9MmUZ3JaGmkD33PdjPTvXUNhxuZyzN49AFtPfKCBu?= =?iso-8859-1?q?CZ/YTAoY6Zepdtl4/TkFlTuRzRYGiTV0VPPsBzmbfrsV0YCHEtlGjvBkcsga?= =?iso-8859-1?q?0pFNk7SR4cDxBwcAmqr0xnUJq+R3DgNvf0lJAoogpev7hPxZzx2iBiMNDItB?= =?iso-8859-1?q?IsntpxEmZiPwsQ2WJfQva+STz9XPx02430RQB2vpzRHTXhQ+EwMt05qO8eGA?= =?iso-8859-1?q?MOGyxnRDZe/GLIMNnJGnMdTMfpJblvrO94cK95hqrEytBTf2oj4253Ib6QkT?= =?iso-8859-1?q?Aew+h7jqYS3FD1frnQr1pPdE1Koi8HjnMowSK2Ao83gH76ReKY3Fnnb+/Rsh?= =?iso-8859-1?q?6S4LfgV45GYv4YJM1j9DHQjDOqTEWnjHMSHJK9EROqDVbon26xeymfVdu7EA?= =?iso-8859-1?q?KxHQyrMcyF8P7kSPDU4brRzwUocb59KLhgfQ70dCCZbGsjPYj8IkEJ8ImeV3?= =?iso-8859-1?q?oCDk1r2PSFrgT64XszLPjepOpZmRzH8YH+Rr31rAruULmkPmib77Drl7moY2?= =?iso-8859-1?q?0JDQEfCAPx1u1haCg5iDJI2ss+xK5tGk2d7ef7tDVB8SQYQd61KF0hQWj6fc?= =?iso-8859-1?q?ng5M0lZxKBMYJlexEe0xe5rUl/FMqn9rmG+7V3k1EZ1TRL4YeOC7BY/WiSNG?= =?iso-8859-1?q?hTsjrFS2B3D4Bw+ueg8Yh4F4HhVwpagndxLyqNHiTs/yIPeEnqRr4u0+Pvx2?= =?iso-8859-1?q?6nhv93YBWR/L17oP2+W1bxkNiLEP+XavLJh4k+h2V9CCUMic7KC2grMo0ahI?= =?iso-8859-1?q?=3D?= MIME-Version: 1.0 X-OriginatorOrg: oracle.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: SN6PR10MB3022.namprd10.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: b1f7e999-e1b0-4857-92b8-08d9b4d709bf X-MS-Exchange-CrossTenant-originalarrivaltime: 01 Dec 2021 14:29:51.6368 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: DluY6L2tPu2g0gqVhwGnZL+mK+8U4+Ti4oXwG2tcHgltHWues4d8DzheCP4UeJGwoD171s8ChJQ/kkhsAOL4QA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN6PR10MB2768 X-Proofpoint-Virus-Version: vendor=nai engine=6300 definitions=10184 signatures=668683 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 adultscore=0 malwarescore=0 mlxscore=0 suspectscore=0 mlxlogscore=999 spamscore=0 phishscore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2110150000 definitions=main-2112010081 X-Proofpoint-ORIG-GUID: SrMVDagNO3cx1jOjHRey6ncOurrZOGk6 X-Proofpoint-GUID: SrMVDagNO3cx1jOjHRey6ncOurrZOGk6 X-Rspamd-Server: rspam04 X-Rspamd-Queue-Id: 16944508BBAA X-Stat-Signature: 6no95paasci4rjsxbaandpy3xckwuxkd Authentication-Results: imf05.hostedemail.com; dkim=pass header.d=oracle.com header.s=corp-2021-07-09 header.b=taUhp5G9; dkim=pass header.d=oracle.onmicrosoft.com header.s=selector2-oracle-onmicrosoft-com header.b=ZXzKQGi6; spf=none (imf05.hostedemail.com: domain of liam.howlett@oracle.com has no SPF policy when checking 205.220.165.32) smtp.mailfrom=liam.howlett@oracle.com; dmarc=pass (policy=none) header.from=oracle.com X-HE-Tag: 1638369020-4852 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: From: "Matthew Wilcox (Oracle)" This thin layer of abstraction over the maple tree state is for iterating over VMAs. You can go forwards, go backwards or ask where the iterator is. Rename the existing vma_next() to __vma_next() -- it will be removed by the end of this series. Signed-off-by: Matthew Wilcox (Oracle) Signed-off-by: Liam R. Howlett Acked-by: Vlastimil Babka --- include/linux/mm.h | 27 +++++++++++++++++++++++++++ include/linux/mm_types.h | 21 +++++++++++++++++++++ mm/mmap.c | 10 +++++----- 3 files changed, 53 insertions(+), 5 deletions(-) diff --git a/include/linux/mm.h b/include/linux/mm.h index 9eae78a155be..acdccbe9b96b 100644 --- a/include/linux/mm.h +++ b/include/linux/mm.h @@ -696,6 +696,33 @@ static inline bool vma_is_accessible(struct vm_area_struct *vma) return vma->vm_flags & VM_ACCESS_FLAGS; } +static inline +struct vm_area_struct *vma_find(struct vma_iterator *vmi, unsigned long max) +{ + return mas_find(&vmi->mas, max); +} + +static inline struct vm_area_struct *vma_next(struct vma_iterator *vmi) +{ + return vma_find(vmi, ULONG_MAX); +} + +static inline struct vm_area_struct *vma_prev(struct vma_iterator *vmi) +{ + return mas_prev(&vmi->mas, 0); +} + +static inline unsigned long vma_iter_addr(struct vma_iterator *vmi) +{ + return vmi->mas.index; +} + +#define for_each_vma(vmi, vma) while ((vma = vma_next(&vmi)) != NULL) + +/* The MM code likes to work with exclusive end addresses */ +#define for_each_vma_range(vmi, vma, end) \ + while ((vma = vma_find(&vmi, end - 1)) != NULL) + #ifdef CONFIG_SHMEM /* * The vma_is_shmem is not inline because it is used only by slow diff --git a/include/linux/mm_types.h b/include/linux/mm_types.h index d9ce412fca04..b0c3494011bb 100644 --- a/include/linux/mm_types.h +++ b/include/linux/mm_types.h @@ -675,6 +675,27 @@ static inline cpumask_t *mm_cpumask(struct mm_struct *mm) return (struct cpumask *)&mm->cpu_bitmap; } +struct vma_iterator { + struct ma_state mas; +}; + +#define VMA_ITERATOR(name, mm, addr) \ + struct vma_iterator name = { \ + .mas = { \ + .tree = &mm->mm_mt, \ + .index = addr, \ + .node = MAS_START, \ + }, \ + } + +static inline void vma_iter_init(struct vma_iterator *vmi, + struct mm_struct *mm, unsigned long addr) +{ + vmi->mas.tree = &mm->mm_mt; + vmi->mas.index = addr; + vmi->mas.node = MAS_START; +} + struct mmu_gather; extern void tlb_gather_mmu(struct mmu_gather *tlb, struct mm_struct *mm); extern void tlb_gather_mmu_fullmm(struct mmu_gather *tlb, struct mm_struct *mm); diff --git a/mm/mmap.c b/mm/mmap.c index c2f1431886d4..9fee6e6b276f 100644 --- a/mm/mmap.c +++ b/mm/mmap.c @@ -626,7 +626,7 @@ static int find_vma_links(struct mm_struct *mm, unsigned long addr, } /* - * vma_next() - Get the next VMA. + * __vma_next() - Get the next VMA. * @mm: The mm_struct. * @vma: The current vma. * @@ -634,7 +634,7 @@ static int find_vma_links(struct mm_struct *mm, unsigned long addr, * * Returns: The next VMA after @vma. */ -static inline struct vm_area_struct *vma_next(struct mm_struct *mm, +static inline struct vm_area_struct *__vma_next(struct mm_struct *mm, struct vm_area_struct *vma) { if (!vma) @@ -1286,7 +1286,7 @@ struct vm_area_struct *vma_merge(struct mm_struct *mm, if (vm_flags & VM_SPECIAL) return NULL; - next = vma_next(mm, prev); + next = __vma_next(mm, prev); area = next; if (area && area->vm_end == end) /* cases 6, 7, 8 */ next = next->vm_next; @@ -2815,7 +2815,7 @@ static void unmap_region(struct mm_struct *mm, struct vm_area_struct *vma, struct vm_area_struct *prev, unsigned long start, unsigned long end) { - struct vm_area_struct *next = vma_next(mm, prev); + struct vm_area_struct *next = __vma_next(mm, prev); struct mmu_gather tlb; lru_add_drain(); @@ -3028,7 +3028,7 @@ int __do_munmap(struct mm_struct *mm, unsigned long start, size_t len, if (error) return error; } - vma = vma_next(mm, prev); + vma = __vma_next(mm, prev); if (unlikely(uf)) { /*