Message ID | 20220720021727.17018-42-Liam.Howlett@oracle.com (mailing list archive) |
---|---|
State | New |
Headers | show
Return-Path: <owner-linux-mm@kvack.org> X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id F26E8C433EF for <linux-mm@archiver.kernel.org>; Wed, 20 Jul 2022 02:18:55 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 63A23940011; Tue, 19 Jul 2022 22:18:40 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 57F98940020; Tue, 19 Jul 2022 22:18:40 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 10A9B940011; Tue, 19 Jul 2022 22:18:40 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0013.hostedemail.com [216.40.44.13]) by kanga.kvack.org (Postfix) with ESMTP id ED63D940011 for <linux-mm@kvack.org>; Tue, 19 Jul 2022 22:18:39 -0400 (EDT) Received: from smtpin16.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay03.hostedemail.com (Postfix) with ESMTP id CF57FA045C for <linux-mm@kvack.org>; Wed, 20 Jul 2022 02:18:39 +0000 (UTC) X-FDA: 79705869558.16.4F9438F Received: from mx0a-00069f02.pphosted.com (mx0a-00069f02.pphosted.com [205.220.165.32]) by imf18.hostedemail.com (Postfix) with ESMTP id 51BC61C0084 for <linux-mm@kvack.org>; Wed, 20 Jul 2022 02:18:39 +0000 (UTC) Received: from pps.filterd (m0246617.ppops.net [127.0.0.1]) by mx0b-00069f02.pphosted.com (8.17.1.5/8.17.1.5) with ESMTP id 26K02wnf031777; Wed, 20 Jul 2022 02:18:36 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h=from : to : cc : subject : date : message-id : references : in-reply-to : content-type : content-transfer-encoding : mime-version; s=corp-2022-7-12; bh=eiLiM7crgpaN8tDarv9bwOFUte49j3//W/vVsup8Pok=; b=m5HabSwH4u7pjneWER0YRB3omC5TT1lnO9lfpS29SN0wktSc5VC2Q8BQt+Rb91xQMT0T JeV7EXISB5jEPsjvBohCUQcRpAbdHsvEmEOgvrUuqd7CavFjZBhMYvVp9kTtaJK0mNg+ iGswnenUYwXCSYR4lNuni8YFYrElLJ4CkiP4KBy9kt6QaNanW7ot/VqEb840OeiNja9K ZGK4vbLLhIUUEhwE47IPu7wOKW8GVVtIC5p4DEUlYf0Yyo7YHflOctDernF2GlrBVMB/ cWOMSTqF0GcbxDjCw+AYMtGUrf83v/rVczM10IWEeVwS23wph9rwAeWwmm3/wfD3c4YD ow== Received: from iadpaimrmta02.imrmtpd1.prodappiadaev1.oraclevcn.com (iadpaimrmta02.appoci.oracle.com [147.154.18.20]) by mx0b-00069f02.pphosted.com (PPS) with ESMTPS id 3hbnvtg6bf-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Wed, 20 Jul 2022 02:18:36 +0000 Received: from pps.filterd (iadpaimrmta02.imrmtpd1.prodappiadaev1.oraclevcn.com [127.0.0.1]) by iadpaimrmta02.imrmtpd1.prodappiadaev1.oraclevcn.com (8.17.1.5/8.17.1.5) with ESMTP id 26K1UAlm002689; Wed, 20 Jul 2022 02:18:35 GMT Received: from nam10-bn7-obe.outbound.protection.outlook.com (mail-bn7nam10lp2101.outbound.protection.outlook.com [104.47.70.101]) by iadpaimrmta02.imrmtpd1.prodappiadaev1.oraclevcn.com (PPS) with ESMTPS id 3hc1mbnuv5-12 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Wed, 20 Jul 2022 02:18:35 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=NLYD8cMI546+Wn+/9Bs/VGRErUD7HGQhMBeGjKdE5clYj1POlfLxIBi+80NQYL364J8NSafkHQWr07X85KiR6aEEvpDcdmUf5bM3Kyl8qxkSeHCfkCf823tIa9U8eE72dI8eVffsz3pYF0xxz+M9bVrNjtfh6+0s6AtdPAfT596Ae9sTy3tUK0kWLaO9P+1eWO2iSOQrvTVQYFFkTNuJ7ss+QGRXbMK+G5pYKeUDqnTBZSVJhgifBmMC6Hr/MEpIRmdHYgN9pAu1yOXtG8vIcHzqootL04WmXUGW9iNDh+o6PFZm+kIsxs3hex8YjpMIG7GURRBAIYsxwHJay/W5xw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=eiLiM7crgpaN8tDarv9bwOFUte49j3//W/vVsup8Pok=; b=QqFxzRx8Gq+pyhfTvSBsPn146LFMoeBQke80Nw2aFGW4X0cfjbKHquKVNKcZPtgIe/kYhuOTiHQ/gxD1ul46DMEUlo+Q4peu6GJ8pZLqZBXMm+QzJlp4CZI3NUoKBY8BSdKGk/lafXrZQWgep+svG9DeRXGBvpQXoI+AKenOchQmjYZgffBKdBkD7RpCtvJMBYwFQ99p/v54zslWc0nPSM50D7c3T3tQ2vd3Xc9qqJ14HDYdxoGtkOvP8wn4WFfFXWJmON+9c3v4wonj+9kF5MtYk1RzC5Jh86eGcBq8SBw4SnhlyjLo3/8EEOsTiL0kwFrSvJe3fo0tBTu92ZH7XQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=oracle.com; dmarc=pass action=none header.from=oracle.com; dkim=pass header.d=oracle.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.onmicrosoft.com; s=selector2-oracle-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=eiLiM7crgpaN8tDarv9bwOFUte49j3//W/vVsup8Pok=; b=LG/MbcJ9Yu4tW1g3YpipwyiQCjrR2wcHY448QEvdzOmQa1Ccq5lk1LwsNReHbmNfNUibVFDqi1Tes2g6JjrulB6JmKDTHWR76irQ3ejeUEsAGpLof7dZ9Y1vyrV2GaD8hK9/4w/a83CAK+9O+xsy5NZ/u+bQrGViBQJpr5hrl0c= Received: from SN6PR10MB3022.namprd10.prod.outlook.com (2603:10b6:805:d8::25) by PH8PR10MB6316.namprd10.prod.outlook.com (2603:10b6:510:1cf::8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5438.22; Wed, 20 Jul 2022 02:18:34 +0000 Received: from SN6PR10MB3022.namprd10.prod.outlook.com ([fe80::c4d1:edc3:7d21:7c68]) by SN6PR10MB3022.namprd10.prod.outlook.com ([fe80::c4d1:edc3:7d21:7c68%6]) with mapi id 15.20.5438.024; Wed, 20 Jul 2022 02:18:34 +0000 From: Liam Howlett <liam.howlett@oracle.com> To: "maple-tree@lists.infradead.org" <maple-tree@lists.infradead.org>, "linux-mm@kvack.org" <linux-mm@kvack.org>, "linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>, Andrew Morton <akpm@linux-foundation.org>, Hugh Dickins <hughd@google.com> CC: Yu Zhao <yuzhao@google.com> Subject: [PATCH v12 41/69] exec: use VMA iterator instead of linked list Thread-Topic: [PATCH v12 41/69] exec: use VMA iterator instead of linked list Thread-Index: AQHYm97t1O2eSReL1UKykxVFnGc7vw== Date: Wed, 20 Jul 2022 02:17:57 +0000 Message-ID: <20220720021727.17018-42-Liam.Howlett@oracle.com> References: <20220720021727.17018-1-Liam.Howlett@oracle.com> In-Reply-To: <20220720021727.17018-1-Liam.Howlett@oracle.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-mailer: git-send-email 2.35.1 x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: a0922206-fd7c-4ffa-74a9-08da69f625aa x-ms-traffictypediagnostic: PH8PR10MB6316:EE_ x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: t9YXx75uQ+r7HR2keZ/XxzZCsnk2iA30eKjQWadhFDFu2iGRcdh0x1AQdmFZCBm9Nf1E7MtAaBWBkHU2zLbV9uy6hHUnCflHVW6lWz1GPoo3/nuTXztznloN4YWtZFa+CxPO9x7zw1EzmLtdR2My+ZUlt6IH0bW6mcdsuF7kZ8OpaeAhl46SZ/R5dIVvbi6/8mhHvGn2S4QbjXvDA2xYPnh+ZDqfH53YOHpByu6sAKuXJShZFTA6rfx3cm5aAht1rywet3EPjEQTAUNhRRQvG9JyM2SIyLHpv4pKW7OJDCPZCLIcHoq4dOUoh+cO+yIDSaXFfxgij4FbKos5RGoc6RvWq6wVUvNWT5PmqPMba4DWyk9bR3Zf6BNsWelTsLqflmLc3hDr8w5iymocE+MEMGXIxihCc7eTAEJjXhONnMeH4Gp1Au9+M/RnSHSL06PbusjFbbNfLt9tI1AdbKa3J3NMONhhXD3kQIr7eDyKoklzWATwIsNpaojIKCbmzNTt6kUGmTuuxVVueuMPYqpI7tFGqBNceHwlIesRiJVQxGVfThVI314nQDXVC/mkWxszzNrW5tzTC5lxZUD++J7j3ibf93eIqpmGIpAOlOXsiyT86bRiNmuoEwg/GNFp1/EEET9TvXvFAA91MdFt29BBBjLF9gXbWkGvh09w600xdvakCUi23T2I395SbIyeK+8+s8bybBdaabJp7X0DwPK3DFXas0c02VAcRKIBRWUCcA78JkdTSdc1NHlOzzENfLT/OPN+uBHc0h4MGp44YmRLSY8PmV4UWINJXEH/0LGMxhkV7Uf/7RdzkKxOnaNG+ctwPBWJe2YWyq2NPpW9zBg+kYO9omIqWv8sFA8MEPe47Q3Fsfy+QXY8JQh00KRGBHP6 x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:SN6PR10MB3022.namprd10.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230016)(346002)(396003)(39860400002)(366004)(376002)(136003)(76116006)(122000001)(44832011)(8936002)(5660300002)(186003)(1076003)(83380400001)(2616005)(4326008)(66446008)(64756008)(36756003)(66946007)(2906002)(8676002)(91956017)(66556008)(316002)(26005)(41300700001)(966005)(66476007)(86362001)(38070700005)(478600001)(6506007)(6486002)(6666004)(71200400001)(110136005)(38100700002)(6512007);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?q?Y8Qe9owSY9zFOd/53TwERNf?= =?iso-8859-1?q?DYXCHmyKq3BJyUqokuwyU2iegiRbVH3tUvPozSNOnXoJF0rjWSVRpt+VOZ2I?= =?iso-8859-1?q?YpYv68ifo7SjTc3v/9z7jQwRbhYFJvzEdk2WYDKTcCuGjKtLqN/wZNGJ+djP?= =?iso-8859-1?q?mnr40M30vJxIC0uJULBZhxIwWjMBt1PkOCu/Q9qSiQuWDwMAFwDbQ2/CO3AY?= =?iso-8859-1?q?QwfbSPXOqMMJAs3ufxSw7ZbKB808yU33KUs+SJjM/2R42yD5fRkWVQ538h80?= =?iso-8859-1?q?dHyRjBo2v3uqu1SzpL8iCbZ0mpdWupaEhGCF1kz0+3voQeTIPvR2ucJFnncy?= =?iso-8859-1?q?6tJMrgiLK30rbOe236hy/gKPsHN1lO0NBA7xkuK8rf7imuK5zog5e14hiQzX?= =?iso-8859-1?q?a8VTJwbSHfonfEwuhRXmYNfs38FM4fsLvndMiLVCVNwCViNpoqXDsiZij03O?= =?iso-8859-1?q?bdQKWPyr7HewsmCEabm6L9S1inh4cPbh/1Hm9CjVUywwWqthEnp2hUoEIUCm?= =?iso-8859-1?q?Mg9pzoWkid2JKJ2OvcduqjrO6C7VlHolR2SpG+7Bl3ntbq66yaGi1tb/Fusv?= =?iso-8859-1?q?fWygNqsl7IxEaQr9SiOq1q5qMWg3Ym3mZI7GjFaEqIlK0i2A2sQAS9vMrkIA?= =?iso-8859-1?q?gEQVy2207yTu+7UcYPUpgELThrkmUbS1pMnzGmr3fW+AYE24iUZsEoJWXX4P?= =?iso-8859-1?q?O78BwLrZ5F6ZAzZtr2nG/H9aB+OdLIMPnzBnHDXnVjS3HtUXHPYj2k40frJl?= =?iso-8859-1?q?R0Yyrg9hqaOntbh+8nTqRlhKhPaKKgqf910WmFTLYU51JWtXHSWfneBHMSnF?= =?iso-8859-1?q?4ompO4t4au3yjIKBbJ4x1zCC1i43longv0tZvPMxp1QmXvFQfbyGnLRhTC2G?= =?iso-8859-1?q?QBlhe523/vACM/yeXCbAokxrzduO+8xCCGah5NHUlI+XLhmxuIV78bgOyrLO?= =?iso-8859-1?q?nOlDOiHxZhDdC+EL3XVcPKo+OSy1czE0TYc5be2/H8waXGfNsIaTpqnhGy6N?= =?iso-8859-1?q?IYTudgrzqYpnyPlL0q6Z/cCFR9aipa1UwPRfI1Yd5kUqLfzdmONXkcivKSXi?= =?iso-8859-1?q?zvcOz7XpJqb+h4D//i4Ky6AqiPXo5RP01gg/JdDFojnuVWNbDJo0dZo7LQ8n?= =?iso-8859-1?q?iIRcj4qTADWdbJweyR+tHDb41J47ssu2JiMH1dvygrFZM1FvF8YRisl7qPH8?= =?iso-8859-1?q?uZ1HZx2hPrh2ijz4LBk++iV52Oc0TwvmowsHjdC5q7ZrXc4XH3kyKeGvRIc3?= =?iso-8859-1?q?+ii8s2nWwdVwacEugC0y/Siq2GPH1mOZ4fHIddbOGL1PXTG+f99FacD0uW5O?= =?iso-8859-1?q?/a1wktr/beg93GLVFH8yDht4ziPvzKnzwx3IMLN0WfV/9sRNdGnNbljZqL/f?= =?iso-8859-1?q?85XWUe7eOtNae3AI6SsQk0enZZTKfg7oZdJ5QvioNPpUpWyfaWfKZTGi49/Z?= =?iso-8859-1?q?auSVA5dewGZ3WeHHQ8WdeNux/zKBhKjacJBZPy76Ztrki2BF6mjj6x3xC15y?= =?iso-8859-1?q?avdzIqdFMcPLQTGYxnvLtcBrdCIFS19gkyNwrsz4kC+qkvsj7TeXfHOawEMT?= =?iso-8859-1?q?rVoHETUVFFrnwtBA1eUz+Rp6oXYKCdtoxjxBeGkOkvxzzVr6uRlZ3iID+pP4?= =?iso-8859-1?q?RQqgLjmfLnq5wc6TcTMpJs/9XToGHHLMeCS3lWA=3D=3D?= Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: oracle.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: SN6PR10MB3022.namprd10.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: a0922206-fd7c-4ffa-74a9-08da69f625aa X-MS-Exchange-CrossTenant-originalarrivaltime: 20 Jul 2022 02:17:57.1960 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: pE5lPz/I6T0kKVd058HJkHkZcGYPC80sn6IJlRXE71QhbQtyORRPp3x/AzfXxa3KuUPH1u/ZsGi+A0McFeqFRA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH8PR10MB6316 X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.205,Aquarius:18.0.883,Hydra:6.0.517,FMLib:17.11.122.1 definitions=2022-07-19_10,2022-07-19_01,2022-06-22_01 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 malwarescore=0 bulkscore=0 phishscore=0 suspectscore=0 mlxlogscore=999 adultscore=0 spamscore=0 mlxscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2206140000 definitions=main-2207200008 X-Proofpoint-GUID: 9eJcNVNE5yVFPV0EpRKiaUpwa9IRsuTO X-Proofpoint-ORIG-GUID: 9eJcNVNE5yVFPV0EpRKiaUpwa9IRsuTO ARC-Authentication-Results: i=2; imf18.hostedemail.com; dkim=pass header.d=oracle.com header.s=corp-2022-7-12 header.b=m5HabSwH; dkim=pass header.d=oracle.onmicrosoft.com header.s=selector2-oracle-onmicrosoft-com header.b="LG/MbcJ9"; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=oracle.com; spf=none (imf18.hostedemail.com: domain of liam.howlett@oracle.com has no SPF policy when checking 205.220.165.32) smtp.mailfrom=liam.howlett@oracle.com ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1658283519; a=rsa-sha256; cv=pass; b=lJE2AY5QTld3OVvZNe3jxV+oVhh9pLSuCWhl2LtW9u4e9/SMeGxKczyFQFQBtQBhUfK4QF dn0lCyn0AMluGooxYFfe/5t9JocSN7783F6acEEYaaVHU4N5JIZDcLgpnUYkiPj3bG9b3m FsxabyysDhPEFNinBSGTaEjFgB5oj8Y= ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1658283519; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=eiLiM7crgpaN8tDarv9bwOFUte49j3//W/vVsup8Pok=; b=66hVcBg1ZsmuJ7guNTl/ymmDUsZfhK0vV+HLihV+4yA1pFGv5/reP0c+WBSnK3pHychvFk IEBahGL+oCrf2j1PY2GrfKbRtOZcQpwWCcN9AwVslRtmxTG3BvaqJ2FjbxJjf6E+24NzqF jVBA/0seCVIEdk6JEna2z6O+PMiq0AI= X-Rspam-User: X-Rspamd-Server: rspam09 X-Rspamd-Queue-Id: 51BC61C0084 Authentication-Results: imf18.hostedemail.com; dkim=pass header.d=oracle.com header.s=corp-2022-7-12 header.b=m5HabSwH; dkim=pass header.d=oracle.onmicrosoft.com header.s=selector2-oracle-onmicrosoft-com header.b="LG/MbcJ9"; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=oracle.com; spf=none (imf18.hostedemail.com: domain of liam.howlett@oracle.com has no SPF policy when checking 205.220.165.32) smtp.mailfrom=liam.howlett@oracle.com X-Stat-Signature: 4c74w6fzk9koui5zr7d5x9mpattwegmq X-HE-Tag: 1658283519-234239 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: <linux-mm.kvack.org> |
Series |
Introducing the Maple Tree
|
expand
|
diff --git a/fs/exec.c b/fs/exec.c index b97afa682ffe..9843cecd031a 100644 --- a/fs/exec.c +++ b/fs/exec.c @@ -686,6 +686,8 @@ static int shift_arg_pages(struct vm_area_struct *vma, unsigned long shift) unsigned long length = old_end - old_start; unsigned long new_start = old_start - shift; unsigned long new_end = old_end - shift; + VMA_ITERATOR(vmi, mm, new_start); + struct vm_area_struct *next; struct mmu_gather tlb; BUG_ON(new_start > new_end); @@ -694,7 +696,7 @@ static int shift_arg_pages(struct vm_area_struct *vma, unsigned long shift) * ensure there are no vmas between where we want to go * and where we are */ - if (vma != find_vma(mm, new_start)) + if (vma != vma_next(&vmi)) return -EFAULT; /* @@ -713,12 +715,13 @@ static int shift_arg_pages(struct vm_area_struct *vma, unsigned long shift) lru_add_drain(); tlb_gather_mmu(&tlb, mm); + next = vma_next(&vmi); if (new_end > old_start) { /* * when the old and new regions overlap clear from new_end. */ free_pgd_range(&tlb, new_end, old_end, new_end, - vma->vm_next ? vma->vm_next->vm_start : USER_PGTABLES_CEILING); + next ? next->vm_start : USER_PGTABLES_CEILING); } else { /* * otherwise, clean from old_start; this is done to not touch @@ -727,7 +730,7 @@ static int shift_arg_pages(struct vm_area_struct *vma, unsigned long shift) * for the others its just a little faster. */ free_pgd_range(&tlb, old_start, old_end, new_end, - vma->vm_next ? vma->vm_next->vm_start : USER_PGTABLES_CEILING); + next ? next->vm_start : USER_PGTABLES_CEILING); } tlb_finish_mmu(&tlb);