From patchwork Tue Jul 10 23:34:08 2018 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Yang Shi X-Patchwork-Id: 10518413 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork.web.codeaurora.org (Postfix) with ESMTP id 0AE2E6032C for ; Tue, 10 Jul 2018 23:34:50 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id F0F9E28EB9 for ; Tue, 10 Jul 2018 23:34:49 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id E4C2628ECF; Tue, 10 Jul 2018 23:34:49 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.9 required=2.0 tests=BAYES_00, MAILING_LIST_MULTI, RCVD_IN_DNSWL_NONE, UNPARSEABLE_RELAY autolearn=unavailable version=3.3.1 Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id E156028EB9 for ; Tue, 10 Jul 2018 23:34:45 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 9ED616B026A; Tue, 10 Jul 2018 19:34:44 -0400 (EDT) Delivered-To: linux-mm-outgoing@kvack.org Received: by kanga.kvack.org (Postfix, from userid 40) id 9C91B6B026D; Tue, 10 Jul 2018 19:34:44 -0400 (EDT) X-Original-To: int-list-linux-mm@kvack.org X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 72F0A6B026E; Tue, 10 Jul 2018 19:34:44 -0400 (EDT) X-Original-To: linux-mm@kvack.org X-Delivered-To: linux-mm@kvack.org Received: from mail-pl0-f69.google.com (mail-pl0-f69.google.com [209.85.160.69]) by kanga.kvack.org (Postfix) with ESMTP id 2C2C26B026A for ; Tue, 10 Jul 2018 19:34:44 -0400 (EDT) Received: by mail-pl0-f69.google.com with SMTP id e1-v6so13362877pld.23 for ; Tue, 10 Jul 2018 16:34:44 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-original-authentication-results:x-gm-message-state:from:to:cc :subject:date:message-id:in-reply-to:references; bh=DPSub3SJpQj4oCRb/e9cLM3sK7h0cGQYJufjp0WjAOU=; b=Hl3vEgMNtY3p5hA0G6twk4Z1ygI+QetOr519hf6f1L5n8bQqZ6oI29mYY9zFlTwm6T aLYAxXfqVPAcr3z2xi62ONMklyDgQduzARfCts9zc4O3wIGNUwg7bb11YCgcPU0BBGnI VqayEjr8cAL28XiDSX7UUJsJeMgRfVQfOUw05yA5LVsNCYTxclk8R9RobOuI868lGnLE 8aCpBylGaYJx6mqv/y0HM8DKf63KmWWUTetS8FWBIu23uwWrDSFv2cm5qp0la4HO1mS9 tE1e7vhdS2GzkfN65wzx2C979h0YiEfGUWOvOF2qiOc9yRj3fMeQ7dhMOShkJO60EH9/ kSvw== X-Original-Authentication-Results: mx.google.com; spf=pass (google.com: domain of yang.shi@linux.alibaba.com designates 47.88.44.36 as permitted sender) smtp.mailfrom=yang.shi@linux.alibaba.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=alibaba.com X-Gm-Message-State: APt69E0TpVIHm5HjzlsFj3hrVzRVw4ge92laYgv796Bi6zwDeEs4vKah dV1EK3nuwfr1+jwZQX5nW3gC7QWzxKJWmVmuCD9VhFurzUDV0g6VjBDjlUIBp6VOzlSKLOMTy7r l1+Z63qjVdV0MNcAyrozNM5+/mC9PtlonCV3Pd+BRAzgv4nkW2Yn6Vnu6/XdOAIyIZg== X-Received: by 2002:a63:3083:: with SMTP id w125-v6mr20975521pgw.369.1531265683871; Tue, 10 Jul 2018 16:34:43 -0700 (PDT) X-Google-Smtp-Source: AAOMgpdh46oRqxboKeMYstvgn9na0IwlObP1F6GGPuhWMZje49cOS+6h2oxgSB0VJjPSUykx/eY4 X-Received: by 2002:a63:3083:: with SMTP id w125-v6mr20975464pgw.369.1531265682577; Tue, 10 Jul 2018 16:34:42 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1531265682; cv=none; d=google.com; s=arc-20160816; b=bhq6kmLWlPJDR0fCNXYIkRqo6ASpPyJRU8ap1xmVOaBvZjCnemA1qxcHp/59JoynAZ dOi6sQU3gSz/10GkWmVcoEATeo7Q+HxTMrVUbU5uTTwuvNPaIgoakk4qH7lwgiT8t126 DmG9k8JZbw+BFsn4cY+RTHrAg/rE09FsDvwoGRAbSZcz5fwP3y24JlW3k/j44dJYxnc1 4AavkhqC3j45BLPbrMV35cdzSQk2Tuc8zdIf2VYFWCLXFIuGXGippVY2HOv62Z/MGRPT GKtjRPF36yHujOaa3sBNwOh3ELw93mh3zwtufLUeo8f5m5aeVCG9mlBxmG65k9NOv1jQ sAiA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=references:in-reply-to:message-id:date:subject:cc:to:from :arc-authentication-results; bh=DPSub3SJpQj4oCRb/e9cLM3sK7h0cGQYJufjp0WjAOU=; b=wpC0OFQYBtFwOOLB5drdf5/4fF5QPnNr+ayn+3WD1TsfD5eqe+iG9x3UnQBkEZrDjC lBL/Vh1ZG52GC6c7fiGHzVwnfeLjK9Z2HlEHjUYNQSdPKeGLRiuCLJtYsJRPDwYaDuw3 8y7ZpC5mi1oKReQqciY+NLPNNRBBVE/nQG3oe5R/XGD+JORwLmtK/DjaHoK0AI2euQJP Vr5W9d9T2jhwwVJkrfrwmzsrMZSD/jrTWeHnW0xeQPD2VJkoodc2MFB299s17Bh9WgBp A2rc+LTwfZiYnNUAf8No1bTgVJdjsdmUYTAbO/k6B84Hhs8BwQucIckZ3ov5xeDr+MOT ydtA== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of yang.shi@linux.alibaba.com designates 47.88.44.36 as permitted sender) smtp.mailfrom=yang.shi@linux.alibaba.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=alibaba.com Received: from out4436.biz.mail.alibaba.com (out4436.biz.mail.alibaba.com. [47.88.44.36]) by mx.google.com with ESMTPS id t18-v6si11964506plo.163.2018.07.10.16.34.41 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 10 Jul 2018 16:34:42 -0700 (PDT) Received-SPF: pass (google.com: domain of yang.shi@linux.alibaba.com designates 47.88.44.36 as permitted sender) client-ip=47.88.44.36; Authentication-Results: mx.google.com; spf=pass (google.com: domain of yang.shi@linux.alibaba.com designates 47.88.44.36 as permitted sender) smtp.mailfrom=yang.shi@linux.alibaba.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=alibaba.com X-Alimail-AntiSpam: AC=PASS; BC=-1|-1; BR=01201311R591e4; CH=green; FP=0|-1|-1|-1|0|-1|-1|-1; HT=e01e01429; MF=yang.shi@linux.alibaba.com; NM=1; PH=DS; RN=8; SR=0; TI=SMTPD_---0T4Ny6oS_1531265651; Received: from e19h19392.et15sqa.tbsite.net(mailfrom:yang.shi@linux.alibaba.com fp:SMTPD_---0T4Ny6oS_1531265651) by smtp.aliyun-inc.com(127.0.0.1); Wed, 11 Jul 2018 07:34:25 +0800 From: Yang Shi To: mhocko@kernel.org, willy@infradead.org, ldufour@linux.vnet.ibm.com, kirill@shutemov.name, akpm@linux-foundation.org Cc: yang.shi@linux.alibaba.com, linux-mm@kvack.org, linux-kernel@vger.kernel.org Subject: [RFC v4 PATCH 2/3] mm: refactor do_munmap() to extract the common part Date: Wed, 11 Jul 2018 07:34:08 +0800 Message-Id: <1531265649-93433-3-git-send-email-yang.shi@linux.alibaba.com> X-Mailer: git-send-email 1.8.3.1 In-Reply-To: <1531265649-93433-1-git-send-email-yang.shi@linux.alibaba.com> References: <1531265649-93433-1-git-send-email-yang.shi@linux.alibaba.com> X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: X-Virus-Scanned: ClamAV using ClamSMTP Introduces three new helper functions: * munmap_addr_sanity() * munmap_lookup_vma() * munmap_mlock_vma() They will be used by do_munmap() and the new do_munmap with zapping large mapping early in the later patch. There is no functional change, just code refactor. Signed-off-by: Yang Shi --- mm/mmap.c | 120 ++++++++++++++++++++++++++++++++++++++++++-------------------- 1 file changed, 82 insertions(+), 38 deletions(-) diff --git a/mm/mmap.c b/mm/mmap.c index d1eb87e..2504094 100644 --- a/mm/mmap.c +++ b/mm/mmap.c @@ -2686,34 +2686,44 @@ int split_vma(struct mm_struct *mm, struct vm_area_struct *vma, return __split_vma(mm, vma, addr, new_below); } -/* Munmap is split into 2 main parts -- this part which finds - * what needs doing, and the areas themselves, which do the - * work. This now handles partial unmappings. - * Jeremy Fitzhardinge - */ -int do_munmap(struct mm_struct *mm, unsigned long start, size_t len, - struct list_head *uf) +static inline bool munmap_addr_sanity(unsigned long start, size_t len) { - unsigned long end; - struct vm_area_struct *vma, *prev, *last; - if ((offset_in_page(start)) || start > TASK_SIZE || len > TASK_SIZE-start) - return -EINVAL; + return false; - len = PAGE_ALIGN(len); - if (len == 0) - return -EINVAL; + if (PAGE_ALIGN(len) == 0) + return false; + + return true; +} + +/* + * munmap_lookup_vma: find the first overlap vma and split overlap vmas. + * @mm: mm_struct + * @vma: the first overlapping vma + * @prev: vma's prev + * @start: start address + * @end: end address + * + * returns 1 if successful, 0 or errno otherwise + */ +static int munmap_lookup_vma(struct mm_struct *mm, struct vm_area_struct **vma, + struct vm_area_struct **prev, unsigned long start, + unsigned long end) +{ + struct vm_area_struct *tmp, *last; /* Find the first overlapping VMA */ - vma = find_vma(mm, start); - if (!vma) + tmp = find_vma(mm, start); + if (!tmp) return 0; - prev = vma->vm_prev; - /* we have start < vma->vm_end */ + + *prev = tmp->vm_prev; + + /* we have start < vma->vm_end */ /* if it doesn't overlap, we have nothing.. */ - end = start + len; - if (vma->vm_start >= end) + if (tmp->vm_start >= end) return 0; /* @@ -2723,7 +2733,7 @@ int do_munmap(struct mm_struct *mm, unsigned long start, size_t len, * unmapped vm_area_struct will remain in use: so lower split_vma * places tmp vma above, and higher split_vma places tmp vma below. */ - if (start > vma->vm_start) { + if (start > tmp->vm_start) { int error; /* @@ -2731,13 +2741,14 @@ int do_munmap(struct mm_struct *mm, unsigned long start, size_t len, * not exceed its limit; but let map_count go just above * its limit temporarily, to help free resources as expected. */ - if (end < vma->vm_end && mm->map_count >= sysctl_max_map_count) + if (end < tmp->vm_end && + mm->map_count > sysctl_max_map_count) return -ENOMEM; - error = __split_vma(mm, vma, start, 0); + error = __split_vma(mm, tmp, start, 0); if (error) return error; - prev = vma; + *prev = tmp; } /* Does it split the last one? */ @@ -2747,7 +2758,48 @@ int do_munmap(struct mm_struct *mm, unsigned long start, size_t len, if (error) return error; } - vma = prev ? prev->vm_next : mm->mmap; + + *vma = *prev ? (*prev)->vm_next : mm->mmap; + + return 1; +} + +static inline void munmap_mlock_vma(struct vm_area_struct *vma, + unsigned long end) +{ + struct vm_area_struct *tmp = vma; + + while (tmp && tmp->vm_start < end) { + if (tmp->vm_flags & VM_LOCKED) { + vma->vm_mm->locked_vm -= vma_pages(tmp); + munlock_vma_pages_all(tmp); + } + tmp = tmp->vm_next; + } +} + +/* Munmap is split into 2 main parts -- this part which finds + * what needs doing, and the areas themselves, which do the + * work. This now handles partial unmappings. + * Jeremy Fitzhardinge + */ +int do_munmap(struct mm_struct *mm, unsigned long start, size_t len, + struct list_head *uf) +{ + unsigned long end; + struct vm_area_struct *vma = NULL, *prev; + int ret = 0; + + if (!munmap_addr_sanity(start, len)) + return -EINVAL; + + len = PAGE_ALIGN(len); + + end = start + len; + + ret = munmap_lookup_vma(mm, &vma, &prev, start, end); + if (ret != 1) + return ret; if (unlikely(uf)) { /* @@ -2759,24 +2811,16 @@ int do_munmap(struct mm_struct *mm, unsigned long start, size_t len, * split, despite we could. This is unlikely enough * failure that it's not worth optimizing it for. */ - int error = userfaultfd_unmap_prep(vma, start, end, uf); - if (error) - return error; + ret = userfaultfd_unmap_prep(vma, start, end, uf); + if (ret) + return ret; } /* * unlock any mlock()ed ranges before detaching vmas */ - if (mm->locked_vm) { - struct vm_area_struct *tmp = vma; - while (tmp && tmp->vm_start < end) { - if (tmp->vm_flags & VM_LOCKED) { - mm->locked_vm -= vma_pages(tmp); - munlock_vma_pages_all(tmp); - } - tmp = tmp->vm_next; - } - } + if (mm->locked_vm) + munmap_mlock_vma(vma, end); /* * Remove the vma's, and unmap the actual pages