From patchwork Tue Oct 23 21:34:50 2018 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Igor Stoppa X-Patchwork-Id: 10653699 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id A9FCE13A4 for ; Tue, 23 Oct 2018 21:36:08 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 941802A3C7 for ; Tue, 23 Oct 2018 21:36:08 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id 879092A3CD; Tue, 23 Oct 2018 21:36:08 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-3.0 required=2.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,FREEMAIL_FROM,MAILING_LIST_MULTI,RCVD_IN_DNSWL_NONE autolearn=ham version=3.3.1 Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 66C9F2A3C7 for ; Tue, 23 Oct 2018 21:36:07 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 5DBBE6B0005; Tue, 23 Oct 2018 17:36:04 -0400 (EDT) Delivered-To: linux-mm-outgoing@kvack.org Received: by kanga.kvack.org (Postfix, from userid 40) id 513E86B0006; Tue, 23 Oct 2018 17:36:04 -0400 (EDT) X-Original-To: int-list-linux-mm@kvack.org X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 3DF4D6B0007; Tue, 23 Oct 2018 17:36:04 -0400 (EDT) X-Original-To: linux-mm@kvack.org X-Delivered-To: linux-mm@kvack.org Received: from mail-lj1-f198.google.com (mail-lj1-f198.google.com [209.85.208.198]) by kanga.kvack.org (Postfix) with ESMTP id BE8666B0005 for ; Tue, 23 Oct 2018 17:36:03 -0400 (EDT) Received: by mail-lj1-f198.google.com with SMTP id k10-v6so988973ljc.4 for ; Tue, 23 Oct 2018 14:36:03 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:dkim-signature:from:to:cc:subject:date :message-id:in-reply-to:references:reply-to; bh=6jXsMcNOASyEUd+AGjVZam8sdvDi65Nq+ICQnyI7NC8=; b=BFwrPJxs3IPrVbK3rbdZZVPqnZPmtDa8XTfgOJDp0yTbSapR0QBdZIcZPmXHjMzlam Gkf4skzdD3AHKHKn0+gQsYUrD56QacyWpCvLrGbTAFFYZygpRhZK2GbI7BgYtUhV8bKg orVPTdyhW6ST+6MfvLE0tvMBOnzwJHkQXN9fcE04KT1LotlNVb5SKF9UpqXY2E9/suUJ vzqa7zTN5FJmtuJkmlAXoy8z5Y1PLzfi9Jorrgrx5ioIzr90QUniUfrwLtRIOQvo8xM1 W8WHHXLiTK9O+L5QCRmQ1hSLQOhSqLXcxrlYlLg2pg3PF7wymfKboGC1pWBxVNjYVCkc f4Lg== X-Gm-Message-State: AGRZ1gLzv9YOrtkcMLdJMaUxg9InDTBOXuLkfBqVsSiZIKgE5NOybN99 qkWCVfHBFDhSTMWUlKa8t8D2lCLnl/ZBtUbojIah5Mo6xpsTQqbbBBZ3CWPffj6R/kLQ7nZRf4r lIdeoK1KqLfgOP5ZCh85Q2iHb1Yra7rtfvDchTTe/zOkj7JeRhtucD/Ixr3iJd/IHkb+R/w6I4p nkSGUZXeBkXf0IejzaGlXTp5W1CMpn3JgTrkORaYzSQNyeQgulZJwfXoORfwnQaa2jweXXgfOBF CkQ1/go7sGimJGNNl8GJDSd9SXE7FNqxZgj6NmN+anyhkcOtRj/Sf1q42BKbZ0iiVNLXjpPOC4+ 1JZVl2FZ/T26VDWWp/yF1MNrO0Keb9V/wF3FIGFEUttf6NmpyX02HRUxEZ1KJeiJzwmYM4qU7Za / X-Received: by 2002:a2e:710c:: with SMTP id m12-v6mr444ljc.66.1540330563046; Tue, 23 Oct 2018 14:36:03 -0700 (PDT) X-Received: by 2002:a2e:710c:: with SMTP id m12-v6mr414ljc.66.1540330561935; Tue, 23 Oct 2018 14:36:01 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1540330561; cv=none; d=google.com; s=arc-20160816; b=T5D8PsIrM69BMrVT58/eomj6mgSnbWJ0R9Aq3A3hOKsbeJkeRgR+OHNi7dL7U+EWhB koN+zX+GmzadRKpOoum8PjQ5e03R0DLxkVZBZzt1crm/NiaAcoS1A5CY0TPcAz/IfKZq biRPchyiLiLswKXBVAyr6+k1RczUjv5Jf+RhGaf5b17kmfbLnTW8Y7kb/jAMxXAv0rZh Lm0u1p3iOhYZZHuBOSARCi7iZSSPFWcNMToPwkZvEWYykfXhGVAAwTuK9MjK58jqJuOe VjJfwbcO33E3dyJoJkxOdXKjaqIYDgFSrptGspE3ItpyiP2Fz+4IRsqSYVKtYlij5p05 OdFA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=reply-to:references:in-reply-to:message-id:date:subject:cc:to:from :dkim-signature; bh=6jXsMcNOASyEUd+AGjVZam8sdvDi65Nq+ICQnyI7NC8=; b=ecf1NdIGe+QEmCXJsLxt+iyu7fiF+N4MQ0VJU5PWto9eJF6u3U4bkidH11JAOdXrro 0fT4VD1tE8oOmRMl1eeOpNF8lmxES9XLGpeMw67pa12Phg/CTbNYo6MwbkDo2yh161wb LoL1/AKrQB/x5F1UNSH88HMjtsj8g5DQAqoX0XCZ2TELLn88CfBBB7u5TYkPr2woMz79 CHF+45bHGzKjwHvDPxXLKlQHcV5l6FuQrWD/gBl0SQThNYdVnL78BfaS45aoZDr80wHY khvRPkJxoOlECbfZFdwCCk8LpT51F+LRbl/eJvgx6SuExP2Z4BsY1WWq9RZg6OFXXraS WyqA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=D2P3EntG; spf=pass (google.com: domain of igor.stoppa@gmail.com designates 209.85.220.65 as permitted sender) smtp.mailfrom=igor.stoppa@gmail.com; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: from mail-sor-f65.google.com (mail-sor-f65.google.com. [209.85.220.65]) by mx.google.com with SMTPS id p20-v6sor851409lfp.41.2018.10.23.14.36.01 for (Google Transport Security); Tue, 23 Oct 2018 14:36:01 -0700 (PDT) Received-SPF: pass (google.com: domain of igor.stoppa@gmail.com designates 209.85.220.65 as permitted sender) client-ip=209.85.220.65; Authentication-Results: mx.google.com; dkim=pass header.i=@gmail.com header.s=20161025 header.b=D2P3EntG; spf=pass (google.com: domain of igor.stoppa@gmail.com designates 209.85.220.65 as permitted sender) smtp.mailfrom=igor.stoppa@gmail.com; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references:reply-to; bh=6jXsMcNOASyEUd+AGjVZam8sdvDi65Nq+ICQnyI7NC8=; b=D2P3EntG9KSCG0qbpHMKa1F9RkSy7Fi1vmdHYMZHlxzpBrRFHHM9NmSDNJ6UUFNIPF XSi1KAxTa0aD5TdT4IY4q5HajQnHuMo2x/tOfbQmk3e8Gv/273K7kgKcTKKN8ICPJDC8 4nfmvBBbpIlF4xCgqU3MJDPqYXXkrivUSNIamTfQjKKdnAPxoAywQP5MZOy3u2PJdNbN 2NQqXXVPhvdWOQYVBqXNNymOa3SgIAbrVfxW3CzlsnFmaD5CaeVIfl4C900BUKgXU5an FofC3Bb9uPmIhTPS+tO5MFQl0G6FTHn7fQfWj2uSai/ifDGqQQf+uh5p7/Lk5iQgg19Q Wf2w== X-Google-Smtp-Source: ACcGV602U2IyIsctESkBUXllpEO17589f4KnIPcsRRLcANMrqKwA6sberqeguWGCzYnkS5FtCx9hDw== X-Received: by 2002:a19:c954:: with SMTP id z81mr8626755lff.150.1540330561406; Tue, 23 Oct 2018 14:36:01 -0700 (PDT) Received: from localhost.localdomain (91-159-62-169.elisa-laajakaista.fi. [91.159.62.169]) by smtp.gmail.com with ESMTPSA id y127-v6sm377950lfc.13.2018.10.23.14.36.00 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 23 Oct 2018 14:36:00 -0700 (PDT) From: Igor Stoppa X-Google-Original-From: Igor Stoppa To: Mimi Zohar , Kees Cook , Matthew Wilcox , Dave Chinner , James Morris , Michal Hocko , kernel-hardening@lists.openwall.com, linux-integrity@vger.kernel.org, linux-security-module@vger.kernel.org Cc: igor.stoppa@huawei.com, Dave Hansen , Jonathan Corbet , Laura Abbott , Andrew Morton , Chintan Pandya , Joe Perches , "Luis R. Rodriguez" , Thomas Gleixner , Kate Stewart , Greg Kroah-Hartman , Philippe Ombredanne , linux-mm@kvack.org, linux-kernel@vger.kernel.org Subject: [PATCH 03/17] prmem: vmalloc support for dynamic allocation Date: Wed, 24 Oct 2018 00:34:50 +0300 Message-Id: <20181023213504.28905-4-igor.stoppa@huawei.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20181023213504.28905-1-igor.stoppa@huawei.com> References: <20181023213504.28905-1-igor.stoppa@huawei.com> Reply-To: Igor Stoppa X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: X-Virus-Scanned: ClamAV using ClamSMTP Prepare vmalloc for: - tagging areas used for dynamic allocation of protected memory - supporting various tags, related to the property that an area might have - extrapolating the pool containing a given area - chaining the areas in each pool - extrapolating the area containing a given memory address NOTE: Since there is a list_head structure that is used only when disposing of the allocation (the field purge_list), there are two pointers for the take, before it comes the time of freeing the allocation. To avoid increasing the size of the vmap_area structure, instead of using a standard doubly linked list for tracking the chain of vmap_areas, only one pointer is spent for this purpose, in a single linked list, while the other is used to provide a direct connection to the parent pool. Signed-off-by: Igor Stoppa CC: Michal Hocko CC: Andrew Morton CC: Chintan Pandya CC: Joe Perches CC: "Luis R. Rodriguez" CC: Thomas Gleixner CC: Kate Stewart CC: Greg Kroah-Hartman CC: Philippe Ombredanne CC: linux-mm@kvack.org CC: linux-kernel@vger.kernel.org --- include/linux/vmalloc.h | 12 +++++++++++- mm/vmalloc.c | 2 +- 2 files changed, 12 insertions(+), 2 deletions(-) diff --git a/include/linux/vmalloc.h b/include/linux/vmalloc.h index 398e9c95cd61..4d14a3b8089e 100644 --- a/include/linux/vmalloc.h +++ b/include/linux/vmalloc.h @@ -21,6 +21,9 @@ struct notifier_block; /* in notifier.h */ #define VM_UNINITIALIZED 0x00000020 /* vm_struct is not fully initialized */ #define VM_NO_GUARD 0x00000040 /* don't add guard page */ #define VM_KASAN 0x00000080 /* has allocated kasan shadow memory */ +#define VM_PMALLOC 0x00000100 /* pmalloc area - see docs */ +#define VM_PMALLOC_WR 0x00000200 /* pmalloc write rare area */ +#define VM_PMALLOC_PROTECTED 0x00000400 /* pmalloc protected area */ /* bits [20..32] reserved for arch specific ioremap internals */ /* @@ -48,7 +51,13 @@ struct vmap_area { unsigned long flags; struct rb_node rb_node; /* address sorted rbtree */ struct list_head list; /* address sorted list */ - struct llist_node purge_list; /* "lazy purge" list */ + union { + struct llist_node purge_list; /* "lazy purge" list */ + struct { + struct vmap_area *next; + struct pmalloc_pool *pool; + }; + }; struct vm_struct *vm; struct rcu_head rcu_head; }; @@ -134,6 +143,7 @@ extern struct vm_struct *__get_vm_area_caller(unsigned long size, const void *caller); extern struct vm_struct *remove_vm_area(const void *addr); extern struct vm_struct *find_vm_area(const void *addr); +extern struct vmap_area *find_vmap_area(unsigned long addr); extern int map_vm_area(struct vm_struct *area, pgprot_t prot, struct page **pages); diff --git a/mm/vmalloc.c b/mm/vmalloc.c index a728fc492557..15850005fea5 100644 --- a/mm/vmalloc.c +++ b/mm/vmalloc.c @@ -742,7 +742,7 @@ static void free_unmap_vmap_area(struct vmap_area *va) free_vmap_area_noflush(va); } -static struct vmap_area *find_vmap_area(unsigned long addr) +struct vmap_area *find_vmap_area(unsigned long addr) { struct vmap_area *va;