From patchwork Sun Oct 30 21:41:50 2022 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Peter Xu X-Patchwork-Id: 13025230 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id F30D5ECAAA1 for ; Sun, 30 Oct 2022 21:42:06 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 88E746B0074; Sun, 30 Oct 2022 17:42:06 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 83E6D6B0075; Sun, 30 Oct 2022 17:42:06 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 6B8A76B0078; Sun, 30 Oct 2022 17:42:06 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0012.hostedemail.com [216.40.44.12]) by kanga.kvack.org (Postfix) with ESMTP id 5C1E66B0074 for ; Sun, 30 Oct 2022 17:42:06 -0400 (EDT) Received: from smtpin29.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay09.hostedemail.com (Postfix) with ESMTP id 3CA3A80712 for ; Sun, 30 Oct 2022 21:42:06 +0000 (UTC) X-FDA: 80078939052.29.608D4F0 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) by imf17.hostedemail.com (Postfix) with ESMTP id BFD954001A for ; Sun, 30 Oct 2022 21:42:05 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1667166125; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=fX+JSCnPsldLCzmeklskU5n+7tkjCg8wbYp4w0X13YE=; b=cnwiqk92UQlOFJF9vAU1FIR/uvhZ3oZ7rUfKmdkldh+/pzv5zye+ByDMNOwMEdH8jxaEor gN2ks/m52xHJccUecu6FVKp8NSZrF8PsisAram/QkTvZoquqnOZIYvId0bpaXqg4PWL+lJ vRrNRAEE2itzunbOqDeTCv7ENlKNrUw= Received: from mail-qk1-f198.google.com (mail-qk1-f198.google.com [209.85.222.198]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_128_GCM_SHA256) id us-mta-48-4X5yY64cN0qFAxgoxaz6WA-1; Sun, 30 Oct 2022 17:41:56 -0400 X-MC-Unique: 4X5yY64cN0qFAxgoxaz6WA-1 Received: by mail-qk1-f198.google.com with SMTP id bj1-20020a05620a190100b006fa12a05188so3862852qkb.4 for ; Sun, 30 Oct 2022 14:41:56 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=fX+JSCnPsldLCzmeklskU5n+7tkjCg8wbYp4w0X13YE=; b=TDGDr5KHHaX/S9lQErmOOjPiKTCHaIOOoqWG4BO5tpXyMHGI5PLtwiDJjYPQD+HiO3 O1Lgpg5ofi6sBQGypV2Ysz2hCriNp5x9Q2qOHpsNTrdprUYcxJjT/jz0QYTV9mg6lv+X 61ozxZwu+ydBx3i+UNeJOXQ1Fe8mJ003HPfZC8rUPQxKAm0wxGLNw1pyxl3mdVc/K5T9 oy1J12eBxu/IgAedZKbc1mKVyIEjBqmP5XTpKPrMfdBG5tKknAbVep5mv8BZYfYqibwa u/GwKoa50X7H/Y6PzEEEUDw+x3amRIwwW0eTj46Azm5mW413U//81qJ8FgpZL7uflIpP +4iw== X-Gm-Message-State: ACrzQf2ySnZKm8YaQAtE+6VWTFaNYNOXVTOTgRWfeWU1JAf7Y/vmrkcM iqX6dXCQLJ4pyQxHhF0hBkhTC6TX79N9osyTU+F8bjJlriAyaSut2uC5z3sRNY/nP2d8Q1XA+dF dAbNJelkiYhY= X-Received: by 2002:ac8:455a:0:b0:3a5:2848:6684 with SMTP id z26-20020ac8455a000000b003a528486684mr151482qtn.339.1667166115648; Sun, 30 Oct 2022 14:41:55 -0700 (PDT) X-Google-Smtp-Source: AMsMyM5USleFlEkZVYw3WrJWxBoYASvDZKqgoasGEWME223t3xhHNLGEwzMnQF0Osvb31iqHDNPp7A== X-Received: by 2002:ac8:455a:0:b0:3a5:2848:6684 with SMTP id z26-20020ac8455a000000b003a528486684mr151472qtn.339.1667166115387; Sun, 30 Oct 2022 14:41:55 -0700 (PDT) Received: from x1n.redhat.com (bras-base-aurron9127w-grc-46-70-31-27-79.dsl.bell.ca. [70.31.27.79]) by smtp.gmail.com with ESMTPSA id az42-20020a05620a172a00b006bb87c4833asm3506450qkb.109.2022.10.30.14.41.54 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 30 Oct 2022 14:41:54 -0700 (PDT) From: Peter Xu To: linux-kernel@vger.kernel.org, linux-mm@kvack.org Cc: Andrew Morton , Miaohe Lin , Huang Ying , David Hildenbrand , HORIGUCHI NAOYA , Andrea Arcangeli , peterx@redhat.com Subject: [PATCH 1/2] mm: Always compile in pte markers Date: Sun, 30 Oct 2022 17:41:50 -0400 Message-Id: <20221030214151.402274-2-peterx@redhat.com> X-Mailer: git-send-email 2.37.3 In-Reply-To: <20221030214151.402274-1-peterx@redhat.com> References: <20221030214151.402274-1-peterx@redhat.com> MIME-Version: 1.0 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-type: text/plain ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1667166125; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=fX+JSCnPsldLCzmeklskU5n+7tkjCg8wbYp4w0X13YE=; b=I9zqML246u1zpOAOtQuiGWcWn2596bfVBjROup0sCWkdk5Wczut+itBLyZop959IKqzwkk J8PsOOmB4mg8kUJ2ZI9iX3cPnLUD+VCr7PNnw6lc5UPv6gXP8bTj0yOvu50AV8H18DXjHP 7FeOa0RFAywXQoUJSBtdaxJuw4v+Rhg= ARC-Authentication-Results: i=1; imf17.hostedemail.com; dkim=pass header.d=redhat.com header.s=mimecast20190719 header.b=cnwiqk92; dmarc=pass (policy=none) header.from=redhat.com; spf=pass (imf17.hostedemail.com: domain of peterx@redhat.com designates 170.10.133.124 as permitted sender) smtp.mailfrom=peterx@redhat.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1667166125; a=rsa-sha256; cv=none; b=L8/2BJ4N7olnynOs74b6TyYvAp68/c2/XNpZpEOU/3C6bgsxWBpGI+gQBM4AR0eWw5rea1 5WN7UkXDTG93nMZU4cH7G7Phx18GsR7F0WHoaT3SBaHrqwEi/S8RSKv8qtI3HXU9I9nozO y5fb1aw2EWehlKZgDrmkVLhS3ciaI6U= X-Rspamd-Server: rspam02 X-Rspamd-Queue-Id: BFD954001A Authentication-Results: imf17.hostedemail.com; dkim=pass header.d=redhat.com header.s=mimecast20190719 header.b=cnwiqk92; dmarc=pass (policy=none) header.from=redhat.com; spf=pass (imf17.hostedemail.com: domain of peterx@redhat.com designates 170.10.133.124 as permitted sender) smtp.mailfrom=peterx@redhat.com X-Stat-Signature: x8cp3bjwwabbcymhjye6hqki6kwzfbe5 X-Rspam-User: X-HE-Tag: 1667166125-417417 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: The PTE markers code is tiny and now it's enabled for most of the distributions. It's fine to keep it as-is, but to make a broader use of it (e.g. replacing read error swap entry) it needs to be there always otherwise we need special code path to take care of !PTE_MARKER case. It'll be easier just make pte marker always exist. Use this chance to extend its usage to anonymous too by simply touching up some of the old comments, because it'll be used for anonymous pages in the follow up patches. Reviewed-by: Huang Ying Reviewed-by: Miaohe Lin Signed-off-by: Peter Xu Acked-by: David Hildenbrand --- include/linux/swap.h | 10 +++------- include/linux/swapops.h | 31 ------------------------------- mm/Kconfig | 7 ------- mm/memory.c | 7 +++---- 4 files changed, 6 insertions(+), 49 deletions(-) diff --git a/include/linux/swap.h b/include/linux/swap.h index 369d7799205d..211aeca9bfa7 100644 --- a/include/linux/swap.h +++ b/include/linux/swap.h @@ -60,17 +60,13 @@ static inline int current_is_kswapd(void) SWP_MIGRATION_NUM + SWP_DEVICE_NUM + \ SWP_PTE_MARKER_NUM) /* - * PTE markers are used to persist information onto PTEs that are mapped with - * file-backed memories. As its name "PTE" hints, it should only be applied to - * the leaves of pgtables. + * PTE markers are used to persist information onto PTEs that otherwise + * should be a none pte. As its name "PTE" hints, it should only be + * applied to the leaves of pgtables. */ -#ifdef CONFIG_PTE_MARKER #define SWP_PTE_MARKER_NUM 1 #define SWP_PTE_MARKER (MAX_SWAPFILES + SWP_HWPOISON_NUM + \ SWP_MIGRATION_NUM + SWP_DEVICE_NUM) -#else -#define SWP_PTE_MARKER_NUM 0 -#endif /* * Unaddressable device memory support. See include/linux/hmm.h and diff --git a/include/linux/swapops.h b/include/linux/swapops.h index 3ba9bf56899d..35c1fe62d2e1 100644 --- a/include/linux/swapops.h +++ b/include/linux/swapops.h @@ -412,8 +412,6 @@ typedef unsigned long pte_marker; #define PTE_MARKER_UFFD_WP BIT(0) #define PTE_MARKER_MASK (PTE_MARKER_UFFD_WP) -#ifdef CONFIG_PTE_MARKER - static inline swp_entry_t make_pte_marker_entry(pte_marker marker) { return swp_entry(SWP_PTE_MARKER, marker); @@ -434,32 +432,6 @@ static inline bool is_pte_marker(pte_t pte) return is_swap_pte(pte) && is_pte_marker_entry(pte_to_swp_entry(pte)); } -#else /* CONFIG_PTE_MARKER */ - -static inline swp_entry_t make_pte_marker_entry(pte_marker marker) -{ - /* This should never be called if !CONFIG_PTE_MARKER */ - WARN_ON_ONCE(1); - return swp_entry(0, 0); -} - -static inline bool is_pte_marker_entry(swp_entry_t entry) -{ - return false; -} - -static inline pte_marker pte_marker_get(swp_entry_t entry) -{ - return 0; -} - -static inline bool is_pte_marker(pte_t pte) -{ - return false; -} - -#endif /* CONFIG_PTE_MARKER */ - static inline pte_t make_pte_marker(pte_marker marker) { return swp_entry_to_pte(make_pte_marker_entry(marker)); @@ -477,9 +449,6 @@ static inline pte_t make_pte_marker(pte_marker marker) * memory, kernel-only memory (including when the system is during-boot), * non-ram based generic file-system. It's fine to be used even there, but the * extra pte marker check will be pure overhead. - * - * For systems configured with !CONFIG_PTE_MARKER this will be automatically - * optimized to pte_none(). */ static inline int pte_none_mostly(pte_t pte) { diff --git a/mm/Kconfig b/mm/Kconfig index 57e1d8c5b505..4b28800d9be1 100644 --- a/mm/Kconfig +++ b/mm/Kconfig @@ -1107,17 +1107,10 @@ config HAVE_ARCH_USERFAULTFD_MINOR help Arch has userfaultfd minor fault support -config PTE_MARKER - bool - - help - Allows to create marker PTEs for file-backed memory. - config PTE_MARKER_UFFD_WP bool "Userfaultfd write protection support for shmem/hugetlbfs" default y depends on HAVE_ARCH_USERFAULTFD_WP - select PTE_MARKER help Allows to create marker PTEs for userfaultfd write protection diff --git a/mm/memory.c b/mm/memory.c index c5599a9279b1..63718094163f 100644 --- a/mm/memory.c +++ b/mm/memory.c @@ -3663,11 +3663,10 @@ static vm_fault_t handle_pte_marker(struct vm_fault *vmf) unsigned long marker = pte_marker_get(entry); /* - * PTE markers should always be with file-backed memories, and the - * marker should never be empty. If anything weird happened, the best - * thing to do is to kill the process along with its mm. + * PTE markers should never be empty. If anything weird happened, + * the best thing to do is to kill the process along with its mm. */ - if (WARN_ON_ONCE(vma_is_anonymous(vmf->vma) || !marker)) + if (WARN_ON_ONCE(!marker)) return VM_FAULT_SIGBUS; if (pte_marker_entry_uffd_wp(entry))