From patchwork Thu Jun 22 20:57:12 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Vishal Moola X-Patchwork-Id: 13289597 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 4DF23EB64DA for ; Thu, 22 Jun 2023 20:58:00 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 91EDD8D0002; Thu, 22 Jun 2023 16:57:59 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 8CE078D0001; Thu, 22 Jun 2023 16:57:59 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 747BA8D0002; Thu, 22 Jun 2023 16:57:59 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0011.hostedemail.com [216.40.44.11]) by kanga.kvack.org (Postfix) with ESMTP id 6462B8D0001 for ; Thu, 22 Jun 2023 16:57:59 -0400 (EDT) Received: from smtpin14.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay05.hostedemail.com (Postfix) with ESMTP id BE56640168 for ; Thu, 22 Jun 2023 20:57:58 +0000 (UTC) X-FDA: 80931595836.14.778E0D1 Received: from mail-yb1-f176.google.com (mail-yb1-f176.google.com [209.85.219.176]) by imf09.hostedemail.com (Postfix) with ESMTP id E712B140019 for ; Thu, 22 Jun 2023 20:57:56 +0000 (UTC) Authentication-Results: imf09.hostedemail.com; dkim=pass header.d=gmail.com header.s=20221208 header.b=mqvv9g7F; spf=pass (imf09.hostedemail.com: domain of vishal.moola@gmail.com designates 209.85.219.176 as permitted sender) smtp.mailfrom=vishal.moola@gmail.com; dmarc=pass (policy=none) header.from=gmail.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1687467477; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:references:dkim-signature; bh=Q4Ig2n4cGI8BP25CqcNRq43JhOmkIIdJVFlb5elIpOA=; b=sYJcTGxIh1P3n2HIrh4qL8HX9+xUdnkjIKx8MbPjgVSjBQwbXY77WoI/z6joxvSpCxqZxm zszPd7Z/rzmkv0RiBpxlz7NPiq4cprmqZdRrelefDJz7USgA3T1LXHAZVEKxRIanbeq1Rv 3x40REkhoxH+bGK4Oxaym+yDFNIWmr4= ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1687467477; a=rsa-sha256; cv=none; b=F+TDbRfnbusulpfiJnAZvlORGlaoyP16aPhnK5rc5BBxGhvEZrYjBlPlmE4vHzqBUGg3u9 oDV1UPSMmyCEkYwBgrGR5zS4ksy1RT/BkFKx0pPC+GfwidcTUFaDMtwX8NJS3933FuSttW C1aiROBLSIT3M4RWThr+fP7sMgaF8Lw= ARC-Authentication-Results: i=1; imf09.hostedemail.com; dkim=pass header.d=gmail.com header.s=20221208 header.b=mqvv9g7F; spf=pass (imf09.hostedemail.com: domain of vishal.moola@gmail.com designates 209.85.219.176 as permitted sender) smtp.mailfrom=vishal.moola@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-yb1-f176.google.com with SMTP id 3f1490d57ef6-be49ca27e1fso7104235276.3 for ; Thu, 22 Jun 2023 13:57:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1687467476; x=1690059476; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:from:to:cc:subject:date:message-id:reply-to; bh=Q4Ig2n4cGI8BP25CqcNRq43JhOmkIIdJVFlb5elIpOA=; b=mqvv9g7FTX6YZrTAez67m8G0SADgQWX+ct2Q2ktq+TbKMG/cOnFNL1HUEejNSN9nds 9vEK9L2HpCPHz3mnLHm7QE7bazoap9KPjRBuUT4kw6MBU7tHylSDou09veevPp+Qm5tI J6+0hmA98DudaYxzAoNczqxDp5g6z2tqapGcR3NSEAPAgqMiM1eNh+iIzBq7ayejKjj9 5MP9SwhVaQTCo1G312fdQXe7vTjboPcFBobNzdFt65RtUbRTWvFRUfh7ZZb+Tak5rboQ uGsNAcBwqdQTtsTo7UoikA/hvdu33PxWnma34tmu5wLmqc0vL2bNnLhMWuiaLjOulKtx 4JUQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1687467476; x=1690059476; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=Q4Ig2n4cGI8BP25CqcNRq43JhOmkIIdJVFlb5elIpOA=; b=b8zM8WDXpl1vM1YprGXefyiYP3DOSJXX6dsntk6q402JLpkpAfiDJ0zkdY6TRkHROs f5QbsOxO6beuk5mj1p2MHpMQSN1GqMBJlo7g86FuZ00VpCZUpkOJML+m6EtAxlUM9Ufi mE+dJMPEqsnBBSla8le0NHfQp303xvmEzhMdGk60xMJ9qGbx2upy3liWsmN093MZuqpb osvROktIMols5sfMo2WbDQMfp0oP3xqUbJ8x4vRHK66/4yPTFEThdu2BrBd2TdppXdf1 vG5MOdFMnXkZ14qlVBohsvd1giWUoSnrgFiEHq25VBic8mOBpd29vbxDT4/yFcJoYd3+ TJPw== X-Gm-Message-State: AC+VfDyOGtG3vJWG5EaL1cg/jyZufVCQ+c1+sbF0K6kQEDPeJKbVnbR5 aweGwvcSD8ps1SwQfdtW1iQ= X-Google-Smtp-Source: ACHHUZ5QdSwF+iokSIDxxYwBaWLG1oGIRpritBhsZ3H79UKVTTkrzsNTtfFGV/ude8v+TVUUcB2uCQ== X-Received: by 2002:a05:6902:92:b0:bba:558e:df05 with SMTP id h18-20020a056902009200b00bba558edf05mr14486764ybs.10.1687467476004; Thu, 22 Jun 2023 13:57:56 -0700 (PDT) Received: from unknowna0e70b2ca394.attlocal.net ([2600:1700:2f7d:1800::36]) by smtp.googlemail.com with ESMTPSA id d18-20020a5b0c52000000b00bc501a1b062sm1684937ybr.42.2023.06.22.13.57.53 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 22 Jun 2023 13:57:55 -0700 (PDT) From: "Vishal Moola (Oracle)" To: Andrew Morton , Matthew Wilcox Cc: linux-mm@kvack.org, linux-arch@vger.kernel.org, linux-arm-kernel@lists.infradead.org, linux-csky@vger.kernel.org, linux-hexagon@vger.kernel.org, loongarch@lists.linux.dev, linux-m68k@lists.linux-m68k.org, linux-mips@vger.kernel.org, linux-openrisc@vger.kernel.org, linuxppc-dev@lists.ozlabs.org, linux-riscv@lists.infradead.org, linux-s390@vger.kernel.org, linux-sh@vger.kernel.org, sparclinux@vger.kernel.org, linux-um@lists.infradead.org, xen-devel@lists.xenproject.org, kvm@vger.kernel.org, Hugh Dickins , "Vishal Moola (Oracle)" , Catalin Marinas , Huacai Chen , Geert Uytterhoeven , Thomas Bogendoerfer , Dinh Nguyen , Jonas Bonn , David Hildenbrand , Claudio Imbrenda , Paul Walmsley , "David S. Miller" , Richard Weinberger , Yoshinori Sato , Dave Hansen , Arnd Bergmann , Christophe Leroy Subject: [PATCH v5 00/33] Split ptdesc from struct page Date: Thu, 22 Jun 2023 13:57:12 -0700 Message-Id: <20230622205745.79707-1-vishal.moola@gmail.com> X-Mailer: git-send-email 2.40.1 MIME-Version: 1.0 X-Stat-Signature: 8ba5mk5ogu56k6bro8k9jkyfqmp1the9 X-Rspamd-Server: rspam10 X-Rspamd-Queue-Id: E712B140019 X-Rspam-User: X-HE-Tag: 1687467476-949467 X-HE-Meta: U2FsdGVkX1+OJGszAxRgUR81dSDyzm+qTXCdeq2+afHRV7O8qG06WYas5Dhk8E8gBlgPzlF+lCpWN1SpPdlM4cKCMiKlibw9UX/7HFQaH/P79kv3HAIBs+hv2cYVOgT4zGSY9dhospYKXoxbdg6vcNTsNp3YLkCpE5V40+M/9j8AzpyCfXAaiCvPS+q3SHbpUUahQdiwaAcBKC1E7/GwerUy4xc7s4jxW0Hh0w9LwOJ0AEjQnYoF0+nnA+Kxt55fD/DQWgiUmEXJAn8jEho1Ow1q8f37oF/jjI+mSVxyZfEnVgjWk8rIJLntlsI5PM9F7q2mlRB4jjzTTlO7pmSpOjFjClGoMfcCYsO6wi/Y78scHOIQDHUTRDcHooghDuAaI5k8c3l7IYIZro4x0Yl8UwLGyYEtAlVe6xUhVag8+BQVaILZY9R0SdMw8VgNInNqcVTTlKP2m1o+/VTHBQ38M4OQbRzouku34sZkkjiwUh1HlEnJj3vY3G3QlvrodkW8/SsTHwPEFTaH5Mkfbb9tsk2tnIwaPz1sCt3L6JmhN6410+lnvOjIiJPO1Fkb+B5Wnmg7mLiB1nYikwlXhKMhAkzvV9SVvKBX714j8d+JtgSNkWstICHdAmgVdolSPz22lH+yM5muv4HYyvShQP1DqN8+Ik8pBl5zB3lSP444j21ST8oFxeoZkajCGftE7RGA+pguB4KiloWSEjVnl7KkCYlBdtU+S1iUn+pUhJ8cxARE8upSP3w/w24eE/D2G6ftZi0Hr6S7idvQyyxzgAqSt62I8WUntk0bshKaV63nfA+hl7297MTqFs5UObCEmfaR0zVf/kfou0k09T1AzWOpAJ/BCTnEU5bvLoiaTspvDq3Oj9nP/YZE449ECo8eUWvVCf8JOF5zqG9V4Ej8lY65TlRJhkDuQXut5BRCeqDok0BaYg+76KVAmAodwX/FR3nonDgPJF36/IhZPivdNpJ SzE74UDx JbUPTxGgRN7AiepcuSQC4dQMjj7poJ5w9Ejspw3uTnhPNbM3nMZCK7MyQmUUWeeQ44G7WpLhshBK69BIeSVLKdGrdPDHxIjQJXvoMyNIuKqlM5Jq8HYRiXu/GKm5OmtRQjNrvVoQ4U3ugtU0SZPJz97IkA+UhVg6LIC0VPZwAG+olR2xb8mJgzMM/ak4t83PPTli/5bo/UdQt7oXt7pXz3FsyXTJuXuYMseLtUU95ChUXj9ib00Q4y0J8/kd89AoM/GH2mfsu1m9TSzXMgB3WovhLiI5sfsfB8mAfL3tSDKmCP2JkWq+F4r9WOZ00vGAU+ro52xGXtxeD+h8VpwJyWo6RyJHwgpWWj8wzckLV5adfk5AuuKtAbcZIXMQaTYHC2FePSm7fQs71UFRoa3F91IO7DkQUr13TRQ0MiEjlZr1lgsVuZrElYsiMUqZKOdbWRn3ZX34tFYjZEaMesuU9+DClx72b/83QoB7EIRPdahIOonN82Qym1RG9N746Zc1nJKV0 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: The MM subsystem is trying to shrink struct page. This patchset introduces a memory descriptor for page table tracking - struct ptdesc. This patchset introduces ptdesc, splits ptdesc from struct page, and converts many callers of page table constructor/destructors to use ptdescs. Ptdesc is a foundation to further standardize page tables, and eventually allow for dynamic allocation of page tables independent of struct page. However, the use of pages for page table tracking is quite deeply ingrained and varied across archictectures, so there is still a lot of work to be done before that can happen. This is rebased on next-20230621. There is a minor conflict with patch 24 and the mm-unstable tree in arch/m68k/mm/motorola.c - The end result of applying the patch should be the same. v5: More Acked-bys :) Cleanup some documentation wording and formatting Add pt_rcu_head to ptdesc Add memcg to ptdesc (and align it with struct page) Ensure all get_free_page() callers prohibit HIGHMEM for 32 bit support. Renamed folio_{set, clear}_table() to folio_{set, clear}_pgtable() Removed pagetable_clear() as it is not necessary right now pagetable_free() now sets page->mapping = NULL Dropped s390 _refcount to _pt_frag_refcount conversion patch Vishal Moola (Oracle) (33): mm: Add PAGE_TYPE_OP folio functions s390: Use _pt_s390_gaddr for gmap address tracking pgtable: Create struct ptdesc mm: add utility functions for ptdesc mm: Convert pmd_pgtable_page() to pmd_ptdesc() mm: Convert ptlock_alloc() to use ptdescs mm: Convert ptlock_ptr() to use ptdescs mm: Convert pmd_ptlock_init() to use ptdescs mm: Convert ptlock_init() to use ptdescs mm: Convert pmd_ptlock_free() to use ptdescs mm: Convert ptlock_free() to use ptdescs mm: Create ptdesc equivalents for pgtable_{pte,pmd}_page_{ctor,dtor} powerpc: Convert various functions to use ptdescs x86: Convert various functions to use ptdescs s390: Convert various gmap functions to use ptdescs s390: Convert various pgalloc functions to use ptdescs mm: Remove page table members from struct page pgalloc: Convert various functions to use ptdescs arm: Convert various functions to use ptdescs arm64: Convert various functions to use ptdescs csky: Convert __pte_free_tlb() to use ptdescs hexagon: Convert __pte_free_tlb() to use ptdescs loongarch: Convert various functions to use ptdescs m68k: Convert various functions to use ptdescs mips: Convert various functions to use ptdescs nios2: Convert __pte_free_tlb() to use ptdescs openrisc: Convert __pte_free_tlb() to use ptdescs riscv: Convert alloc_{pmd, pte}_late() to use ptdescs sh: Convert pte_free_tlb() to use ptdescs sparc64: Convert various functions to use ptdescs sparc: Convert pgtable_pte_page_{ctor, dtor}() to ptdesc equivalents um: Convert {pmd, pte}_free_tlb() to use ptdescs mm: Remove pgtable_{pmd, pte}_page_{ctor, dtor}() wrappers Documentation/mm/split_page_table_lock.rst | 12 +- .../zh_CN/mm/split_page_table_lock.rst | 14 +- arch/arm/include/asm/tlb.h | 12 +- arch/arm/mm/mmu.c | 7 +- arch/arm64/include/asm/tlb.h | 14 +- arch/arm64/mm/mmu.c | 7 +- arch/csky/include/asm/pgalloc.h | 4 +- arch/hexagon/include/asm/pgalloc.h | 8 +- arch/loongarch/include/asm/pgalloc.h | 27 ++- arch/loongarch/mm/pgtable.c | 7 +- arch/m68k/include/asm/mcf_pgalloc.h | 43 ++-- arch/m68k/include/asm/sun3_pgalloc.h | 8 +- arch/m68k/mm/motorola.c | 4 +- arch/mips/include/asm/pgalloc.h | 32 +-- arch/mips/mm/pgtable.c | 8 +- arch/nios2/include/asm/pgalloc.h | 8 +- arch/openrisc/include/asm/pgalloc.h | 8 +- arch/powerpc/mm/book3s64/mmu_context.c | 10 +- arch/powerpc/mm/book3s64/pgtable.c | 32 +-- arch/powerpc/mm/pgtable-frag.c | 46 ++-- arch/riscv/include/asm/pgalloc.h | 8 +- arch/riscv/mm/init.c | 16 +- arch/s390/include/asm/pgalloc.h | 4 +- arch/s390/include/asm/tlb.h | 4 +- arch/s390/mm/gmap.c | 207 ++++++++++-------- arch/s390/mm/pgalloc.c | 108 ++++----- arch/sh/include/asm/pgalloc.h | 9 +- arch/sparc/mm/init_64.c | 17 +- arch/sparc/mm/srmmu.c | 5 +- arch/um/include/asm/pgalloc.h | 18 +- arch/x86/mm/pgtable.c | 47 ++-- arch/x86/xen/mmu_pv.c | 2 +- include/asm-generic/pgalloc.h | 88 +++++--- include/asm-generic/tlb.h | 11 + include/linux/mm.h | 153 +++++++++---- include/linux/mm_types.h | 14 -- include/linux/page-flags.h | 30 ++- include/linux/pgtable.h | 77 +++++++ mm/memory.c | 8 +- 39 files changed, 684 insertions(+), 453 deletions(-)