From patchwork Tue Feb 28 21:37:07 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Matthew Wilcox X-Patchwork-Id: 13155258 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 09489C64EC4 for ; Tue, 28 Feb 2023 21:38:28 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 5E81F6B009F; Tue, 28 Feb 2023 16:38:02 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 598D96B00A1; Tue, 28 Feb 2023 16:38:02 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 43B606B00A2; Tue, 28 Feb 2023 16:38:02 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0011.hostedemail.com [216.40.44.11]) by kanga.kvack.org (Postfix) with ESMTP id 1CAA46B009F for ; Tue, 28 Feb 2023 16:38:02 -0500 (EST) Received: from smtpin20.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay04.hostedemail.com (Postfix) with ESMTP id D60D11A06E2 for ; Tue, 28 Feb 2023 21:38:01 +0000 (UTC) X-FDA: 80518013562.20.EEB60C1 Received: from casper.infradead.org (casper.infradead.org [90.155.50.34]) by imf22.hostedemail.com (Postfix) with ESMTP id 2EA92C0006 for ; Tue, 28 Feb 2023 21:37:59 +0000 (UTC) Authentication-Results: imf22.hostedemail.com; dkim=pass header.d=infradead.org header.s=casper.20170209 header.b="Mb2B/eUZ"; dmarc=none; spf=none (imf22.hostedemail.com: domain of willy@infradead.org has no SPF policy when checking 90.155.50.34) smtp.mailfrom=willy@infradead.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1677620280; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=PAvoXOK82YrXRCPGzqy64Am4nG7Ga3Zg7EaGsyDnllk=; b=EYEt2BDTA4uTUVvdROmBPshzqhhJOq7WoiLE49+wJ15ojNW9RwDOuCGai+qKRl4FVo8shX k91OyXQHsY06W7QTZqd7OnPgPQRAPmLuV/oX2PSnk5FY1upMB+ws9zC+acgisNVelTxYJQ YuStfpo2lchlBLfFKDVSBu2PRzkYgRY= ARC-Authentication-Results: i=1; imf22.hostedemail.com; dkim=pass header.d=infradead.org header.s=casper.20170209 header.b="Mb2B/eUZ"; dmarc=none; spf=none (imf22.hostedemail.com: domain of willy@infradead.org has no SPF policy when checking 90.155.50.34) smtp.mailfrom=willy@infradead.org ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1677620280; a=rsa-sha256; cv=none; b=M2oeApolbyIiZz6ZUeuFmz79TzmrhRIZl0fso+/VIkcc+X2W+yf8ZJNdW4+ij+byNEGYLl 2lFmzjzJ6E+cTuOErn4dJcgK60X26snmHSIxL+s2s4cDCX/jT2zuZLqzYOnjaMe9qR8DES MnMXrs4fOc3Lyy3lbC/0fdspsE0sQcs= DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=casper.20170209; h=Content-Transfer-Encoding:MIME-Version: References:In-Reply-To:Message-Id:Date:Subject:Cc:To:From:Sender:Reply-To: Content-Type:Content-ID:Content-Description; bh=PAvoXOK82YrXRCPGzqy64Am4nG7Ga3Zg7EaGsyDnllk=; b=Mb2B/eUZDO3A6Nr3GqwqsvSxmi lKzUIgIND8zK6qKTldjjPDYxZwwUlrvqIytprySaAQ0Lpm+NiO9mXdipCnTBaC9jHw5AmdYfzRvvY 8fFXPiTzh+I/yYVlLSZ0W2vDwreJkCfzxII57ZVJ/rDE+jp1VGmOYdZ6Ks6anE8rOpKH9Z0roqoXQ yuS+T7W9QUQlE5mJGWTdDHOUq5nZtOaK2PzoF0ieWlTtKT/I0MczMVn53GhjjhuuoHRrr+tnaFoOA +6Zp2va55mYQfwv8i0peZPzId35gouagzWffGihIaW1Y3/efFZrJk9mAWxH+i1U1gOygMMhnuqGdT wNNvlzFQ==; Received: from willy by casper.infradead.org with local (Exim 4.94.2 #2 (Red Hat Linux)) id 1pX7fH-0018oa-S8; Tue, 28 Feb 2023 21:37:39 +0000 From: "Matthew Wilcox (Oracle)" To: linux-mm@kvack.org, linux-arch@vger.kernel.org Cc: "Matthew Wilcox (Oracle)" , linux-kernel@vger.kernel.org Subject: [PATCH v3 04/34] mm: Remove ARCH_IMPLEMENTS_FLUSH_DCACHE_FOLIO Date: Tue, 28 Feb 2023 21:37:07 +0000 Message-Id: <20230228213738.272178-5-willy@infradead.org> X-Mailer: git-send-email 2.37.1 In-Reply-To: <20230228213738.272178-1-willy@infradead.org> References: <20230228213738.272178-1-willy@infradead.org> MIME-Version: 1.0 X-Rspamd-Queue-Id: 2EA92C0006 X-Rspamd-Server: rspam09 X-Rspam-User: X-Stat-Signature: xqxijb8psbgdz6isyydm43iin3wzjsop X-HE-Tag: 1677620279-512899 X-HE-Meta: U2FsdGVkX19IZDgUAQL0qwCBDJtsNMMAggtsLlAMicFfnhQyt0/Cs6LI3wkVSV/8tw4MbSP8qCVIuzwiwBbgoSNS/oYSPEhptdezZsXtlO4NZOUND6/o+PfJh681W+ajsH0HTrsAGPiL24iLFTULafKvkYfQpUrEe6zh6SBUJiMBl7C1JHwDEAzshisidSw73bw8gi9BelEEd7895f2EiA+xAlw+9iXDBLXTY3kVZZmMcPyA/U09OKteath/3GS1lEkvUjnOQmrJKoiIukQX9XoaFTOcVZIoFIEL+/V0lK39pxUWc16OybHqEDX++LH5Bbia4uoJagXP4gHo0616iF4l0qCu3rL9zWTs3oMIyHPZ6YC3mlLFN4tHf2Zly/AhpSShcf84iUdhlCcHjyWug6EEXT8iim9zqCswfoAlJo7B1ZDpRYOu2Vc8PohPyPF4mv+mqSP48Fxy4r+NwAgY+Aq1DBq8VlR2rwp/euHbacV3DXubNSbyAjHlkTt0u2H8iV3IAHiN9G0gys1VBsaK88OJhvuzCGuNaQUakVR4VhuKZn/+A0oV41JbkxA4hLUBLik5OCGUea6G7/dGPDaxhdObrmDmztEySNBhgX7eX9n+ohYD+Vhd7rMoY0ZS27+LL29vj1nHO7J9BHFCJVIJdGFNC9pUDUk5rnNP5yhz5vu0JbRyp3qmIF2KkUEJzebylELHN+ZXeLCHDln3jsLO6YaKMF9Z8+7cbSE4ylYJm9lxXAEC1JOAGaDCd1ptdM9BgH7p3nMKE+Tg7OypCGX99N1qsRb4WI6qX1bgj7JPM+AN3FBfd4baDc9f309o2/LCPJ6e5gJgl6b/BN3Qglv6XhGle47n7pS7w3ra1kIuc+VTMQGDHowQgdDazs5qoy6HX8qYjQOOtWG6xqeCaL4FIJMGfS2zrm+75edEQlp3fb+8MMuMyRNp9oQZycPvcAsQwmaPm8whY+RKH2EoR1Q v/mfr+mW OawvNkjI6OuQ4F0Zqtr3n3qAuXkSMC6NwOvFhOJNATWju5cONHkx4iyXhvqs9O2o6j4kDSDu9+iMJ/JxCTtdGnDGKM8BMKEh19tTOWIgpCnAV4UHhWS+M6TrqX/gYIxu/q8WtIVMjWoYc8YJENy5E4GtOEOWhmx0+3fg2v+xX4Uj3srJsZgYHUvMuLDLtL2tY02wx54GfMuNiNNgiatsME/S+A5/7WyWkQFMQbvz8KxtaP9hBY0L9mAESNQ== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Current best practice is to reuse the name of the function as a define to indicate that the function is implemented by the architecture. Signed-off-by: Matthew Wilcox (Oracle) --- Documentation/core-api/cachetlb.rst | 24 +++++++++--------------- include/linux/cacheflush.h | 4 ++-- mm/util.c | 2 +- 3 files changed, 12 insertions(+), 18 deletions(-) diff --git a/Documentation/core-api/cachetlb.rst b/Documentation/core-api/cachetlb.rst index d4c9e2a28d36..770008afd409 100644 --- a/Documentation/core-api/cachetlb.rst +++ b/Documentation/core-api/cachetlb.rst @@ -269,7 +269,7 @@ maps this page at its virtual address. If D-cache aliasing is not an issue, these two routines may simply call memcpy/memset directly and do nothing more. - ``void flush_dcache_page(struct page *page)`` + ``void flush_dcache_folio(struct folio *folio)`` This routines must be called when: @@ -277,7 +277,7 @@ maps this page at its virtual address. and / or in high memory b) the kernel is about to read from a page cache page and user space shared/writable mappings of this page potentially exist. Note - that {get,pin}_user_pages{_fast} already call flush_dcache_page + that {get,pin}_user_pages{_fast} already call flush_dcache_folio on any page found in the user address space and thus driver code rarely needs to take this into account. @@ -291,7 +291,7 @@ maps this page at its virtual address. The phrase "kernel writes to a page cache page" means, specifically, that the kernel executes store instructions that dirty data in that - page at the page->virtual mapping of that page. It is important to + page at the kernel virtual mapping of that page. It is important to flush here to handle D-cache aliasing, to make sure these kernel stores are visible to user space mappings of that page. @@ -302,18 +302,18 @@ maps this page at its virtual address. If D-cache aliasing is not an issue, this routine may simply be defined as a nop on that architecture. - There is a bit set aside in page->flags (PG_arch_1) as "architecture + There is a bit set aside in folio->flags (PG_arch_1) as "architecture private". The kernel guarantees that, for pagecache pages, it will clear this bit when such a page first enters the pagecache. This allows these interfaces to be implemented much more efficiently. It allows one to "defer" (perhaps indefinitely) the actual flush if there are currently no user processes mapping this - page. See sparc64's flush_dcache_page and update_mmu_cache_range + page. See sparc64's flush_dcache_folio and update_mmu_cache_range implementations for an example of how to go about doing this. - The idea is, first at flush_dcache_page() time, if - page_file_mapping() returns a mapping, and mapping_mapped on that + The idea is, first at flush_dcache_folio() time, if + folio_flush_mapping() returns a mapping, and mapping_mapped() on that mapping returns %false, just mark the architecture private page flag bit. Later, in update_mmu_cache_range(), a check is made of this flag bit, and if set the flush is done and the flag bit @@ -327,12 +327,6 @@ maps this page at its virtual address. dirty. Again, see sparc64 for examples of how to deal with this. - ``void flush_dcache_folio(struct folio *folio)`` - This function is called under the same circumstances as - flush_dcache_page(). It allows the architecture to - optimise for flushing the entire folio of pages instead - of flushing one page at a time. - ``void copy_to_user_page(struct vm_area_struct *vma, struct page *page, unsigned long user_vaddr, void *dst, void *src, int len)`` ``void copy_from_user_page(struct vm_area_struct *vma, struct page *page, @@ -353,7 +347,7 @@ maps this page at its virtual address. When the kernel needs to access the contents of an anonymous page, it calls this function (currently only - get_user_pages()). Note: flush_dcache_page() deliberately + get_user_pages()). Note: flush_dcache_folio() deliberately doesn't work for an anonymous page. The default implementation is a nop (and should remain so for all coherent architectures). For incoherent architectures, it should flush @@ -370,7 +364,7 @@ maps this page at its virtual address. ``void flush_icache_page(struct vm_area_struct *vma, struct page *page)`` All the functionality of flush_icache_page can be implemented in - flush_dcache_page and update_mmu_cache_range. In the future, the hope + flush_dcache_folio and update_mmu_cache_range. In the future, the hope is to remove this interface completely. The final category of APIs is for I/O to deliberately aliased address diff --git a/include/linux/cacheflush.h b/include/linux/cacheflush.h index a6189d21f2ba..82136f3fcf54 100644 --- a/include/linux/cacheflush.h +++ b/include/linux/cacheflush.h @@ -7,14 +7,14 @@ struct folio; #if ARCH_IMPLEMENTS_FLUSH_DCACHE_PAGE -#ifndef ARCH_IMPLEMENTS_FLUSH_DCACHE_FOLIO +#ifndef flush_dcache_folio void flush_dcache_folio(struct folio *folio); #endif #else static inline void flush_dcache_folio(struct folio *folio) { } -#define ARCH_IMPLEMENTS_FLUSH_DCACHE_FOLIO 0 +#define flush_dcache_folio flush_dcache_folio #endif /* ARCH_IMPLEMENTS_FLUSH_DCACHE_PAGE */ #endif /* _LINUX_CACHEFLUSH_H */ diff --git a/mm/util.c b/mm/util.c index b8ed9dbc7fd5..f66e0ca82d2d 100644 --- a/mm/util.c +++ b/mm/util.c @@ -1124,7 +1124,7 @@ void page_offline_end(void) } EXPORT_SYMBOL(page_offline_end); -#ifndef ARCH_IMPLEMENTS_FLUSH_DCACHE_FOLIO +#ifndef flush_dcache_folio void flush_dcache_folio(struct folio *folio) { long i, nr = folio_nr_pages(folio);