From patchwork Mon Aug 22 17:35:01 2016 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Josef Bacik X-Patchwork-Id: 9293997 Return-Path: Received: from mail.wl.linuxfoundation.org (pdx-wl-mail.web.codeaurora.org [172.30.200.125]) by pdx-korg-patchwork.web.codeaurora.org (Postfix) with ESMTP id A82F0607F0 for ; Mon, 22 Aug 2016 17:36:44 +0000 (UTC) Received: from mail.wl.linuxfoundation.org (localhost [127.0.0.1]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 9615F289E4 for ; Mon, 22 Aug 2016 17:36:44 +0000 (UTC) Received: by mail.wl.linuxfoundation.org (Postfix, from userid 486) id 8A63828A2C; Mon, 22 Aug 2016 17:36:44 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on pdx-wl-mail.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-6.8 required=2.0 tests=BAYES_00,DKIM_SIGNED, RCVD_IN_DNSWL_HI,T_DKIM_INVALID autolearn=unavailable version=3.3.1 Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.wl.linuxfoundation.org (Postfix) with ESMTP id 662CF28A33 for ; Mon, 22 Aug 2016 17:36:42 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1756099AbcHVRgd (ORCPT ); Mon, 22 Aug 2016 13:36:33 -0400 Received: from mx0a-00082601.pphosted.com ([67.231.145.42]:59890 "EHLO mx0a-00082601.pphosted.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1756062AbcHVRg3 (ORCPT ); Mon, 22 Aug 2016 13:36:29 -0400 Received: from pps.filterd (m0044012.ppops.net [127.0.0.1]) by mx0a-00082601.pphosted.com (8.16.0.17/8.16.0.17) with SMTP id u7MHYjXX018403; Mon, 22 Aug 2016 10:35:22 -0700 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=fb.com; h=from : to : subject : date : message-id : in-reply-to : references : mime-version : content-type; s=facebook; bh=JdDu8kiifxq7zAazZ1HMJ0hjUCAZE9rtvmwwteg+h7Y=; b=ageH9O44WQnjtkDNVPigpJZmu04mgHphoVYKPqk7yZpHzZaCyL8w4lSkLjxW3wSTkyWL uxdZQXBdbDJ8AW88pWoe3LvbXaWPxEr3O3J/1fKnDuq9nRdzcogt9gMaKxmHAQ0BCpwP FYgemeqkfv84gRUZM8uHANgYsjo9UZKh++c= Received: from mail.thefacebook.com ([199.201.64.23]) by mx0a-00082601.pphosted.com with ESMTP id 2501e2sp7m-3 (version=TLSv1 cipher=ECDHE-RSA-AES256-SHA bits=256 verify=NOT); Mon, 22 Aug 2016 10:35:22 -0700 Received: from NAM01-SN1-obe.outbound.protection.outlook.com (192.168.54.28) by o365-in.thefacebook.com (192.168.16.13) with Microsoft SMTP Server (TLS) id 14.3.294.0; Mon, 22 Aug 2016 10:35:19 -0700 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=fb.onmicrosoft.com; s=selector1-fb-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=HiX6CHSUeBoHXH3O5bc4R9IP2rDvzeDoTWv5+utOhwc=; b=fVcClIQp9yNNbwjHpL0859giR3VwFlT7r2kap8o0y0nehSFquulf/mOIs9wY170eDAZbhZlSP4zJj26quK1HW8RyX0P7l0ZmxD92Nywo3VqNv8eHMRZpcoLvdFQXiVINXR3MnY7PGbVMqAk/Sq1pDwbeel352HUdR+JHMHtVtd0= Received: from localhost (107.15.72.49) by BN6PR15MB1314.namprd15.prod.outlook.com (10.172.206.140) with Microsoft SMTP Server (version=TLS1_0, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA_P384) id 15.1.587.13; Mon, 22 Aug 2016 17:35:16 +0000 From: Josef Bacik To: , , , , , , , Subject: [PATCH 2/3] writeback: allow for dirty metadata accounting Date: Mon, 22 Aug 2016 13:35:01 -0400 Message-ID: <1471887302-12730-3-git-send-email-jbacik@fb.com> X-Mailer: git-send-email 1.8.3.1 In-Reply-To: <1471887302-12730-1-git-send-email-jbacik@fb.com> References: <1471887302-12730-1-git-send-email-jbacik@fb.com> MIME-Version: 1.0 X-Originating-IP: [107.15.72.49] X-ClientProxiedBy: DM2PR0501CA0041.namprd05.prod.outlook.com (10.162.29.179) To BN6PR15MB1314.namprd15.prod.outlook.com (10.172.206.140) X-MS-Office365-Filtering-Correlation-Id: 7a55606c-281f-4577-72dd-08d3cab2ae4a X-Microsoft-Exchange-Diagnostics: 1; BN6PR15MB1314; 2:GvGW8RF2lGk5c+6E3DuvYaKM9urbMpIvqaYqG0iWfW9ZYWJEy4qzh8aREglM0oUAY+weyLjjSxK6+QHVPtJa4dHOcPvKAF0mz5z4c/dxh6iHmABcwLTcjr/CQUp6pB0hGLEvMPfRU6C8rPymtqBN52/WZNNoOTu8nNPNjCMV0xePM8TL/RRdFnk68yPrX/3e; 3:tIGuCjdu8Q01/As2c6kzsdwY5RludmKxamm1Rj14OTV4m7NVIUX5Vz6MwimlOJwg0xCo91QOvPl8g+iFcG5ecYb5w2tmCpclRKI65N1f/6CoQoCFQIdmc0IONHeVNLah; 25:yS0oaLqVe8SDRb1N7NBWasCqYA/CuAnh8lzjINv8UOeUr4iyHum0M6UeSlaOW1q3MjAw24oZy1sNOxmfCKP87two9T/Q0awN5R1Loz+G9zgXwF/L6ZfbGQpqhlifRA/nORtO6lQlnELpDlSwlBbjqtDSfG4L1dlD5hJhm/NdldQ6FLzKtp2E7oTrLeuw2DRl/GgkXTWs6bIl1U0gkb99no5Qti4dFjKUOw3+IzZpmmr3lbXiwxgWQCrDRxyd28BAkkMJ9ZOf4sf/cDNaa1/1lx4iN0zsMNt0eKUDK4wfhH4lOwDs0M+unq78PDyst8XP1B6GOYvVY1Ote4o68R5YP1ilqUHH91pRmV9cwWtbPomPYSozTnghQO5mTRjtWnYnzyTFptKlwXdPe8Seb2s7qZBPwvGV1VMXDF7gXzumCzw= X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:BN6PR15MB1314; X-LD-Processed: 8ae927fe-1255-47a7-a2af-5f3a069daaa2,ExtAddr X-Microsoft-Exchange-Diagnostics: 1; BN6PR15MB1314; 31:5wwlOHK8PeOxCMLKzoJeX+II2JnL1+5zNQ1AaIVRzCrTPfyV2D+xaiyzrmFP6oB6PXyowwKXggP2uw9neKqjSgBTmt0YaMG4zjGF3Y5LHKZlSG6UCTbphVQO5GIhMYaHyIHCEhhiamTkNvoGzajRTwbAc6Edb207Y0A3uLVIkWAXXoJ2OXIdv4cxwkKtg4UAHbfcLYKsdLtbmZ5vsLXZfUnmrf/TWAz/NkqRuRAvlNs=; 20:LPWUB1Rf2L24uOTvnQXieKN5+dPMXDW81jzqQWuSheVbck3Ukd0CCiN9H1q46N8eJ7iOPeaE4SRbFSK1PnKEo7ciekuHwDZZE/mgJpO5foI1Z9amGK4y0bXhZnHZk5pP2TtRzSQygnu2Hj35jf0PHwF94GEBv8x3YuBgE+6kK3Q=; 4:lWYm/8gMTAPSdmuaD+YdCwp7tbmcevJAg19yxKdeD/5wx0uamTsMUblx6rla/I8Zc7D6uM44sD5JCO4l+e8q+KsL+LPWHen0AmHXsgJqc1EouYuOTImspiTieifT3vM5RA0TWFoD041SG8HBQHsuQpqb3z2Z0Ll4qLetSQqtpBl/mRWxXY3kHDXb2F5/JGvCOh9sKsXC54qiGVMa4MQLbbFUBa2chPuZYniyfCzyRDA7B4NYc+rHEUWuQzazis815FCysRjCEW81t8S1K/IzG7MEcNGWmk1tvxRFbAZO976HvM/QFq3jB9Gx8oiEQWJUDyE476QiE7FMcq+ErqA8EfeKyvQwUo0Zs5UE49JrIxmI3Vj4YLVL1ViR55tvN60/+dtbtJ8KElkCtJPk7+9UGjw4O4rwmFNpBNj8pwc2aj++g0DQwrtsENPig1JpZT5K X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:(67672495146484); X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(6040176)(601004)(2401047)(5005006)(8121501046)(3002001)(10201501046); SRVR:BN6PR15MB1314; BCL:0; PCL:0; RULEID:; SRVR:BN6PR15MB1314; X-Forefront-PRVS: 00429279BA X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10019020)(4630300001)(979002)(6009001)(6069001)(7916002)(199003)(189002)(106356001)(92566002)(305945005)(7736002)(5660300001)(7846002)(8676002)(81166006)(81156014)(50226002)(2950100001)(77096005)(5003940100001)(19580405001)(15650500001)(189998001)(97736004)(5001770100001)(48376002)(107886002)(2906002)(105586002)(2201001)(86362001)(50466002)(76176999)(50986999)(3846002)(6116002)(19580395003)(76506005)(42186005)(47776003)(586003)(36756003)(66066001)(101416001)(68736007)(229853001)(33646002)(14143004)(4720700001)(969003)(989001)(999001)(1009001)(1019001); DIR:OUT; SFP:1102; SCL:1; SRVR:BN6PR15MB1314; H:localhost; FPR:; SPF:None; PTR:InfoNoRecords; A:1; MX:1; LANG:en; Received-SPF: None (protection.outlook.com: fb.com does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1; BN6PR15MB1314; 23:lXwJNMFQGLyHd1UHwcm9LNO7Yypmzy8UStNdJSm1j?= =?us-ascii?Q?4MY76T0X390gEXP4X9ZK04AbucIRHZzQb0ccnnkGKmbFlqWP/h1XrNJv+tQD?= =?us-ascii?Q?sFD2xd/Su7Q/3vNMNth6xihXEImE6btkiWymjhZRvaIHvRjrac+lNBMN4gdX?= =?us-ascii?Q?QdGwclvuyP/c9ViUHc3Y6D5x4wzT/CttEruGPkIP3BuV+3/UEbjc12LD09i0?= =?us-ascii?Q?hQ1fF3iTfBYOVbmlGzm9lqmkNh3bTGD9AHeQRXi3qpuHjMAlDf71RVjsxd8B?= =?us-ascii?Q?pj6KvRJjH9dJUYg20SnPuqAx+j2dpZb7voqIbFP1diPkDwognh2xC5BPTltW?= =?us-ascii?Q?nSqaJ31iOP6tEPCzcApK82ES7rqrQRfsGAwkFkiRcea/ws4ubh99xh21x6at?= =?us-ascii?Q?XGk4p9ZuuVAGOByD5pRRSzJcSPjxVHTB3JDG1eauju185XFW1KOg919y5cAD?= =?us-ascii?Q?MxgsEqgEODASTzWrI2Gk+UooHC3ClD/Hk6wmxXNqQMS6+wGpzU6pxZrILs8x?= =?us-ascii?Q?jNwpiPRaCOZdAUeG5Rw67SsyZq9qr+DlSdFoh2AWqiKfZ8WH4mCrFBowIGq3?= =?us-ascii?Q?zWTSiCjmESZxV1S0sCmApsFcUWz2DjZ+SVkSBopD/fWEwvG/sGM3pTtkmZV+?= =?us-ascii?Q?zBXskB6ipyVFLRRHdV//O/fsIie7CkZxoArDQV++faVVuHAFhpWu46+Z0XOT?= =?us-ascii?Q?HzBUM5eSxiks63RT+4FO2twZRR6BiHdVWeo1CiD0/9McQB7Z7xTVT/1xK1Ru?= =?us-ascii?Q?9kCkW7rW1rPbSNdfDCcZq88r0eB5ObqPIdXPSTTsN0U9qrurPjt0o7H81g3u?= =?us-ascii?Q?CHUSOGAGl0KTz3YnNuWy7N4nH3AOXfBdtLk+9DGPwu4tpApE4hC0wo7/xTfA?= =?us-ascii?Q?tz91jN/4/dcgCpsoenVZNkMVIJhuDwZEfxkgsmxmxuK+fdmsV4tJVrqz9FQq?= =?us-ascii?Q?NB+y5WpmaCe0ySawVRUVbOXJNrgOt1kmN2tqVSiiCaWAv67bCWzERazNk6HM?= =?us-ascii?Q?+dEq0O4T3YZm8FNy0wEs6rowurhxax2ih4geQPBiuwSZQQr34G0nKv2Z1cQn?= =?us-ascii?Q?FvSx2TlWJoYMVTTsrmJM0e/SqyICvEKmAviMAdpWmLvh/zV0KBrbJ0ijndwu?= =?us-ascii?Q?JANFlNF541L/hGALRvjI4K0No52MMyUc5HGp2/ZnVu7xiELK29pOsIb6kgZX?= =?us-ascii?Q?5GXyD/STywqOuAigGfrsl0dsrSAdX83q0jO3brJNF0qtegT2RR+1Vgy7zwq/?= =?us-ascii?Q?vh7C4GREQZBRRe3WxR074pUA8lR8ze8XEW/j6gHFNNT19MSPBWasO2Bwy6JY?= =?us-ascii?Q?kirtyojmJ4cjr1rpyKWCVk=3D?= X-Microsoft-Exchange-Diagnostics: 1; BN6PR15MB1314; 6:DErKnl2oX6uNNSWSsKiQRk7SlD9j1gdHj1IA0zyxTxfYC31yurlTjyKfl9AV6Vzq7++VMeyh8DK+buZKT6nMFT+n5R3oU2BLqmzn/EZfENAwva1+i6gzfeCEtPFOE95UcuRzLYC0P25TbgZoBZmjzCN7Zq9ZKlBUTRHz4bCAXgCjgtelXHNSfcMSB7IsIACewJ7gg7nB/+7dFh9rIAo+UtzFpPep1F1fw3HTWBTBGKfTekPnop357QVw6Xtq/q7IwC/jAgsP/iXJ2W45dpzNLkREyQyvOGbQjghTgUrI1yg=; 5:ygL+iPo8Pe/QM98AjXBE20PkEP3mTUZlB3FEMEsFzfcr8NSuPMWh1JYF4KAEzJp4D16dneAmttQOgnqLHz/tG8Hu5vl7Y9lq/1Jp+95vHbdo5WjcVgtx2oYjd8cp7Is444Jxx/YobAFmb7KVHJvqZA==; 24:O1TF1Wym6/hIJsGp3UpzwExOzziMrzVMpCHfz0sfagS01Buwaf3GaFh9cP9wE/K19FmmI/0iQPOvxGe6ADq5+eI5LwmxFUaritb+NJXma50=; 7:W12bOo3bc4YPY/OyYfduPV4/ObBIJHZ9vtonht1ZMbvv367N6I7MJh0Ido0xdSrRQVqYabnwx/BeZpMFD+wMb7qRywdny4eLFaETuQxDkk7CGhic/nFpg1A9x3RVgNEcCQRvZhc584LqvobOkW4Xg+Asm0dvJ2Q8+5Tt8fl98RXwesNbvm4jbGHscjvsEnA2i6xWV1iDYdW8+9lcv+pfSAfRuo1sxQYf5cL0uKkG4MslngqEEU6snXv/FE8lip53 SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-Microsoft-Exchange-Diagnostics: 1; BN6PR15MB1314; 20:adS0Rc9ELvzjzWlmGG3wsxe2ZWT4tDXvOFJH6kGLZllN5e1ztLL5Z7jid/GQK9j9/YtEqhjW/OHuWLTB+jJhlP6j610di+I3ZmACJMBMLk6GdkHEaRK5Dzy4ABCo36oNtX8liIq/HzbK/QGTHoLEH6X9+nEJ7JAin9DHOIbW8tY= X-MS-Exchange-CrossTenant-OriginalArrivalTime: 22 Aug 2016 17:35:16.4104 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN6PR15MB1314 X-OriginatorOrg: fb.com X-Proofpoint-Spam-Reason: safe X-FB-Internal: Safe X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:, , definitions=2016-08-22_09:, , signatures=0 Sender: linux-fsdevel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-fsdevel@vger.kernel.org X-Virus-Scanned: ClamAV using ClamSMTP Provide a mechanism for file systems to indicate how much dirty metadata they are holding. This introduces a few things 1) Zone stats for dirty metadata, which is the same as the NR_FILE_DIRTY. 2) WB stat for dirty metadata. This way we know if we need to try and call into the file system to write out metadata. This could potentially be used in the future to make balancing of dirty pages smarter. Signed-off-by: Josef Bacik --- arch/tile/mm/pgtable.c | 3 +- drivers/base/node.c | 2 + fs/fs-writeback.c | 1 + fs/proc/meminfo.c | 2 + include/linux/backing-dev-defs.h | 1 + include/linux/mm.h | 7 +++ include/linux/mmzone.h | 1 + include/trace/events/writeback.h | 7 ++- mm/backing-dev.c | 2 + mm/page-writeback.c | 100 +++++++++++++++++++++++++++++++++++++-- mm/page_alloc.c | 7 ++- mm/vmscan.c | 3 +- 12 files changed, 127 insertions(+), 9 deletions(-) diff --git a/arch/tile/mm/pgtable.c b/arch/tile/mm/pgtable.c index 7cc6ee7..9543468 100644 --- a/arch/tile/mm/pgtable.c +++ b/arch/tile/mm/pgtable.c @@ -44,12 +44,13 @@ void show_mem(unsigned int filter) { struct zone *zone; - pr_err("Active:%lu inactive:%lu dirty:%lu writeback:%lu unstable:%lu free:%lu\n slab:%lu mapped:%lu pagetables:%lu bounce:%lu pagecache:%lu swap:%lu\n", + pr_err("Active:%lu inactive:%lu dirty:%lu metadata_dirty:%lu writeback:%lu unstable:%lu free:%lu\n slab:%lu mapped:%lu pagetables:%lu bounce:%lu pagecache:%lu swap:%lu\n", (global_node_page_state(NR_ACTIVE_ANON) + global_node_page_state(NR_ACTIVE_FILE)), (global_node_page_state(NR_INACTIVE_ANON) + global_node_page_state(NR_INACTIVE_FILE)), global_node_page_state(NR_FILE_DIRTY), + global_node_page_state(NR_METADATA_DIRTY), global_node_page_state(NR_WRITEBACK), global_node_page_state(NR_UNSTABLE_NFS), global_page_state(NR_FREE_PAGES), diff --git a/drivers/base/node.c b/drivers/base/node.c index 5548f96..efc867b2 100644 --- a/drivers/base/node.c +++ b/drivers/base/node.c @@ -99,6 +99,7 @@ static ssize_t node_read_meminfo(struct device *dev, #endif n += sprintf(buf + n, "Node %d Dirty: %8lu kB\n" + "Node %d MetadataDirty: %8lu kB\n" "Node %d Writeback: %8lu kB\n" "Node %d FilePages: %8lu kB\n" "Node %d Mapped: %8lu kB\n" @@ -119,6 +120,7 @@ static ssize_t node_read_meminfo(struct device *dev, #endif , nid, K(node_page_state(pgdat, NR_FILE_DIRTY)), + nid, K(node_page_state(pgdat, NR_METADATA_DIRTY)), nid, K(node_page_state(pgdat, NR_WRITEBACK)), nid, K(node_page_state(pgdat, NR_FILE_PAGES)), nid, K(node_page_state(pgdat, NR_FILE_MAPPED)), diff --git a/fs/fs-writeback.c b/fs/fs-writeback.c index 56c8fda..d329f89 100644 --- a/fs/fs-writeback.c +++ b/fs/fs-writeback.c @@ -1809,6 +1809,7 @@ static unsigned long get_nr_dirty_pages(void) { return global_node_page_state(NR_FILE_DIRTY) + global_node_page_state(NR_UNSTABLE_NFS) + + global_node_page_state(NR_METADATA_DIRTY) + get_nr_dirty_inodes(); } diff --git a/fs/proc/meminfo.c b/fs/proc/meminfo.c index 09e18fd..8ca094f 100644 --- a/fs/proc/meminfo.c +++ b/fs/proc/meminfo.c @@ -80,6 +80,7 @@ static int meminfo_proc_show(struct seq_file *m, void *v) "SwapTotal: %8lu kB\n" "SwapFree: %8lu kB\n" "Dirty: %8lu kB\n" + "MetadataDirty: %8lu kB\n" "Writeback: %8lu kB\n" "AnonPages: %8lu kB\n" "Mapped: %8lu kB\n" @@ -139,6 +140,7 @@ static int meminfo_proc_show(struct seq_file *m, void *v) K(i.totalswap), K(i.freeswap), K(global_node_page_state(NR_FILE_DIRTY)), + K(global_node_page_state(NR_METADATA_DIRTY)), K(global_node_page_state(NR_WRITEBACK)), K(global_node_page_state(NR_ANON_MAPPED)), K(global_node_page_state(NR_FILE_MAPPED)), diff --git a/include/linux/backing-dev-defs.h b/include/linux/backing-dev-defs.h index 3f10307..1200aae 100644 --- a/include/linux/backing-dev-defs.h +++ b/include/linux/backing-dev-defs.h @@ -34,6 +34,7 @@ typedef int (congested_fn)(void *, int); enum wb_stat_item { WB_RECLAIMABLE, WB_WRITEBACK, + WB_METADATA_DIRTY, WB_DIRTIED, WB_WRITTEN, NR_WB_STAT_ITEMS diff --git a/include/linux/mm.h b/include/linux/mm.h index 08ed53e..5a3f626 100644 --- a/include/linux/mm.h +++ b/include/linux/mm.h @@ -31,6 +31,7 @@ struct file_ra_state; struct user_struct; struct writeback_control; struct bdi_writeback; +struct backing_dev_info; #ifndef CONFIG_NEED_MULTIPLE_NODES /* Don't use mapnrs, do it properly */ extern unsigned long max_mapnr; @@ -1363,6 +1364,12 @@ int redirty_page_for_writepage(struct writeback_control *wbc, void account_page_dirtied(struct page *page, struct address_space *mapping); void account_page_cleaned(struct page *page, struct address_space *mapping, struct bdi_writeback *wb); +void account_metadata_dirtied(struct page *page, struct backing_dev_info *bdi); +void account_metadata_cleaned(struct page *page, struct backing_dev_info *bdi); +void account_metadata_writeback(struct page *page, + struct backing_dev_info *bdi); +void account_metadata_end_writeback(struct page *page, + struct backing_dev_info *bdi); int set_page_dirty(struct page *page); int set_page_dirty_lock(struct page *page); void cancel_dirty_page(struct page *page); diff --git a/include/linux/mmzone.h b/include/linux/mmzone.h index f2e4e90..c4177ef 100644 --- a/include/linux/mmzone.h +++ b/include/linux/mmzone.h @@ -167,6 +167,7 @@ enum node_stat_item { NR_VMSCAN_IMMEDIATE, /* Prioritise for reclaim when writeback ends */ NR_DIRTIED, /* page dirtyings since bootup */ NR_WRITTEN, /* page writings since bootup */ + NR_METADATA_DIRTY, /* Metadata dirty pages */ NR_VM_NODE_STAT_ITEMS }; diff --git a/include/trace/events/writeback.h b/include/trace/events/writeback.h index 2ccd9cc..c9f6427 100644 --- a/include/trace/events/writeback.h +++ b/include/trace/events/writeback.h @@ -402,6 +402,7 @@ TRACE_EVENT(global_dirty_state, TP_STRUCT__entry( __field(unsigned long, nr_dirty) + __field(unsigned long, nr_metadata_dirty) __field(unsigned long, nr_writeback) __field(unsigned long, nr_unstable) __field(unsigned long, background_thresh) @@ -413,6 +414,7 @@ TRACE_EVENT(global_dirty_state, TP_fast_assign( __entry->nr_dirty = global_node_page_state(NR_FILE_DIRTY); + __entry->nr_metadata_dirty = global_node_page_state(NR_METADATA_DIRTY); __entry->nr_writeback = global_node_page_state(NR_WRITEBACK); __entry->nr_unstable = global_node_page_state(NR_UNSTABLE_NFS); __entry->nr_dirtied = global_node_page_state(NR_DIRTIED); @@ -424,7 +426,7 @@ TRACE_EVENT(global_dirty_state, TP_printk("dirty=%lu writeback=%lu unstable=%lu " "bg_thresh=%lu thresh=%lu limit=%lu " - "dirtied=%lu written=%lu", + "dirtied=%lu written=%lu metadata_dirty=%lu", __entry->nr_dirty, __entry->nr_writeback, __entry->nr_unstable, @@ -432,7 +434,8 @@ TRACE_EVENT(global_dirty_state, __entry->dirty_thresh, __entry->dirty_limit, __entry->nr_dirtied, - __entry->nr_written + __entry->nr_written, + __entry->nr_metadata_dirty ) ); diff --git a/mm/backing-dev.c b/mm/backing-dev.c index efe2377..b48d4e4 100644 --- a/mm/backing-dev.c +++ b/mm/backing-dev.c @@ -78,6 +78,7 @@ static int bdi_debug_stats_show(struct seq_file *m, void *v) "BackgroundThresh: %10lu kB\n" "BdiDirtied: %10lu kB\n" "BdiWritten: %10lu kB\n" + "BdiMetadataDirty: %10lu kB\n" "BdiWriteBandwidth: %10lu kBps\n" "b_dirty: %10lu\n" "b_io: %10lu\n" @@ -92,6 +93,7 @@ static int bdi_debug_stats_show(struct seq_file *m, void *v) K(background_thresh), (unsigned long) K(wb_stat(wb, WB_DIRTIED)), (unsigned long) K(wb_stat(wb, WB_WRITTEN)), + (unsigned long) K(wb_stat(wb, WB_METADATA_DIRTY)), (unsigned long) K(wb->write_bandwidth), nr_dirty, nr_io, diff --git a/mm/page-writeback.c b/mm/page-writeback.c index 121a6e3..6a52723 100644 --- a/mm/page-writeback.c +++ b/mm/page-writeback.c @@ -506,6 +506,7 @@ bool node_dirty_ok(struct pglist_data *pgdat) nr_pages += node_page_state(pgdat, NR_FILE_DIRTY); nr_pages += node_page_state(pgdat, NR_UNSTABLE_NFS); nr_pages += node_page_state(pgdat, NR_WRITEBACK); + nr_pages += node_page_state(pgdat, NR_METADATA_DIRTY); return nr_pages <= limit; } @@ -1595,7 +1596,8 @@ static void balance_dirty_pages(struct bdi_writeback *wb, * been flushed to permanent storage. */ nr_reclaimable = global_node_page_state(NR_FILE_DIRTY) + - global_node_page_state(NR_UNSTABLE_NFS); + global_node_page_state(NR_UNSTABLE_NFS) + + global_node_page_state(NR_METADATA_DIRTY); gdtc->avail = global_dirtyable_memory(); gdtc->dirty = nr_reclaimable + global_node_page_state(NR_WRITEBACK); @@ -1935,7 +1937,8 @@ bool wb_over_bg_thresh(struct bdi_writeback *wb) */ gdtc->avail = global_dirtyable_memory(); gdtc->dirty = global_node_page_state(NR_FILE_DIRTY) + - global_node_page_state(NR_UNSTABLE_NFS); + global_node_page_state(NR_UNSTABLE_NFS) + + global_node_page_state(NR_METADATA_DIRTY); domain_dirty_limits(gdtc); if (gdtc->dirty > gdtc->bg_thresh) @@ -2009,7 +2012,8 @@ void laptop_mode_timer_fn(unsigned long data) { struct request_queue *q = (struct request_queue *)data; int nr_pages = global_node_page_state(NR_FILE_DIRTY) + - global_node_page_state(NR_UNSTABLE_NFS); + global_node_page_state(NR_UNSTABLE_NFS) + + global_node_page_state(NR_METADATA_DIRTY); struct bdi_writeback *wb; /* @@ -2473,6 +2477,96 @@ void account_page_dirtied(struct page *page, struct address_space *mapping) EXPORT_SYMBOL(account_page_dirtied); /* + * account_metadata_dirtied + * @page - the page being dirited + * @bdi - the bdi that owns this page + * + * Do the dirty page accounting for metadata pages that aren't backed by an + * address_space. + */ +void account_metadata_dirtied(struct page *page, struct backing_dev_info *bdi) +{ + unsigned long flags; + + local_irq_save(flags); + __inc_node_page_state(page, NR_METADATA_DIRTY); + __inc_zone_page_state(page, NR_ZONE_WRITE_PENDING); + __inc_node_page_state(page, NR_DIRTIED); + __inc_wb_stat(&bdi->wb, WB_RECLAIMABLE); + __inc_wb_stat(&bdi->wb, WB_DIRTIED); + __inc_wb_stat(&bdi->wb, WB_METADATA_DIRTY); + current->nr_dirtied++; + task_io_account_write(PAGE_SIZE); + this_cpu_inc(bdp_ratelimits); + local_irq_restore(flags); +} +EXPORT_SYMBOL(account_metadata_dirtied); + +/* + * account_metadata_cleaned + * @page - the page being cleaned + * @bdi - the bdi that owns this page + * + * Called on a no longer dirty metadata page. + */ +void account_metadata_cleaned(struct page *page, struct backing_dev_info *bdi) +{ + unsigned long flags; + + local_irq_save(flags); + __dec_node_page_state(page, NR_METADATA_DIRTY); + __dec_zone_page_state(page, NR_ZONE_WRITE_PENDING); + __dec_wb_stat(&bdi->wb, WB_RECLAIMABLE); + __dec_wb_stat(&bdi->wb, WB_METADATA_DIRTY); + task_io_account_cancelled_write(PAGE_SIZE); + local_irq_restore(flags); +} +EXPORT_SYMBOL(account_metadata_cleaned); + +/* + * account_metadata_writeback + * @page - the page being marked as writeback + * @bdi - the bdi that owns this page + * + * Called on a metadata page that has been marked writeback. + */ +void account_metadata_writeback(struct page *page, + struct backing_dev_info *bdi) +{ + unsigned long flags; + + local_irq_save(flags); + __inc_wb_stat(&bdi->wb, WB_WRITEBACK); + __inc_node_page_state(page, NR_WRITEBACK); + __dec_node_page_state(page, NR_METADATA_DIRTY); + __dec_wb_stat(&bdi->wb, WB_METADATA_DIRTY); + __dec_wb_stat(&bdi->wb, WB_RECLAIMABLE); + local_irq_restore(flags); +} +EXPORT_SYMBOL(account_metadata_writeback); + +/* + * account_metadata_end_writeback + * @page - the page we are ending writeback on + * @bdi - the bdi that owns this page + * + * Called on a metadata page that has completed writeback. + */ +void account_metadata_end_writeback(struct page *page, + struct backing_dev_info *bdi) +{ + unsigned long flags; + + local_irq_save(flags); + __dec_wb_stat(&bdi->wb, WB_WRITEBACK); + __dec_node_page_state(page, NR_WRITEBACK); + __dec_zone_page_state(page, NR_ZONE_WRITE_PENDING); + __inc_node_page_state(page, NR_WRITTEN); + local_irq_restore(flags); +} +EXPORT_SYMBOL(account_metadata_end_writeback); + +/* * Helper function for deaccounting dirty page without writeback. * * Caller must hold lock_page_memcg(). diff --git a/mm/page_alloc.c b/mm/page_alloc.c index 39a372a..bc3523e 100644 --- a/mm/page_alloc.c +++ b/mm/page_alloc.c @@ -4218,8 +4218,8 @@ void show_free_areas(unsigned int filter) printk("active_anon:%lu inactive_anon:%lu isolated_anon:%lu\n" " active_file:%lu inactive_file:%lu isolated_file:%lu\n" - " unevictable:%lu dirty:%lu writeback:%lu unstable:%lu\n" - " slab_reclaimable:%lu slab_unreclaimable:%lu\n" + " unevictable:%lu dirty:%lu metadata_dirty:%lu writeback:%lu\n" + " unstable:%lu slab_reclaimable:%lu slab_unreclaimable:%lu\n" " mapped:%lu shmem:%lu pagetables:%lu bounce:%lu\n" " free:%lu free_pcp:%lu free_cma:%lu\n", global_node_page_state(NR_ACTIVE_ANON), @@ -4230,6 +4230,7 @@ void show_free_areas(unsigned int filter) global_node_page_state(NR_ISOLATED_FILE), global_node_page_state(NR_UNEVICTABLE), global_node_page_state(NR_FILE_DIRTY), + global_node_page_state(NR_METADATA_DIRTY), global_node_page_state(NR_WRITEBACK), global_node_page_state(NR_UNSTABLE_NFS), global_page_state(NR_SLAB_RECLAIMABLE), @@ -4253,6 +4254,7 @@ void show_free_areas(unsigned int filter) " isolated(file):%lukB" " mapped:%lukB" " dirty:%lukB" + " metadata_dirty:%lukB" " writeback:%lukB" " shmem:%lukB" #ifdef CONFIG_TRANSPARENT_HUGEPAGE @@ -4275,6 +4277,7 @@ void show_free_areas(unsigned int filter) K(node_page_state(pgdat, NR_ISOLATED_FILE)), K(node_page_state(pgdat, NR_FILE_MAPPED)), K(node_page_state(pgdat, NR_FILE_DIRTY)), + K(node_page_state(pgdat, NR_METADATA_DIRTY)), K(node_page_state(pgdat, NR_WRITEBACK)), #ifdef CONFIG_TRANSPARENT_HUGEPAGE K(node_page_state(pgdat, NR_SHMEM_THPS) * HPAGE_PMD_NR), diff --git a/mm/vmscan.c b/mm/vmscan.c index 374d95d..fb3eb62 100644 --- a/mm/vmscan.c +++ b/mm/vmscan.c @@ -3714,7 +3714,8 @@ static unsigned long node_pagecache_reclaimable(struct pglist_data *pgdat) /* If we can't clean pages, remove dirty pages from consideration */ if (!(node_reclaim_mode & RECLAIM_WRITE)) - delta += node_page_state(pgdat, NR_FILE_DIRTY); + delta += node_page_state(pgdat, NR_FILE_DIRTY) + + node_page_state(pgdat, NR_METADATA_DIRTY); /* Watch for any possible underflows due to delta */ if (unlikely(delta > nr_pagecache_reclaimable))