From patchwork Mon Jun 28 00:02:09 2021 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Shiyang Ruan X-Patchwork-Id: 12347141 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-11.8 required=3.0 tests=BAYES_00, HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_PATCH,MAILING_LIST_MULTI,SPF_HELO_NONE, SPF_PASS,USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 30964C49EAB for ; Mon, 28 Jun 2021 00:03:03 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id CAB7F619F1 for ; Mon, 28 Jun 2021 00:03:02 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org CAB7F619F1 Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=fujitsu.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id 17FA58D0009; Sun, 27 Jun 2021 20:03:02 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 10B646B0080; Sun, 27 Jun 2021 20:03:02 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id E4ECB8D0009; Sun, 27 Jun 2021 20:03:01 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0110.hostedemail.com [216.40.44.110]) by kanga.kvack.org (Postfix) with ESMTP id A39C26B007E for ; Sun, 27 Jun 2021 20:03:01 -0400 (EDT) Received: from smtpin08.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay04.hostedemail.com (Postfix) with ESMTP id 8F9BE18F71 for ; Mon, 28 Jun 2021 00:03:01 +0000 (UTC) X-FDA: 78301182162.08.BBF9C20 Received: from heian.cn.fujitsu.com (mail.cn.fujitsu.com [183.91.158.132]) by imf28.hostedemail.com (Postfix) with ESMTP id A2C74200107A for ; Mon, 28 Jun 2021 00:03:00 +0000 (UTC) IronPort-HdrOrdr: A9a23:V8gBeKG6lsoZXInUpLqEAMeALOsnbusQ8zAXP0AYc3Jom6uj5qSTdZUgpHjJYVkqOE3I9ertBEDiewK4yXcW2/hzAV7KZmCP0wHEEGgI1+rfKlPbdBEWjtQtt5uIbZIOc+HYPBxri9rg+gmkH5IFyNmDyqqhguDT1B5WPHhXQpAl/wFkERyaD0EzYAFHAKAyHJ2a6tECiCGnfR0sH7yGL0hAT+7evMfKiZ6jRRYHAiQs4A6IgSjtyJOSKWn/4isj X-IronPort-AV: E=Sophos;i="5.83,304,1616428800"; d="scan'208";a="110256323" Received: from unknown (HELO cn.fujitsu.com) ([10.167.33.5]) by heian.cn.fujitsu.com with ESMTP; 28 Jun 2021 08:02:57 +0800 Received: from G08CNEXMBPEKD04.g08.fujitsu.local (unknown [10.167.33.201]) by cn.fujitsu.com (Postfix) with ESMTP id 28CF14D0BA69; Mon, 28 Jun 2021 08:02:53 +0800 (CST) Received: from G08CNEXCHPEKD07.g08.fujitsu.local (10.167.33.80) by G08CNEXMBPEKD04.g08.fujitsu.local (10.167.33.201) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Mon, 28 Jun 2021 08:02:44 +0800 Received: from irides.mr.mr.mr (10.167.225.141) by G08CNEXCHPEKD07.g08.fujitsu.local (10.167.33.209) with Microsoft SMTP Server id 15.0.1497.2 via Frontend Transport; Mon, 28 Jun 2021 08:02:22 +0800 From: Shiyang Ruan To: , , , , , CC: , , , , , , Subject: [PATCH v5 0/9] fsdax: introduce fs query to support reflink Date: Mon, 28 Jun 2021 08:02:09 +0800 Message-ID: <20210628000218.387833-1-ruansy.fnst@fujitsu.com> X-Mailer: git-send-email 2.32.0 MIME-Version: 1.0 X-yoursite-MailScanner-ID: 28CF14D0BA69.A2AEF X-yoursite-MailScanner: Found to be clean X-yoursite-MailScanner-From: ruansy.fnst@fujitsu.com Authentication-Results: imf28.hostedemail.com; dkim=none; spf=neutral (imf28.hostedemail.com: 183.91.158.132 is neither permitted nor denied by domain of ruansy.fnst@fujitsu.com) smtp.mailfrom=ruansy.fnst@fujitsu.com; dmarc=none X-Stat-Signature: 5e494z53y6k1h5nayfy5dy77obwu6y7c X-Rspamd-Server: rspam04 X-Rspamd-Queue-Id: A2C74200107A X-HE-Tag: 1624838580-247503 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: This patchset is aimed to support shared pages tracking for fsdax. Change from V4: - Add nr_pfns for ->memory_failure() to support range based notification - Remove struct bdev in dax_holder_notify_failure() - Add rwsem for dax_holder - Rename functions to (*_)notify_failure() - Remove sb->corrupted_range(), implement holder_ops in filesystem and MD driver instead - Reorganize the patchset, make it easy to review - Rebased to v5.13-rc7 This patchset moves owner tracking from dax_assocaite_entry() to pmem device driver, by introducing an interface ->memory_failure() for struct pagemap. This interface is called by memory_failure() in mm, and implemented by pmem device. Then call holder operations to find the filesystem which the corrupted data located in, and call filesystem handler to track files or metadata associated with this page. Finally we are able to try to fix the corrupted data in filesystem and do other necessary processing, such as killing processes who are using the files affected. The call trace is like this: memory_failure() |* fsdax case |------------ |pgmap->ops->memory_failure() => pmem_pgmap_memory_failure() | dax_holder_notify_failure() => | dax_device->holder_ops->notify_failure() => | - xfs_dax_notify_failure() | - md_dax_notify_failure() | |* xfs_dax_notify_failure() | |-------------------------- | | xfs_rmap_query_range() | | xfs_currupt_helper() | | * corrupted on metadata | | try to recover data, call xfs_force_shutdown() | | * corrupted on file data | | try to recover data, call mf_dax_kill_procs() | |* md_dax_notify_failure() | |------------------------- | md_targets->iterate_devices() | md_targets->rmap() => linear_rmap() | dax_holder_notify_failure() |* normal case |------------- mf_generic_kill_procs() The fsdax & reflink support for XFS is not contained in this patchset. (Rebased on v5.13-rc7) == Shiyang Ruan (9): pagemap: Introduce ->memory_failure() dax: Introduce holder for dax_device mm: factor helpers for memory_failure_dev_pagemap pmem,mm: Implement ->memory_failure in pmem driver mm: Introduce mf_dax_kill_procs() for fsdax case xfs: Implement ->corrupted_range() for XFS dm: Introduce ->rmap() to find bdev offset md: Implement dax_holder_operations fs/dax: Remove useless functions block/genhd.c | 30 +++++++ drivers/dax/super.c | 49 ++++++++++ drivers/md/dm-linear.c | 20 +++++ drivers/md/dm.c | 126 +++++++++++++++++++++++++- drivers/nvdimm/pmem.c | 13 +++ fs/dax.c | 73 ++++----------- fs/xfs/xfs_fsops.c | 5 ++ fs/xfs/xfs_mount.h | 1 + fs/xfs/xfs_super.c | 140 +++++++++++++++++++++++++++++ include/linux/dax.h | 27 ++++++ include/linux/device-mapper.h | 5 ++ include/linux/genhd.h | 1 + include/linux/memremap.h | 9 ++ include/linux/mm.h | 10 +++ mm/memory-failure.c | 165 ++++++++++++++++++++++------------ 15 files changed, 564 insertions(+), 110 deletions(-) --- 2.32.0